Modder converts $95 AMD APU into a 16GB Linux AI workhorse
Modder converts $95 AMD APU into a 16GB Linux AI workhorse
A modder recently published instructions for coaxing AMD APUs that cost around $100 into running AI tasks usually associated with far more expensive graphics cards. If it...
Reddit user chain-77 discovered that a $95 Ryzen 5 4600G APU can do respectable AI work by telling Linux to see it as a 16GB GPU. Although the processor doesn't compare to dedicated cards in traditional graphics rendering, AI relies heavily on memory, where an APU's ability to allocate shared memory freely becomes an advantage.
Interesting. If LLama performance and the GPU allocation improves, it could make a lot of sense to build something like that with the last generation of DDR4 APUs because that memory is cheap.