Stable Diffusion on AMD 6800XT - Ubuntu 22.04 - Experience so far and just how much faster it is than machineML on Windows
I thought I would share my experience this evening with the group here seeing that I still excited as hell for getting this hodgepodge to work at all.
I have been playing with the machineMl version of stable diffusion on Windows for a while now (we won't go into the reasons why, but I have the 6800XT, which is not well suited to this use case)
Automatic11111 on MachineML is dog slow, but I got some interesting results. So today I cleared out an old SSD, wired it up and installed a clean ubuntu. Following this guide I managed to get rocM running and the difference is like chalk and cheese. Or rather Impulse and Warp drive. Totally crazy!
So for you AMD Radeon users out there. There is hope. It is in Linux, but it is there.
I am on Windows, automatic1111 with directML and rendering is pretty fast. 7700x, 6750xt and 32GB at 4800mhz and a couple of m.2 drives. No xformers tho and some problems when upscaling in txt2image, but it renders prompts with default settings in 10 to 15 seconds. Fast enough for me. AMD has updated their Adrenalin drivers lately to have better directML performance.
Some things can take some time or aren't supported on AMD, but it's surely faster then my rtx 1070 and 1080 rigs wich performed adequately, except with training.
For sure. It works, especially if you use Shark with the experimental driver, but the speed difference was an order of magnitude for the rocm compiled driver on linux. I am already needing more card though. The 6800xt 16gb ram is not enough.I am running on medium ram settings. I hear rocm support for windows is coming soon, so that will be interesting as well. There were some rumours earlier this year.
I am working my way there. I am interested in the gaming possibilities. NPC dialogue and so on. But I wanted to get the environment working first. I found more guides for stable diffusion. Now I can venture deeper knowing that rocm is working.
I've been running SD on AMD GPU and Linux since more or less the beginning. It's been smooth sailing all the way. Not nearly as fast as some equally expensive RTX cards. But, it is what is is.
Awesome, I am still finding my way and am happy if I simply don't crash. I don't have a frame of reference to compare to a Nvidia card for this, but it does seem like we have a little more work in getting things smooth with the AMD cards. I can't say that my speed is terrible. Most renders finish in reasonable time. I am simply amazed that we can do this on consumer grade hardware.