I finally got TruNas running an LLM on my AMD GPU!!!
I finally got TruNas running an LLM on my AMD GPU!!!
gotosocial.michaeldileo.org
Post by Michael DiLeo, @mdileo@michaeldileo.org
I finally got my #trunas server using the #gpu for #openwebui running the #deepseek coder v2. I got so close before with the system identifying the gpu and then not using it. I followed this guide and...
And I'm making everyone go to my gotosocial post because the server is running, so I'm going to use it!