Post by Michael DiLeo, @[email protected]
gotosocial.michaeldileo.org
I finally got my #trunas server using the #gpu for #openwebui running the #deepseek coder v2. I got so close before with the system identifying the gpu and then not using it. I followed this guide and made only one change to put the open web ui portion into a custom app yaml so that it'd show up...

And I’m making everyone go to my gotosocial post because the server is running, so I’m going to use it!