Mastodon 🐘

Michael DiLeoI finally got my <a href="https://gotosocial.michaeldileo.org/tags/trunas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#trunas</a> server using the <a href="https://gotosocial.michaeldileo.org/tags/gpu" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpu</a> for <a href="https://gotosocial.michaeldileo.org/tags/openwebui" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openwebui</a> running the <a href="https://gotosocial.michaeldileo.org/tags/deepseek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#deepseek</a> coder v2. I got so close before with the system identifying the gpu and then not using it. I followed this guide and made only one change to put the open web ui portion into a custom app yaml so that it'd show up under the apps list, as doing <code>docker run</code> won't show up under the TruNas apps. It might with portainer or something else, but I don't have that.Here's the guide that I followed: <a href="https://burakberk.dev/deploying-ollama-open-webui-self-hosted/" rel="nofollow noopener noreferrer" target="_blank">https://burakberk.dev/deploying-ollama-open-webui-self-hosted/</a>It wound up just being two docker commands. Now I can start cleaning up the previous 5 attempts lol.

Michael DiLeoLast night I was up until 2AM trying to get <a href="https://gotosocial.michaeldileo.org/tags/trunas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#trunas</a> <a href="https://gotosocial.michaeldileo.org/tags/amd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#amd</a> drivers installed inside of a <a href="https://gotosocial.michaeldileo.org/tags/docker" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#docker</a> <a href="https://gotosocial.michaeldileo.org/tags/container" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#container</a> so that <a href="https://gotosocial.michaeldileo.org/tags/ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ollama</a> would actually use the <a href="https://gotosocial.michaeldileo.org/tags/gpu" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpu</a>. I was so close. It sees the gpu, it sees it has 16GB of ram, then it uses the <a href="https://gotosocial.michaeldileo.org/tags/cpu" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cpu</a>.Trunas locks down the file system at the root level, so if you want to do much of anything, you have to do it inside of a container. So I made a container for the <a href="https://gotosocial.michaeldileo.org/tags/rocm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rocm</a> drivers, which btw comes to like 40GB in size.It's detecting, but I don't know if the ollama container has some missing commands, ie <code>rocm</code> or <code>rocm-info</code>, that it may need.Another alternative is one I don't really want, and that's to install either <a href="https://gotosocial.michaeldileo.org/tags/debian" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#debian</a> or windows as a VM - windows because I did a test on the application that runs locally in windows on this machine before and it was super fast. It isn't ideal from RAM usage, but I may be able to run the models more easily with the <a href="https://gotosocial.michaeldileo.org/tags/windows" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#windows</a> drivers than the <a href="https://gotosocial.michaeldileo.org/tags/linux" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linux</a> ones.But anyway, last night was too much of <a href="https://gotosocial.michaeldileo.org/tags/onemoreturn" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#onemoreturn</a> for a weeknight.

srfaudioAs your <a href="https://defcon.social/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#homelab</a> grows, we sometimes get bad about documenting what we did and how it's all working. And then, sitting down in draw.io to diagram it all out can be a chore. I think many people already use git repos for their homelab config (and if you're not, you should give it a try), so my pro-tip is: diagram your setup with <a href="https://defcon.social/tags/json" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#json</a>.It's concise enough to be useful and quick to write. You can version control it easily. The schema is up to you. Make it make sense for you. "But...that's not a diagram...?", i hear you asking. And I reply to you: : "Yes it is!" <a href="https://jsoncrack.com/editor" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://jsoncrack.com/editor</a> <a href="https://defcon.social/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#selfhosting</a> <a href="https://defcon.social/tags/selfhost" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#selfhost</a> <a href="https://defcon.social/tags/trunas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#trunas</a> <a href="https://defcon.social/tags/synology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#synology</a> <a href="https://defcon.social/tags/SynologyNAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SynologyNAS</a> <a href="https://defcon.social/tags/smarthome" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#smarthome</a>

srfaudioMy <a href="https://defcon.social/tags/synology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#synology</a> NAS has, honestly, been bulletproof for several years. It's getting long in the tooth, but still chugs away great. That said, I'm at the point where, for philosophical reasons, I'm probably going to move to a <a href="https://defcon.social/tags/trunas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#trunas</a> <a href="https://defcon.social/tags/nextcloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nextcloud</a> combo.In preparation for that upgrade, this morning I'm in the middle of doing a Volume/iSCSI LUN refactor on my <a href="https://defcon.social/tags/SynologyNAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SynologyNAS</a> for better data organization, and I'm in that nervous middle phase where all the data only exists on my external hard drives attached to my computer, while the storage pool gets an overhaul...<a href="https://i.giphy.com/media/v1.Y2lkPTc5MGI3NjExa2trOXlkOHk5OTZobGkzMzY3b2htYTltNndvbTdqZGQzZjFpNnd1OSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/f9ZLRWMBjKAbe07PtH/giphy.gif" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://i.giphy.com/media/v1.Y2lkPTc5MGI3NjExa2trOXlkOHk5OTZobGkzMzY3b2htYTltNndvbTdqZGQzZjFpNnd1OSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/f9ZLRWMBjKAbe07PtH/giphy.gif</a><a href="https://defcon.social/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#homelab</a> <a href="https://defcon.social/tags/selfhost" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#selfhost</a> <a href="https://defcon.social/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#selfhosting</a> <a href="https://defcon.social/tags/nas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nas</a>

JazzynupeFixing my worst TrueNAS Scale mistake! - YouTube <a href="https://www.youtube.com/watch?v=10coStxT5CI" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.youtube.com/watch?v=10coStxT5CI</a> <a href="https://mstdn.party/tags/ChristianLempa" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ChristianLempa</a> <a href="https://mstdn.party/tags/TruNAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TruNAS</a> <a href="https://mstdn.party/tags/ZFS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ZFS</a> <a href="https://mstdn.party/tags/VDev" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#VDev</a> <a href="https://mstdn.party/tags/Mistakes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mistakes</a> <a href="https://mstdn.party/tags/NAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NAS</a>

JazzynupeChoosing The BEST Drive Layout For Your NAS - YouTube <a href="https://www.youtube.com/watch?v=ykhaXo6m-04" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.youtube.com/watch?v=ykhaXo6m-04</a> <a href="https://mstdn.party/tags/hardwareHaven" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hardwareHaven</a> <a href="https://mstdn.party/tags/FreeBSD" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FreeBSD</a> <a href="https://mstdn.party/tags/TruNAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TruNAS</a> <a href="https://mstdn.party/tags/VDev" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#VDev</a> <a href="https://mstdn.party/tags/ZFS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ZFS</a> <a href="https://mstdn.party/tags/NAS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NAS</a> <a href="https://mstdn.party/tags/DriveLayout" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DriveLayout</a> <a href="https://mstdn.party/tags/RaidZ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RaidZ</a> <a href="https://mstdn.party/tags/Optimization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Optimization</a>

Recent searches

Search options

Administered by:

Server stats: