prostagma@lemmy.world to memes@lemmy.worldEnglish · 9 天前Life of a PC gamerlemmy.worldimagemessage-square88fedilinkarrow-up1837arrow-down17
arrow-up1830arrow-down1imageLife of a PC gamerlemmy.worldprostagma@lemmy.world to memes@lemmy.worldEnglish · 9 天前message-square88fedilink
minus-squarehaulyard@lemmy.worldlinkfedilinkarrow-up2·9 天前If I build a rig with a 3090 running Debian will stuff like ollama be able to take advantage of it? Thinking up building a new system for my containers and getting into that.
minus-squareFlexibleToast@lemmy.worldlinkfedilinkEnglisharrow-up2·9 天前Yes. I’m not using Debian, but I am doing basically that.
minus-squareSneezycat@sopuli.xyzlinkfedilinkarrow-up1·edit-29 天前Probably. On arch, you install ollama and ollama-cuda and you’re good to go.
If I build a rig with a 3090 running Debian will stuff like ollama be able to take advantage of it? Thinking up building a new system for my containers and getting into that.
Yes! I do this with a 3060 and Debian.
Yes. I’m not using Debian, but I am doing basically that.
Probably. On arch, you install ollama and ollama-cuda and you’re good to go.