baatliwala@lemmy.world to memes@lemmy.world · 6 days agoThe AI revolution is cominglemmy.worldexternal-linkmessage-square76fedilinkarrow-up1323arrow-down138
arrow-up1285arrow-down1external-linkThe AI revolution is cominglemmy.worldbaatliwala@lemmy.world to memes@lemmy.world · 6 days agomessage-square76fedilink
minus-squareLurker@sh.itjust.workslinkfedilinkarrow-up47arrow-down2·6 days agoDeepseek is good locally.
minus-squareMora@pawb.sociallinkfedilinkarrow-up1·5 days agoAs someone who is rather new to the topic: I have a GPU with 16 GB VRAM and only recently installed Ollama. Which size should I use for Deepseek R1?🤔
minus-squareLurker@sh.itjust.workslinkfedilinkarrow-up3·5 days agoYou can try from lowest to bigger. You probably can run biggest too but it will be slow.
minus-squarekyoji@lemmy.worldlinkfedilinkarrow-up2·5 days agoI also have 16gb vram and the 32b version runs ok. Anything larger would take too long I think
Deepseek is good locally.
As someone who is rather new to the topic: I have a GPU with 16 GB VRAM and only recently installed Ollama. Which size should I use for Deepseek R1?🤔
You can try from lowest to bigger. You probably can run biggest too but it will be slow.
I also have 16gb vram and the 32b version runs ok. Anything larger would take too long I think