

3·
6 hours agoNot everyone has a GPU with enough RAM. I have a 3060 with 12GB, and I cannot run ollama and a 3D game at the same time. As soon as ollama starts processing, the GPU is at 100% and game and ollama start swapping data in and out of the GPU RAM, which means the whole computer becomes unresponsive for a long time. I had to set up a script that disables ollama if steam is running.
That’s not how it works. The ram chips soldered onto the AI accelerator cards, you cannot just take them out and use them in a PC :(