

1·
6 days agoGot a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions. China is really kicking ass with the open source models.


Got a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions. China is really kicking ass with the open source models.


You should put in some Disney lyrics so they issue a takedown request if it leaks.
Just wish I had more VRAM and could load it faster.