Running a 35B AI Model on 8GB VRAM: How to Keep it FAST
The common wisdom says that if you want to run a 35-billion-parameter model, you need a desktop with a massive, expensive GPU.…
Just a guy trying to play God without permission.
Tag
1 post
The common wisdom says that if you want to run a 35-billion-parameter model, you need a desktop with a massive, expensive GPU.…