Gamers Nexus

  • 🔧 Site instability resolved. You can report double-posts and broken attachments. For bigger issues, use the Technical Grievances thread.
    🇵🇦 Nuestro primer dominio localizado está en español en kiwifarms.pa. Our first localized domain is on Spanish on kiwifarms.pa.
  • Want to keep track of this thread?
    Accounts can bookmark posts, watch threads for updates, and jump back to where you stopped reading.
    Create account
7 days later jeettube recommends me that bragstationer met with 史蒂夫(steve in chinkenese) to discuss stuff about the market.
 
The big problem is that one of the very few places LLMs actually make sense is coding, and you can't get away from using these tools at this point. I've heard qwen3.6:35b-a3b has gotten really good and on par with some of the OpenAI models, but it won't run on my 32GB AMD 9700R. Not enough VRAM!
I think you are misunderstanding something. You can run the MoE 35b model with as little as 8gb VRAM and get decent performance. It runs just fine on my 12gb and 16gb cards. If you have 32gb, you should be going one step higher to the dense 27b model, which is distinctly better.
 
Atrás
Top Abajo