Respuestas al mensaje #675

🇵🇦 Nuestro primer dominio localizado está en español en kiwifarms.pa. Our first localized domain is on Spanish on kiwifarms.pa.

Interesting. I have that same exact CPU but with a 4090. For 30b models using GPTQ inference it's about 50 tokens a second. For 65b GGML models...