Respuestas al mensaje #4,311

Ollama if you just want to run a model without any extra work, they have a bunch of models available in their library you can just pull directly...

For the platform I'd start with: https://github.com/oobabooga/text-generation-webui I have no recommendations for actual models though. I tried...

Right now, I like Mistral-Nemo. Pretty good general purpose model.

Llama is a rare Facebook W, the 8B variant of 3.1 can run on consumer hardware well Use ollama to manage it and it will work as a REST API with...