Respuestas al mensaje #204,788

A lot of computers can, it just depends on how fast you want to go. Look up your graphics card, look for the number of TOPS it has.

Depends on how large of a model you want to use. Some of the small ones will run on a phone even. Take a look at LM Studio, KobaldCPP, and...

16gb ram and an ssd is the low low end, and scales from there.

Instead of locally, I would recommend using OpenRouter. They are an API service have all the major LLMs and a bunch of smaller ones you can play...

Bare minimum, you can run models on your CPU. It's slow but it technically works. I was able to run a 13b/INT8 model on a 3rd gen i5 with DDR3 RAM...