Sillytavern thread

[Foundinglaunderer]

Which models do you run with it ?
Locally or api
Which finetunes do you prefer if you run locally etc

 

[Tablet County]

Jesse what the fuck are you talking about?

 

[Lokenstien]

Silly taverns are where the jesters would meet after court whimsy during medieval times.

 

[Foundinglaunderer]

Jesse what the fuck are you talking about?

https://github.com/SillyTavern/SillyTavern its a popular front-end , same with koboldcpp and other stuff

 

[Tablet County]

https://github.com/SillyTavern/SillyTavern its a popular front-end

Oh gay coding shit. I should've guessed from the subforum.
Carry on.

 

[Suburban Bastard]

Nano GPT, it’s a better alternative of OpenRouter but with a subscription that gives you 60 million tokens per week, which if you’re using it for fucking around with AI characters OneyPlays style, is more than enough.

 

[Foundinglaunderer]

Nano GPT, it’s a better alternative of OpenRouter but with a subscription that gives you 60 million tokens per week, which if you’re using it for fucking around with AI characters OneyPlays style, is more than enough.

do you think apis are the future instead of running stuff locally ?

 

[Suburban Bastard]

do you think apis are the future instead of running stuff locally ?

It’s going to be a choice between the two for the foreseeable future.

Obviously the advantage of running locally is that’s as private as you can get and you don’t have to worry about paying. The obstacle being having a rig with enough VRAM, so if you’re already rich, run locally.