KoboldCpp

Other Free

Local LLM runtime focused on storytelling and chat usage.

About KoboldCpp

KoboldCpp offers lightweight local inference for compatible GGUF models.