Repo

KeepRoLLMing

OpenAI-compatible proxy that makes local LLMs serving easy and reliable. Sits between your client and any OpenAI-compatible backend, adding routing, pooling, sticky sessions, fallback, loop detection and context window management.

Visit github.com ↗

Built with

Python

Comments · 0

No comments yet. Tried it? Tell Daniele what worked, what didn't, or what you'd want next.

More from members

All projects

See what other members are building and what each project is looking for.