Repo

LiSa-LLM

@yogsothoby Yog-Sotho YogSotho · Independent

0

Sandboxed, OpenAI-compatible LLM server for GGUF models: drop in a model → get a ChatGPT-style API → the model runs in a padded cell. llama.cpp engine · continuous batching + prompt cache (faster than llama-server under load) · namespace/Landlock/seccomp sandbox · hashed API keys · TLS/mTLS · Prometheus metrics · signed static binaries & Docker

Built withC++artificial-intelligenceclicppggufhuggingfaceinference

See what other members are building and what each project is looking for.