Repo

llm-engineering-platform

A production-oriented LLM engineering platform with OpenAI-compatible serving, streaming, observability, evaluation, reproducible experiments, and deterministic RAG.

Visit github.com ↗

Built with

Pythonai-infrastructure

dockerevaluationexperiment-tracking

fastapi

Comments · 0

No comments yet. Tried it? Tell Linzhang what worked, what didn't, or what you'd want next.

More from members

All projects

See what other members are building and what each project is looking for.