Repo

forge

Single-binary batch-inference coordinator — fan a JSONL across N OpenAI-compatible endpoints, survive spot kills, resume with zero loss

Built with

Rustbatch-inferencebatch-processingllm

openai

rust

Comments · 0

No comments yet. Tried it? Tell Nicholas what worked, what didn't, or what you'd want next.

See what other members are building and what each project is looking for.