Repo

rag-cost-latency-router

@kashaffnoorby Kashaf Noor · Arbotrix

0

Benchmarks a cost-latency optimized RAG router: static vs adaptive top-k retrieval. Adaptive router uses similarity-score elbow detection to right-size context per query — no extra LLM calls. Tested on 50 QA pairs via Gemini: 17% fewer input tokens than static k=5, with higher Exact Match and F1. Includes a data-driven margin calibration script.

Built withPython

See what other members are building and what each project is looking for.