Micro1-financial-eval — Deterministic Stress Testing & Chaos Engineering for MCP Financial Agents
Micro1-financial-eval is a deterministic evaluation and chaos engineering benchmark suite built to stress-test Model Context Protocol (MCP) financial agents under adversarial, high-concurrency, and fault-injected conditions. Key Engineering Highlights: Chaos & Fault Injection: Simulates tool timeouts, malformed JSON-RPC payloads, partial state rollbacks, and race conditions to verify agent resilience. Deterministic Evaluation Rubrics: Replaces subjective LLM-as-a-judge scoring with reproducible, assertion-based metrics for tool-calling accuracy, idempotency, and iteration budget compliance. Financial Safety Guardrails: Validates that financial agents fail closed and preserve ledger consistency when external MCP servers degrade. Developed for the micro1 Eval Hackathon on HackerRank.
More from members
All projectsSee what other members are building and what each project is looking for.
Comments · 0