← Raul Rodriguez Mesia's projects
Repo

Micro1-financial-eval — Deterministic Stress Testing & Chaos Engineering for MCP Financial Agents

Micro1-financial-eval is a deterministic evaluation and chaos engineering benchmark suite built to stress-test Model Context Protocol (MCP) financial agents under adversarial, high-concurrency, and fault-injected conditions. Key Engineering Highlights: Chaos & Fault Injection: Simulates tool timeouts, malformed JSON-RPC payloads, partial state rollbacks, and race conditions to verify agent resilience. Deterministic Evaluation Rubrics: Replaces subjective LLM-as-a-judge scoring with reproducible, assertion-based metrics for tool-calling accuracy, idempotency, and iteration budget compliance. Financial Safety Guardrails: Validates that financial agents fail closed and preserve ledger consistency when external MCP servers degrade. Developed for the micro1 Eval Hackathon on HackerRank.

Built withModel Context ProtocolMCPPythonJavaChaos EngineeringLLM EvaluationDeterministic TestingLLM EvaluationChaos EngineeringMCPFinTechAI SafetyBenchmarking

Comments · 0

No comments yet. Tried it? Tell Raul what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.