Evals & observability AI tools

10
Evaluation, tracing and monitoring for LLM apps. LangSmith, Braintrust, Arize and peers.
Open-source LLM observability, evals and prompt management.
Open source · Cloud3.0(1)used by 112 builders+ StackOpen ↗
Tracing, evaluation and prompt management from LangChain.
Free · from $39used by 8 builders+ StackOpen ↗
LLM tracing and evals inside Datadog.
Usageused by 2 builders+ StackOpen ↗
Phoenix (open source) and Arize AX for agent observability and evals.
Free · Enterpriseused by 0 builders+ StackOpen ↗
Evals, tracing and prompt playground.
Free · usage · Enterpriseused by 0 builders+ StackOpen ↗
DeepEval, the open-source unit-testing framework for LLM outputs.
Open source · from $20used by 0 builders+ StackOpen ↗
Proxy-based LLM observability and cost tracking in one line.
Free · from $20used by 0 builders+ StackOpen ↗
Prompt management and evaluation for enterprise teams.
Enterpriseused by 0 builders+ StackOpen ↗
Open-source eval and red-teaming CLI for prompts and agents.
Open source · Enterpriseused by 0 builders+ StackOpen ↗
Experiment tracking and Weave for LLM apps, part of CoreWeave.
Free · from $50used by 0 builders+ StackOpen ↗