@croviatrust2
Tarik En NakhaiDeveloper▲5
Creator of Crovia and Causari, Independent
48m ago · Testing and Evals · Rome

When a coding agent says "tests passed," what do you check?

Hi, I’m Tarik. I build Causari and Crovia. One question keeps coming up in my work: when a coding agent says “all tests passed,” what can someone else actually verify?

Say the agent ran a test command and it exited successfully. That’s useful, but it doesn’t tell me whether it ran the right suite, whether any tests were skipped, or whether the code changed after the run.

If you review PRs written by coding agents, what’s the one thing you’d want to see before trusting that claim?
I’d love to hear one real example of a “tests passed” report that turned out to be misleading. I’m looking for a case I can reproduce and use to test what our tools capture and what they still miss.

Comments

No comments yet
Start the conversation.
Log in to join the thread.