← Rok Benko's projects
Repo

fieldtrial

@rokbenkoby Rok Benko · quackd

Statistically rigorous real-world evaluation for robot policies. Plan how many rollouts you need, run them randomized and blinded from a phone at the robot, let fieldtrial switch LeRobot or openpi policies itself, and get a report that only says "better" when a pre-registered test does.

Built withPythonab-testingconfidence-intervalsembodied-aievaluationexperimental-designexperimentation

Comments · 0

No comments yet. Tried it? Tell Rok what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.