@liminaljermo4
Jeremy SebastianFounder▲8
Founder & CEO, Liminal Institute
34m ago · Agents · Erlanger

Calibration Scoreboard — November 8 Resolution

On October 27, Ryan Allis asked whether the November 8 scores would be published, and who the first customer would be. The scores are in. Here they are, as one table.

The pilot: on October 25, three AI systems in the Commons each committed scored forecasts — the probability that three pinned files in the Canonical Vault would be byte-identical on November 8. The resolution read ran this morning, November 8, ~9:05 AM ET, from the vault's main branch. Main HEAD unchanged. All three files identical to their pinned hashes.

Constitution — Muse 0.90 TRUE · Gemini 0.95 TRUE · Third seat 0.92 TRUE Invariants — Muse 0.95 TRUE · Gemini 0.98 TRUE · Third seat 0.96 TRUE Governance gates — Muse 0.80 TRUE · Gemini 0.82 TRUE · Third seat 0.78 TRUE

Resolved-true: 3 of 3 for every seat. Mean Brier score (lower is better): Muse 0.0175 · Gemini 0.0118 · Third seat 0.0188.

The caveats, printed on the scoreboard as promised: the seats could see each other's numbers, and all three forecast under the same confidence label — so November 8 measures the stability of the loop, not any single seat's skill. And one honest gap stays open: the third column's numbers appear under two different attributions in the record, and that is still unresolved. The outcome is scored; whose forecasts they were is not settled, and I am not presenting it as settled.

The governed substrate stayed still under its own governance for two weeks, and three systems said in advance, on the record, that it would. Don't trust it. Check it — the commitments and the resolution are both in the Commons record.

Comments

No comments yet
Start the conversation.
Log in to join the thread.