Scopes

Research · methodology note · Sept 1, 2026

In-play contamination: what changed and why

The scorecard compares a market's price to an independent pregame benchmark: a de-vigged sharp book for games, an options- or realized-vol fair value for index and commodity contracts. That comparison is only meaningful while the benchmark still describes the same uncertainty the market does. Once a game is underway, or a daily contract is minutes from settlement, that stops being true.

The problem

The benchmark is a pregame line, it doesn't update once play begins. The market does. So a snapshot taken after kickoff isn't market-vs-fair-value; it's a live price against a frozen number. Near settlement the failure is the mirror image: the market and the fair value both collapse toward the outcome, so any remaining "gap" is convergence noise, not a measurable disagreement. Flags minted from either kind of snapshot don't measure what the scorecard claims to measure.

The rule change (flagging v2)

Each snapshot now carries a comparison_valid flag. It is false for in-play snapshots (sports, once the game has started) and near-expiry snapshots (stocks within 2h of settlement, energy within 24h). The scorecard counts comparison-valid flags only. Invalid snapshots are not deleted, they stay in the archive in full (the convergence window is valuable history), simply labeled and excluded from the score, ranking, and the hero. The record is append-only: prior flags remain, tagged by the rule that created them.

What it did to the record

The split at cutover: the share of resolved flags where the fair value proved right, under the old rule (all flags) versus the new one (valid-only):

Deskv1 (all)v2 (valid)resolvedexcluded
Stocks44.4%63.2%36 → 1917
Energy27.7%25.8%256 → 23620
Sports49.1%49.1%226 → 2260
Weather37.5%37.5%56 → 560
Rates100.0%100.0%1 → 10
Update, November 1, 2026. The table is kept as the September 1 record, but its Sports row no longer describes the scorecard. All 226 sports flags in it were minted before August 24, when a game-binding bug was fixed: it bound some games' fair value to the wrong game or snapshot, including the wrong first-pitch time. On September 21 those 226 flags were withheld from scoring (see the MLB binding artifact). The sports desk now contributes no scored flags, and none has been minted since August 24. The statement below that sports flags "were already created pregame-only" also did not hold for those flags: with a wrong first-pitch time, the pregame check could not be relied on. The 226 flags remain in the record, marked not scored.

Reading it honestly

Every prior flag is still in the record, tagged with the rule that created it; nothing was rewritten. This is the scorecard the change now governs.

Cite this study

Free to cite with attribution to Scopes. For the citation format, boilerplate, and media contact, see Press & citation.