Scopes

The independent record

Scorecard statistics.

How accurate are the markets, really? Every number here is computed from resolved flags: the mechanical record of when a market price and the Scopes Fair Value diverged, tracked to outcome. No opinions, no projections; the statistics decide what can and can't yet be said.

786
Resolved flags
420
Market right
366
Scopes Fair Value right

Is the difference real yet?

366/786 resolved to the Scopes Fair Value side. If both sides were equally good, a split this uneven or more would occur by chance 6% of the time (p = 0.06).

No statistically significant difference yet (binomial test, n = 786).

At the current flag rate, a true 60/40 skill difference becomes detectable around n ≈ 194 resolved flags; a 55/45 difference around n ≈ 783.

Brier comparison

0.183
Market: mean Brier
n = 786
0.182
Scopes Fair Value: mean Brier
n = 786

Mean Brier difference (market minus fair value): 0.001 [95% CI -0.007, 0.009]

The interval includes zero: no side is reliably more accurate yet.

The Brier score is the mean squared error between a probability and the 0/1 outcome, lower is more accurate. Probabilities are taken as recorded at flag time, not revised after the fact. The interval is a cluster bootstrap: correlated outcomes, e.g. multiple flags on the same election cycle, are resampled together so they cannot manufacture false precision. This is a paired forecast-comparison in the spirit of Diebold–Mariano. What the scorecard’s split does and doesn’t mean →

By desk

DesknRight (fair / market)Binomial pBrier: marketBrier: fair
Rates4— · n < 10
Polls123 / 90.150.1960.242
Sports1— · n < 10
stocks14173 / 680.740.1220.147
energy628287 / 3410.030.1970.189

Explore the record

Filter the resolved record by desk, event family, minimum Scopes Divergence, and date range, every slice recomputes the same binomial test and paired Brier comparison. Slices below 10 flags report counts only, no verdict.

Loading the record…

Flags are deduplicated (one per binary event) and grouped into event families for testing; families, not individual flags, are the unit of statistical resampling. Sports flags are the closest to independent observations; election flags within one cycle are treated as correlated.