Products/Verification
Score
Verification: anyone who publishes a probability, scored on the record under the same rules as the index.
A scoring table
Sample| Producer | Brier | Skill | 90% interval |
|---|---|---|---|
| Producer A | 0.171 | +0.09 | [+0.03, +0.15] |
| Producer B | 0.188 | +0.04 | [-0.02, +0.10] |
| Venue baseline | 0.179 | +0.06 | [+0.01, +0.12] |
Illustrative scores with intervals, shown to convey the shape of a result.
What it is
Forecasting firms, model vendors, AI labs and venues all publish probabilities. Scopes scores them against outcomes the way it scores the markets: Brier and skill by horizon, calibration, with intervals, under rules fixed before outcomes. The matched question set, the rules for matching, and the scoring rules are published before any result, with timestamp receipts, so neither side can choose the comparison after the fact. Scores are published with attribution; the producer's raw probabilities are shown only if the producer allows it.
Who it is for
Producers of probabilities who want an independent score they can cite: superforecasting firms, election and sports models, model vendors. Evaluators who need the venue baseline, including AI labs measuring forecasting models. Venues whose self-reported accuracy claims would carry more weight with a third party behind them.
What you receive
A scoring methodology document for the engagement, the matched set published before outcomes, scores by horizon with intervals on a standing page, and a scoring report the client may cite. Independent verification, not an audit.
How it is priced
Per engagement for a one-time scoring. A standing fee for continuous scoring on the record. Research use by arrangement.
The fences
Scopes measures. It does not forecast, advise, or recommend. Rules are specified in advance and versioned. Corrections are appended, never overwritten. No positions in covered contracts. Delivered subject to source-data rights.
Inquire
Tell us the scope and we will follow up on fit, licensing, and delivery.