Home · Beta · Metaculus community-prediction aggregate
Beta · Forecaster aggregator platform · cited; not independently recomputed
Metaculus community-prediction aggregate
- Source class
- Forecaster aggregator platform
- Metric
- Brier score (binary questions, all-time)
- Reported value
- public — reported on Metaculus track-record page
- Measured
- 2026-04-27
Context
Metaculus's aggregated community prediction across all resolved binary questions on the platform. Metaculus publishes its own track record openly. Specific time-windowed Brier varies; the platform's methodology and live numbers are public at the citation URL.
Citation
Metaculus, Track Record + Scoring Methodology (publicly maintained dashboard).
https://www.metaculus.com/questions/track-record/
What Phase 1 launch will add
Calibration Ledger has not independently recomputed the value above. Phase 1 launch (target Q3 2027, gated on prerequisites) will add for this source class:
- Independent recomputation from the original outcome data, under data-licensing agreement
- Time-windowed breakdown (rolling 3-month, 12-month, lifetime)
- Cross-domain calibration (does this source calibrate uniformly across topical verticals?)
- Append-only timestamp anchoring of every score so retroactive revisions are visible
- Per-source citation page with full Murphy decomposition (Reliability − Resolution + Uncertainty)
All other findings
- Good Judgment Project Superforecasters (Human forecasters)
- Manifold Markets — platform calibration (Prediction market)
- GPT-4 (OpenAI) — pre-RLHF vs post-RLHF calibration (AI models)
- Sell-side equity analysts — earnings forecast accuracy (Analyst firms)
- Open Science Collaboration — psychological science replication rate (Scientific papers)
- Anthropic — Claude / language model self-knowledge (AI models)
- Camerer et al. — social science experiment replication (Nature/Science 2010-2015) (Scientific papers)
- Federal Reserve Survey of Professional Forecasters — GDP / inflation accuracy (Analyst firms)
- Hausfather et al. — climate model projections vs. observed warming (Scientific papers)
Related
- All beta findings — at-a-glance + JSON + BibTeX exports
- Methodology v1.1 — full Brier + Murphy + append-only framework
- Operator track record — methodology applied to Paulo de Vries’s own dated forecasts
- Source classes — what each of the 6 source classes will score at Phase 1
- Roadmap — milestone status + Q3 2027 launch gate + kill criterion
Last verified: 2026-04-28. Cited; Calibration Ledger has not independently recomputed this finding. Independent recomputation in Phase 1 (Q3 2027). Operator: Paulo de Vries. Contact: contact@calibrationledger.com.