Metaculus is an online forecasting platform and aggregation engine that
crowdsources predictions about future events. Founded in 2015, the company
operates a community-driven system where individuals submit probabilistic
forecasts on a wide range of questions spanning science, technology,
geopolitics, health, economics, and other domains. Metaculus combines the
collective judgment of thousands of forecasters with statistical aggregation
methods to produce calibrated predictions intended to inform decision-making
by researchers, policymakers, nonprofits, and the general public.
The name "Metaculus" is derived from a play on "meta" and "oculus,"
suggesting a collective eye on the future. The platform is designed around the
principles of forecasting science, drawing on research demonstrating that
well-aggregated predictions from motivated, calibrated individuals can
outperform expert judgment and rival more resource-intensive forecasting
methods.
What Metaculus Does
At its core, Metaculus poses precisely worded questions about uncertain future
outcomes and invites its community to answer them with numerical probabilities
or value ranges. Each question is framed with clear resolution criteria so
that, once the relevant event occurs or a deadline passes, the question can be
objectively resolved as correct or incorrect. This structure allows the
platform to track forecaster accuracy over time and to reward those who
consistently make well-calibrated predictions.
The platform's value comes from aggregation. Rather than relying on any single
person's opinion, Metaculus combines many individual forecasts into a single
community prediction using weighted statistical models. The system gives more
weight to forecasters with strong track records and updates the aggregate as
new predictions arrive. This produces a continuously evolving estimate that
reflects the current state of collective knowledge on a given question.
Metaculus emphasizes calibration and scoring. Forecasters earn points and are
ranked based on the accuracy and timeliness of their predictions relative to
the community and to the eventual outcomes. This scoring framework encourages
honest, thoughtful contributions and helps identify skilled forecasters whose
input carries additional weight in the aggregation process.
Types of Questions and Topics
Metaculus hosts questions across a broad spectrum of subject areas. Common
categories include:
- Artificial intelligence and machine learning progress, such as benchmark
achievements, model capabilities, and timelines for technological
milestones.
- Public health and epidemiology, including disease outbreaks, vaccine
development, and pandemic-related outcomes.
- Geopolitics and international affairs, covering elections, conflicts,
treaties, and policy changes.
- Science and technology, spanning space exploration, energy, climate, and
research breakthroughs.
- Economics and finance, including market indicators, employment, and
macroeconomic trends.
- Existential and global catastrophic risks, an area of particular interest
given the platform's ties to the effective altruism and long-term risk
research communities.
Questions may be binary (yes/no), numeric (predicting a specific value or
range), or date-based (predicting when an event will occur).
Products and Services
The Public Forecasting Platform
The primary offering is the free, publicly accessible Metaculus website, where
anyone can register, browse open questions, submit forecasts, and view
community predictions. Users can comment on questions, discuss reasoning,
and follow topics of interest. The platform maintains detailed records of
each forecaster's performance, fostering a reputation-based community of
skilled predictors.
Tournaments and Challenges
Metaculus regularly runs forecasting tournaments, often with cash prizes,
focused on specific themes or sponsored by partner organizations. These
tournaments concentrate community attention on high-priority questions and
help surface and reward top forecasting talent. Tournaments have addressed
subjects such as pandemic response, artificial intelligence, biosecurity,
and other pressing issues.
Pro Forecasting and Consulting Services
Beyond the open platform, Metaculus offers professional forecasting services
to organizations. It maintains a network of vetted, high-performing
forecasters ("Pro Forecasters") who can be engaged to produce tailored
predictions on questions of interest to clients. This allows institutions to
access rigorous, aggregated forecasts on custom topics relevant to their
strategic planning and research needs.
Partnerships and Sponsored Question Series
Metaculus collaborates with academic institutions, foundations,
nonprofits, and government-adjacent organizations to develop question sets
and forecasting projects aligned with those partners' missions. These
collaborations have focused on areas such as global health, artificial
intelligence safety, and other domains where improved foresight can support
better decisions and resource allocation.
Data and API Access
The platform provides access to its forecasting data, enabling researchers and
developers to study the aggregated predictions, analyze forecasting
performance, and integrate Metaculus data into their own tools and research.
This supports the broader field of forecasting research and quantitative
analysis of collective prediction.
Methodology and Philosophy
Metaculus is grounded in the science of judgmental forecasting, an area
popularized by research showing that carefully selected and trained
individuals can make remarkably accurate predictions when their forecasts are
properly aggregated and scored. The platform draws on concepts such as
calibration (whether stated probabilities match observed frequencies) and
proper scoring rules that reward honesty and accuracy.
A distinguishing feature of the platform is its emphasis on continuous
updating and transparency. Forecasters can revise their predictions as
circumstances change, and the community prediction reflects these updates in
near real time. Historical accuracy is publicly tracked, providing
accountability and allowing users to assess the reliability of the aggregate.
Mission and Impact
Metaculus positions itself as a public-benefit-oriented organization aiming to
improve human reasoning and decision-making about the future. By generating
accurate, accessible forecasts on socially important questions, the company
seeks to help institutions and individuals navigate uncertainty more
effectively. The platform has been particularly active around questions
related to emerging technologies, global health crises, and long-term risks,
reflecting a mission focused on questions with significant societal stakes.
Community
The Metaculus community is central to its operation. It consists of amateur
and professional forecasters, subject-matter experts, researchers, and
enthusiasts who contribute predictions and engage in discussion. The
reputation and scoring systems create incentives for thoughtful participation,
and the discussion features enable the sharing of reasoning, evidence, and
analysis that enrich the collective forecasting process.
Summary
Metaculus is a forecasting platform that harnesses the collective intelligence
of a global community to predict future events across many domains. Through its
public prediction platform, tournaments, professional forecasting services,
partnerships, and data access, it turns dispersed knowledge into calibrated,
actionable forecasts. Rooted in the science of prediction and aggregation, the
company aims to advance human understanding of the future and to support
better decisions on issues of scientific, technological, and societal
importance.