ML researchers’ median probability of existential risk from AI
ML researchers’ median probability of existential risk from AI
Mini
10
Ṁ473
Jun 11
20
expected

What is ML researchers’ median probability of existential risk from AI according to the most recent survey conducted at a major AI conference (NeurIPS, ICML) by June 2025?

The AI impacts report puts the median probability estimate of human extinction by the median ML researcher at about 5% in 2022. How will this change in the next few years?

Get
Ṁ1,000
and
S1.00


Sort by:
1y

Once this market settles somewhere, you could make a binary over/under market to get much more engagement.

people don’t feel compelled to bet in these markets because if the realistic range is 5-35%, your max win is pretty small for the amount of mana you need to commit

Winner takes all over/under markets are more exciting, or a multi choice market with buckets, e.g. possible answers of

  • 0-10%

  • 11-20%

  • 21-30%

  • 31-40%

  • 41%+

Which still gives a winner-takes all rather than a 5-25% payout

1y

An informal poll within the channel AISafety@Neurips2023 on the whova app with 58 responses puts p(doom) at 32%. The poll participants may select only a bin in the form 0-20, 21-40, etc… and I took the weighted average of the centers of the bins. This leads to an overestimate for two reasons: 1) selection bias (these are ML safety people -not any ML people- who choose to respond to a poll) 2) the 0-20 bin holds roughly 50% of respondents, and I suspect that most of them actually value p(doom) at near 0, but they get counted at 10%.

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Win cash prizes for your predictions on our sweepstakes markets! Always free to play. No purchase necessary.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like trading still use Manifold to get reliable news.
How do I win cash prizes?
Manifold offers two market types: play money and sweepstakes.
All questions include a play money market which uses mana Ṁ and can't be cashed out.
Selected markets will have a sweepstakes toggle. These require sweepcash S to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.
Redeem your sweepcash won from markets at
S1.00
→ $1.00
, minus a 5% fee.
Learn more.