This market resolves to the year in which an AI system exists which is capable of passing a high quality, adversarial Turing test. It is used for the Big Clock on the manifold.markets/ai page.
The Turing test, originally called the imitation game by Alan Turing in 1950, is a test of a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human.
For proposed testing criteria, refer to this Metaculus Question by Matthew Barnett, or the Longbets wager between Ray Kurzweil and Mitch Kapor.
As of market creation, Metaculus predicts there is an ~88% chance that an AI will pass the Longbets Turing test before 2030, with a median community prediction of July 2028.
Manifold's current prediction of the specific Longbets Turing test can be found here:
/dreev/will-ai-pass-the-turing-test-by-202
This question is intended to determine the Manifold community's median prediction, not just of the Longbets wager specifically but of any similiarly high-quality test.
Additional Context From Longbets:
One or more human judges interview computers and human foils using terminals (so that the judges won't be prejudiced against the computers for lacking a human appearance). The nature of the dialogue between the human judges and the candidates (i.e., the computers and the human foils) is similar to an online chat using instant messaging.
The computers as well as the human foils try to convince the human judges of their humanness. If the human judges are unable to reliably unmask the computers (as imposter humans) then the computer is considered to have demonstrated human-level intelligence.
Additional Context From Metaculus:
This question refers to a high quality subset of possible Turing tests that will, in theory, be extremely difficult for any AI to pass if the AI does not possess extensive knowledge of the world, mastery of natural language, common sense, a high level of skill at deception, and the ability to reason at least as well as humans do.
A Turing test is said to be "adversarial" if the human judges make a good-faith attempt, in the best of their abilities, to successfully unmask the AI as an impostor among the participants, and the human confederates make a good-faith attempt, in the best of their abilities, to demonstrate that they are humans. In other words, all of the human participants should be trying to ensure that the AI does not pass the test.
Note: These criteria are still in draft form, and may be updated to better match the spirit of the question. Your feedback is welcome in the comments.
1,000
1.00Would be curious to know other bettors' response to this question:
How do you update on this if GPT-5 (or its equivalent, regardless of name) comes out and isn't a significant qualitative improvement over GPT-4?
And to clarify, I mean "significant" in the colloquial sense, not the statistical sense. Otherwise put: if GPT-5 doesn't feel like a "leap".
“Superintelligence in a few thousand days” was, I think, Sam Altman’s way of trying to dampen expectations while looking like he’s exciting them. In various online spaces (e.g. prediction markets) people have gotten into the habit of treating powerful AGI as about 6 years away. “A few thousand days” could easily be 4380 days=12 years away. It puts 6 years (2190 days) as close to an absolute minimum.
@luiswirth long thinking yes, but the length alone wouldn't solve it. The thinking is still misguided and erratic.
I don't think this Turing test test is a good indicator of when AGI would occur, unlike what the phrase "AGI When?" suggests in the title. A well-behaved AGI would be easy to detect. The whole purpose or fine-tuning techniques like RLHF is to make AIs behave better than humans, rather than just imitating them. Making an AGI that can pass such a Turing test would perhaps be foolish and dangerous.
But what if the AGI is trained, for example, to avoid being vulgar, or to be consistently truthful? It would be easy to detect which one is the AI in an adversarial test, independently of its level of intelligence.
And honestly, I don't think most people would be anywhere close to passing a reverse Turing test in real-time against ChatGPT (see here for what it may look like: https://www.youtube.com/watch?v=MxTWLm9vT_o).
@ALN Who cares if people can pass a reverse Turing Test. No one wants to prove they have the qualities of a machine; but the point of the Turing Test was to prove that a machine has some qualities of humans.
6.1189497717
3.3294520548
0.5833333333
add to get ~10.03
10.03 / 3 = 3.34
3 years and 4 months until AGI
This market type is still immature: no limit orders, sells have to be done for all shares in a year, extra fees.
You can see this in the wild swings of expected value over time. One player can swing it significantly if others aren't on standby to push it back. And currently we see e.g. 2043 is at 3x the price of 2042 or 2044, that's nonsense; it's not an efficient market yet.
As I wrote that comment, 2043 jumped up to 13% lol.
Does someone have a time machine?
That's kind of crazy, let's be honest. But also that's even crazier for a model's AVERAGE prediction of when AGI will happen, implying there's a 50% chance it happens before GPT-5.
The Alan Thompson one was just an extrapolation based on the time between the percentages on his website; so it was really just an educated guess. There just wasn’t enough data to average.
Also if you want to express your feelings about this market’s accuracy: https://manifold.markets/BooLightning/how-accurate-is-the-ai-countdown?r=Qm9vTGlnaHRuaW5n