Will GPT-5 perform better than o1 (not preview) at AIME 2024, Codeforces elo, GPQA, or the 2024 ioi?
Mini
10
Ṁ326Dec 2
91%
chance
1D
1W
1M
ALL
o1's scores are the ones mentioned here. https://openai.com/index/learning-to-reason-with-llms/
Resolves yes if OpenAI or a third party tester is able to get GPT-5 to achieve higher scores on any of these benchmarks without any kind of prompt engineering or agent scaffolding
Get
1,000and
1.00
1,0001.00Sort by:
I had a previous question that asked whether I would judge GPT-5 smarter than 01 that is sitting at 85% yes.
Personally I am unsure why people think this since it is heavily implied GPT-5 won't utilize the scaled test-time compute paradigm which was so key to o1's success. I would bet that GPT-5 will be unable to do this and that the goal is more so achieving near o1 performance more quickly and economically
Related questions
Related questions
Will an AI win a gold medal on the IOI (competitive programming contest) before 2026?
80% chance
Will GPT-5 qualify for the USAMO?
69% chance
Will an AI win a gold medal on the IOI (competitive programming contest) before 2027?
86% chance
Will GPT-5 reach a 1000 rating on Codeforces?
96% chance
Will GPT-5 win Bronze or better at IMO 2025?
22% chance
Will I judge GPT-5 to be smarter than o1 (not preview) after both are released?
81% chance
Will GPT-5 have an estimated IQ higher than 101?
79% chance
Will GPT-5 ace exams?
76% chance
Will GPT-5 be able to get gold on the International Mathematical Olympiad?
23% chance
Will GPT-5 be more competent than me in my area of expertise?
44% chance