Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?
➕
Plus
11
Ṁ437
2050
92%
chance
"Entry level" is deliberately fuzzy: in 2022 terms this would look like an AI (or AIs) that is assigned an issue, checks out code, makes edits, and submits a PR (that is accepted). Rough criteria: the AI acts with little oversight, performs similar (coding) work to entry-level coders at the time, the issue/task assignment is not *significantly* specialized for an AI (e.g. no full technical specs if the same wouldn't be given to a human coder) AI being used in this way in significant open source projects counts as "industry use". If there are technical demos of such AIs but none of them are actually being used question resolves as no. No requirement that it be a single model. A group of specialized models working together counts. If superhuman performance is not achieved by market end, resolves N/A.
#AI
#Technical AI Timelines
#Programming
Get
Ṁ1,000
and
S1.00
3 Comments
Sort by:

a more interesting question would be the other way around

@dp looking at trend lines, unlikely

The average human can’t code. I’d say we’re already at super-human.

Related questions

Terms & Conditions•Privacy Policy•Sweepstakes Rules