Is code-davinci-002 just the largest non-GPT-4 model in the GPT-4 scaling law experiment? | Manifold

Is code-davinci-002 just the largest non-GPT-4 model in the GPT-4 scaling law experiment?

Mini

3

Ṁ35

Feb 17

44%

chance

1D

1W

1M

ALL

https://arxiv.org/pdf/2303.08774.pdf

Resolves Yes/No when I have >90% confidence.

Get

1,000

and

1.00

Sort by:

It's 4 orders of magnitude less compute than GPT-4! GPT-3 was 2 OOMs less compute.

Related questions

What will be true about GPT-5?

Will GPT-5 have more than 5 trillion parameters?

Will GPT-4 be trained (roughly) compute-optimally using the best-known scaling laws at the time?

If we find out in 2024, was o1's Transformer base trained on 10+x as much compute as GPT-4's?

Will GPT-4 improve on the Chinchilla scaling law?

Is GPT-4 best? (Thru 2025)

Will GPT-5 have more than 10 trillion parameters?

What will be true about GPT-5? (See description)

OpenAI releases a model unquestionably named "GPT-4.5" or "GPT-4.5x" (where X varies) by mid 2025, hardcore legalism arc

Will the performance jump from GPT4->GPT5 be less than the one from GPT3->GPT4?

Related questions

What will be true about GPT-5?

Is GPT-4 best? (Thru 2025)

Will GPT-5 have more than 5 trillion parameters?

Will GPT-5 have more than 10 trillion parameters?

Will GPT-4 be trained (roughly) compute-optimally using the best-known scaling laws at the time?

What will be true about GPT-5? (See description)

If we find out in 2024, was o1's Transformer base trained on 10+x as much compute as GPT-4's?

OpenAI releases a model unquestionably named "GPT-4.5" or "GPT-4.5x" (where X varies) by mid 2025, hardcore legalism arc

Will GPT-4 improve on the Chinchilla scaling law?

Will the performance jump from GPT4->GPT5 be less than the one from GPT3->GPT4?

Terms & Conditions•Privacy Policy•Sweepstakes Rules