On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark | Manifold

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

Plus

35

Ṁ2830

2026

54%

chance

1D

1W

1M

ALL

Tracking external bet: https://www.isattentionallyouneed.com/

Get

1,000

and

1.00

Sort by:

https://x.com/_philschmid/status/1846452029582959012

@MalachiteEagle Transformers, yes. Attention, not really:

followed by two shared attention blocks.

https://blog.rwkv.com/p/eagle-7b-soaring-past-transformers

It even links the wager page in its bragging points:

All while being an “Attention-Free Transformer”

I thought this wager was made today haha

Does this strictly resolve to the outcome of the bet?

@FranekZak Yep. Whatever details they come up with are in.

Related questions

When will a non-Transformer model become the top open source LLM?

Will there be a model that has a 75% win rate against the latest iteration of GPT-4 as of January 1st, 2025?

Who will release a GPT-4o comparable model in 2024?

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.

Which AI will be the best at the end of 2024?

Will Tesla begin using Optimus Tesla Bots to produce electric vehicles before January 1, 2025?

Will transformers still be the dominant DL architecture in 2026?

Will Transformer based architectures still be SOTA for language modelling by 2026?

Will a new type of AI model replace transformers as the state-of-the-art artificial intelligence technology by 2024?

Related questions

When will a non-Transformer model become the top open source LLM?

Which AI will be the best at the end of 2024?

Will there be a model that has a 75% win rate against the latest iteration of GPT-4 as of January 1st, 2025?

Will Tesla begin using Optimus Tesla Bots to produce electric vehicles before January 1, 2025?

Who will release a GPT-4o comparable model in 2024?

Will transformers still be the dominant DL architecture in 2026?

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

Will Transformer based architectures still be SOTA for language modelling by 2026?

Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.

Will a new type of AI model replace transformers as the state-of-the-art artificial intelligence technology by 2024?

Terms & Conditions•Privacy Policy•Sweepstakes Rules