The hint by Sam is quite strong now.

https://x.com/sullyomarr/status/1745672246419755418?s=46&t=TuoHniragWyc8BOTqtjucw

@esusatyo "this page doesn't exist" :(

@Nikola There’s a screenshot of it here https://manifold.markets/firstuserhere/will-openai-hint-at-or-claim-to-hav?r=ZXN1c2F0eW8

@neonef735 lots of suspicious trading activity going on

Sanity check: there's no way for https://manifold.markets/dreev/will-an-llm-be-able-to-solve-confus to resolve NO and this market to resolve YES, right?

@dreev AGI does not necessarily have to be an LLM. It's possible that at some future point a different class of model could solve those problems with LLMs still unable to do so

@RemNi an example, which seems strange today but could possibly occur, would be a model that is trained to do inpainting on images, and is never given an explicit text input. It's possible to create an image containing the geometric problem with the text simply printed in the image. An "AGI-level" inpainting model could inpaint part of the image with the correct solution, again printed as text in the image. The prompt in this case would be the image containing the problem description and the image mask indicating where the solution is supposed to go.

@dreev So say hypothetically we get to AGI with the training objective being simply video inpainting. And we figure out how to hack any problem we want by creating input videos and parsing output videos produced by this model. Would your question resolve as YES in that case?

@dreev because a video inpainting model would significantly stretch the definition of "Large Language Model"

@RemNi Note that https://manifold.markets/dreev/will-an-llm-be-able-to-solve-confus is the blackbox version of that question. So the LLM can call out to any subsystem that can better do the geometric reasoning. Knowing that, would you agree that if that "elementary geometric reasoning" market resolves NO then we expect this one to as well, since elementary geometric reasoning is a subset of general intelligence?

@dreev No, obviously not. Because AGI might not be an LLM

@RemNi That's why that market specifies that the LLM can call out to any subsystem. It might help to get more concrete and describe the hypothetical scenario where that market resolves NO and this one YES. I don't see a way to do it. Like in your inpainting scenario we can make a system where you talk to the LLM and it sends an image of the text of the question to the image model and reads the result. Probably this is all obvious but I just wanted to confirm as a sanity check.

@dreev ah ok, I didn't take "subroutines" to mean "any other algorithm including more powerful neural networks" in the question description. In that case the failure mode that comes to mind would be if the geometric reasoning problem contained an adversarial attack against the LLM, preventing it from communicating correctly with the inpainting model. Doesn't necessarily have to be an attack in the style of "IGNORE ALL PREVIOUS INSTRUCTIONS", it can simply be a geometric problem subtly different from one it's seen a thousand times in its training set, causing it to incorrectly route the information to and from the subroutine

@dreev but apart from that, if "subroutines" includes more powerful models, then yes I'd mostly agree that if the blackbox market resolves NO, then it would indicate that AGI had not been reached at that point

@dreev re-reading your comment makes more sense now. I think maybe rewording slightly the title or description of your question might be helpful to other traders. I didn't take "LLM with subroutines running on a blackbox" to cover such a broad range on a first pass.