Will any model in Apple’s 2024 MacBook lineup feature an on-device LLM “ChatBot”? (updates count)
➕
Plus
37
Ṁ11k
Dec 31
96%
chance

I have been seeing many reports/rumors that Apple might be working on local on-device LLMs.

The LLM feature can be a combination of on-device and cloud-based processing, but must include some on-device functionality.

ps: i will participate in this market because it is very objective - in case some subjective interpretation is required I will delegate to one of the moderators

Get
Ṁ1,000
and
S1.00
Sort by:

Can you confirm (or deny) if the on-device 3B Apple Intelligence model counts? It is specifically a chatbot (Siri), but also not specifically a chatbot like chatGPT or Claude that only uses one model. It's partially on-device for fast interactions, and for more complex tasks it hands them off. I still think that we need clarification here, since one can interpret the question differently here (does the 3B model count? It's an on-device chatbot. Or does Siri, the chatbot, not count, as it's not 100% on device all the time?)

(I would argue it counts. ChatGPT is also not just chatGPT all the time, as it also gets input from the web. But the counterargument would be something like “there is no standalone chatbot application that is purely on-device all the time", the OS seamlessly switches to off-device models.)

Apple's summary: https://machinelearning.apple.com/research/introducing-apple-foundation-models

Claude's opinion:

4o's opinion:



@JonathanMannhart i knew this would happen when i created the market which is why I included the following in the description which imo makes it very clear that it should count ☺️. So yes I agree with you!!

The LLM feature can be a combination of on-device and cloud-based processing, but must include some on-device functionality.

I think usually a local LLM would be packaged with macOS, with some minimum hardware requirements to use it. What happens if a MacBook releases and an LLM is “coming soon” via a macOS update? Or conversely, does it count if a macOS update adds an LLM to any existing MacBook model?

If an LLM is included in a macOS update, it counts as long as it becomes available to any model in the 2024 MacBook lineup, regardless of when the update is released.

Does the chatbot LLM need to be accessible directly to the end user, or is a chatbot LLM that’s accessible to developers via an API sufficient?

The LLM must be accessible directly to the end user for it to count, not just through an API for developers.

Define "Large" Language Model

is this still needed? 😅 feel free to propose a definition

Nah, I just wanted to exclude Siri or Alexa-like chatbot that is not "large" enough

I will just leave this here