foundation models framework 的记忆长度是多少？
Asked on 06/13/2025
1 search
The Foundation Models framework, as discussed in the WWDC sessions, does not explicitly mention a specific "memory length" for the models. However, it is noted that the on-device model is a large language model with 3 billion parameters, each quantized to 2 bits. This model is optimized for tasks like summarization, extraction, and classification, and is designed to run efficiently on Apple devices. The framework provides a stateful session feature, which records all prompts and responses, but there is a limit to how large a session can grow. For more details, you can refer to the session Deep dive into the Foundation Models framework (00:01:55).
Meet the Foundation Models framework
Learn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for responsive experiences, to tool calling for integrating data sources and sessions for context management. This session has no prerequisites.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Deep dive into the Foundation Models framework
Level up with the Foundation Models framework. Learn how guided generation works under the hood, and use guides, regexes, and generation schemas to get custom structured responses. We’ll show you how to use tool calling to let the model autonomously access external information and perform actions, for a personalized experience. To get the most out of this video, we recommend first watching “Meet the Foundation Models framework”.