Whats foundation model
Asked on 06/12/2025
1 search
The Foundation Models framework, introduced by Apple, provides access to an on-device large language model through a Swift API. This framework is available on macOS, iOS, iPadOS, and VisionOS, and is designed to enhance app features by providing capabilities such as content generation, text summarization, and user input analysis. The model operates entirely on-device, ensuring user data privacy and allowing offline functionality. It is optimized for performance and efficiency, using techniques like quantization and speculative decoding. The framework also supports structured data output, tool calling, and stateful sessions, making it versatile for various applications, from personalized search suggestions to generating game dialogue. For more details, you can refer to the session Meet the Foundation Models framework.

Meet the Foundation Models framework
Learn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for responsive experiences, to tool calling for integrating data sources and sessions for context management. This session has no prerequisites.

Platforms State of the Union
Discover the newest advancements on Apple platforms.

Discover machine learning & AI frameworks on Apple platforms
Tour the latest updates to machine learning and AI frameworks available on Apple platforms. Whether you are an app developer ready to tap into Apple Intelligence, an ML engineer optimizing models for on-device deployment, or an AI enthusiast exploring the frontier of what is possible, we’ll offer guidance to help select the right tools for your needs.