Can you quickly summarize the new Foundation Model?

The new Foundation Models framework introduced by Apple at WWDC 2025 provides developers with access to an on-device large language model through a convenient and powerful Swift API. This framework is available on macOS, iOS, iPadOS, and Vision OS, and is designed to enhance existing app features or create new ones, such as personalized search suggestions or generating itineraries in travel apps. The model is optimized for tasks like content generation, text summarization, and user input analysis, all while maintaining privacy since it runs entirely on-device and can function offline.

Key features of the Foundation Models framework include:

• Guided Generation: This allows developers to get structured output in Swift, making it easier to integrate the model's capabilities into apps.
• Streaming APIs: These APIs help manage latency by providing incremental responses, enhancing user experience.
• Tool Calling: This feature lets the model autonomously execute code defined in your app, expanding its functionality.
• Stateful Sessions: These sessions maintain context over multiple interactions, allowing for more coherent and contextually aware responses.

The framework is designed to be highly efficient, using state-of-the-art quantization techniques and speculative decoding to ensure performance and quality. It also includes built-in guardrails for safety, and developers can add their own rules to suit specific use cases.

For a more detailed introduction, you can watch the session Meet the Foundation Models framework.