Foundational Model

The Foundation Models framework was introduced at WWDC 2025, providing developers with access to an on-device large language model through a convenient Swift API. This framework is available on macOS, iOS, iPadOS, and VisionOS, and it allows for the enhancement of existing app features or the creation of new ones, all while ensuring data privacy since everything runs on-device.

Key features of the Foundation Models framework include:

• On-Device Processing: The model runs entirely on the device, ensuring that all data remains private and can function offline.
• Guided Generation: This feature allows developers to get structured output in Swift, making it easier to integrate the model's responses into app interfaces.
• Tool Calling: The model can autonomously execute code defined in your app, allowing for dynamic interactions and actions based on user input.
• Stateful Sessions: These sessions allow for multi-turn interactions, maintaining context across multiple exchanges with the model.
• Safety and Guardrails: The framework includes built-in guardrails to prevent harmful outputs and allows developers to add their own safety rules.

For more detailed information, you can explore sessions like Meet the Foundation Models framework and Explore prompt design & safety for on-device foundation models.