Give me summary of Foundation Models APIs
Asked on 06/25/2025
1 search
The Foundation Models APIs, introduced at WWDC 2025, provide developers with access to Apple's on-device large language model through a convenient Swift API. This framework is available across macOS, iOS, iPadOS, and VisionOS, allowing developers to enhance their apps with intelligent features while ensuring user data privacy since all operations are performed on-device.
Key features of the Foundation Models framework include:
-
Prompting and Sessions: Developers can easily prompt the model with just a few lines of code. The framework supports stateful sessions, which maintain a transcript of interactions, useful for debugging or UI display.
-
Guided Generation: This feature allows developers to obtain structured output from the model. By using macros like
Generable
andGuide
, developers can define the types of data they want the model to generate, ensuring more reliable and structured responses. -
Tool Calling: The model can autonomously call functions defined in your app, allowing it to perform actions or fetch additional information as needed. This is particularly useful for integrating live or personal data, such as weather or calendar events, into the model's responses.
-
Streaming Output: The API supports streaming responses, which can enhance user experience by providing incremental output, turning latency into a moment of delight.
-
Developer Tools: The framework includes tools for profiling model requests and optimizing performance. Developers can also provide feedback to Apple to help improve the models and APIs.
For a more detailed introduction, you can refer to the session Meet the Foundation Models framework (00:00:00) and explore the chapters on guided generation, tool calling, and more.

Platforms State of the Union
Discover the newest advancements on Apple platforms.

Discover machine learning & AI frameworks on Apple platforms
Tour the latest updates to machine learning and AI frameworks available on Apple platforms. Whether you are an app developer ready to tap into Apple Intelligence, an ML engineer optimizing models for on-device deployment, or an AI enthusiast exploring the frontier of what is possible, we’ll offer guidance to help select the right tools for your needs.

Meet the Foundation Models framework
Learn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for responsive experiences, to tool calling for integrating data sources and sessions for context management. This session has no prerequisites.