how can i run the new foundation models on my phone
Asked on 2025-06-11
1 search
To run the new foundation models on your phone, you can use the Foundation Models Framework introduced by Apple. This framework provides access to an on-device large language model through a convenient Swift API, available on macOS, iOS, iPadOS, and VisionOS. Here are the key points to get started:
-
On-Device Execution: The models run entirely on your device, ensuring that all data remains private and can be processed offline. This means you don't need to send data to a server, and it eliminates the need for account setup or API keys.
-
Integration: You can integrate the Foundation Models Framework into your app with just a few lines of code. Start by importing the framework, creating a session, and sending your prompt to the model.
-
Capabilities: The framework is optimized for tasks such as content generation, text summarization, and user input analysis. It can be used to enhance existing app features or create new ones, like generating itineraries in a travel app or creating dialogue for game characters.
-
Performance: The framework leverages Apple's hardware, including the CPU, GPU, and neural engine, to optimize performance and energy efficiency.
For a practical example of how to implement this, you can refer to the session Code-along: Bring on-device AI to your app using the Foundation Models framework, which provides a step-by-step guide on using the framework in an app.

Meet the Foundation Models framework
Learn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for responsive experiences, to tool calling for integrating data sources and sessions for context management. This session has no prerequisites.

Platforms State of the Union
Discover the newest advancements on Apple platforms.

Discover machine learning & AI frameworks on Apple platforms
Tour the latest updates to machine learning and AI frameworks available on Apple platforms. Whether you are an app developer ready to tap into Apple Intelligence, an ML engineer optimizing models for on-device deployment, or an AI enthusiast exploring the frontier of what is possible, we’ll offer guidance to help select the right tools for your needs.