How can I use Apple Intelligence in my app
Generated on 8/1/2024
1 search
To integrate Apple Intelligence into your app, you can leverage several new APIs and tools introduced at WWDC 2024. Here are some key points and features you can use:
-
App Intents Toolbox: This toolbox allows your app to expose its capabilities to Apple Intelligence. By defining app intents, your app can interact with Siri and the Shortcuts app, enabling users to perform actions using natural language. Over time, Siri will gain the ability to call these app intents in supported domains. You can start working on this integration today (Platforms State of the Union).
-
Writing Tools: These tools help users rewrite, proofread, and summarize text. If your app uses standard UI frameworks to render text fields, it will automatically benefit from these writing tools. You can also customize the behavior using the new textview delegate API (Platforms State of the Union).
-
Image Playground: This API allows you to integrate image creation features into your app without needing to train your own models. It provides a consistent and playful experience for users to create images (Explore machine learning on Apple platforms).
-
Spotlight API: This new API enables app entities to be included in Siri's index, allowing Siri to search data from your app. When combined with app intents, it unlocks new ways for users to connect content across the system (Platforms State of the Union).
-
On-Device Intelligence: Apple Intelligence leverages on-device machine learning models to provide low-latency and privacy-preserving experiences. This includes a semantic index that organizes personal information from across apps and uses it to ground requests in relevant personal context (Platforms State of the Union).
For a deeper dive into these features and how to implement them, you can refer to the session "Explore machine learning on Apple platforms" which covers various ML-powered APIs and how to run models on device.
Relevant Sessions
These sessions provide comprehensive insights into integrating Apple Intelligence into your apps and leveraging the new capabilities introduced at WWDC 2024.
Platforms State of the Union 5-Minute Recap
Watch a quick recap of the newest advancements on Apple platforms.
Explore machine learning on Apple platforms
Get started with an overview of machine learning frameworks on Apple platforms. Whether you’re implementing your first ML model, or an ML expert, we’ll offer guidance to help you select the right framework for your app’s needs.
Platforms State of the Union
Discover the newest advancements on Apple platforms.