What can Siri do
Generated on 7/31/2024
1 search
Siri has received several enhancements and new capabilities, as presented at WWDC 2024. Here are some of the key features:
-
Invoke App Menu Items: Siri can now invoke any item from your app's menus. For example, a user can say "show presenter notes" while reviewing a slide deck, and Siri will know what to do. (Platforms State of the Union)
-
Access Text in Apps: Siri can access and act on text displayed in any app that uses Apple's standard text systems. For instance, if a user sees a reminder to wish someone a happy birthday, they can say "Facetime him," and Siri will initiate the call. (Platforms State of the Union)
-
Personal Context: Siri is equipped with personal context through Apple Intelligence, allowing it to access a semantic index of photos, messages, files, calendar events, and more. This helps Siri find and understand things it couldn't before. (Platforms State of the Union)
-
Natural Language Processing: Siri now sounds more natural and can understand more contextually relevant and personal commands. It can understand what you're looking at on your screen and take action on it. (Bring your app to Siri)
-
Semantic Search: Siri can perform semantic searches, meaning it understands the context of what you're searching for. For example, searching for "pets" will bring up results for cats, dogs, and other pets, not just the word "pet." (Bring your app to Siri)
-
Spotlight API: Siri can search data from your app using a new Spotlight API, which includes app entities in its index. This allows users to connect content from across the system to actions supported by your app. (Platforms State of the Union)
-
App Intents Framework: Siri can now perform more actions in and across apps using the app intents framework. This includes new APIs called app Intent domains, which are collections of app intent-based APIs designed for specific functionalities like books, camera, or spreadsheets. (Bring your app to Siri)
-
Enhanced Integration: Developers can integrate their apps with Siri using Sirikit and app intents. This allows users to perform actions with their apps through Siri, no matter where they are on their device. (Bring your app to Siri)
These enhancements make Siri more capable, flexible, and intelligent, providing a richer and more natural user experience.
Bring your app’s core features to users with App Intents
Learn the principles of the App Intents framework, like intents, entities, and queries, and how you can harness them to expose your app’s most important functionality right where people need it most. Find out how to build deep integration between your app and the many system features built on top of App Intents, including Siri, controls and widgets, Apple Pencil, Shortcuts, the Action button, and more. Get tips on how to build your App Intents integrations efficiently to create the best experiences in every surface while still sharing code and core functionality.
18 things from WWDC24
Here’s your guide to the big announcements from this year’s Worldwide Developers Conference.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Bring your app to Siri
Learn how to use App Intents to expose your app’s functionality to Siri. Understand which intents are already available for your use, and how to create custom intents to integrate actions from your app into the system. We’ll also cover what metadata to provide, making your entities searchable via Spotlight, annotating onscreen references, and much more.