What can Siri do

Generated on 7/31/2024

1 search

Siri has received several enhancements and new capabilities, as presented at WWDC 2024. Here are some of the key features:

  1. Invoke App Menu Items: Siri can now invoke any item from your app's menus. For example, a user can say "show presenter notes" while reviewing a slide deck, and Siri will know what to do. (Platforms State of the Union)

  2. Access Text in Apps: Siri can access and act on text displayed in any app that uses Apple's standard text systems. For instance, if a user sees a reminder to wish someone a happy birthday, they can say "Facetime him," and Siri will initiate the call. (Platforms State of the Union)

  3. Personal Context: Siri is equipped with personal context through Apple Intelligence, allowing it to access a semantic index of photos, messages, files, calendar events, and more. This helps Siri find and understand things it couldn't before. (Platforms State of the Union)

  4. Natural Language Processing: Siri now sounds more natural and can understand more contextually relevant and personal commands. It can understand what you're looking at on your screen and take action on it. (Bring your app to Siri)

  5. Semantic Search: Siri can perform semantic searches, meaning it understands the context of what you're searching for. For example, searching for "pets" will bring up results for cats, dogs, and other pets, not just the word "pet." (Bring your app to Siri)

  6. Spotlight API: Siri can search data from your app using a new Spotlight API, which includes app entities in its index. This allows users to connect content from across the system to actions supported by your app. (Platforms State of the Union)

  7. App Intents Framework: Siri can now perform more actions in and across apps using the app intents framework. This includes new APIs called app Intent domains, which are collections of app intent-based APIs designed for specific functionalities like books, camera, or spreadsheets. (Bring your app to Siri)

  8. Enhanced Integration: Developers can integrate their apps with Siri using Sirikit and app intents. This allows users to perform actions with their apps through Siri, no matter where they are on their device. (Bring your app to Siri)

These enhancements make Siri more capable, flexible, and intelligent, providing a richer and more natural user experience.