voice to text improvement available right now?

Generated on 9/4/2024

1 search

Apple has introduced several improvements to voice-to-text capabilities, particularly through enhancements to Siri and the use of the web speech API.

  1. Siri Improvements: Siri has become more natural in its speech, more contextually relevant, and more personal, thanks to advancements in Apple Intelligence and large language models. This means that Siri can understand and process spoken language more effectively, even if the user stumbles over their words. These improvements are automatically available to apps that have already adopted SiriKit. For more details, you can check the session Bring your app to Siri.

  2. Web Speech API: On platforms like Vision Pro, users can utilize voice input for text fields through the web speech API, which processes speech locally on the device, ensuring privacy and efficiency. This API allows real-time voice interaction and can respond back with speech, enhancing the voice-to-text experience on the web. This is discussed in the session Optimize for the spatial web.

These improvements are part of Apple's broader efforts to enhance user interaction through voice, making it a more seamless and integrated experience across their platforms.