Eye interface

Apple's WWDC 2024 introduced several new features and capabilities related to eye interaction, particularly in the context of visionOS and Apple Vision Pro. Here are some key points:

1. Natural Input in visionOS:

   • VisionOS introduced natural input, allowing users to target interaction regions in an app or webpage using their eyes and interact by tapping their fingers together. These regions are highlighted when the user looks at them, ensuring privacy as the highlights are drawn by a process outside of Safari, so even the browser doesn't know where the user is looking. This is discussed in the session Optimize for the spatial web.

2. HealthKit in visionOS:

   • VisionOS allows users to enter an immersive space where they can reflect on their activities and feelings without distractions. This immersive experience can be saved to HealthKit, enhancing the user's ability to manage their health data in a spatial computing environment. This feature is highlighted in the session Get started with HealthKit in visionOS.

3. Game Input in visionOS:

   • VisionOS supports game input using eye and hand gestures, making it easy for players to interact with games without extra equipment. The session Explore game input in visionOS covers the different types of gestures and physical input devices supported by visionOS.

Relevant Sessions

1. Optimize for the spatial web
2. Get started with HealthKit in visionOS
3. Explore game input in visionOS

These sessions provide a comprehensive overview of how eye interaction is integrated into visionOS and Apple Vision Pro, enhancing user experience across different applications and contexts.