How do I add eye tracking

Generated on 8/18/2024

1 search

To add eye tracking in your application, you can utilize the capabilities introduced with visionOS. VisionOS allows for natural input using eye tracking to target interaction regions in an app or webpage. When a user looks at an interaction region, it is highlighted, and they can interact by tapping their fingers together. This feature is part of the spatial web optimization, as discussed in the session Optimize for the spatial web.

For more detailed implementation, you might want to explore the session on building immersive web experiences with WebXR, which discusses how to handle input sources and interaction using eye tracking and hand tracking. This session is titled Build immersive web experiences with WebXR.

If you are interested in object tracking and anchoring virtual content to real-world objects, the session Explore object tracking for visionOS provides insights into creating reference objects and anchoring virtual content.

Optimize for the spatial web

Optimize for the spatial web

Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.

Discover RealityKit APIs for iOS, macOS and visionOS

Discover RealityKit APIs for iOS, macOS and visionOS

Learn how new cross-platform APIs in RealityKit can help you build immersive apps for iOS, macOS, and visionOS. Check out the new hover effects, lights and shadows, and portal crossing features, and view them in action through real examples.

Explore object tracking for visionOS

Explore object tracking for visionOS

Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.

Build immersive web experiences with WebXR

Build immersive web experiences with WebXR

Discover how WebXR empowers you to add fully immersive experiences to your website in visionOS. Find out how to build WebXR experiences that take full advantage of the input capabilities of visionOS, and learn how you can use Simulator to test WebXR experiences on macOS.

Platforms State of the Union

Platforms State of the Union

Discover the newest advancements on Apple platforms.

Create enhanced spatial computing experiences with ARKit

Create enhanced spatial computing experiences with ARKit

Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.