What new features are the in the Visionos 2 SDK?

Asked on 07/31/2024

1 search

The VisionOS 2 SDK introduces several new features to enhance the development of spatial computing applications. Here are some of the key updates:

  1. Hand Positioning: Developers can now decide if the user's hands appear in front of or behind the content, offering more creative control over the app experience.
  2. Enhanced Scene Understanding: The fidelity of scene understanding capabilities has been significantly extended. Planes can now be detected in all orientations, allowing for anchoring objects on various surfaces. Additionally, room anchors can consider the user's surroundings on a per-room basis, and user movement across rooms can be detected.
  3. Object Tracking API: A new object tracking API allows developers to attach content to individual objects found around the user. This enables attaching virtual content, like instructions, to physical objects for new dimensions of interactivity.
  4. Known Object Tracking: Enhanced known object tracking through parameter adjustment allows apps to detect and track specific reference objects within their viewing area. This feature includes configurable parameters to optimize object tracking for different use cases, such as changing the maximum number of objects tracked and adjusting the tracking rate for static and dynamic objects.

For more details, you can refer to the Platforms State of the Union session.

Relevant Sessions

  1. Platforms State of the Union
  2. Introducing enterprise APIs for visionOS
  3. Create enhanced spatial computing experiences with ARKit