whats new in Vision?

At WWDC 2024, Apple introduced several new features and enhancements for Vision and Vision Pro. Here are the key updates:

1. Vision Pro Enhancements:

   • Hand Positioning: Developers can now decide if the user's hands appear in front of or behind the content, enhancing creative possibilities.
   • Scene Understanding: Improved fidelity in scene understanding capabilities, including detection of planes in all orientations and room anchors that consider the user's surroundings on a per-room basis.
   • Object Tracking API: A new API allows attaching content to individual objects around the user, enabling new dimensions of interactivity.
   • Room Movement Detection: Ability to detect user movement across rooms.
   • Samples and Documentation: More resources provided to help developers get started with spatial computing on VisionOS.

   For more details, you can watch the Platforms State of the Union.

2. Vision Framework Enhancements:

   • New API: A streamlined syntax designed for Swift, making it easier to bring computer vision into apps.
   • Swift Concurrency: Full support for Swift concurrency and Swift 6, enabling more performant apps.
   • New Capabilities: Introduction of new capabilities in Vision, such as enhanced known object tracking with configurable parameters for enterprise use.

   For more details, you can watch the Discover Swift enhancements in the Vision framework.

3. HealthKit in VisionOS:

   • Immersive Spaces: Users can enter immersive spaces to reflect on their activities, with the surrounding pass-through dimming to provide a sense of separation from the workspace.
   • Guest User Feature: Allows others to set up and try out Apple Vision Pro while preserving the owner's data and privacy.

   For more details, you can watch the Get started with HealthKit in visionOS.

These updates highlight Apple's commitment to enhancing the capabilities of Vision and Vision Pro, making it easier for developers to create innovative and immersive experiences.