What is new on VisionKit?

What's New in VisionKit

At WWDC 2024, several updates and enhancements were introduced for VisionKit and related frameworks. Here are the key highlights:

1. Vision Pro Enhancements:

   • Hand Positioning: You can now decide if you want the user's hands to appear in front of or behind the content, providing more creative control in app experiences.
   • Scene Understanding: Improved fidelity in scene understanding capabilities, including detection of planes in all orientations and room anchors that consider the user's surroundings on a per-room basis.
   • Object Tracking API: A new API allows you to attach content to individual objects found around the user, enabling new dimensions of interactivity (Platforms State of the Union).

2. Vision Framework Enhancements:

   • New Swift API: A new API with streamlined syntax designed for Swift, making it easier to bring computer vision into your apps.
   • Swift Concurrency: Full support for Swift concurrency and Swift 6, enabling the creation of more performant apps.
   • New Capabilities: Introduction of new capabilities such as hand pose detection, body pose requests, and aesthetic score requests (Discover Swift enhancements in the Vision framework).

3. ARKit Updates:

   • Room Tracking: New room tracking features to customize experiences based on the room.
   • Plane Detection: Updates to plane detection to enhance scene understanding.
   • Object Tracking: Enhanced object tracking capabilities to further creativity (Create enhanced spatial computing experiences with ARKit).

These updates collectively enhance the capabilities of VisionKit and related frameworks, making it easier for developers to create immersive and interactive experiences on Apple devices.