what's new for Vision Pro?

What's New for Vision Pro?

Apple has introduced several exciting updates and features for Vision Pro at WWDC 2024. Here are the key highlights:

1. Scene Understanding and Object Tracking:

   • Enhanced Scene Understanding: Vision Pro can now detect planes in all orientations, allowing for more versatile anchoring of objects on surfaces. Room anchors have been introduced to consider the user's surroundings on a per-room basis, and user movement across rooms can be detected.
   • Object Tracking API: A new API allows developers to attach content to individual objects found around the user, enabling new dimensions of interactivity. For example, virtual instructions can be attached to physical objects (Platforms State of the Union).

2. Hand Interaction:

   • Developers can now decide if they want the user's hands to appear in front of or behind the content, providing more creative control over app experiences (Platforms State of the Union).

3. Enterprise APIs:

   • Enhanced Sensor Access: Vision Pro now supports enhanced sensor access, including the Apple Neural Engine for on-device machine learning tasks, which enhances Core ML capabilities (Introducing enterprise APIs for visionOS).
   • Platform Control: New APIs allow for better control over compute power, thermal usage, and battery life, enabling developers to optimize performance for specific use cases (Introducing enterprise APIs for visionOS).
   • Known Object Tracking: VisionOS 2.0 introduces known object tracking with configurable parameters, allowing for tuning and optimizing object tracking to best suit enterprise use cases (Introducing enterprise APIs for visionOS).

4. Device Management:

   • Vision Pro now supports device and user enrollment through VisionOS 1.1, making it easier for IT teams to manage Vision Pro devices using familiar device management infrastructure (What’s new in device management).

5. HealthKit Integration:

   • Vision Pro supports immersive health experiences, such as reflecting on calendar events in an immersive space, and includes features like Guest User support to allow others to try out the device while preserving the owner's data and privacy (Get started with HealthKit in visionOS).

6. Spatial Web Optimization:

   • Vision Pro offers tools for inspecting and debugging web content, including support for WebXR, making it easier to develop and optimize web experiences for spatial computing (Optimize for the spatial web).

Relevant Sessions

• Platforms State of the Union
• Introducing enterprise APIs for visionOS
• What’s new in device management
• Get started with HealthKit in visionOS
• Optimize for the spatial web

These updates and features highlight Apple's commitment to enhancing the Vision Pro platform, making it more versatile and powerful for both developers and users.