what are the new vision pro features?
Generated on 7/30/2024
1 search

This post is brought to you by Tailscan,
the best devtool for Tailwind CSS.
Here are some of the new features for Vision Pro presented at WWDC:
-
Enhanced Scene Understanding:
- Vision Pro now allows you to decide if the user's hands appear in front of or behind the content, enhancing creativity in app experiences.
- Improved scene understanding capabilities, including detecting planes in all orientations and anchoring objects on surfaces.
- Introduction of room anchors that consider the user's surroundings on a per-room basis and detect movement across rooms.
- New object tracking API to attach content to individual objects around the user, enabling new dimensions of interactivity. (Platforms State of the Union)
-
Spatial Photos:
- Spatial photos are displayed carefully to avoid disorientation. They are shown as 2D in a grid and only switch to spatial view when centered. Feathered borders blend the photo content with the scene. (Optimize for the spatial web)
-
Guest User Support:
- Vision Pro includes a guest user feature, allowing others to set up and try out the device while preserving the owner's data and privacy. (Get started with HealthKit in visionOS)
-
Screen Capture:
- New screen capture API captures all open windows but removes the background, including the passthrough video feed of the user's surroundings. This feature requires the use of a broadcast upload extension for privacy. (Introducing enterprise APIs for visionOS)
-
Enhanced Machine Learning:
- Vision Pro now has access to the Apple Neural Engine, allowing for more efficient on-device machine learning tasks. (Introducing enterprise APIs for visionOS)
-
Known Object Tracking:
- VisionOS 2.0 introduces known object tracking, allowing apps to detect and track specific reference objects within the viewing area. This feature includes configurable parameters for tuning and optimizing object tracking. (Introducing enterprise APIs for visionOS)
-
Device Management:
- Vision Pro supports device management similar to iPhone and iPad, using familiar device management infrastructure. (What’s new in device management)
These features collectively enhance the capabilities of Vision Pro, making it a more powerful tool for both developers and users.

Get started with HealthKit in visionOS
Discover how to use HealthKit to create experiences that take full advantage of the spatial canvas. Learn the capabilities of HealthKit on the platform, find out how to bring an existing iPadOS app to visionOS, and explore the special considerations governing HealthKit during a Guest User session. You’ll also learn ways to use SwiftUI, Swift Charts, and Swift concurrency to craft innovative experiences with HealthKit.

Optimize for the spatial web
Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.

Introducing enterprise APIs for visionOS
Find out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.

Platforms State of the Union
Discover the newest advancements on Apple platforms.

What’s new in device management
Learn about the latest management capabilities for iOS, iPadOS, macOS, and visionOS, then discover the latest changes to Apple Business Manager and Apple School Manager. We’ll also share updates to Activation Lock, SoftwareUpdate, and Safari management.