what are the new vision pro features?

Generated on 7/30/2024

1 search

Tailscan

This post is brought to you by Tailscan, the best devtool for Tailwind CSS.

Here are some of the new features for Vision Pro presented at WWDC:

  1. Enhanced Scene Understanding:

    • Vision Pro now allows you to decide if the user's hands appear in front of or behind the content, enhancing creativity in app experiences.
    • Improved scene understanding capabilities, including detecting planes in all orientations and anchoring objects on surfaces.
    • Introduction of room anchors that consider the user's surroundings on a per-room basis and detect movement across rooms.
    • New object tracking API to attach content to individual objects around the user, enabling new dimensions of interactivity. (Platforms State of the Union)
  2. Spatial Photos:

    • Spatial photos are displayed carefully to avoid disorientation. They are shown as 2D in a grid and only switch to spatial view when centered. Feathered borders blend the photo content with the scene. (Optimize for the spatial web)
  3. Guest User Support:

  4. Screen Capture:

    • New screen capture API captures all open windows but removes the background, including the passthrough video feed of the user's surroundings. This feature requires the use of a broadcast upload extension for privacy. (Introducing enterprise APIs for visionOS)
  5. Enhanced Machine Learning:

  6. Known Object Tracking:

    • VisionOS 2.0 introduces known object tracking, allowing apps to detect and track specific reference objects within the viewing area. This feature includes configurable parameters for tuning and optimizing object tracking. (Introducing enterprise APIs for visionOS)
  7. Device Management:

These features collectively enhance the capabilities of Vision Pro, making it a more powerful tool for both developers and users.