what changes have been make to vision kit?

Asked on 08/02/2024

1 search

Changes to Vision Kit

Several updates and enhancements have been made to Vision Kit, particularly in the context of Vision Pro and visionOS. Here are the key changes:

  1. Scene Understanding Capabilities:

    • Planes Detection: Planes can now be detected in all orientations, allowing for anchoring objects on various surfaces in your surroundings.
    • Room Anchors: The concept of room anchors has been introduced, which considers the user's surroundings on a per-room basis. This includes the ability to detect a user's movement across rooms.
    • Object Tracking API: A new object tracking API for visionOS allows you to attach content to individual objects found around the user, enabling new dimensions of interactivity. For example, you can attach virtual content like instructions to a physical object (Platforms State of the Union).
  2. Known Object Tracking:

    • Enhanced Known Object Tracking: This feature allows apps to have specific reference objects built into their project that they can then detect and track within their viewing area. For enterprise customers, this feature includes configurable parameters to tune and optimize object tracking, such as changing the maximum number of objects tracked at once and modifying the detection rate for identifying new instances of known objects (Introducing enterprise APIs for visionOS).
  3. Spatial Barcode Scanning:

    • Enterprise APIs: New enterprise APIs provide access to spatial barcode scanning, which can be used in specific workflow use cases to take advantage of spatial computing (Platforms State of the Union).
  4. Swift Enhancements:

    • New Vision API: The Vision framework has been updated to use async/await syntax, eliminating the need for completion handlers. Observations produced by requests are now returned directly from the perform call (Discover Swift enhancements in the Vision framework).

Relevant Sessions

These updates collectively enhance the capabilities of Vision Kit, making it more powerful and flexible for developers working on spatial computing applications.