What new things can I do in Vision Pro regarding interacting with the real world?

In Vision Pro, there are several new features that enhance interaction with the real world:

1. Hand Positioning: You can now decide if you want the user's hands to appear in front of or behind the content, providing more creative control in your app experience. This allows for more immersive and interactive experiences. Platforms State of the Union

2. Enhanced Scene Understanding: The fidelity of scene understanding capabilities has been significantly extended. Planes can now be detected in all orientations, allowing for anchoring objects on various surfaces in your surroundings. Platforms State of the Union

3. Room Anchors: The concept of room anchors has been introduced, which considers the user's surroundings on a per-room basis. This means you can detect a user's movement across rooms and create more context-aware applications. Platforms State of the Union

4. Object Tracking API: A new object tracking API for visionOS allows you to attach content to individual objects found around the user. This can be used to attach virtual content like instructions to physical objects, adding new dimensions of interactivity. Platforms State of the Union

5. Main Camera Access: With a new API, apps can access the device's main camera video feed. This can be used for various purposes, such as anomaly detection in a production line or providing expert guidance remotely. Introducing enterprise APIs for visionOS

6. Spatial Barcode and QR Code Scanning: Vision Pro can now automatically detect and parse barcodes and QR codes, allowing for custom app functionality based on these detected codes. This includes receiving information about the type of code, its spatial position relative to the user, and the payload content. Introducing enterprise APIs for visionOS

These features collectively enhance the ways you can interact with the real world using Vision Pro, making it a powerful tool for creating immersive and context-aware applications.