What sensors data is available in Vision Pro applications?

Generated on 8/24/2024

1 search

In Vision Pro applications, sensor data is available through several new APIs introduced for visionOS. One of the key features is enhanced sensor access, which allows apps to access the device's main camera video feed. This enables applications to analyze and interpret the environment around Vision Pro, unlocking enhanced spatial capabilities. For example, this can be used for tasks like anomaly detection in a production line by using computer vision algorithms to identify and highlight parts that don't meet quality standards.

Additionally, Vision Pro supports enhanced known object tracking, which allows apps to detect and track specific reference objects within the viewing area. This feature is configurable, enabling developers to adjust parameters such as the maximum number of objects tracked, the tracking rate for static and dynamic objects, and the detection rate for new instances of known objects.

For more detailed information, you can refer to the session Introducing enterprise APIs for visionOS (02:36).