What sensors data is available in Vision Pro applications?
Asked on 2024-08-24
1 search
In Vision Pro applications, sensor data is available through several new APIs introduced for visionOS. One of the key features is enhanced sensor access, which allows apps to access the device's main camera video feed. This enables applications to analyze and interpret the environment around Vision Pro, unlocking enhanced spatial capabilities. For example, this can be used for tasks like anomaly detection in a production line by using computer vision algorithms to identify and highlight parts that don't meet quality standards.
Additionally, Vision Pro supports enhanced known object tracking, which allows apps to detect and track specific reference objects within the viewing area. This feature is configurable, enabling developers to adjust parameters such as the maximum number of objects tracked, the tracking rate for static and dynamic objects, and the detection rate for new instances of known objects.
For more detailed information, you can refer to the session Introducing enterprise APIs for visionOS (02:36).
Design great visionOS apps
Find out how to create compelling spatial computing apps by embracing immersion, designing for eyes and hands, and taking advantage of depth, scale, and space. We’ll share several examples of great visionOS apps and explore how their designers approached creating new experiences for the platform.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Introducing enterprise APIs for visionOS
Find out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.