What’s the top new dev APIs available on visionos

Generated on 8/1/2024

1 search

The top new developer APIs available on visionOS include:

  1. Enhanced Sensor Access: This includes access to the main camera, improved capture and streaming, and enhanced functionality through the camera. These APIs are intended for enterprise use and are available for proprietary in-house apps or those custom-made for other businesses (Introducing enterprise APIs for visionOS).

  2. Platform Control: This category includes advanced machine learning capabilities via the Apple Neural Engine, enhanced object tracking capabilities, and the ability to tune the performance of your app for intensive workloads (Introducing enterprise APIs for visionOS).

  3. Scene Understanding Capabilities: VisionOS has significantly extended the fidelity of its scene understanding capabilities. This includes detecting planes in all orientations, room anchors that consider the user's surroundings on a per-room basis, and a new object tracking API that allows you to attach content to individual objects found around the user (Platforms State of the Union).

  4. Hand Pose Detection and Body Pose Requests: The Vision framework introduces hand pose detection and body pose requests, which can be integrated into your apps using a new Swift API with Swift 6 support (Explore machine learning on Apple platforms).

These APIs and frameworks provide powerful tools for creating rich and interactive spatial computing experiences on visionOS.