what is the new observation tracking framework called?
Asked on 2024-07-30
1 search
The new observation tracking framework is called "intelligent subject tracking." It is introduced in iOS 18 and uses advanced algorithms and machine learning to analyze a scene in real time, identifying main subjects and determining the most relevant person to track based on various factors like movement, speech, and proximity to the camera.
For more details, you can refer to the session What’s new in DockKit.
Explore object tracking for visionOS
Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.
Create enhanced spatial computing experiences with ARKit
Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.
What’s new in Create ML
Explore updates to Create ML, including interactive data source previews and a new template for building object tracking models for visionOS apps. We’ll also cover important framework improvements, including new time-series forecasting and classification APIs.