What’s new and exciting for ARKit?
Generated on 8/8/2024
1 search
At WWDC 2024, Apple introduced several exciting updates for ARKit, particularly for visionOS. Here are the key highlights:
- Room Tracking: A new feature that allows apps to customize experiences based on the room they are in. This can enhance the spatial understanding of the environment.
- Plane Detection: Updates to plane detection improve the ability to recognize and interact with surfaces in the real world.
- Object Tracking: A new capability that helps create interactive visualizations for real-world items. This can be particularly useful for precise placement of virtual content on physical objects.
- World Tracking: Enhancements have been made to make world tracking more robust under various lighting conditions.
- Hand Tracking: Improvements in hand tracking include display-aligned hand anchor updates for gesture detection and drawing smooth strokes, as well as hand predictions for attaching content to hands with minimal latency.
For a detailed overview, you can watch the session Create enhanced spatial computing experiences with ARKit (00:57).
Additionally, RealityKit has been updated to support these new ARKit features, making it easier to build immersive and interactive 3D content across macOS, iOS, and iPadOS. For more on RealityKit, you can check out the session Platforms State of the Union (42:32).
Relevant Sessions:
Build a spatial drawing app with RealityKit
Harness the power of RealityKit through the process of building a spatial drawing app. As you create an eye-catching spatial experience that integrates RealityKit with ARKit and SwiftUI, you’ll explore how resources work in RealityKit and how to use features like low-level mesh and texture APIs to achieve fast updates of the users’ brush strokes.
Create enhanced spatial computing experiences with ARKit
Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Compose interactive 3D content in Reality Composer Pro
Discover how the Timeline view in Reality Composer Pro can bring your 3D content to life. Learn how to create an animated story in which characters and objects interact with each other and the world around them using inverse kinematics, blend shapes, and skeletal poses. We’ll also show you how to use built-in and custom actions, sequence your actions, apply triggers, and implement natural movements.
Explore object tracking for visionOS
Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.