What’s new this year in ARKit
Generated on 8/2/2024
1 search
This post is brought to you by Tailscan,
the best devtool for Tailwind CSS.
This year, ARKit has introduced several exciting updates to enhance spatial computing experiences on visionOS. Here are the key new features:
- Room Tracking: A new feature that allows for better customization of experiences based on the room you are in.
- Plane Detection: An update to plane detection now includes a new slanted plane alignment for detecting angled surfaces, in addition to horizontal and vertical surfaces.
- Object Tracking: ARKit can now track real-world objects that are statically placed in your environment, providing their position and orientation to anchor virtual content to them.
- World Tracking: Improvements have been made to make world tracking more robust under various lighting conditions.
- Hand Tracking: Enhanced hand tracking capabilities, including display-aligned hand anchor updates for gesture detection and drawing smooth strokes, as well as hand predictions for attaching content to hands.
For a detailed overview, you can watch the session Create enhanced spatial computing experiences with ARKit starting at 00:57.
Relevant Sessions
Create enhanced spatial computing experiences with ARKit
Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.
Compose interactive 3D content in Reality Composer Pro
Discover how the Timeline view in Reality Composer Pro can bring your 3D content to life. Learn how to create an animated story in which characters and objects interact with each other and the world around them using inverse kinematics, blend shapes, and skeletal poses. We’ll also show you how to use built-in and custom actions, sequence your actions, apply triggers, and implement natural movements.
Build a spatial drawing app with RealityKit
Harness the power of RealityKit through the process of building a spatial drawing app. As you create an eye-catching spatial experience that integrates RealityKit with ARKit and SwiftUI, you’ll explore how resources work in RealityKit and how to use features like low-level mesh and texture APIs to achieve fast updates of the users’ brush strokes.
Platforms State of the Union
Discover the newest advancements on Apple platforms.