Whats is ARKit?

Generated on 10/3/2024

1 search

ARKit is a framework developed by Apple that provides a suite of real-time algorithms to power spatial computing experiences on devices like iPhone, iPad, and now Vision Pro. It is designed to help developers create immersive augmented reality (AR) applications by offering capabilities such as tracking, scene understanding, and hand gesture recognition. ARKit allows apps to understand and interact with the physical environment by using features like room tracking, plane detection, and object tracking. These features enable developers to create interactive and engaging AR experiences by anchoring virtual content to real-world objects and spaces.

For more detailed information on ARKit's capabilities and updates, you can refer to the session Create enhanced spatial computing experiences with ARKit.

Create enhanced spatial computing experiences with ARKit

Create enhanced spatial computing experiences with ARKit

Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.

Platforms State of the Union

Platforms State of the Union

Discover the newest advancements on Apple platforms.

Render Metal with passthrough in visionOS

Render Metal with passthrough in visionOS

Get ready to extend your Metal experiences for visionOS. Learn best practices for integrating your rendered content with people’s physical environments with passthrough. Find out how to position rendered content to match the physical world, reduce latency with trackable anchor prediction, and more.

Explore object tracking for visionOS

Explore object tracking for visionOS

Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.

What’s new in USD and MaterialX

What’s new in USD and MaterialX

Explore updates to Universal Scene Description and MaterialX support on Apple platforms. Discover how these technologies provide a foundation for 3D content creation and delivery, and learn how they can help streamline your workflows for creating great spatial experiences. Learn about USD and MaterialX support in RealityKit and Storm, advancements in our system-provided tooling, and more.

Build a spatial drawing app with RealityKit

Build a spatial drawing app with RealityKit

Harness the power of RealityKit through the process of building a spatial drawing app. As you create an eye-catching spatial experience that integrates RealityKit with ARKit and SwiftUI, you’ll explore how resources work in RealityKit and how to use features like low-level mesh and texture APIs to achieve fast updates of the users’ brush strokes.