what was something special and brand new

Generated on 9/8/2024

1 search

At WWDC 2024, Apple introduced several special and brand new features across various sessions. Here are some highlights:

  1. RealityKit Enhancements: RealityKit has been significantly updated with new capabilities, including low-level mesh and texture access, an advanced animation system, and features like pixel cast and subdivision surfaces. These updates allow for more detailed and interactive 3D content creation across iOS, macOS, and visionOS. Discover RealityKit APIs for iOS, macOS and visionOS.

  2. Reality Composer Pro: This tool now supports video docking, deployment to iOS and macOS, and environment authoring for visionOS. It also includes new features like full-body inverse kinematics and blend shape animation, enhancing the creation of interactive 3D content. Compose interactive 3D content in Reality Composer Pro.

  3. Spatial Computing with ARKit: New object tracking capabilities and enhanced spatial computing experiences were introduced, allowing developers to create more immersive and interactive applications. Create enhanced spatial computing experiences with ARKit.

  4. USD and MaterialX: These technologies have been improved for better compatibility and performance, providing a strong foundation for creating anything from simple spatial experiences to complex feature films. What’s new in USD and MaterialX.

These innovations reflect Apple's commitment to advancing spatial computing and providing developers with powerful tools to create immersive experiences.

Create enhanced spatial computing experiences with ARKit

Create enhanced spatial computing experiences with ARKit

Learn how to create captivating immersive experiences with ARKit’s latest features. Explore ways to use room tracking and object tracking to further engage with your surroundings. We’ll also share how your app can react to changes in your environment’s lighting on this platform. Discover improvements in hand tracking and plane detection which can make your spatial experiences more intuitive.

Discover RealityKit APIs for iOS, macOS and visionOS

Discover RealityKit APIs for iOS, macOS and visionOS

Learn how new cross-platform APIs in RealityKit can help you build immersive apps for iOS, macOS, and visionOS. Check out the new hover effects, lights and shadows, and portal crossing features, and view them in action through real examples.

What’s new in USD and MaterialX

What’s new in USD and MaterialX

Explore updates to Universal Scene Description and MaterialX support on Apple platforms. Discover how these technologies provide a foundation for 3D content creation and delivery, and learn how they can help streamline your workflows for creating great spatial experiences. Learn about USD and MaterialX support in RealityKit and Storm, advancements in our system-provided tooling, and more.

Build a spatial drawing app with RealityKit

Build a spatial drawing app with RealityKit

Harness the power of RealityKit through the process of building a spatial drawing app. As you create an eye-catching spatial experience that integrates RealityKit with ARKit and SwiftUI, you’ll explore how resources work in RealityKit and how to use features like low-level mesh and texture APIs to achieve fast updates of the users’ brush strokes.

Platforms State of the Union

Platforms State of the Union

Discover the newest advancements on Apple platforms.

Explore object tracking for visionOS

Explore object tracking for visionOS

Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.

Optimize for the spatial web

Optimize for the spatial web

Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.

Compose interactive 3D content in Reality Composer Pro

Compose interactive 3D content in Reality Composer Pro

Discover how the Timeline view in Reality Composer Pro can bring your 3D content to life. Learn how to create an animated story in which characters and objects interact with each other and the world around them using inverse kinematics, blend shapes, and skeletal poses. We’ll also show you how to use built-in and custom actions, sequence your actions, apply triggers, and implement natural movements.

Design interactive experiences for visionOS

Design interactive experiences for visionOS

Learn how you can design a compelling interactive narrative experience for Apple Vision Pro from the designers of Encounter Dinosaurs. Discover how these types of experiences differ from existing apps, media, and games, and explore how to design narratives that bring audiences into new worlds. Find out how you can create stories that adapt to any space and size, provide multiple levels of interaction to make them accessible to all, and use animation, spatial audio, and custom gestures to further immerse people in your experience.