whats new in Vision?

Generated on 8/9/2024

1 search

At WWDC 2024, Apple introduced several new features and enhancements for Vision and Vision Pro. Here are the key updates:

  1. Vision Pro Enhancements:

    • Hand Positioning: Developers can now decide if the user's hands appear in front of or behind the content, enhancing creative possibilities.
    • Scene Understanding: Improved fidelity in scene understanding capabilities, including detection of planes in all orientations and room anchors that consider the user's surroundings on a per-room basis.
    • Object Tracking API: A new API allows attaching content to individual objects around the user, enabling new dimensions of interactivity.
    • Room Movement Detection: Ability to detect user movement across rooms.
    • Samples and Documentation: More resources provided to help developers get started with spatial computing on VisionOS.

    For more details, you can watch the Platforms State of the Union.

  2. Vision Framework Enhancements:

    • New API: A streamlined syntax designed for Swift, making it easier to bring computer vision into apps.
    • Swift Concurrency: Full support for Swift concurrency and Swift 6, enabling more performant apps.
    • New Capabilities: Introduction of new capabilities in Vision, such as enhanced known object tracking with configurable parameters for enterprise use.

    For more details, you can watch the Discover Swift enhancements in the Vision framework.

  3. HealthKit in VisionOS:

    • Immersive Spaces: Users can enter immersive spaces to reflect on their activities, with the surrounding pass-through dimming to provide a sense of separation from the workspace.
    • Guest User Feature: Allows others to set up and try out Apple Vision Pro while preserving the owner's data and privacy.

    For more details, you can watch the Get started with HealthKit in visionOS.

These updates highlight Apple's commitment to enhancing the capabilities of Vision and Vision Pro, making it easier for developers to create innovative and immersive experiences.

Get started with HealthKit in visionOS

Get started with HealthKit in visionOS

Discover how to use HealthKit to create experiences that take full advantage of the spatial canvas. Learn the capabilities of HealthKit on the platform, find out how to bring an existing iPadOS app to visionOS, and explore the special considerations governing HealthKit during a Guest User session. You’ll also learn ways to use SwiftUI, Swift Charts, and Swift concurrency to craft innovative experiences with HealthKit.

Platforms State of the Union 5-Minute Recap

Platforms State of the Union 5-Minute Recap

Watch a quick recap of the newest advancements on Apple platforms.

Discover Swift enhancements in the Vision framework

Discover Swift enhancements in the Vision framework

The Vision Framework API has been redesigned to leverage modern Swift features like concurrency, making it easier and faster to integrate a wide array of Vision algorithms into your app. We’ll tour the updated API and share sample code, along with best practices, to help you get the benefits of this framework with less coding effort. We’ll also demonstrate two new features: image aesthetics and holistic body pose.

Design great visionOS apps

Design great visionOS apps

Find out how to create compelling spatial computing apps by embracing immersion, designing for eyes and hands, and taking advantage of depth, scale, and space. We’ll share several examples of great visionOS apps and explore how their designers approached creating new experiences for the platform.

Introducing enterprise APIs for visionOS

Introducing enterprise APIs for visionOS

Find out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.

What’s new in device management

What’s new in device management

Learn about the latest management capabilities for iOS, iPadOS, macOS, and visionOS, then discover the latest changes to Apple Business Manager and Apple School Manager. We’ll also share updates to Activation Lock, SoftwareUpdate, and Safari management.

Platforms State of the Union

Platforms State of the Union

Discover the newest advancements on Apple platforms.