What‘s new on immersive video?
Generated on 7/31/2024
1 search
Apple introduced several new features and enhancements for immersive video at WWDC 2024. Here are the key updates:
-
Apple Immersive Video:
- High-End Professional Content: Apple immersive video now supports 180-degree 8K resolution with spatial audio in VisionOS 2.0. This format is designed for high-fidelity professional storytelling, allowing viewers to be fully immersed in the action (Build compelling spatial photo and video experiences).
- Preview Presentation: Similar to spatial videos, Apple immersive video now includes a preview presentation that renders content through a smaller floating window, enabling users to watch videos in stereo while interacting with other apps (Build compelling spatial photo and video experiences).
-
Spatial Video:
- Capture and Playback: Spatial video can be captured on devices like Vision Pro and iPhone 15 Pro. It renders through a window with a faint glow around the edges and custom playback controls, enhancing the sense of depth and reducing discomfort (Build compelling spatial photo and video experiences).
- Immersive Presentation: Spatial video can expand into an immersive presentation where the content scales to match the real size of objects, making the edges of the frame disappear and blending the content seamlessly into the real world (Build compelling spatial photo and video experiences).
-
3D Video:
- Docking into Environment: 3D video can dock into an environment where the screen moves backward and enlarges, providing an immersive viewing experience (Build compelling spatial photo and video experiences).
-
APIs and Frameworks:
- Integration with Existing Frameworks: Spatial media capabilities have been integrated into existing Apple frameworks like AV Foundation, Photokit, Quicklook, and Webkit. This allows developers to add spatial media to their apps with minimal code changes (Build compelling spatial photo and video experiences).
-
Immersive Space Scene Type:
- Customizable Immersion: The immersive space scene type in AVKit allows users to set the desired amount of immersion using the digital crown on Apple Vision Pro, from no immersion to fully immersive (Enhance the immersion of media viewing in custom environments).
For a comprehensive overview, you can refer to the following sessions:
Optimize for the spatial web
Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.
Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.
Enhance the immersion of media viewing in custom environments
Extend your media viewing experience using Reality Composer Pro components like Docking Region, Reverb, and Virtual Environment Probe. Find out how to further enhance immersion using Reflections, Tint Surroundings Effect, SharePlay, and the Immersive Environment Picker.