what's new in stereoscopic video

What's New in Stereoscopic Video

Apple introduced several new features and enhancements for stereoscopic video at WWDC 2024, particularly focusing on the Vision Pro and iPhone 15 Pro. Here are the key updates:

1. Types of Stereoscopic Experiences:

   • 3D Video: Similar to 3D movies available in apps like Apple TV and Disney, these videos render on a flat screen but have depth, making moments appear to pop out or recede.
   • Spatial Video: Capturable on Vision Pro and iPhone 15 Pro, these videos render through a window with a faint glow around the edges and custom playback controls, enhancing the sense of depth and reducing discomfort.
   • Apple Immersive Video: High-end professional content shot in 180-degree 8K resolution with spatial audio. It now includes a preview presentation that allows interaction with other apps while watching in stereo.

2. Enhanced Viewing Modes:

   • Windowed Presentation: Allows multitasking with other apps in the shared space.
   • Full Immersion: Backgrounds other apps and focuses on the content, with different flavors for each type of video. For example, 3D video docks into an environment where the screen moves backward and enlarges.

3. APIs and Frameworks:

   • Recording Spatial Videos: New APIs integrated into existing frameworks like AV Foundation, Photokit, Quicklook, and Webkit. This allows developers to add spatial media to their apps with minimal code changes.
   • Device Support: Spatial video capture is supported on iPhone 15 Pro, leveraging the side-by-side placement of the wide and ultra-wide cameras for better horizontal baseline alignment.

4. Professional Content Creation:

   • Apple Immersive Video: Expands into its native experience, wrapping around the viewer and disabling passthrough for full immersion, ideal for professional storytelling.

5. Technical Enhancements:

   • Improved Video Stabilization: Using cinematic extended enhanced mode for smoother videos.
   • Horizontal Disparity Adjustment: Fine-tuning the disparity to enhance the perception of depth.

For more detailed information, you can refer to the session Build compelling spatial photo and video experiences starting at the "Types of stereoscopic experiences" chapter.

Relevant Sessions

1. Build compelling spatial photo and video experiences
2. Bring your iOS or iPadOS game to visionOS