AVKit

AVKit at WWDC

AVKit was prominently featured in several sessions at WWDC 2024, showcasing its capabilities and enhancements for media playback, particularly in visionOS. Here are some key highlights:

1. Explore Multiview Video Playback in visionOS

   • Introduction: AVKit, and specifically AVPlayerViewController, offers a familiar user interface and integrates with many system features to enhance video viewing capabilities on visionOS. One of the unique capabilities introduced is Multiview, which allows simultaneous viewing of multiple video screens.
   • Introducing Multiview: Multiview is a system-integrated viewing experience that is customizable to the application. It allows users to watch multiple streams, such as different camera angles or multiple sports games, simultaneously.
   • Design a Multiview Experience: This section discusses how to design a multiview experience, including the use of a content browser to select different video streams and the visual effects that enhance the viewing experience.

   Explore Multiview Video Playback in visionOS (00:01:55)

2. Build Compelling Spatial Photo and Video Experiences

   • Tour of the New APIs: This session covers how to add spatial media to apps using AVKit, including support for both 2D and 3D video. It also discusses the use of AVPlayerViewController for consistent presentation of video content.
   • Deep Dive into Spatial Media Formats: This section provides a detailed look at spatial media formats and how to record, detect, load, and present spatial media using AVKit and other related frameworks.

   Build Compelling Spatial Photo and Video Experiences (00:04:13)

3. Enhance the Immersion of Media Viewing in Custom Environments

   • SharePlay: AVKit now supports synchronization of the environment state in SharePlay, allowing for a shared immersive watching experience. This includes synchronizing media playback and the viewing environment across devices.

   Enhance the Immersion of Media Viewing in Custom Environments (00:15:33)

Sessions Mentioned

1. Explore Multiview Video Playback in visionOS
2. Build Compelling Spatial Photo and Video Experiences
3. Enhance the Immersion of Media Viewing in Custom Environments

These sessions provide a comprehensive overview of the new features and capabilities of AVKit, particularly in the context of visionOS and spatial media.