What’s new in AVFoundation?

Recording Spatial Video: AVFoundation now supports recording spatial video, leveraging the new camera setup on the iPhone 15 Pro. This setup places the wide and ultra-wide cameras side by side, enabling spatial video recording. The API for this is now public, allowing any app to record spatial video.
Detecting and Loading Spatial Media: New APIs allow for detecting if a file is spatial and loading it. This is integrated into existing frameworks like AVFoundation, Photokit, Quicklook, and Webkit.
Presenting Spatial Media: There are various options for presenting spatial media, including using the preview application API in the Quicklook framework.

Multiview Architecture: AVFoundation now supports multiview video playback in visionOS, allowing simultaneous video watching with features like spatial audio and 3D video. This is integrated with RealityKit for high-quality rendering.
AVKit Enhancements: AVKit leverages AVFoundation and RealityKit to create a customizable and intuitive playback experience across platforms.

For more details, you can refer to the session Explore multiview video playback in visionOS.

New Metrics System: In iOS 18, AVFoundation introduces a new way to gather media performance metrics represented as events. This helps in triaging issues like media playback taking too long to start or stalling.
Client-Side Metrics: These metrics provide insights into the workings of AVFoundation APIs, making it easier to understand and improve performance.

These sessions provide a comprehensive overview of the new features and improvements in AVFoundation.