Is there anything new in avfoundation

Asked on 08/02/2024

1 search

Yes, there are several new features and enhancements in AVFoundation presented at WWDC 2024:

  1. Spatial Media Integration:

    • AVFoundation now supports recording spatial videos using the new APIs. This is enabled by the new camera setup on the iPhone 15 Pro, which places the wide and ultra-wide cameras side by side, allowing for spatial video recording. You can add spatial media to your apps with just a few lines of code, similar to how you would handle other types of media (Build compelling spatial photo and video experiences).
  2. Multiview Video Playback:

    • AVFoundation now supports multiview video playback in visionOS. This allows users to watch multiple video streams simultaneously, enhancing the viewing experience with features like spatial audio and 3D video (Explore multiview video playback in visionOS).
  3. Media Performance Metrics:

    • A new way to gather media performance metrics has been introduced in iOS 18. These metrics are represented as events, which can help in triaging issues like playback taking too long to start or stalling. This enhancement provides deeper insights into the workings of AVFoundation APIs (Discover media performance metrics in AVFoundation).

Relevant Sessions

  1. Build compelling spatial photo and video experiences
  2. Explore multiview video playback in visionOS
  3. Discover media performance metrics in AVFoundation