Is there anything new in avfoundation
Generated on 8/2/2024
1 search
Yes, there are several new features and enhancements in AVFoundation presented at WWDC 2024:
-
Spatial Media Integration:
- AVFoundation now supports recording spatial videos using the new APIs. This is enabled by the new camera setup on the iPhone 15 Pro, which places the wide and ultra-wide cameras side by side, allowing for spatial video recording. You can add spatial media to your apps with just a few lines of code, similar to how you would handle other types of media (Build compelling spatial photo and video experiences).
-
Multiview Video Playback:
- AVFoundation now supports multiview video playback in visionOS. This allows users to watch multiple video streams simultaneously, enhancing the viewing experience with features like spatial audio and 3D video (Explore multiview video playback in visionOS).
-
Media Performance Metrics:
- A new way to gather media performance metrics has been introduced in iOS 18. These metrics are represented as events, which can help in triaging issues like playback taking too long to start or stalling. This enhancement provides deeper insights into the workings of AVFoundation APIs (Discover media performance metrics in AVFoundation).
Relevant Sessions
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Discover Swift enhancements in the Vision framework
The Vision Framework API has been redesigned to leverage modern Swift features like concurrency, making it easier and faster to integrate a wide array of Vision algorithms into your app. We’ll tour the updated API and share sample code, along with best practices, to help you get the benefits of this framework with less coding effort. We’ll also demonstrate two new features: image aesthetics and holistic body pose.
Explore multiview video playback in visionOS
Learn how AVExperienceController can enable playback of multiple videos on Apple Vision Pro. Review best practices for adoption and explore great use cases, like viewing a sports broadcast from different angles or watching multiple games simultaneously. And discover how to design a compelling and intuitive multiview experience in your app.
Discover media performance metrics in AVFoundation
Discover how you can monitor, analyze, and improve user experience with the new media performance APIs. Explore how to monitor AVPlayer performance for HLS assets using different AVMetricEvents, and learn how to use these metrics to understand and triage player performance issues.
Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.