what's new in avfoundation
Generated on 8/8/2024
2 searches
What's New in AVFoundation
Spatial Media Integration
AVFoundation has introduced new APIs to support spatial media, allowing developers to record and play back spatial videos. This includes:
- Recording Spatial Videos: The iPhone 15 Pro's camera setup enables spatial video recording, and the API for this is now public. You can use AVFoundation to record spatial videos by configuring the AV capture device, selecting a supported video format, and enabling spatial video recording on the output. (Build compelling spatial photo and video experiences)
- Detecting and Loading Spatial Media: New methods to detect if a file is spatial and load it using AVFoundation, Photokit, and Quicklook. (Build compelling spatial photo and video experiences)
Multiview Video Playback
AVFoundation now supports multiview video playback, particularly useful for visionOS. This feature allows users to watch multiple video streams simultaneously, enhancing the viewing experience with customizable options. (Explore multiview video playback in visionOS)
Media Performance Metrics
In iOS 18, AVFoundation introduces a new way to gather media performance metrics represented as events. This helps in triaging issues like playback delays and stalling by providing client-side metrics. (Discover media performance metrics in AVFoundation)
Relevant Sessions
- Build compelling spatial photo and video experiences
- Explore multiview video playback in visionOS
- Discover media performance metrics in AVFoundation
For a deeper dive into these topics, you can refer to the specific sessions mentioned above.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.
Explore multiview video playback in visionOS
Learn how AVExperienceController can enable playback of multiple videos on Apple Vision Pro. Review best practices for adoption and explore great use cases, like viewing a sports broadcast from different angles or watching multiple games simultaneously. And discover how to design a compelling and intuitive multiview experience in your app.
Discover media performance metrics in AVFoundation
Discover how you can monitor, analyze, and improve user experience with the new media performance APIs. Explore how to monitor AVPlayer performance for HLS assets using different AVMetricEvents, and learn how to use these metrics to understand and triage player performance issues.