What is AVFoundation?
Generated on 8/2/2024
1 search
AVFoundation is a powerful framework provided by Apple that handles all the work of playing movies, including both 2D and 3D content. It interfaces with other frameworks like RealityKit to render high-quality video and spatial audio. AVFoundation is used extensively in various applications to manage media playback, recording, and performance metrics.
For example, in the session Build compelling spatial photo and video experiences, AVFoundation is used to record spatial video by leveraging the wide and ultra-wide cameras on the iPhone 15 Pro. It also integrates with other frameworks like Photokit, Quicklook, and Webkit to add spatial media to apps with just a few lines of code.
In the session Explore multiview video playback in visionOS, AVFoundation is highlighted for its role in playing movies on visionOS, including 3D content. It works with AVKit and RealityKit to create a seamless playback experience tailored to the platform.
Additionally, in the session Discover media performance metrics in AVFoundation, AVFoundation is discussed in the context of gathering media performance metrics, which helps in understanding and improving media playback performance.
Relevant Sessions
Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.
Discover media performance metrics in AVFoundation
Discover how you can monitor, analyze, and improve user experience with the new media performance APIs. Explore how to monitor AVPlayer performance for HLS assets using different AVMetricEvents, and learn how to use these metrics to understand and triage player performance issues.
Explore multiview video playback in visionOS
Learn how AVExperienceController can enable playback of multiple videos on Apple Vision Pro. Review best practices for adoption and explore great use cases, like viewing a sports broadcast from different angles or watching multiple games simultaneously. And discover how to design a compelling and intuitive multiview experience in your app.