How do I capture passthrough video on Vision Pro
Generated on 8/2/2024
1 search
To capture passthrough video on Vision Pro, you can use the new API introduced in visionOS. Here are the steps to implement this:
-
Include Passthrough Entitlement: Add the
include passthroughentitlement file to your project. This gives you access to the combined spatial view with the passthrough camera when taking a screen capture. -
Start Broadcast: Utilize the system's start broadcast button each time you start a screen capture or share. This is necessary to protect user privacy and ensure that the user is aware of the capture.
-
Capture the View: When doing a screen capture with Vision Pro, all the windows a user has open are captured, but the background is removed. Instead of the black background, the passthrough camera's view is included, enabling the "see what I see" capability in your captures.
For more detailed information, you can refer to the session Introducing enterprise APIs for visionOS (05:40).
Relevant Sessions
- Introducing enterprise APIs for visionOS
- Build compelling spatial photo and video experiences
- Capture HDR content with ScreenCaptureKit
If you need more specific details or code examples, you might want to check out the chapters in the sessions mentioned above.
Capture HDR content with ScreenCaptureKit
Learn how to capture high dynamic colors using ScreenCaptureKit, and explore new features like HDR support, microphone capture, and straight-to-file recording.
Introducing enterprise APIs for visionOS
Find out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.
Optimize for the spatial web
Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.
Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.