3d capture
Asked on 2024-07-30
1 search
Apple's WWDC 2024 introduced several updates and features related to 3D capture, particularly focusing on the new "area mode" for Object Capture. Here are the key points:
-
Area Mode for Object Capture:
- Introduction: Area mode allows for capturing uneven terrain outdoors, objects that can't be walked around, or complex surfaces. This mode is ideal for creating 3D models for use in 3D environments or artistic projects on Apple Vision Pro. (Discover area mode for Object Capture)
- Usage: To use area mode, open the sample app, select area mode, aim at your subject, and start capturing. The app provides haptic feedback, audio cues, and visual indicators to guide the capture process. (Discover area mode for Object Capture)
- Processing: After capturing, you can process the images to create a 3D model directly on your iPhone. The new macOS sample app offers more options and higher quality for processing captures. (Discover area mode for Object Capture)
-
Enhancements and Tools:
- Camera Pose Visualization: This feature helps ensure you have captured all necessary data while on location. (Discover area mode for Object Capture)
- Quad Meshing: A new output type that makes editing UVs and animating 3D objects easier. (Discover area mode for Object Capture)
- Data Loading API: Provides more flexibility for creating photogrammetry sessions and custom pipelines. (Discover area mode for Object Capture)
-
Integration with Apple Vision Pro:
- Viewing and Editing: Captured models can be edited and viewed in Reality Composer Pro and Quicklook on Apple Vision Pro. (Discover area mode for Object Capture)
For more detailed information, you can refer to the session "Discover area mode for Object Capture" which covers these topics extensively.

Bring your iOS or iPadOS game to visionOS
Discover how to transform your iOS or iPadOS game into a uniquely visionOS experience. Increase the immersion (and fun factor!) with a 3D frame or an immersive background. And invite players further into your world by adding depth to the window with stereoscopy or head tracking.

Discover area mode for Object Capture
Discover how area mode for Object Capture enables new 3D capture possibilities on iOS by extending the functionality of Object Capture to support capture and reconstruction of an area. Learn how to optimize the quality of iOS captures using the new macOS sample app for reconstruction, and find out how to view the final results with Quick Look on Apple Vision Pro, iPhone, iPad or Mac. Learn about improvements to 3D reconstruction, including a new API that allows you to create your own custom image processing pipelines.

Build compelling spatial photo and video experiences
Learn how to adopt spatial photos and videos in your apps. Explore the different types of stereoscopic media and find out how to capture spatial videos in your iOS app on iPhone 15 Pro. Discover the various ways to detect and present spatial media, including the new QuickLook Preview Application API in visionOS. And take a deep dive into the metadata and stereo concepts that make a photo or video spatial.
