How do I lift a subject

Asked on 2024-07-30

1 search

To lift a subject using object tracking in visionOS, you can follow the steps outlined in the session "Explore object tracking for visionOS" from WWDC 2024. Here is a summary of the process:

  1. Create a Reference Object:

    • Use the CreateML app to create a reference object. This involves configuring the training session with your USDZ assets, training your ML model locally on your Mac, and saving the reference object. This is covered in the chapter Create reference object.
  2. Anchor Virtual Content:

    • Once you have your reference object, you can anchor virtual content to your real-world items. This involves using Reality Composer Pro to set up the object anchor entity and configuring the viewing angles for optimal tracking. This is detailed in the chapter Anchor virtual content.
  3. Implement Coaching UI:

    • To help users interact with the tracked object, you can implement a coaching UI. This includes displaying a preview 3D model, adding virtual labels, and creating transition animations. This is explained in the segment starting at Explore object tracking for visionOS.

By following these steps, you can effectively lift a subject and create an immersive experience using object tracking in visionOS.