What's new in visionOS 27?

What’s new in visionOS 27

Apple highlighted several major updates in visionOS 27 in the session Build next-generation experiences with visionOS 27:

• Object tracking improvements

  • High frame rate tracking for more frequent pose updates.
  • Better support for building spatial accessories.

• Spatial accessories

  • New support for accessories that can extend apps with smaller, glanceable widgets.

• Spatial Preview Framework

  • Lets you extend images, documents, and 3D content from a Mac into Apple Vision Pro.

• Foveated Streaming

  • Streams OpenXR content from a PC with native spatial content alongside screen content.

• Immersive media updates

  • New camera presentation override commands.
  • Immersive preview rendering API.
  • Wide aspect ratio portals.
  • Updates to production tools and sample code.

• Other visionOS 27 updates

  • Siri enhancements
  • A new Iceland environment
  • Spatial panoramas
  • Personal environments
  • Freeform updates

• Spatial web improvements

  • Wider Safari window aspect ratios.
  • Large windows curve naturally to keep content comfortable to view.
  • Web environments are enabled by default, so websites can have backgrounds like apps.

• Capture and Control Center

  • Improved Control Center for notifications, system status, controls, and environments.
  • High-quality capture for recording apps in 4K video directly on Vision Pro, without needing a Mac.

If you want, I can also break this down by chapter, like Object tracking and spatial accessories or Other visionOS 27 updates.