what's new on vision?

At WWDC 2025, Apple introduced several new features and enhancements related to vision technologies across its platforms:

1. Vision Framework Enhancements:

   • Two new APIs were added to the Vision framework. One is for document recognition, which can group different document structures, making it easier to process and understand documents. The other is a lens smudge detection mode to identify smudges on camera lenses that could affect image quality. For more details, you can check the session Discover machine learning & AI frameworks on Apple platforms.

2. VisionOS 26 Updates:

   • VisionOS 26 introduced new volumetric features, allowing developers to create more immersive 3D experiences. This includes enhancements for spatial games and media, as well as new APIs for widgets that can adjust based on user proximity.
   • The Progressive Immersion style was expanded to support new aspect ratios, ideal for high-motion games, and now includes features like Hover Effects and Dynamic Render Quality.
   • VisionOS also supports new spatial accessories, such as the Sony PlayStation VR 2 sense controller, enhancing input mechanisms for games and apps.
   • For more details on these updates, you can refer to the session What’s new in visionOS 26.

3. Shared Experiences and Spatial Web:

   • VisionOS 26 enhances shared experiences through SharePlay and introduces nearby window sharing for co-located users.
   • The concept of a spatial web is introduced, allowing for 3D objects to be embedded directly into web pages, enhancing the browsing experience with depth and dimension.

These updates reflect Apple's ongoing commitment to enhancing spatial computing and immersive experiences across its platforms.