what's spatial computing?

Spatial computing refers to the technology and methods used to create and interact with digital content in a three-dimensional space. It leverages frameworks like SwiftUI, RealityKit, and ARKit to develop applications that provide rich spatial experiences, taking full advantage of depth and space. This is particularly relevant for Vision Pro and visionOS, which allow for spatial multitasking and immersive interactions with 3D objects and scenes.

For example, in the Platforms State of the Union, it is mentioned that spatial computing provides incredible opportunities for apps, allowing developers to create richer spatial experiences. VisionOS is built on the foundation of macOS, iOS, and iPadOS, and uses common tools and frameworks across these platforms, making it easier for developers to create spatial computing apps.

Additionally, the session Optimize for the spatial web discusses how spatial computing in visionOS involves natural input using eyes, hands, and voice, and how it supports immersive visual and audio content, including spatial photos and 3D models.

Here is a list of relevant sessions mentioned in the context:

1. Platforms State of the Union
2. Optimize for the spatial web
3. Build compelling spatial photo and video experiences
4. Build a spatial drawing app with RealityKit