microphone controls
Generated on 8/3/2024
1 search
Microphone Controls at WWDC 2024
Sessions Mentioned:
- Capture HDR content with ScreenCaptureKit
- What’s new in SwiftUI
- Enhance your spatial computing app with RealityKit audio
- Optimize for the spatial web
Key Points:
-
ScreenCaptureKit:
- Microphone Capture: The
SCStreamconfiguration now includes properties to capture microphone audio. You can setcaptureMicrophoneto enable microphone capture and specify themicrophoneCaptureDeviceIDto choose which microphone to use. This allows your app to capture screen, system audio, and microphone audio simultaneously. - Code Example: Create a stream configuration, set the microphone properties, and start capturing. The samples can be received using the
SCStreamOutputand written to a file using the new API. - Capture HDR content with ScreenCaptureKit (07:14)
- Microphone Capture: The
-
SwiftUI:
- Microphone in Immersive Spaces: In VisionOS, you can create immersive experiences with volumes and control elements like a microphone. The microphone can be made to rotate to always face the user using the
onVolumeViewpointChangemodifier. - What’s new in SwiftUI (19:43)
- Microphone in Immersive Spaces: In VisionOS, you can create immersive experiences with volumes and control elements like a microphone. The microphone can be made to rotate to always face the user using the
-
RealityKit Audio:
- Audio Mixer: RealityKit allows you to control different categories of audio, including microphone input, using an audio mixer. You can adjust the levels of each category to create the desired audio experience.
- Enhance your spatial computing app with RealityKit audio (20:41)
-
Spatial Web:
- Voice Input: Vision Pro supports voice input for text fields and more flexible voice interactions through the Web Speech API. This includes both speech recognition and synthesis, allowing for real-time voice interaction.
- Optimize for the spatial web (08:34)
These sessions provide comprehensive insights into how microphone controls and audio management are integrated into various Apple platforms and frameworks.
Design great visionOS apps
Find out how to create compelling spatial computing apps by embracing immersion, designing for eyes and hands, and taking advantage of depth, scale, and space. We’ll share several examples of great visionOS apps and explore how their designers approached creating new experiences for the platform.
What’s new in SwiftUI
Learn how you can use SwiftUI to build great apps for any Apple platform. Explore a fresh new look and feel for tabs and documents on iPadOS. Improve your window management with new windowing APIs, and gain more control over immersive spaces and volumes in your visionOS apps. We’ll also take you through other exciting refinements that help you make expressive charts, customize and layout text, and so much more.
Capture HDR content with ScreenCaptureKit
Learn how to capture high dynamic colors using ScreenCaptureKit, and explore new features like HDR support, microphone capture, and straight-to-file recording.
Enhance your spatial computing app with RealityKit audio
Elevate your spatial computing experience using RealityKit audio. Discover how spatial audio can make your 3D immersive experiences come to life. From ambient audio, reverb, to real-time procedural audio that can add character to your 3D content, learn how RealityKit audio APIs can help make your app more engaging.
Optimize for the spatial web
Discover how to make the most of visionOS capabilities on the web. Explore recent updates like improvements to selection highlighting, and the ability to present spatial photos and panorama images in fullscreen. Learn to take advantage of existing web standards for dictation and text-to-speech with WebSpeech, spatial soundscapes with WebAudio, and immersive experiences with WebXR.