What new features are in Core Audio

Asked on 11/27/2024

1 search

The new features in Core Audio presented at WWDC 2024 include several advancements across different sessions:

  1. RealityKit Audio Enhancements: The session "Enhance your spatial computing app with RealityKit audio" introduces new audio APIs in RealityKit that enhance spatial computing experiences. These include spatial audio sources with real-time generated audio, collision sounds, reverb presets, and audio mix groups to create an immersive audio experience. The session also discusses using audio units and the audio generator controller for real-time audio processing. Enhance your spatial computing app with RealityKit audio

  2. Game Audio Frameworks: In the session "Port advanced games to Apple platforms," Apple highlights the use of the Face framework, a physical audio specialization engine, to create rich, dynamic audio experiences for games. This framework helps simulate complex audio effects like geometric sound occlusion. The session also mentions the integration of popular middleware like Audio Kinetic Wwise and FMOD for playing music and sound effects in games. Port advanced games to Apple platforms

  3. Real-time ML Inference with Audio: The session "Support real-time ML inference on the CPU" discusses using audio units with machine learning to create or modify audio and MIDI data. This includes functionalities like separating audio to isolate vocals or applying timbre transfer to change instrument sounds. Support real-time ML inference on the CPU

These features collectively enhance the capabilities of Core Audio, providing developers with more tools to create immersive and interactive audio experiences across Apple's platforms.