Can i use music from Apple musicKit for new musis understanding framework?
Asked on 2026-06-18
•@wwdc261 search
No — MusicKit is not the audio source for Music Understanding.
Music Understanding analyzes audio you provide, such as:
- an
AVAsset - a custom audio provider
So if you want to analyze a song, you need access to the audio file or stream in a form the framework can process. MusicKit is for accessing, browsing, and playing Apple Music content and media library content, not for directly feeding Apple Music catalog tracks into Music Understanding.
From the WWDC sessions:
- Meet the Music Understanding framework: says the framework works with
AVAssetor a custom audio provider. - Integrate MusicKit into your app: says MusicKit lets apps access and play Apple Music catalog and library music.
So the practical answer is:
- Use MusicKit to pick or play music.
- Use Music Understanding to analyze audio you already have access to as an asset/provider.
If you want, I can help you figure out the best workflow for analyzing music picked with MusicKit.
Meet the Music Understanding framework
Discover Music Understanding, a new framework that lets your app analyze audio across six dimensions, on device: key, rhythm, structure, pace, instrument activity, and loudness. And use the Music Understanding Lab sample app to visualize each result.
Integrate MusicKit into your app
Bring the power of Apple Music into your app using MusicKit. We’ll cover authorization, subscription-status checks, music selection, playback control, and cross-storefront song sharing. Learn how to use the new Music Picker to let people browse the Apple Music catalog and their personal libraries. We’ll also break down the differences between SystemMusicPlayer and ApplicationMusicPlayer, and show you how to observe playback state.