on device
Asked on 2025-06-30
1 search
Apple's WWDC sessions have highlighted several advancements in on-device capabilities. Here are some key points:
-
Foundation Models Framework: Apple introduced a large language model with 3 billion parameters, optimized for on-device use. This model supports tasks like summarization, extraction, and classification, ensuring user data privacy as it operates without needing server-side processing. This is part of the broader Foundation Models framework, which integrates with Apple's suite of machine learning APIs for on-device intelligence. For more details, you can refer to the session Meet the Foundation Models framework.
-
SpeechAnalyzer: The new on-device model for speech-to-text, called Speech Transcriber, allows developers to integrate advanced speech recognition capabilities into their apps without increasing app size or memory usage. This model is designed to keep speech data private and is available across all platforms except watchOS. More information can be found in the session Bring advanced speech-to-text to your app with SpeechAnalyzer.
-
Power Profiling: The Power Profiler tool is available on-device, allowing developers to diagnose battery usage issues that may not be reproducible during development. This tool helps in gathering real-world data without needing a direct connection to Xcode. For more insights, see the session Profile and optimize power usage in your app.
These sessions illustrate Apple's focus on enhancing on-device processing capabilities, ensuring privacy, and providing developers with robust tools to optimize app performance.
Meet the Foundation Models framework
Learn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for responsive experiences, to tool calling for integrating data sources and sessions for context management. This session has no prerequisites.
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Profile and optimize power usage in your app
Learn how to optimize your app for maximum battery life. Discover how to identify the root cause of power issues in your app — whether you can reproduce the issue while connected to Xcode or on the go. Find out how to measure power use so you can make better decisions about new features and proactively build more efficient apps.