Whats foundation model

Asked on 06/12/2025

1 search

The Foundation Models framework, introduced by Apple, provides access to an on-device large language model through a Swift API. This framework is available on macOS, iOS, iPadOS, and VisionOS, and is designed to enhance app features by providing capabilities such as content generation, text summarization, and user input analysis. The model operates entirely on-device, ensuring user data privacy and allowing offline functionality. It is optimized for performance and efficiency, using techniques like quantization and speculative decoding. The framework also supports structured data output, tool calling, and stateful sessions, making it versatile for various applications, from personalized search suggestions to generating game dialogue. For more details, you can refer to the session Meet the Foundation Models framework.