What are Foundation Models?

Foundation Models are a new framework introduced by Apple that provides access to an on-device large language model through a convenient Swift API. This framework is available on macOS, iOS, iPadOS, and VisionOS. It allows developers to enhance existing app features or create new ones by leveraging the capabilities of the language model, such as generating content, summarizing text, and analyzing user input. The framework is designed to run entirely on-device, ensuring that all data remains private and can operate offline without increasing app size. It is optimized for performance and efficiency using state-of-the-art techniques like quantization and speculative decoding. The Foundation Models framework also includes features like stateful sessions, guided generation, and tool calling, which allow for structured output and integration with custom app functions.