what is CoreML

Core ML is a framework provided by Apple that allows developers to deploy machine learning models on Apple devices, such as iOS, iPadOS, and macOS. It is designed to optimize the performance of AI models by automatically distributing workloads across the CPU, GPU, and neural engine, maximizing hardware utilization. Core ML simplifies the development workflow by integrating with Xcode and provides a unified API for on-device inference across various model types.

Core ML supports a wide array of models, including those developed in PyTorch, which can be converted into the Core ML format using Core ML tools. These tools offer optimization techniques like quantization and efficient key-value caching for large language models. Additionally, Core ML includes new features such as ML tensor types, multifunction models, and updated performance reports to help developers efficiently deploy and run state-of-the-art AI models on Apple devices.

For more detailed information, you can refer to the session Explore machine learning on Apple platforms (07:16) and Deploy machine learning and AI models on-device with Core ML (01:07).