what llms are available on ios?
Generated on 7/30/2024
1 search
This post is brought to you by Tailscan,
the best devtool for Tailwind CSS.
On iOS, you can run a variety of large language models (LLMs) that you have downloaded from open-source communities. Some of the LLMs mentioned include:
- Whisper
- Stable Diffusion
- Mistral
These models can be integrated into your app using Apple's Core ML framework, which optimizes hardware-accelerated execution across the CPU, GPU, and neural engine. You can start with any PyTorch model and convert it into the Core ML format using Core ML tools.
For more details, you can refer to the session Explore machine learning on Apple platforms.
Relevant Sessions
Bring your machine learning and AI models to Apple silicon
Learn how to optimize your machine learning and AI models to leverage the power of Apple silicon. Review model conversion workflows to prepare your models for on-device deployment. Understand model compression techniques that are compatible with Apple silicon, and at what stages in your model deployment workflow you can apply them. We’ll also explore the tradeoffs between storage size, latency, power usage and accuracy.
What’s new in Create ML
Explore updates to Create ML, including interactive data source previews and a new template for building object tracking models for visionOS apps. We’ll also cover important framework improvements, including new time-series forecasting and classification APIs.
Explore machine learning on Apple platforms
Get started with an overview of machine learning frameworks on Apple platforms. Whether you’re implementing your first ML model, or an ML expert, we’ll offer guidance to help you select the right framework for your app’s needs.
Platforms State of the Union
Discover the newest advancements on Apple platforms.