how large are the llm for the iphone
Generated on 7/30/2024
1 search
This post is brought to you by Tailscan,
the best devtool for Tailwind CSS.
The large language models (LLMs) for the iPhone can be quite substantial in size. For example, in the session Bring your machine learning and AI models to Apple silicon, a model was mentioned to be 13 GB in size, which is considered quite large. However, there are techniques such as model compression and quantization that can be used to reduce the size of these models while maintaining performance.
For more details on how to optimize and run these models on Apple devices, you can refer to the session Bring your machine learning and AI models to Apple silicon.
Relevant Sessions
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Explore machine learning on Apple platforms
Get started with an overview of machine learning frameworks on Apple platforms. Whether you’re implementing your first ML model, or an ML expert, we’ll offer guidance to help you select the right framework for your app’s needs.
Explore object tracking for visionOS
Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.
Bring your machine learning and AI models to Apple silicon
Learn how to optimize your machine learning and AI models to leverage the power of Apple silicon. Review model conversion workflows to prepare your models for on-device deployment. Understand model compression techniques that are compatible with Apple silicon, and at what stages in your model deployment workflow you can apply them. We’ll also explore the tradeoffs between storage size, latency, power usage and accuracy.