how large are the llm for the iphone
Asked on 07/30/2024
1 search
The large language models (LLMs) for the iPhone can be quite substantial in size. For example, in the session Bring your machine learning and AI models to Apple silicon, a model was mentioned to be 13 GB in size, which is considered quite large. However, there are techniques such as model compression and quantization that can be used to reduce the size of these models while maintaining performance.
For more details on how to optimize and run these models on Apple devices, you can refer to the session Bring your machine learning and AI models to Apple silicon.
Relevant Sessions
Platforms State of the Union
Discover the newest advancements on Apple platforms.
Explore machine learning on Apple platforms
Get started with an overview of machine learning frameworks on Apple platforms. Whether you’re implementing your first ML model, or an ML expert, we’ll offer guidance to help you select the right framework for your app’s needs.
Explore object tracking for visionOS
Find out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out how to create a reference object using machine learning in Create ML and attach content relative to your target object in Reality Composer Pro, RealityKit or ARKit APIs.