Does the neural engine support int4 now?
Asked on 07/17/2024
1 search
Yes, the neural engine now supports int4. This was mentioned in the session Accelerate machine learning with Metal where it was stated that new this year, MP's (Metal Performance Shaders) also supports a four-bit integer format, allowing for further reduction in the size of the weights.
Introducing enterprise APIs for visionOS
Find out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.
Deploy machine learning and AI models on-device with Core ML
Learn new ways to optimize speed and memory performance when you convert and run machine learning and AI models through Core ML. We’ll cover new options for model representations, performance insights, execution, and model stitching which can be used together to create compelling and private on-device experiences.
Explore machine learning on Apple platforms
Get started with an overview of machine learning frameworks on Apple platforms. Whether you’re implementing your first ML model, or an ML expert, we’ll offer guidance to help you select the right framework for your app’s needs.