what’s new in metal

What's New in Metal

Improvements in Machine Learning

1. JAX Metal Backend:

   • Mixed Precision and Pfloat 16: The JAX Metal backend now supports the Pfloat 16 data type, which is beneficial for mixed precision training. This data type allows for a wide dynamic range of floating point values (Train your machine learning and AI models on Apple GPUs).
   • Advanced Array Indexing: Enhanced support for advanced array indexing and update operations, allowing for more efficient manipulation of arrays with a numpy-like syntax (Train your machine learning and AI models on Apple GPUs).

2. TensorFlow and PyTorch:

   • Distributed Training and Custom Operations: The Metal backend for TensorFlow and PyTorch supports distributed training, custom operations, and profiling, making it easier to benchmark and improve network performance (Train your machine learning and AI models on Apple GPUs).

3. MPS Graph:

   • Transformer Model Efficiency: Improvements to MPS and MPS Graph are focused on enhancing the efficiency of transformer models (Accelerate machine learning with Metal).

Enhancements for Gaming

1. Metal Shader Converter:

   • Ray Tracing and Mesh Shaders: The Metal Shader Converter now supports all shader stages, including ray tracing and mesh shaders, which accelerates the porting timeline for games (Port advanced games to Apple platforms).
   • Resource Layouts: Helps in porting resource layouts to Metal and includes a runtime header-only library for binding resources to pipelines (Port advanced games to Apple platforms).

2. Resource Residency:

   • Simplified Ray Tracing: Residency sets simplify adopting Metal ray tracing by allowing all ray-traced scene resources to be marked as resident as part of a set (Port advanced games to Apple platforms).

3. MetalfX:

   • Performance Improvement: MetalfX scales lower resolution images up to improve game performance significantly (Port advanced games to Apple platforms).

General Advancements

1. Unified Gaming Platform:
   • Console-Class Gaming: With the advancements in Metal and Apple silicon, Apple devices like the latest iPhone 15 Pro and M series Macs can now play console-class games, creating a unified gaming platform (Platforms State of the Union).

Relevant Sessions

1. Train your machine learning and AI models on Apple GPUs
2. Accelerate machine learning with Metal
3. Port advanced games to Apple platforms
4. Platforms State of the Union