What is new in AI?

What's New in AI at WWDC 2024

Apple has introduced several exciting advancements in AI and machine learning at WWDC 2024. Here are the key highlights:

1. Apple Intelligence:

   • Generative AI Models: Apple Intelligence is a new personal intelligence system that brings powerful generative models to iOS, iPadOS, and macOS. These models are capable of understanding and generating language and images, helping users take actions with rich awareness of personal context. This system is deeply integrated into features and apps across the system and is built with privacy from the ground up. Platforms State of the Union
   • On-Device AI: Apple Intelligence leverages on-device AI to deliver low latency and a better user experience while keeping personal data private. The foundation model is a highly capable large language model optimized to run locally on devices. Platforms State of the Union

2. Machine Learning Frameworks:

   • New Swift API for Vision Framework: The vision framework is getting a new Swift API, allowing developers to tap into advanced vision capabilities. Developers can also use Create ML to augment image models with unique datasets for improved classification and object detection. Platforms State of the Union
   • Training Models on Mac: For those experimenting with the latest advancements, including training models, the Mac provides an excellent environment with hardware acceleration and unified memory. Apple continues to push the boundaries of machine learning research and shares many tools as open source. Platforms State of the Union

3. Siri Enhancements:

   • Natural Language Processing: Siri has been improved with new large language models, making it more natural and contextually relevant. Siri can now understand and act on what users are looking at on their screens and handle more natural speech, even if users stumble over their words. Bring your app to Siri

4. ML-Powered APIs:

   • Writing Tools: New writing tools help users communicate more effectively by rewriting text for tone and clarity, proofreading for mistakes, and summarizing key points. These tools are powered by Apple Intelligence's new language capabilities. Explore machine learning on Apple platforms
   • Image Playground: This feature allows developers to integrate image creation features into their apps without needing to train models themselves. Explore machine learning on Apple platforms

Relevant Sessions

• Platforms State of the Union
• Bring your app to Siri
• Explore machine learning on Apple platforms

These sessions provide a comprehensive overview of the new AI and machine learning capabilities introduced at WWDC 2024.