Tell me what I can do with private cloud compute foundation models

The Foundation Models framework introduced by Apple at WWDC allows you to leverage on-device large language models for various applications while maintaining user privacy. With this framework, you can enhance your apps by integrating features such as personalized search suggestions, generating itineraries in travel apps, or creating dynamic dialogues for game characters. All of these capabilities run on-device, ensuring that data remains private and the app can function offline.

One of the key features of the Foundation Models framework is tool calling, which allows the model to autonomously execute code you define in your app. This is particularly useful for integrating personal data like contacts and calendar events without needing to upload data to a server, thus preserving privacy. The framework also supports guided generation, enabling you to get structured output in Swift, and it provides APIs for streaming responses and stateful sessions.

For more detailed information, you can explore sessions like Meet the Foundation Models framework and Deep dive into the Foundation Models framework.