Apple has officially confirmed that its generative AI platform, Apple Intelligence, will be coming to the Vision Pro headset with the release of visionOS 2.4. The first beta version of the software has been made available to developers, with a public release planned for April.
Apple Intelligence updates to Vision Pro will be rolled out gradually, as they have been for iPhone and Mac. The first wave will include text and image tools, including Rewrite, Proofread, and Summarize, which will run natively on the device. This will improve the text experience, which is currently difficult due to the way the user types.
At the moment, typing in a headset is still a real challenge, as the standard method requires focusing your eyes on a letter and then swiping with two fingers to select it. Voice input and the updated Siri solve this problem partly, but not completely.
Image Source: Apple
Apple hopes that the combination of voice input and generative text tools will improve the user experience on the headset. AI features like Message Summary and Smart Reply to emails will help users interact with apps more quickly, without taking their focus away from the task at hand.
Another important innovation will be Image Playground, a voice-based image generation tool that will be integrated into the Photos app on visionOS. However, Vision Pro will not receive exclusive Apple Intelligence features in this update — all the innovations have already appeared on iOS, macOS, and iPadOS.
Interestingly, along with the headset’s operating system update, Apple will also release the Vision Pro app for iPhone, which will allow you to preview content before transferring it to the headset, as well as manage guest accounts.