Apple's Intellectual Capacities and ChatGPT's Gradual Advancement Approach Towards the Vision Pro
Ditching the longing for emoji-creating functionality in Vision Pro, Apple finally unveiled its first foray into Apple Intelligence features on the $3,500 device last Friday. Although these features might seem familiar to Mac users of late, their implementation on Vision Pro hints at a potential integration of Siri across all Apple MR headsets someday.
The recently revamped Vision Pro 2.4 beta now includes AI capabilities with UI modifications to make it easier for typing prompts without the need for a mouse or keyboard. Users can now access the limited AI prompt box, similar to Mac or iOS, and utilize writing tools for text composition or proofreading. So why use Apple's headset for composing emails is still a valid question.
Emoji enthusiasts will delight in the support for Genmojis in the Messages app. Users can now create AI-generated emojis tailored to their expressions and context, although some might struggle with the uncanny valley effect. Adding a personalized touch to communications is easier than ever with these cartoon-styled Genmojis.
Vision Pro's Photos app introduces a new "Create a Memory" feature that uses AI to select users' videos and photos that align with entered prompts. Coupled with the in-headset keyboard or voice command, the feature produces custom slideshows, blending a collection of clips with simple transitions. For example, the "day in the skatepark" prompt combined loose clips in a captivating slide show.
© GIF: Apple
Although VisionPro OS 2.4 isn't as transformative as the 2.0 transition, Apple attempts to carve a niche within its expanding ecosystem with new features. The integrated Vision Pro app for iOS enables users to do tasks like creating watchlists and installing apps remotely. The app also shares the headset's serial number and will be available on iPhones upgrading to iOS 18.4.
The update also showcases the Spatial Gallery, a new feature that gathers all users' spatial photos and videos captured by the headset or other compatible devices, such as iPhone 15 Pro and 16. The seamless guest user feature is perhaps the most valuable aspect: new users can access the headset without requiring the owner to pre-load it, making it easier to share the Vision Pro without relinquishing control.
AI in VR has been a foregone conclusion, though its arrival on Vision Pro took longer than expected. With Apple's M2 chip, Vision Pro's new AI features assure Macs with M-series silicon have the power for Apple Intelligence. The introduction of these AI features not significantly impacting Vision Pro users, yet offering useful benefits like a massive ultra-wide Mac screen or enhanced passive content streaming on the pseudo-large display with dual 4K OLED lenses.
As Apple hints at supercharged Siri on the horizon, expanding its capabilities and facilitating actions within Vision Pro apps, the potential for Visual Intelligence features, which utilize external cameras to answer questions, opens up new possibilities for users.
Lamentably, the long-awaited iPhone-to-Vision Pro mirroring, similar to the macOS Sequoia, remains absent, even as the AI features offered by Vision Pro fall short of truly revolutionary. However, the future seems promising with the potential of enabling apps to take advantage of Visual Intelligence for enhancing the user experience.
The integration of artificial-intelligence into Vision Pro's UI enables easier typing prompts, eliminating the need for a mouse or keyboard. (technology, Vision Pro)Users can now create AI-generated emojis with Genmoji, adding a personalized touch to their communications. (emojis, Genmojis)Utilizing the "Create a Memory" feature in Vision Pro's Photos app, users can create custom slideshows with entered prompts. (AI, Photos app)Apple's M2 chip in Vision Pro ensures Macs with M-series silicon have the power for Apple Intelligence features. (M2 chip, Apple Intelligence)
