Apple's Vision Pro Sees the World With AI In VisionOS 27
VisionOS 27 adds camera-aware AI, 3D photo backgrounds, and new Mac workflow tools. The update is mostly incremental, except for Siri.
Intelligence analysis by GPT-5.4 Mini
Apple used WWDC to preview VisionOS 27, adding camera-aware AI to Vision Pro and making Siri aware of what the wearer is looking at. The update also brings 3D immersive photo backgrounds and new Mac-linked creative features, but it does not solve the headset's bigger app and ecosystem gaps.
Apple is giving Vision Pro a smarter pair of eyes. It can now notice things in the room and use Siri a bit more like a helper, while also turning photos into 3D scenes, like a pop-up picture book.
Analysis
What Apple added
Apple previewed VisionOS 27 at WWDC, and the biggest change is Visual Intelligence, a camera-aware AI feature for Vision Pro. The article says this is the sort of capability Apple’s future smart glasses will likely need, but in VisionOS 27 it is limited to snapshots of what is in front of the wearer rather than a constant live view.
Siri is also changing. According to the article, asking Siri can now surface what is on open apps in VisionOS and can also recognize things in the room. The article contrasts this with Google and Samsung’s more continuous live AI modes, saying Apple is not doing that here. Instead, Siri uses gaze tracking to capture a momentary view of the world.
Other updates
The update includes smaller quality-of-life features too. Personal panoramic photos can be turned into 3D immersive backgrounds, and Vision Pro can now preview 3D objects from Mac apps as part of a creative workflow. These additions make the headset more useful for people already working across Apple devices.
What still feels incomplete
The article argues that these changes are welcome but mostly incremental. Apple still has not shipped new core Vision Pro apps, and it has not meaningfully turned Apple Watch, iPhone, or iPad into connected Vision accessories. The company is still leaning on Macs as the best companion for the $3,500 headset.
The broader takeaway is that Vision Pro is gaining features that show off its sensors and processing power, but Apple has not yet closed the gap between a premium demo device and a must-have spatial computer.
Key points
- Apple previewed VisionOS 27 at WWDC with camera-aware AI for Vision Pro.
- Siri can now recognize things in the room, but not with a continuous live mode.
- Personal panoramic photos can be converted into 3D immersive backgrounds.
- Vision Pro can preview 3D objects from Mac apps for creative workflows.
- The article says the update is useful, but mostly incremental aside from Siri.
If Apple keeps building on these features, Vision Pro could become more useful for everyday tasks and creative work. The camera-aware AI also gives Apple a clear path for future glasses and other wearable devices.
The update may not be enough to attract many new buyers if the headset still lacks strong core apps and tighter links to other Apple devices. If Vision Pro remains mostly a premium companion for Mac users, it could stay a niche product while the market moves toward lighter smart glasses.
