Google Launches Guided Vision in Gemini Live, Built With Aira

Google's assistant can now talk a blind user through what the camera sees, and tell them to tilt the phone down. The company announced Guided Vision in Gemini Live, a conversational real-time visual assistance mode built with the accessibility firm Aira, rolling out on Android 9 and above wherever Gemini Live is available.

The feature lets users "share your camera to receive dynamic audio descriptions and natural verbal reframing cues to explore your environment," and prompt the assistant with follow-up questions. When the shot is wrong, it coaches: "natural verbal prompts to help you reframe — asking you to pan slowly to the right, tilt downward, or step back."

Aira is the part that makes this more than another camera demo. "We partnered with Aira to visually interpret data for a total of tens of thousands of hours," the Google post says, and more than 1,000 members of Aira's Trusted Tester network stress-tested the system, with Aira specialists writing safety guidelines. Testing pulled in communities in India, Brazil, Singapore, Indonesia and Japan.

Users turn it on from Gemini app settings, Android's Vision assistance menu, or a three-finger tap through TalkBack.

Google is blunt about what it is not. "As with any generative AI technology, Guided Vision is an assistive utility and can make mistakes. It is not a medical device, mobility aid, or white cane replacement, and it's not intended for navigation, safe-travel guidance, or obstacle detection." The post does not publish an accuracy figure, and does not say how Aira's interpreter data was licensed. It is one of many Google launches we have tracked in the last 90 days.