Gemini Live now advises where to point the camera. Guided Vision also helps with small print

Pointing your phone at an object might not be enough. The camera might be too high, too close, or pointing incorrectly. This is exactly what Guided Vision, a new feature Google is launching in Gemini Live on compatible Android devices, aims to help with. In addition to describing what the camera sees, it will also offer voice instructions for adjusting the shot. It was primarily developed for blind and visually impaired users.

The phone tells you when to tilt or move the camera

After enabling Guided Vision, simply share your camera in a conversation with Gemini Live. The assistant may ask you to slowly turn right, tilt the phone, or step back to get a better view of what you’re asking about. The description of the surroundings can be followed up with additional questions; it’s not just a one-time reading of the image content.

This is the most interesting aspect of the new feature: the help doesn’t just involve recognizing an object, but also finding the correct shot itself. For a person who cannot see the image on the display well, this part can be crucial.

From washing machine controls to an earbud on the floor

Google provides specific examples from the home: reading small nutritional information on food packaging, distinguishing appliance control positions or washing programs. Outside the home, the feature can help with printed menus in restaurants. Its use therefore doesn’t have to be limited to people with visual impairments; small print in poor lighting can trouble anyone.

Other scenarios include finding a dropped earbud on the floor or pepper among spice jars. Gemini can also describe the colors, patterns, and shapes of clothing or explain the layout of an unfamiliar room. When getting dressed, you can ask it about the color of a specific jacket or the combination of a striped shirt with trousers.

Google collaborated with Aira and its community of testers on the development. Specialists also helped set safety boundaries. These have a clear limit: Guided Vision can make mistakes and is not intended for navigation, obstacle detection, or as a substitute for a white cane.

How to enable and quickly launch Guided Vision

In the Gemini mobile app, open settings via your profile and turn on the toggle for „Use Guided Vision in Live“. Then launch Gemini Live and share your camera. Google states support for Android 9 and newer in regions and languages where Gemini Live works (including here in the Czech Republic); it recommends updating both the Gemini app and the system.

For repeated use, you can set a Guided Vision shortcut in Android settings under Accessibility and Vision assistance. Launching can then be handled by a floating accessibility button, a two-finger swipe gesture, or pressing both volume buttons. TalkBack users can tap with three fingers to open its menu and select Guided Vision directly from there.

What would voice assistance via camera make easiest for you in your day?

Sources: blog.google, androidauthority.com