- The Guided Vision feature aims to provide real-time visual assistance to visually impaired individuals.
- Google collaborated with Aira on data visual interpretation training to enhance feature performance.
- Users can obtain environment descriptions and proactive voice prompts through Gemini Live.
- The feature does not replace medical devices and still requires reliance on traditional assistive tools.
Google officially announced the launch of the Guided Vision feature on Gemini Live, aimed at providing real-time visual assistance to blind and low-vision individuals. Users can share their camera to receive dynamic audio descriptions and natural language prompts to explore their surroundings.
Google stated that Guided Vision was developed in close collaboration with the blind and low-vision community, with the purpose of enabling technology to open the world for everyone. The Senior Product Manager noted: "Guided Vision turns Gemini into a conversational visual partner."Google
Collaboration with Aira to enhance functionality
To enable Gemini Live to perform conversational visual interpretation in the real world, Google collaborated with Aira, conducting tens of thousands of hours of data visual interpretation training. More than 1,000 members of Aira's Trusted Tester network participated in testing, helping refine the model to address everyday needs.
Users can receive real-time assistance
After enabling the Guided Vision feature in Gemini Live, users can obtain clear environment descriptions, ask detailed follow-up questions, and receive proactive voice prompts to help them readjust camera angles. The feature supports daily tasks such as reading small print, locating items, and describing objects, enabling users to gain better visual verification in daily life.
The Guided Vision feature is available on devices running Android 9 and above, and can be easily enabled through the Gemini app. Users simply need to open personal settings in the app, enable "Use Guided Vision in Live," then share their camera. Additionally, the feature supports TalkBack integration for convenient operation.
Feature does not replace traditional assistive tools
Google emphasized that Guided Vision is an assistive tool and does not replace medical devices or other mobility aids; users in physical environments must still rely on traditional mobility aids and safe travel practices.
Guided Vision is now rolling out in regions and languages that support Gemini Live; users should ensure their Gemini app and Android system software are updated to the latest versions.
Source: Google official announcement
Impact of Guided Vision on visually impaired individuals
The launch of the Guided Vision feature demonstrates Google's emphasis on improving quality of life for visually impaired individuals. Through its collaboration with Aira, Google not only enhanced Gemini Live's practicality but also provided better support for the blind community in daily life. This technological development helps users perform daily tasks more effectively, thereby increasing their independence and confidence. Nevertheless, Google also stressed that this feature cannot fully replace traditional assistive tools, reflecting that considerations for user safety and practical needs remain paramount amid technological advancement.