Google's Lookout app narrates the world for blind users

On May 8, 2018, Google announced Lookout, an Android app meant to help people who are blind or have low vision learn about their surroundings. The user wears or holds a phone with the camera pointed outward, and Lookout uses on-device computer vision to speak short cues aloud - naming objects, reading text, and noting people and landmarks such as a chair, an exit sign, or text on a document. Google described it as running on the device so it could work without a connection, and shipping with modes tuned for different situations like being at home or out and about.

Lookout was part of a wave of camera-plus-AI accessibility tools that arrived around the same time, alongside Microsoft’s Seeing AI. The shared idea was to turn the smartphone camera into a narrator: rather than asking a sighted person for help, a blind user could point a phone and have the machine describe what was in front of it. The app rolled out more broadly over the following year, reaching the US Play Store in 2019 and later expanding its modes and languages.

The technology was a precursor to the much richer scene-description that large multimodal models would later enable - the same trajectory that led to Be My Eyes pairing with GPT-4. Lookout’s early version was limited to recognizing categories and reading text, but it established the interaction pattern of an AI that speaks the visual world on demand.

Why business readers should care: Lookout is a concrete example of computer vision deployed as assistive technology, where the product is not analytics for a business but independence for a user, and where running the model on-device was a deliberate choice for privacy and offline reliability.