Seeing AI: Narrating the world around you

Seeing AI is a free app that narrates the world around you. Designed with and for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world by describing nearby people, text and objects. Seeing AI provides tools to assist with a variety of daily tasks: • Read - Hear text as soon as it appears in front of the camera. Document alignment provides audio cues to capture a printed page and recognize the text along with its original formatting. Ask Seeing AI about the contents to easily find the information you need. • Describe - Take photos to hear a rich description. Ask questions to focus on the information you care about. Explore photos by moving your finger over the screen to hear the location of different objects. • Products - Scan barcodes and Accessible QR codes using audio beeps to guide you; hear the product name and package information when available. • People - Save photos of friends and coworkers so you can recognize them later. Get an estimate of their age, gender, and expression. • Currency - Recognize currency notes. • Find My Things - Teach Seeing AI to recognize your personal objects and follow the audio cues to find them later. • World - An Audio Augmented Reality experience to explore an unfamiliar environment, including hearing objects announced around you with Spatial Audio (requires a device with a LiDAR, and iOS 14+). • Colors - Identify colors. • Light - Hear an audible tone corresponding to the brightness of your surroundings. • Photos and Videos in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe media from Mail, Photos, WhatsApp, and more. • Browse Photos - Hear descriptions of photos and videos saved on your device. Seeing AI continues to evolve as we hear from the community, and AI research advances. Visit http://SeeingAI.com for more details. Questions, feedback or feature requests? Email us at SeeingAI@Microsoft.com.