We first saw a demo of Seeing AI at Microsoft's 2016 Build conference, but the app is now finally available to download in the U.S. on iOS.
The page Microsoft has set up contains a number of video demos, but since the app is free of charge to download I simply would recommend that you download it yourself to see the work Microsoft is doing in this area. The app is also capable of recognizing currency bills and user's friends.
Optimized for use with VoiceOver, the app enables you to recognize. There is no word yet on whether the app will come to Android, Windows 10 Mobile or other countries, or when that might happen. They can point it at a product and the app will tell them what that is.
Not only can Seeing AI recognize people that it has seen people, it can even guess the age and emotion of strangers.
For example, Microsoft brought its SQL Server database software to Linux, and it has ported Office apps to the iPad. However, Seeing AI's experimental features - like describing an entire scene or recognizing hand-writing - require a connection to the cloud.More news: Centre girds up for safe Amarnath Yatra as ultras plan Burhan anniversary
More news: Canada to compensate ex-Guantanamo inmate
More news: Tom Holland is flawless to play Spider-man: Robert Downey Jr
Products - Scans barcodes, using audio beeps to guide you; hear the name, and package information when available.
The app uses neural networks to identify the world around it - the same basic technology that's being deployed all over Silicon Valley, powering self-driving cars, drones, and more. "As the research progresses, more channels may be added", the developers say via the app description.
Scenes (early preview) - Hear an overall description of the scene captured.
Speaking to The Verge at a Microsoft event in London, Saqib Shaikh, the tech lead on Seeing AI, said he most commonly used the app for reading documents like signs and menus.