Seeing AI – the Swiss army knife of talking camera apps

Post date: 
Monday, 2 October 2017
Seeing AI - The Swiss army knife of talking camera apps

In the US, Microsoft has released Seeing AI, a new talking camera app for the iPhone that narrates the world around you. This app could prove to be invaluable to many blind and partially sighted people, so we found out more from tech enthusiasts Steven Scott and Scott Kayeker. 

Seeing AI is like the Swiss Army knife of apps – when you launch it, you get five modes to choose from.

Short text

The first is short text mode, which you’d use for reading short pieces of text, such as on a box or sign. 


The document mode allows you to take a picture, much like you would with an optical character recognition (OCR) programme. This is designed for reading printed material such as letters and books.


The product mode integrates barcode scanning and product identification. It can help you locate the barcode on an object you’re interested in. It uses proximity alerts to give an indication of where it thinks the barcode is, and it gives audible signals as you get closer to the barcode. 


The person mode identifies faces in a picture or live video stream. You can 'programme in' people who you know by taking three pictures of the same person and naming them. Once you’ve done that, the app should say “Shaun, five feet away” instead of “Face, five feet away”.


The last feature is a beta one. Called the scene feature, you can take a picture and the app will describe or try to figure out what is in the picture. 

Looking forward

Update: You can download Seeing AI for free from the UK App Store.

This article originally appeared in Connect magazine - Autumn 2017 edition.

More you might like


Become part of our growing community of people affected by sight loss and you will receive more great stories like these

Elsewhere in the community