The app, currently only available on iOS, uses the device’s camera to perform a number of useful functions including:
Reading documents – with spoken hints to make sure the user captures the full page. It then recognises the structure of the document such as headings, paragraphs and lists, allowing the user to rapidly skip through the document using VoiceOver.
Identifying a product based on its barcode – simply move the phone’s camera over the product; beeps indicate how close the barcode is (the faster the beeps, the closer it is) until the full barcode is detected. It then snaps a photo and reads the name of the product.
Recognising people based on their face – and providing a description of their visual appearance such as their gender, facial expression and other identifying characteristics.
Recognising images within other apps – just tap Share and Recognise with Seeing AI.
Because the app is still a work in progress, there are some features that are considered “experimental”.