Microsoft, Nreal Partners to Support Vision Impaired Children

by Guy Frum

Social interaction is complex enough without impairments or defects to make it even harder. This is especially true among blind people and those with visual impairments.
But recently, Microsoft, in conjunction with Nreal, unveiled PeopleLens, smart AR AI-powered glasses to help support social interaction among blind children and their friends.

Privacy Concerns?

Facial recognition is one of the important algorithms in the PeopleLens system. It could be connected to a phone.

This phone can be used to take photographs of people that want to be registered under the system for easy recognition by the wearer.

However, to solve any privacy concerns, later on, photographs aren’t stored on the system but are converted into a vector of numbers that aren't used by any other system. So, recognition by PeopleLens is independent of any other recognition software anywhere else. And since images aren’t captured, photographs or videos can’t be used maliciously.

The Sound System

The system could also use a series of sounds to place people in the wearer’s immediate surroundings.
A percussive bump when their gaze comes upon someone who is about 10 meters away: and if the person is registered under the system, the name of the person follows the bump.
But the person’s name is only mentioned if he/she is within four meters of the wearer and both ears are showing.

The system also uses pitch. If the gaze of the wearer centers upon someone for a second, someone who the system hasn’t identified yet, the system changes in pitch to help the wearer adjust their gaze.
Those who are unregistered are recognized with the sound of a click.
This system also makes use of a gaze notification to alert the wearer when they are being watched.