Future Now
The IFTF Blog
Wearable computer to recognize emotion
"MIT Media Lab researchers are building a device to help autistic people determine if they're boring or annoying the person they're talking to. The "emotional social intelligence prosthetic device" is a camera that clips on eyeglasses and feeds images to a small computer that uses image recognition software to characterize emotions. If the listener doesn't seem to be engaged, the device vibrates to alert the wearer. Progress on the device will be presented at the International Workshop on Wearable and Implantable Body Sensor Networks next week at MIT. From New Scientist:
(Researcher Rana El Kaliouby's) program is based on a machine-learning algorithm that she trained by showing it more than 100 8-second video clips of actors expressing particular emotions. The software picks out movements of the eyebrows, lips and nose, and tracks head movements such as tilting, nodding and shaking, which it then associates with the emotion the actor was showing. When presented with fresh video clips, the software gets people's emotions right 90 per cent of the time when the clips are of actors, and 64 per cent of the time on footage of ordinary people...
Getting the software to work is only the first step, (researcher Rosalind) Picard warns. In its existing form it makes heavy demands on computing power, so it may need to be pared down to work on a standard hand-held computer. Other challenges include finding a high-resolution digital camera that can be worn comfortably, and training people with autism to look at the faces of those they are conversing with so that the camera picks up their expressions.