Computer maps 21 distinct emotional expressions

Researchers have found a way for computers to recognise 21 distinct facial expressions - even those for complex or seemingly contradictory emotions such as 'happily disgusted' or 'sadly angry'.
The study by Ohio State University more than triples the number of documented facial expressions that researchers can now use for cognitive analysis.
"We've gone beyond facial expressions for simple emotions like 'happy' or 'sad'. We found a strong consistency in how people move their facial muscles to express 21 categories of emotions," said Aleix Martinez, associate professor of electrical and computer engineering at Ohio State.
The resulting computational model will help map emotion in the brain with greater precision than ever, and perhaps even aid the diagnosis and treatment of mental conditions such as autism and post-traumatic stress disorder (PTSD).

Until now, cognitive scientists have confined their studies to six basic emotions - happy, sad, fearful, angry, surprised and disgusted - mostly because the facial expressions for them were thought to be self-evident.
But deciphering a person's brain functioning with only six categories is like painting a portrait with only primary colours, Martinez said.

The study photographed 230 volunteers - 130 female, 100 male, and mostly college students - making faces in response to verbal cues.
In the resulting 5,000 images, they tagged prominent landmarks for facial muscles, such as the corners of the mouth or the outer edge of the eyebrow.

They used a method used by psychologist Paul Ekman, the scientific consultant for the television show "Lie to Me". Ekman's Facial Action Coding System, or FACS, is a standard tool in body language analysis.
They searched the FACS data for similarities and differences in the expressions, and found 21 emotions - the six basic emotions, as well as emotions that exist as combinations of those emotions, such as "happily surprised" or "sadly angry."
The researchers referred to these combinations as "compound emotions." The model was able to determine the degree to which the basic emotions and compound emotions were characterised by a particular expression.

For example, the expression for happy is nearly universal: 99 per cent of the time, study participants expressed happiness by drawing up the cheeks and stretching the mouth in a smile.
Surprise was also easily detected: 92 per cent of the time, surprised participants opened their eyes wide and dropped their mouth open.
"Happily surprised" turned out to be a compound of the expressions for "happy" and "surprised."
About 93 per cent of the time, the participants expressed it the same way: with the wide-open eyes of surprise and the raised cheeks of happiness - and a mouth that was a hybrid of the two - both open and stretched into a smile.