Do faces speak louder than words?

The use of facial recognition in advertising research. As published in the June-July 2018 edition of the Australian Market and Social Research Society’s publication Research News. Our facial expressions, unconsciously or not, reveal more than we think or we say. Even if a person tries hard to hide their real feelings, our countenance will often uncover the truth. A frown, wink, grimace, snarl, laugh, wince, smile… these are just a number of our – often subconscious – micro expressions, which reveal our inner emotions. They often only last a split second, yet these small facial movements uncover whether someone is angry, sad, scared, disgusted, surprised, happy or full of contempt.

Tweetaway blueTweetaway: Facial expressions reveal more than we think or say by @KPallini via @InSites #mrx #newmr #implicit #emotions #indirectmeasures #advertisingresearch

This brings an interesting perspective to marketing research, where the core lies in understanding what people think and feel. Recent evidence in neuroscience has shown that people are not always aware of their own behaviour. We might generally agree to like something, yet the implicit and automatic behaviour such as our emotional expressions may well reveal otherwise. This duality brings an interesting viewpoint when wanting to understand consumer perceptions, for example of commercials. Many advertisements are centred on emotions, as research has shown that if you want people to act – whether by voting or by buying a product – you need to appeal to their emotions. Hence, emotions are a key metric when evaluating advertisement effectiveness.

Tweetaway greenTweetaway: If you want people to act, from voting to buying your brand, you need to appeal to their emotions by @KPallini via @InSites #mrx #newmr #implicit #emotions #indirectmeasures

Keeping in mind the fact that people aren’t always aware of their expressions, the use of eye tracking and facial coding brings many opportunities for marketing research, especially since research shows that humans are less effective in registering and analysing these reactions. Quantum Lab research, for example, demonstrates how the human eye succeeded in capturing emotional responses with a 46.33 per cent accuracy while technology was able to recognise emotions with 83.28 per cent accuracy.

Tweetaway redTweetaway: Eye tracking technology can detect emotions twice as accurate compared to the human eye by @KPallini via @InSites #mrx #newmr #implicit #emotions #indirectmeasures #eyetracking

Do faces speak louder than words?
Yet the question remains whether these new techniques match their promises and provide the necessary insights for decision-making. Are implicit measures the new ad-testing reality and should they replace the more traditional, explicit research approaches?

Tweetaway greenTweetaway: Is implicit the go-to for ad testing and what is the role of explicit measures by @KPallini via @InSites #mrx #newmr #implicit #emotions #indirectmeasures #adtesting

In order to gain insights into the added value of these techniques, we conducted a phased research project together with TUI Group, the leading tour operator in Europe. In addition to more classic conditions, where participants are invited to give their opinion on an ad’s execution, message and impact, another condition was added, exploring the integration of physiological data in survey research through facial coding using Quantum Sense Technology.
Do faces speak louder than words?
The use of this facial recognition technique uncovered that next to dominant expressions of (mainly positive) emotions, people also showed signs of anger or sadness, which did not become apparent through explicit questioning. Combining the facial expression analysis with the actual scene in the commercial allowed us to pinpoint the emotions and give clear guidelines for optimisation. Yet the true value comes from combining the explicit questioning with the analysis of the facial expressions. Although the facial coding provided insights about which scenes generated more negative reactions, it did not explain why. Feeding back the results of the facial recognition to the participants allowed us not only to validate their emotions but moreover to gain an understanding of the reason behind them.

Tweetaway blueTweetaway: While implicit covers the what of emotion measurement, explicit brings the why layer by @KPallini via @InSites #mrx #newmr #implicit #emotions #indirectmeasures

This clearly demonstrates that explicit questioning still has its value and is extremely powerful when combined with other data streams. More than ever, it is the role of researchers to smartly combine emerging techniques with existing ones, in order to gain augmented understanding. These new technologies also provide new opportunities for cross-cultural research. The expression patterns of the six basic emotions are intercultural and universal, yet there are studies showing that Japanese, for example, generally reveal emotions less than those living in other cultures. Facial coding could therefore be a good technique to break through the cultural barriers.
Faces can speak louder than words, yet words will always play an essential role in gathering a comprehensive understanding of how people think and act.

You might also be interested in

SkyTeam x Experience Marketing - podcast

SkyTeam x Experience Marketing [podcast]

When we think about brands, we generally think about whatever it is they sell. Apple sells phones and computers, Disney sells entertainment, McDonald’s sells fast food. There is a key aspect to each that is incredibly important to what they sell; but it is far less tangible: experience.

Supercharging concepts for direct-to-consumer launch of Perrigo’s ACO brand

Supercharging concepts for direct-to-consumer launch of Perrigo’s ACO brand

Perrigo launched its ACO skincare brand successfully in the German market. The basis was a versatile mix of Culture + Trends analysis and leading-edge consumer insights.

Var x Sonic Branding - a podcast by InSites Consulting

Var x Sonic Branding [podcast]

What does your brand sound like? Our previous podcast episode talked about distinctive assets, those brand identifiers that are easily…