#
© Jean-Julien Aucouturier et Louise Goupil, laboratoire STMS (CNRS/Ircam/Sorbonne Université/Ministère de la Culture)

Recognizing liars from the sound of their voice?

Digital

Faster speech rate, greater intensity in the middle of the word, and falling pitch at the end of the word: that is the prosody1 to adopt if one wants to come across as reliable and honest to one’s listeners. Scientists from the Science and Technology for Music and Sound laboratory (CNRS/Ircam/Sorbonne Université/Ministère de la Culture)2 and the Perceptual Systems Laboratory (CNRS/ENS PSL) have conducted a series of experiments3   to understand how we decide, based on the voice, whether a speaker is honest and confident, or on the contrary dishonest and uncertain. They have also shown that this signature was perceived similarly in a number of languages (French, English, Spanish), and that it is registered “automatically” by the brain: even when participants were not judging the speaker’s certainty or honesty, this characteristic sound impacted how they memorized the words. Prosody consequently conveys information on the truth-value or certainty of a proposition. Scientists are now trying to understand how speakers produce such prosody based on their intentions. This research was published on 8 February 2021 in Nature Communications.

Examples of these sounds:


 

 

#
Two types of judgements (certainty, honesty) are based on a single acoustic signature: high pitch that falls at the end of the word, intensity in the middle of the word, and fast speech rate. Above: certainty, below: honesty.
© Jean-Julien Aucouturier and Louise Goupil, STMS laboratory (CNRS/Ircam/Sorbonne Université/Ministère de la Culture)

 

  • 1Prosody refers to the “melody” of a phrase or word: its pitch, rate, and intensity.
  • 2Jean-Julien Aucouturier now works at the FEMTO-ST laboratory (CNRS/Université de Bourgogne-Franche Comté/ENSMM/UTBM), and Louise Goupil at the University of East London.
  • 3Scientists used vocal signal processing techniques to create random pronunciations of words (rising pitch, falling pitch, etc.), and then asked multiple groups of participants whether these words were pronounced with certainty or honesty. The software they developed as part of this effort, CLEESE, is open source: https://forum.ircam.fr/projects/detail/cleese/
Bibliography

Listeners’ perceptions of the certainty and honesty of a speaker are associated with a common prosodic signature. Louise Goupil, Emmanuel Ponsot, Daniel Richardson, Gabriel Reyes, Jean-Julien Aucouturier. Nature communications, le 8 february 2021. DOI : 10.1038/s41467-020-20649-4

Contact

Jean-Julien Aucouturier
CNRS researcher
Louise Goupil
Post-doctoral researcher (in England)
Alexiane Agullo
CNRS press officer