Petri Laukka1* Hillary Anger Elfenbein2 Nela Söder1 Henrik Nordström1 Jean Althoff3 Wanda Chui4 Frederick K. Iraki5 Thomas Rockstuhl6 Nutankumar S. Thingujam7- 1Department of Psychology, Stockholm University, Stockholm, Sweden
- 2Olin Business School, Washington University, St. Louis, MO, USA
- 3UQ Business School, University of Queensland, Brisbane, QLD, Australia
- 4Haas School of Business, University of California, Berkeley, CA, USA
- 5United States International University, Nairobi, Kenya
- 6Nanyang Business School, Nanyang Technological University, Singapore
- 7Department of Psychology, Sikkim University, Gangtok, India
Which emotions are associated with universally recognized non-verbal signals?We address this issue by examining how reliably non-linguistic vocalizations (affect bursts) can convey emotions across cultures. Actors from India, Kenya, Singapore, and USA were instructed to produce vocalizations that would convey nine positive and nine negative emotions to listeners. The vocalizations were judged by Swedish listeners using a within-valence forced-choice procedure, where positive and negative emotions were judged in separate experiments. Results showed that listeners could recognize a wide range of positive and negative emotions with accuracy above chance. For positive emotions, we observed the highest recognition rates for relief, followed by lust, interest, serenity and positive surprise, with affection and pride receiving the lowest recognition rates. Anger, disgust, fear, sadness, and negative surprise received the highest recognition rates for negative emotions, with the lowest rates observed for guilt and shame. By way of summary, results showed that the voice can reveal both basic emotions and several positive emotions other than happiness across cultures, but self-conscious emotions such as guilt, pride, and shame seem not to be well recognized from non-linguistic vocalizations.
Introduction
Studies of non-verbal emotion expression have provided crucial input to many of the central debates in emotion science. Controversies ranging from the universality of emotions (e.g., Ekman, 1993; Russell, 1994; Elfenbein, 2013), to the wider issue of how emotions should be conceptualized (e.g., Scherer, 1986; Ekman, 1992; Barrett, 2006), have all been fueled by data from studies of emotion expression. Here, we address a fundamental question raised in these debates—namely which emotions can be communicated across cultures—by examining how reliably the voice can convey cross-culturally a wide range of both positive and negative emotions.
The human voice is a rich source of emotional information and non-verbal vocal expressions come in two main forms, namely modifications of prosody (tone of voice) during speech (i.e., prosodic expressions), and through non-speech vocal sounds such as breathing sounds, crying, hums, grunts, laughter, shrieks, and sighs (i.e., non-linguistic vocalizations). Extensive reviews have established that prosodic expressions of basic emotions such as anger, fear, happiness, and sadness are conveyed by acoustic patterns of cues related to pitch, intensity, voice quality, and durations (Juslin and Laukka, 2003; Scherer, 2003). Several studies have further shown that decoders are able to infer the emotional content of prosodic expressions across languages and cultural boundaries with accuracy above chance (e.g., Kramer, 1964; Beier and Zautra, 1972; Albas et al., 1976; van Bezooijen et al., 1983; Graham et al., 2001; Scherer et al., 2001; Thompson and Balkwill, 2006; Bryant and Barrett, 2008; Pell et al., 2009). These studies suggest that perception of prosodic expressions has a universal component, although meta-analyses have also shown that communication is more accurate when judges rate expressions from their own culture compared with unfamiliar cultures (Elfenbein and Ambady, 2002; Juslin and Laukka, 2003).
Non-linguistic vocalizations [sometimes also referred to as affect bursts; see Scherer (1994)] differ from prosodic expressions in important ways. For example, speech requires highly precise and coordinated movement of the articulators (e.g., lips, tongue, and larynx) in order to transmit linguistic information, whereas non-linguistic vocalizations are not constrained by linguistic codes and thus do not require such precise articulations (Scott et al., 2009). This entails that non-linguistic vocalizations can exhibit larger ranges for many acoustic features than prosodic expressions—as evident by comparing, for example, pitch ranges in laughter vs. speech (Bachorowski et al., 2001). Compared to prosodic expressions, non-linguistic vocalizations may also be more strongly affected by physiological alterations (e.g., autonomic activation) to the appraisal of emotional situations and their effects on the vocal apparatus. Because vocal expressions are hypothesized to largely result from such emotion-related somatic alterations (see Scherer, 1986), non-linguistic vocalizations may be particularly suited for emotive communication.
However, compared to the large number of studies on prosodic expressions, relatively few studies have investigated emotion recognition from non-linguistic vocalizations (Schröder, 2003; Sauter and Scott, 2007; Belin et al., 2008; Hawk et al., 2009; Simon-Thomas et al., 2009; Sauter et al., 2010a; Lima et al., 2013). These studies show that decoders are generally accurate when judging basic emotions from non-linguistic vocalizations, often reaching higher recognition rates than for prosodic stimuli (e.g., Hawk et al., 2009). Some studies on vocalizations have also extended their coverage of emotions to include several emotions not generally viewed as basic. In particular, findings suggest that non-linguistic vocalizations may convey a wider palette of positive emotional states compared to facial expressions (Sauter and Scott, 2007; Simon-Thomas et al., 2009), as hypothesized by Ekman (1992). This suggests that different modalities of expression, such as facial and vocal expression, and perhaps also different varieties of expression within each modality, such as prosodic expressions and non-linguistic vocalizations, may be preferentially suited for expressing different emotions (see also Hawk et al., 2009; App et al., 2011).
It would seem that non-linguistic vocalizations, being unconstrained by conventions of language, would provide ideal stimuli for cross-cultural studies, but we are aware of very few previous studies on this topic. Sauter et al. (2010b) examined recognition of nine emotions, including basic emotions and additional positive emotions, across European English speaking individuals and individuals from remote, culturally isolated Namibian villages. They reported successful communication of basic emotions across cultural barriers, whereas recognition of positive emotions reached accuracy above chance mainly in within-group conditions. Koeda et al. (2013), in turn, let individuals from Canada and Japan rate Canadian vocalizations of basic emotions with regard to perceived levels of activation, valence and intensity, and reported some group differences in ratings of valence and intensity for both positive and negative emotions. Previous research has thus provided initial findings of both cultural similarities and differences, but further research is needed to establish the degree of cross-cultural variance and invariance of non-linguistic vocalizations.
In the present study we double the number of included emotions compared to previous studies and examine recognition of 18 emotions in cross-cultural conditions. By including the widest selection of emotions to date in a cross-cultural study, we aim to examine the limits of what non-linguistic vocalizations can reveal about emotion in a cross-cultural context. Notably, our selection of emotions includes equally many positive (affection, amusement, happiness, interest, sexual lust, peacefulness/serenity, pride, relief, and positive surprise) and negative (anger, contempt, disgust, distress, fear, guilt, sadness, shame, and negative surprise) emotions. Very few previous cross-cultural studies—regardless of expression modality—have examined recognition of positive emotional states beyond happiness, and our study will therefore provide novel clues about the universality of positive emotion expressions.
Study 1—Decoding of Positive Non-Linguistic Vocalizations
Materials and Methods
Vocal stimuli
We utilized non-linguistic vocalizations from the VENEC corpus, which is a large cross-cultural database of vocal emotion expressions portrayed by 100 professional actors (Laukka et al., 2010). The majority of stimuli in the VENEC corpus consist of prosodic expressions, but a subset of the actors also provided non-linguistic vocalizations, or affect bursts, and these stimuli are used in the present study. Actors from India, Kenya, Singapore, and USA were instructed to convey nine positive emotions (affection, amusement, happiness, interest, sexual lust, peacefulness/serenity, pride, relief, and positive surprise) by means of non-linguistic vocalizations. All vocalizations were intended to convey expressions with medium (moderately high) emotion intensity. Emotionally neutral vocalizations were also recorded, but these are not included in the current study.
The actors were instructed to express the emotions as convincingly as possible and in a similar way as in real emotional situations. To achieve this, the actors were first provided with scenarios describing typical situations in which each emotion may be elicited, based on current research on emotion appraisals (e.g., Ortony et al., 1988; Lazarus, 1991; Ellsworth and Scherer, 2003), and were then instructed to try to enact finding themselves in similar situations. As a further aid for producing convincing portrayals, they were also told to try to remember similar situations that they had experienced personally and that had evoked the specified emotions, and if possible to try to put themselves into the same emotional state of mind. Scherer and Bänziger (2010) have argued that a combination of scenarios and induction methods is likely to increase the authenticity and believability of the resulting portrayals because it discourages the use of stereotypical expressions.
The actors were free to choose whatever kind of human sounds that they thought fit for the purpose (e.g., breathing sounds, crying, hums, grunts, laughter, shrieks, and sighs). They were, however, told to avoid actual words (e.g., “heaven,” “no,” “yes”) and vocalizations with conventionalized semantic meaning (e.g., “yuck,” “ouch”), although non-linguistic interjections (e.g., “ah,” “er,” “hm,” “oh”) were allowed. Some actors nevertheless used words and these stimuli were excluded in an initial screening of the stimuli. Non-linguistic vocalizations were not recorded for each actor, and the number of emotions that each actor provided vocalizations for also varied. In total, our selection included 213 positive non-linguistic vocalizations from 41 actors (India, N = 9; Kenya, N = 11; Singapore, N = 7; and USA, N = 14), and contained approximately equally many portrayals of each emotion from each culture (see Table 1). The selection further included approximately the same number of stimuli by female and male actors in each condition.
Table 1. Number of non-linguistic vocalizations for each emotion and culture.
Recordings were conducted on location in each country (Pune, India; Nairobi, Kenya; Singapore, Singapore; and Berkeley, CA, USA), and the vocalizations were recorded directly onto a computer with 44 kHz sampling frequency using a high-quality microphone (sE Electronics USB2200A, Shanghai, China). The loudness of the stimuli varied widely—literally ranging from whispers to screams—and the amplitude of each stimulus was therefore peak normalized using Adobe Audition software (Adobe Systems Inc., San Jose, CA, USA). The normalization procedure controlled for differences in recording level between actors and softened the contrast between stimuli which would otherwise have been disturbingly loud or inaudibly quiet.
Participants and procedure
Twenty-nine Swedish individuals, mainly university students, took part in the study (20 women; mean age = 31 years). Participants judged the vocalizations of positive emotions by choosing one label which best represented the expression conveyed by each speech stimulus, and the alternatives they could choose from were the same as the nine intended expressions (affection, amusement, happiness, interest, lust, peacefulness, pride, relief, and positive surprise). All participants were provided dictionary definitions of each emotion, and also received the same emotion scenarios as did the actors, to make sure that they understood all of the included emotion labels.
Responses were scored as correct if the response matched the intended expressions of the emotion portrayals. Experiments were computerized and conducted individually using MediaLab software (Jarvis, 2008). Stimuli were presented in random order, and the participants were only allowed to listen to each stimulus once. The participants listened to stimuli through high-quality headphones, with the sound level kept constant across participants. Sessions lasted for ~40 min, and participants received course credits or a movie ticket voucher as compensation for their participation.
Results
Table 2 shows the recognition rates and confusion patterns for positive emotions. The overall recognition rate was 39%, which is 3.5 times higher than the proportion expected by chance guessing (the chance level in a 9-alternative forced choice task is 11%; 1 out of 9). All emotions were recognized with accuracy above chance in at least some cultural conditions, as indicated by binomial tests. This suggests that a wide range of positive vocalizations were conveyed across cultures. Vocalizations of relief (mean recognition rate = 70%) were most accurately perceived, followed by lust (45%), interest (44%), serenity (43%), and positive surprise (42%). These emotions were not frequently confused with other states, although interest was sometimes confused with positive surprise, and serenity with relief.
Table 2. Recognition rates and confusion patterns for non-linguistic vocalizations of nine positive emotions from four cultures.
Happiness (36%) and amusement (32%) were symmetrically confused with each other at a level equal to accurate decoding proportion, which suggests that vocalizations of these states are not easy to separate. Given the conceptual similarity between these states this was hardly a surprising finding, and a combined happiness/amusement category received 60% accuracy. At the bottom end of recognizability, we found pride (22%) and affection (20%). Although recognized with above-chance accuracy in some conditions, these emotions were frequently misclassified, and vocalizations of both pride and affection were most commonly confused with interest.
Inspection of the recognition rates as a function of speaker culture further revealed that both recognition and confusion patterns were similar across all four cultures (see Table 2). This suggests cross-cultural consistency with regard to which emotions were easy or hard to recognize, and which emotions were confused with each other and which were not. Nevertheless, some emotions were only recognized in some, but not in other, cultural conditions. For example, Swedish listeners did not accurately perceive amusement vocalizations from Indian stimuli, but instead judged them as surprised sounding. However, it is difficult to interpret such group differences, because they may result from group effects not having to do with culture per se (e.g., the Indian actors may simply not have been as successful in portraying amusement compared to actors from other cultures).
Study 2—Decoding of Negative Non-Linguistic Vocalizations
Materials and Methods
Vocal stimuli
Non-linguistic vocalizations of nine negative emotions (anger, contempt, disgust, distress/pain, fear, guilt, sadness, shame, and negative surprise) portrayed by professional actors from India, Kenya, Singapore, and USA served as stimuli in Study 2. The vocalizations were selected from the VENEC corpus (Laukka et al., 2010) and were collected using the same methods as described for Study 1. In total, the selection contained 214 negative emotional vocalizations from 40 actors (India, N = 8; Kenya, N = 10; Singapore, N = 7; and USA, N = 15), see Table 1 for details.
Participants and procedure
We used the same judgment procedures in Study 2, as previously described for Study 1, except that we presented negative vocalizations and response alternatives. Twenty-eight Swedish individuals (18 women; mean age = 31 years) judged the expressed emotion of each presented stimulus, by choosing one from nine alternatives (anger, contempt, disgust, distress, fear, guilt, sadness, shame, and negative surprise). Four of the participants had previously taken part in Study 1.
Results
Recognition rates and confusion patterns for negative emotions are presented in Table 3. For negative emotions, the overall recognition rate was approximately four times higher than chance at 45%. Similar to Study 1, we conducted binomial tests to test whether the proportion of participants who chose the correct response alternative for each emotion was higher than the proportion that would be expected by chance guessing. All emotions were recognized with accuracy above chance in at least some conditions—which suggests that a wide range of negative emotions can be expressed cross-culturally through the voice. Disgust (mean recognition rate = 63%) was the best recognized emotion, followed by anger (57%), fear (57%), sadness (56%), negative surprise (53%), and contempt (44%). These emotions were seldom confused with other states, although contempt was sometimes confused with negative surprise.
Table 3. Recognition rates and confusion patterns for non-linguistic vocalizations of nine negative emotions from four cultures.
Distress (33%) was frequently confused with both fear and sadness, which suggests that distress vocalizations may show some overlap with these emotions. The most frequently observed confusions occurred symmetrically between shame (mean recognition rate = 21%) and guilt (mean recognition rate = 20%). A joint shame/guilt category indeed received 40% accuracy, which could be interpreted as evidence for the notion that the voice can reveal a negative self-conscious emotion category. However, both shame and guilt were frequently confused also with other emotions, such as distress and negative surprise, which instead indicates that they may not be associated with distinct vocal signals.
Table 3 further displays recognition rates as a function of speaker culture, and inspection revealed substantial cross-cultural consistency with regard to both recognition and confusion patterns. However, some cultural variability could also be observed. For example, Swedish listeners frequently confused distress vocalizations from India and Kenya with sadness, whereas distress vocalizations from Singapore and USA were instead confused with fear. However, as previously explained, we cannot know if group differences are caused by cultural factors or factors unrelated to culture.
Discussion
The present results establish non-linguistic vocalizations as a rich and nuanced source of emotional signals. Across two studies, our results suggest that the voice can convey a wide range of positive (Study 1) as well as negative (Study 2) emotions across cultures. More specifically, we observed above-chance cross-cultural recognition of basic emotions such as anger, contempt, disgust, fear, happiness, sadness, and surprise. Notably, we also observed for the first time above-chance recognition of several positive emotions other than happiness—such as interest, lust, relief, and serenity—in a cross-cultural context. However, not all emotions were equally recognizable across cultures and we observed only modest recognition rates for affection, guilt, pride, and shame. The implications of these findings are discussed below in relation to the larger issue about which emotions are associated with universally recognized expressions.
Findings of universality in emotion expression are traditionally interpreted as support for the proposition that emotion expressions are based on biologically driven evolved mechanisms (e.g., Ekman, 1992), although this view also has its critics (e.g., Barrett, 2006). Non-linguistic vocalizations are often considered an especially “primitive” form of human emotion signaling that is functional already at the time of birth and that in many ways resembles animal expressions more than human speech (Owren et al., 2010; Briefer, 2012). Thus, it may be hypothesized that cross-culturally communicable vocalizations may, at least to a certain extent, be based on evolved biologically driven mechanisms (e.g., Ekman, 1992), such as physiological effects of emotion appraisals on the voice production apparatus (Scherer, 1986). Our observation of above-chance recognition of basic emotions corroborates findings from the sole previous cross-cultural study on non-linguistic vocalizations by Sauter et al. (2010b), as well as previous studies on prosodic and facial expressions (e.g., Elfenbein and Ambady, 2002; Juslin and Laukka, 2003), and suggests that basic emotion vocalizations have a universal component.
We included a wide selection of positive emotions, and our observation of above-chance recognition of positive states other than happiness expands upon previous studies conducted in a within-cultural context (e.g., Simon-Thomas et al., 2009). The finding of a universal component to positive emotion vocalizations may appear contrary to the previous findings of Sauter et al. (2010b), who reported largely non-significant cross-cultural recognition for positive emotions. However, the distinctions between different positive emotions are not well understood, and as a consequence different studies have included different positive states. Between our study and Sauter et al. (2010b), the only common positive emotions were amusement and relief. Whereas Sauter et al. (2010b) observed cross-cultural recognition for amusement (which they viewed as a basic emotion) but not relief, we instead observed above-chance recognition for both emotions (although amusement was frequently confused with happiness). The main difference between studies thus concerns recognition of relief only, and may have been caused by idiosyncratic differences in the sets of expressive stimuli used in respective study. Despite the fact that expressors and perceivers in our study came from different continents, it also remains a possibility that the cultural distances may have been larger in Sauter et al. (2010b) compared to our study.
Similar to our observations, previous within-cultural studies have also reported modest recognition rates for affection, guilt, pride, and shame (Hawk et al., 2009; Simon-Thomas et al., 2009). Taken together, current evidence thus suggests that these emotions may not be associated with highly distinct vocalizations. Guilt, pride, and shame involve reflection upon and evaluation of the self (Tangney and Tracy, 2012), which makes these emotions more dependent on complex cognitive skills compared to basic emotions. Cultures vary regarding how the self is conceptualized (Markus and Kitayama, 1991), and this may lead to culture-specific interpretations of situations particularly relevant for self-conscious emotions such pride and shame (Imada and Ellsworth, 2011). There is thus a possibility that cultural variance may be especially salient for expressions of self-conscious emotions. Although we cannot draw this conclusion based on our current data—because we did not assess emotion recognition in both within- and cross-cultural conditions—this remains an interesting question for future studies. However, evidence also suggests that pride and shame are expressed in a similar fashion cross-culturally through facial and bodily cues (Tracy and Matsumoto, 2008), which leaves open the possibility that they may have distinct expressions through other modalities than the voice.
Comparing our results to previous studies on prosodic expressions, we note that disgust vocalizations received high accuracy rates in our study (as well as in most previous vocalization studies; e.g., Schröder, 2003), whereas disgust is often poorly recognized from prosodic stimuli (e.g., Banse and Scherer, 1996). This suggests that some emotions may be better decoded from vocalizations versus emotional prosody, and future studies could perform direct comparisons to establish which emotions are preferentially recognized from which type of expression. Hawk et al. (2009) reported higher accuracy for vocalizations compared to prosodic expressions for a range of mainly negative emotions, but comparisons for positive emotions are currently missing. Such studies could also include other expression channels—such as facial, bodily, olfactory, and tactile cues—in order to provide a foundation for understanding of which emotions are preferentially expressed through which modalities (e.g., App et al., 2011).
Our investigation also has several limitations which merit consideration. Recent cross-cultural studies on decoding of facial (Elfenbein et al., 2007), musical (Laukka et al., 2013), and vocal (Sauter et al., 2010b) expressions have reported evidence for an in-group advantage to the effect that decoders perform better for expressions from a familiar versus an unfamiliar culture. However, we only assessed decoding in cross-cultural conditions, which precluded investigation of an in-group advantage in the current study. The lack of a within-cultural baseline rate, together with the small number of stimuli in each emotion × culture cell, also prevents a meaningful comparison of recognition rates between cultures—because differences may have been caused by group effects other than culture. We further assessed positive and negative emotions in separate forced-choice experiments in order to avoid fatigue in the participants and to keep the number of response options at a manageable level. However, this design prevented us from investigating possible confusions between positive and negative expressions. The use of a forced-choice format has also been criticized on the grounds that it may lead to inflated recognition rates by enabling judges to use informed guessing strategies to a certain extent (e.g., Russell, 1994). Finally, we used portrayed rather than spontaneous vocalizations, whereas some previous studies have reported that acted expressions may be more prototypical and intense than spontaneous expressions (e.g., Laukka et al., 2012). We are addressing the question of a possible in-group advantage in ongoing cross-cultural judgment studies, and would welcome future studies that consider effects of the format of the judgment task and type of expressive stimuli on cross-cultural emotion decoding (e.g., Jürgens et al., 2013).
Non-linguistic vocalizations are heterogeneous and contain many different types of human sounds, and our sample can only represent a limited subset of all possible vocalizations. We instructed the actors to avoid the use of vocalizations with conventionalized semantic meaning, because the production and recognition of emblematic affect expressions is hypothesized to be strongly culture-dependent (see Scherer, 1994). However, it remains a possibility that some of our vocal stimuli nevertheless contained such culture-dependent information, and this may have reduced recognition accuracy for some emotion × culture combinations. Our study was limited to decoding, but future studies could also investigate how different emotions are encoded in the acoustic properties (such as pitch, intensity, voice quality, and durations; Sauter et al., 2010a; Lima et al., 2013) and in the segmental-phonemic structure (Schröder, 2003) of non-linguistic vocalizations. Currently, cross-cultural studies linking encoding and decoding are missing, but such studies have the potential to reveal which aspects of non-linguistic emotion vocalizations are culturally invariant and which rely on culture-dependent templates.
To conclude, our results show that non-linguistic vocalizations can convey detailed emotional information—not limited to the usual basic emotions, or activation and valence dimensions—to listeners across cultures. We therefore propose that vocalizations may provide ideal stimuli for theory development and applied research in emotion science. Compared to negative emotions, positive emotions have received much less attention, and as a result knowledge about the cognitive appraisals underlying different positive states, and their effects on physiology, is limited. Because vocalizations seem to convey a particularly wide range of positive states, we suggest that studies on non-linguistic vocalizations provide a promising avenue for investigating the distinctiveness of positive emotions.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We acknowledge the following grants: Swedish Research Council 2006-1360 to Petri Laukka and US National Science Foundation BCS-0617624 to Hillary Anger Elfenbein.
References
Albas, D. C., McCluskey, K. W., and Albas, C. A. (1976). Perception of the emotional content of speech: a comparison of two Canadian groups. J. Cross Cult. Psychol. 7, 481–490. doi: 10.1177/002202217674009
App, B., McIntosh, D. N., Reed, C. L., and Hertenstein, M. J. (2011). Nonverbal channel use in communication of emotion: how may depend on why. Emotion 11, 603–617. doi: 10.1037/a0023164
Bachorowski, J.-A., Smoski, M. J., and Owren, M. J. (2001). The acoustic features of human laughter. J. Acoust. Soc. Am. 110, 1581–1597. doi: 10.1121/1.1391244
Banse, R., and Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636. doi: 10.1037/0022-3514.70.3.614
Barrett, L. F. (2006). Are emotions natural kinds? Perspect. Psychol. Sci. 1, 28–58. doi: 10.1111/j.1745-6916.2006.00003.x
Beier, E. G., and Zautra, A. J. (1972). Identification of vocal communication of emotions across cultures. J. Consult. Clin. Psychol. 39, 166. doi: 10.1037/h0033170
Belin, P., Fillion-Bilodeau, S., and Gosselin, F. (2008). The Montreal Affective Voices: a validated set of nonverbal affect bursts for research on auditory affective processing. Behav. Res. Methods 40, 531–539. doi: 10.3758/BRM.40.2.531
Briefer, E. F. (2012). Vocal expression of emotions in mammals: mechanisms of production and evidence. J. Zool. 288, 1–20. doi: 10.1111/j.1469-7998.2012.00920.x
Bryant, G. A., and Barrett, H. C. (2008). Vocal emotion recognition across disparate cultures. J. Cogn. Cult. 8, 135–148. doi: 10.1163/156770908X289242
Ekman, P. (1992). An argument for basic emotions. Cogn. Emot. 6, 169–200. doi: 10.1080/02699939208411068
Ekman, P. (1993). Facial expressions of emotion. Am. Psychol. 48, 384–392. doi: 10.1037/0003-066X.48.4.384
Elfenbein, H. A. (2013). Nonverbal dialects and accents in facial expressions of emotion. Emot. Rev. 5, 90–96. doi: 10.1177/1754073912451332
Elfenbein, H. A., and Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: a meta-analysis. Psychol. Bull. 128, 203–235. doi: 10.1037/0033-2909.128.2.203
Elfenbein, H. A., Beaupré, M., Lévesque, M., and Hess, U. (2007). Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. Emotion 7, 131–146. doi: 10.1037/1528-3542.7.1.131
Ellsworth, P. C., and Scherer, K. R. (2003). “Appraisal processes in emotion,” in Handbook of Affective Sciences, eds R. J. Davidson, K. R. Scherer, and H. H. Goldsmith (New York, NY: Oxford University Press), 572–595.
Graham, C. R., Hamblin, A., and Feldstein, S. (2001). Recognition of emotion in English voices by speakers of Japanese, Spanish, and English. Int. Rev. Appl. Linguist. Lang. Teach. 39, 19–37. doi: 10.1515/iral.39.1.19
Hawk, S. T., van Kleef, G. A., Fischer, A. H., and van der Schalk, J. (2009). "Worth a thousand words”: absolute and relative decoding of nonlinguistic affect vocalizations. Emotion 9, 293–305. doi: 10.1037/a0015178
Imada, T., and Ellsworth, P. C. (2011). Proud Americans and lucky Japanese: cultural differences in appraisal and corresponding emotion. Emotion 11, 329–345. doi: 10.1037/a0022855
Jürgens, R., Drolet, M., Pirow, R., Scheiner, E., and Fischer, J. (2013). Encoding conditions affect recognition of vocally expressed emotions across cultures. Front. Psychol. 4:111. doi: 10.3389/fpsyg.2013.00111
Juslin, P. N., and Laukka, P. (2003). Communication of emotions in vocal expression and music performance: different channels, same code? Psychol. Bull. 129, 770–814. doi: 10.1037/0033-2909.129.5.770
Koeda, M., Belin, P., Hama, T., Masuda, T., Matsuura, M., and Okubo, Y. (2013). Cross-cultural differences in the processing of nonverbal affective vocalizations by Japanese and Canadian listeners. Front. Psychol. 4:105. doi: 10.3389/fpsyg.2013.00105
Kramer, E. (1964). Elimination of verbal cues in judgments of emotion from voice. J. Abnorm. Soc. Psychol. 68, 390–396. doi: 10.1037/h0042473
Laukka, P., Audibert, N., and Aubergé, V. (2012). Exploring the determinants of the graded structure of vocal emotion expressions. Cogn. Emot. 26, 710–719. doi: 10.1080/02699931.2011.602047
Laukka, P., Eerola, T., Thingujam, N. S., Yamasaki, T., and Beller, G. (2013). Universal and culture-specfic factors in the recognition and performance of musical affect expressions. Emotion 13, 434–449. doi: 10.1037/a0031388
Laukka, P., Elfenbein, H. A., Chui, W., Thingujam, N. S., Iraki, F. K., Rockstuhl, T., et al. (2010). “Presenting the VENEC corpus: development of a cross-cultural corpus of vocal emotion expressions and a novel method of annotating emotion appraisals,” in Proceedings of the LREC 2010 Workshop on Corpora for Research on Emotion and Affect, eds L. Devillers, B. Schuller, R. Cowie, E. Douglas-Cowie, and A. Batliner (Valletta: European Language Resources Association), 53–57.
Lima, C. F., Castro, S. L., and Scott, S. K. (2013). When voices get emotional: a corpus of nonverbal vocalizations for research on emotion processing. Behav. Res. Methods doi: 10.3758/s13428-013-0324-3. [Epub ahead of print].
Markus, H. R., and Kitayama, S. (1991). Culture and the self: implications for cognition, emotion, and motivation. Psychol. Rev. 98, 224–253. doi: 10.1037/0033-295X.98.2.224
Ortony, A., Clore, G. L., and Collins, A. (1988). The Cognitive Structure of Emotions. Cambridge, England: Cambridge University Press. doi: 10.1017/CBO9780511571299
Owren, M. J., Amoss, R. T., and Rendall, D. (2010). Two organizing principles of vocal production: implications for nonhuman and human primates. Am. J. Primatol. 73, 530–544. doi: 10.1002/ajp.20913
Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., and Kotz, S. A. (2009). Factors in the recognition of vocally expressed emotions: a comparison of four languages. J. Phon. 37, 417–435. doi: 10.1016/j.wocn.2009.07.005
Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of cross-cultural studies. Psychol. Bull. 115, 102–141. doi: 10.1037/0033-2909.115.1.102
Sauter, D. A., Eisner, F., Calder, A. J., and Scott, S. K. (2010a). Perceptual cues in nonverbal vocal expressions of emotion. Q. J. Exp. Psychol. 63, 2251–2272. doi: 10.1080/17470211003721642
Sauter, D. A., Eisner, F., Ekman, P., and Scott, S. K. (2010b). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proc. Natl. Acad. Sci. U.S.A. 107, 2408–2412. doi: 10.1073/pnas.0908239106
Sauter, D. A., and Scott, S. K. (2007). More than one kind of happiness: can we recognize vocal expressions of different positive states? Motiv. Emot. 31, 192–199. doi: 10.1007/s11031-007-9065-x
Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychol. Bull. 99, 143–165. doi: 10.1037/0033-2909.99.2.143
Scherer, K. R. (1994). “Affect bursts,” in Emotions: Essays on Emotion Theory, eds S. H. M. Goozen, N. E. van de Poll, and J. A. Sergeant (Hillsdale, NJ: Erlbaum), 161–193.
Scherer, K. R. (2003). Vocal communication of emotion: a review of research paradigms. Speech Commun. 40, 227–256. doi: 10.1016/S0167-6393(02)00084-5
Scherer, K. R., Banse, R., and Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. J. Cross Cult. Psychol. 32, 76–98. doi: 10.1177/0022022101032001009
Scherer, K. R., and Bänziger, T. (2010). “On the use of actor portrayals in research on emotional expression,” in Blueprint for Affective Computing: A Sourcebook, eds K. R. Scherer, T. Bänziger, and E. B. Roesch (New York, NY: Oxford University Press), 166–176.
Schröder, M. (2003). Experimental study of affect bursts. Speech Commun. 40, 99–116. doi: 10.1016/S0167-6393(02)00078-X
Scott, S. K., Sauter, D., and McGettigan, C. (2009). “Brain mechanisms for processing perceived emotional vocalizations in humans,” in Handbook of Mammalian Vocalization: An Integrative Neuroscience Approach, ed S. M. Brudzynski (Oxford: Academic Press), 187–198.
Simon-Thomas, E. R., Keltner, D. J., Sauter, D., Sinicropi-Yao, L., and Abramson, A. (2009). The voice conveys specific emotions: evidence from vocal burst displays. Emotion 9, 838–846. doi: 10.1037/a0017810
Tangney, J. P., and Tracy, J. L. (2012). “Self-conscious emotions,” in Handbook of Self and Identity, 2nd Edn., eds M. Leary and J. P. Tangney (New York, NY: Guilford), 446–478.
Thompson, W. F., and Balkwill, L.-L. (2006). Decoding speech prosody in five languages. Semiotica 158, 407–424.
Tracy, J. L., and Matsumoto, D. (2008). The spontaneous expression of pride and shame: evidence for biologically innate nonverbal displays. Proc. Natl. Acad. Sci. U.S.A. 105, 11655–11660. doi: 10.1073/pnas.0802686105
Keywords: affect bursts, cross-cultural, emotion recognition, non-verbal behavior, positive emotions, vocalizations
Citation: Laukka P, Elfenbein HA, Söder N, Nordström H, Althoff J, Chui W, Iraki FK, Rockstuhl T and Thingujam NS (2013) Cross-cultural decoding of positive and negative non-linguistic emotion vocalizations. Front. Psychol. 4:353. doi: 10.3389/fpsyg.2013.00353
Received: 31 March 2013; Paper pending published: 23 April 2013;
Accepted: 30 May 2013; Published online: 30 July 2013.
Edited by:
Anjali Bhatara, Université Paris Descartes, FranceCopyright © 2013 Laukka, Elfenbein, Söder, Nordström, Althoff, Chui, Iraki, Rockstuhl and Thingujam. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Petri Laukka, Department of Psychology, Stockholm University, 106 91 Stockholm, Sweden e-mail: petri.laukka@psychology.su.se