Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 28 September 2016
Sec. Cognition

What’s in a Face? How Face Gender and Current Affect Influence Perceived Emotion

  • 1Developmental and Brain Sciences, Department of Psychology, University of Massachusetts Boston, Boston MA, USA
  • 2Clinical Psychology, Department of Psychology, University of Massachusetts Boston, Boston MA, USA

Faces drive our social interactions. A vast literature suggests an interaction between gender and emotional face perception, with studies using different methodologies demonstrating that the gender of a face can affect how emotions are processed. However, how different is our perception of affective male and female faces? Furthermore, how does our current affective state when viewing faces influence our perceptual biases? We presented participants with a series of faces morphed along an emotional continuum from happy to angry. Participants judged each face morph as either happy or angry. We determined each participant’s unique emotional ‘neutral’ point, defined as the face morph judged to be perceived equally happy and angry, separately for male and female faces. We also assessed how current state affect influenced these perceptual neutral points. Our results indicate that, for both male and female participants, the emotional neutral point for male faces is perceptually biased to be happier than for female faces. This bias suggests that more happiness is required to perceive a male face as emotionally neutral, i.e., we are biased to perceive a male face as more negative. Interestingly, we also find that perceptual biases in perceiving female faces are correlated with current mood, such that positive state affect correlates with perceiving female faces as happier, while we find no significant correlation between negative state affect and the perception of facial emotion. Furthermore, we find reaction time biases, with slower responses for angry male faces compared to angry female faces.

Introduction

When navigating the social world, humans rely on the information conveyed in faces. Faces help us identify people we know vs. people we do not and determine whom we can safely approach and whom we should avoid (McArthur and Baron, 1983). Faces also elucidate basic demographic information, such as presumed age, gender, and ethnicity. The adaptive value of faces is clear in an infant’s ability to mimic facial expressions just hours after birth (Meltzoff and Moore, 1983) as well as in our reflexive tendency to perceive face-like patterns in random stimuli (i.e., face pareidolia; Liu et al., 2014).

Early research on faces, especially the evolutionary significance of emotion, dates back to Darwin (1872) and James (1890). Darwin postulated that facial expressions are innate and serve a functional and adaptive purpose. Research by Ekman and Friesen (1971) supported this claim, demonstrating that humans from different cultures perceive similar emotional categories. Perspectives conceptualizing the evolution of expressive faces, suggest that social perception is our tool to safely interact with our environment. According to Gibson (1979) and Reed’s (1996) ecological perspective, facial expressions guide us to take appropriate social action. Because facial expressions are accurate predictors of future behavior, correctly perceiving and avoiding an angry face may allow us to avoid harm and promote self-perseveration, just as openly greeting a happy face may incur greater resources and reproductive fitness (Andrew, 1963; Chevalier-Skolnikoff, 1973).

Biases in Processing Emotional Faces

Behavioral studies have used various methods to demonstrate biases in reaction times to processing faces based on their emotional content. For example, Eastwood et al. (2003) found that participants needed more time to process emotional information in displays of negative expressions compared to displays of neutral or positive emotions. In their paradigm participants viewed several schematic faces made of three arcs, two for the eyes and one for the mouth. Depending on the orientation of the arcs, each schematic face frowned or smiled to depict either negative or positive emotion. More time was needed to count the number of arcs when the stimuli depicted a negative compared to neutral and positive emotions. In a related visual search task Fox et al. (2000) found that participants were slower to determine if a crowded display of faces all expressed the same emotion when all faces expressed anger as opposed to happiness. Interestingly, participants in this task were faster to detect an angry face amidst a crowd of happy faces, compared to a happy face amidst a crowd of angry faces.

Speeded reaction time tasks, where participants have to judge the emotion of affective faces as quickly as possible, have also found slower responses to faces displaying a negative emotional valence. For example, Becker et al. (2007) found significantly slower reaction times for judgements of angry faces compared to happy faces, and Palermo and Coltheart (2004) found significantly slower reaction times especially for fearful compared to positive facial expressions. In general, slower reaction times for processing emotions of negative valence, have been interpreted as arising from the biased reallocation of attentional resources, such that negative valence preferentially activates subcortical amygdalar pathways to prepare for sympathetic nervous system activation, drawing resources away from higher order cognitive processing (Anderson et al., 2003; Santos et al., 2011). Of note, there is some discrepancy in the literature, with some studies reporting faster, not slower, responses to threatening stimuli (i.e., behavioral responses: de Valk et al., 2015; neuronal responses: Vuilleumier et al., 2003). Such discrepancies likely reflect differences in the underlying cognitive requirements of tasks and the importance of subcortical vs. cortical areas for sensory processing.

Behavioral studies have also elucidated biases in reaction time to negative and positive faces based on the gender of an emotional face. Becker et al. (2007) reported that participants were not only faster and more accurate to judge angry-male face parings, compared to angry-female faces, but also faster and more accurate to judge happy-female pairings, compared to happy-male faces (see also Dimberg and Öhman, 1996; Aguado et al., 2009, for similar results). The angry-male and happy-female bias has also been demonstrated using visual imagery. Neutral male faces are more likely to be judged as angry compared to female neutral faces. When asked to imagine an angry face, participants tend to report the gender of the face as male, and, when asked to imagine a happy face they tend to report the gender of the face as female (Becker et al., 2007). These associations are so prevalent that feminine face structures (i.e., round and soft face contours) are associated with happiness, while more masculine face features (i.e., large forehead and square jaw) are associated with threat (Becker et al., 2007; Hess et al., 2009). Such associations are fairly ubiquitous, transcending the specific example provided above of face features and extending across sensory domains. In particular, rounder shapes tend to be associated with positive emotional valence, more pleasant and positive assessments, while angular shapes tend to be associated with more negative emotional valence, unpleasant and negative assessments (for some examples of associations between emotional valence and visual shapes see Palumbo et al., 2015; Bertamini et al., 2016; for some examples of associations between visual shapes and taste moderated by emotional valence see Salgado-Montejo et al., 2015; Velasco et al., 2015).

Furthermore, not only have gender biases for emotional processing been found in reaction time and perception, but the encoding and memory for emotional information is also modulated. Recall for happy female faces is superior to that for happy male faces, and recall for negative male faces is superior to that for negative female faces (Hofmann et al., 2006), which could further bias various aspects of sensory processing of emotional content. Our biases in associating anger with males and happiness with females has been argued to be an adaptive mechanism, such that facial structure and cognitive mechanisms may have evolved to maintain and optimize more efficient perception of angry males and happy females over angry females and happy males (reviewed in Tay, 2015).

It has been postulated that reaction time biases are driven not only by attentional allocation and salience, but also by learned social stereotypes and learned associations. Because our perception of faces is predicated on the evolutionary significance of identifying threat, our perceptual systems are tuned to associate patterns among threatening and social behaviors (Haselton and Buss, 2000). Taking an ecological and evolutionary perspective, Becker et al. (2007) further argue that the interaction of gender and emotion is representative of an interaction between social learning and evolutionary mechanisms. For example, a brief survey of criminal justice statistics reveals that, on average1, men commit significantly more violent crimes in the USA than women (Daly and Wilson, 1994; United States Department of Justice, 2010). It has also been shown that men tend to display more anger than women (Fabes and Martin, 1991). On the other hand, women tend to smile more (Shiota et al., 2004), possess superior empathizing skills (Baron-Cohen et al., 2003), and are thought to be more nurturing and caring compared to their male counterparts (Eagly and Crowley, 1986). Additionally, as noted by several authors (e.g., Todd et al., 2005; Becker et al., 2007; Tay, 2015), although the angry-male and happy-female association may be due, in part, to socialization, they may also stem from evolution. They argue that angry males tend to pose a greater threat than angry females because of inherent physiological differences in stature and social dominance, such that males are typically larger and possess more muscle than women. Therefore, selective pressures may have perceptually ossified the sexually dimorphic angry-male and happy-female into our visual systems.

Induced Mood and State Affect Bias the Processing of Emotional Faces

In addition to the role of gender in biasing the processing of affective faces, one’s mood has also been shown to bias the processing of the emotional content of a face. Previous work has examined the effects of induced mood on attentional biases and perceptual judgments. In general, people in a negative mood tend to focus their attention on specific features of a stimulus, whereas those in a positive mood exhibit more global stimulus processing (Schwarz and Clore, 1983; Gasper and Clore, 2002; Schwarz and Clore, 2003; Schmid et al., 2011). As Gasper and Clore (2002, p. 34) describe, “happier moods promote a greater focus on the forest and sadder moods a greater focus on the trees.” Furthermore, inducing a positive mood results in mood congruent biases in the deployment of exogenous attention, as measured by eye tracking, to happy compared to sad or neutral faces (Sanchez et al., 2014). Interestingly, inducing a negative mood results in mood-incongruent biases. For example, Sanchez et al. (2014) reported that a negative mood induction biased the deployment of exogenous attention to positive faces (see also Isaacowitz et al., 2008, 2009). It has been suggested that the directing of attention to positive faces when in a negative mood may help assuage negative feelings (Isaacowitz et al., 2009).

Mood induction has also been shown to bias how emotion is perceived in a face. Bouhuys et al. (1995) found that faces were judged more negatively subsequent to depressive mood induction compared to happy mood indication. Niedenthal et al. (2000) also induced moods of happy, sad or neutral and measured perceptual biases via a sequence of faces dynamically varying in emotional content to cover the full affective range from happy or sad. Participants viewed movies of faces slowly morphing from fully affective happy or sad emotions to neutral and judged when the emotion in the face was no longer perceptible, in other words, the point at which it appeared emotionally ambiguous or neutral. When the facial emotion and the mood induction emotion were congruent the percept of that emotion persisted longer than for incongruent pairs. In other words, for a happy mood induction and a dynamic face morphing from happy to neutral, happy emotions in the face were perceived for longer, such that the face considered neutral would be shifted further from happy and closer to neutral along the morph space continuum. These results suggest that induced mood can enhance sensitivity for perceiving congruent facial emotions.

Although a full review is beyond the scope of this paper, it should be noted that perceptual biases in perceiving emotion can result across a range of different methodologies used to induce mood. Many of the above studies induced mood via music or by having participants imagine emotionally charged situations or memories. However, mood can also be induced via sensorimotor manipulations, such as placing a pencil between the lips to passively create a smile configuration (e.g., Blaesi and Wilson, 2010; Marmolejo-Ramos and Dunn, 2013) and sensorimotor feedback may be important for the perceptual processing of emotional information (e.g., Wood et al., 2016).

Despite much research demonstrating the effect of induced mood in biasing the perceived emotion in a face, few studies have examined the role of state affect (your current mood, not experimentally induced) in biasing emotional processing. Interestingly, the influence of state affect in biasing emotional processing has been evaluated in clinical populations, and ignored, for the most part, in the non-clinical cohorts, which are the focus of the current study.

Although it is beyond the scope of this paper to provide an overview of the influence of state affect on emotional processing in clinical populations, we provide a few relevant examples of findings in clinical populations with depression, a mood disorder characterized by negative mood and/or irritability along with impaired functioning (DSM-5; American Psychiatric Association, 2013). Bouhuys et al. (1999) studied a cohort of patients with major depression and found that more negative evaluations of schematic faces at admission and discharge were associated with relapse. Additionally, patients who relapsed had judged schematic faces as more negative, compared to those who did not relapse. The authors posit that their findings suggest the perception of emotion in a face is state dependent, with more depressed states leading to more negative biases. Joormann and Gotlib (2006) used a dynamically changing morphed face task, such that a neutral face slowly morphed into a happy, sad, or angry expression and participants had to identify the point when the expression became perceivable. They found that individuals with major depression required more intense happiness to perceive that emotion, compared to healthy controls and participants with social phobia. In contrast, participants with social phobia required less emotional intensity to identify angry emotions compared to participants with major depression and healthy controls. In general, evidence suggests a mood-congruent bias in clinical cohorts, such that negative moods lead to a negative bias in attending to and remembering social information and positive moods lead to a positive bias, even within the same individual transitioning between different aspects of a mood disorder, such as bipolar disorder (e.g., García-Blanco et al., 2013).

The only study we are aware of which does not focus on clinical populations and considers the influence of state affect on the perception of emotion is a very recent study by Jackson and Arlegui-Prieto (2016). They used a dynamically morphing face task, similar to those used by Niedenthal et al. (2000) and Joormann and Gotlib (2006), to quantify perceptual biases. Faces were dynamically changing, morphing from emotionally neutral to fully happy, angry, sad, or surprised and participants had to judge when the dynamically changing emotion becomes perceivable (defined as emotional sensitivity) and when the participant was sure of their judgment (defined as conceptual sensitivity). Results indicated a mood-incongruency effect, such that more positive state affect led to a significant, yet small, decrease in perceptual and conceptual sensitivity to angry and sad expressions. Interestingly, though negative affect did not influence perceptual sensitivity, it modestly reduced conceptual sensitivity for angry and sad expressions. The authors argue that intense moods, positive or negative, may monopolize limited attentional resources (Kahneman, 1973), and reduce cognitive capacity for processing social cues efficiently.

Overall, despite much previous work demonstrating biases in reaction time or the allocation of attentional or memory resources in maintaining prioritized processing for angry-male and happy-female associations, we know of no studies to date that have directly quantified perceptual differences between emotional male and female faces. More specifically, we want to know whether what is considered emotionally neutral is or is not the same for male and female faces? If not, how different are the perceptions of emotionally neutral male and female faces? Furthermore, despite much previous work demonstrating the effect of induced mood in biasing the perceived emotion in a face, to our knowledge, only one recent study has investigated the influence of current state affect on biases in the perception of emotional face, and this study did not consider the influence of the gender of the face. Importantly, whereas the impact of state affect on the perception of emotion is commonly investigated in clinical populations, it is commonly ignored in non-clinical studies, and thus a missing aspect in most of the literature.

In sum, our study had three main aims: (1) to quantify perceptual biases in judging emotional information as a function of the gender of a face, (2) to determine the influence of current state affect on perceptual biases by correlating baseline biases in perceiving happy and angry male and female faces with measures of current positive and negative state affect and (3) to quantify biases in reaction time in judging emotional information as a function of face gender. Our cohort was a non-clinical population of undergraduate students.

We hypothesized that explicit measures for what is considered a neutral male face would be biased in the direction predicted by male faces being perceived as angrier [a more positive point of subjective equality (PSE) in our design] and perceptual biases for what is considered a neutral female face would be less pronounced or even biased in the opposite direction (a more negative PSE). Furthermore, we predicted that, just as induced mood could bias the perception of emotion in a face, that current state affect, the mood you bring to the experiment, could also bias the perception of emotion in a face. We hypothesized that positive affect would bias faces to be perceived as happier, yielding a more negative bias in the PSE, especially for female faces. Likewise, we hypothesized that negative affect would bias faces to be perceived as angrier, yielding a more positive bias in the PSE, especially for female faces. Finally, we hypothesized slower reaction times for angry relative to happy faces, and for angry male faces compared to angry females faces. However, we remained ambivalent regarding reaction time differences: given that our task was not a speeded reaction time task, even though participants had a limited time to respond, our experimental paradigm might not be sensitive enough to quantify the expected reaction time differences.

Materials and Methods

Participants

Participants, undergraduate and graduate students from the University of Massachusetts Boston, were recruited via email or posted flyers to participate in this study for monetary reward or for extra credit toward approved coursework in the undergraduate psychology curriculum. A total of 126 participants completed our experiment. In our sample, 89 participants self-identified as females and 37 self-identified as male, with no participants reporting a non-binary gender identity (overall mean age: 22.68 years; SEM: 0.5002; range: 18–64 years; for female participants: mean age: 22.98 years; SEM: 0.432; range: 18–45 years; for male participants: mean age: 24.24; SEM: 1.335; range: 18–64 years; see Table 1 for a breakdown by participant gender and ethnicity). There were no significant differences in age between male and female participants (p = 0.201). All participants gave informed consent and reported normal or corrected-to-normal vision. The study was approved by the University of Massachusetts Boston Institutional Review Board.

TABLE 1
www.frontiersin.org

TABLE 1. Participant demographics (N = 126).

Measures

We used the Positive and Negative Affect Scale – State Version (PANAS: Watson et al., 1988) to quantify current affective state when participants started our experiment. This widely used measure consists of 20 items across two subscales measuring positive and negative affect. This measure has been shown to have good reliability and validity (Watson et al., 1988; Mackinnon et al., 1999). For each item, participants indicate on a 5-point Likert scale how much they are experiencing each emotion. We used the PANAS to account for state-level arousal, which was broken down into an overall composite measure for positive affect and an overall composite measure for negative affect.

Stimuli

Test face stimuli consisted of eight unique facial identities (with the following racial breakdown, five White, two Asian, and one Black). Faces were selected from the NimStim face database (Tottenham et al., 2009). The NimStim database includes faces rated and scored for their validity of emotional expression (Tottenham et al., 2009). For our study we only used face exemplars from the NimStim database with validity ratings of 75% or higher for happy and angry expressions.

Test faces from the NimStim database which met the criterion specified above were selected. For each of eight unique face identities (four male and four female) we selected the face from the dataset specified as 100% happy, 100% angry and neutral for each unique identity). We used the MorphMan software package (STOIK Imaging, Moscow, Russia) to morph a face. We placed points on prominent face features: eyebrow ≈ 28 mean points; eyes ≈ 30 mean points; nose ≈ 14 mean points; mouth ≈ 22 mean points; face contour ≈ 18 mean points (for example see Figure 2, Harris and Ciaramitaro, 2016). Spatial differences between neutral and 100% angry faces and neutral and 100% happy faces of the same identity were gradually connected by different increments to create a continuum of morphed faces ranging from neutral to angry with morphs representing 10, 20, 40, and 80% angry and the complementary percentages, with morphs representing 10, 20, 40, and 80% happy. The 100% happy, 100% angry and neutral face for each unique face identity and emotion were set as the default NimStim face stimuli. In sum, we had 8 unique face identities, each with eight emotional face morphs and one neutral face, for a total set of 72 potential test face stimuli.

All faces were gray-scaled 50% and were embedded within a gray oval to occlude non-relevant, potentially distracting stimuli, such as hair and clothing. Stimuli were 595 pixels × 595 pixels on the screen and were presented so as to subtend a visual angle of ∼19.8°.

Apparatus

Face stimuli were presented on a Nexus cathode ray-tube (CRT) monitor. Stimulus presentation was controlled using MATLAB and the psychophysics toolbox (Brainard, 1997; Pelli, 1997). Participants were seated 45 cm away from the CRT monitor and used a chin and forehead rest to maintain stable head position and a consistent viewing distance from the screen to ensure visual stimuli subtended the same visual angle across participants. All participants were instructed to maintain central fixation, but eye position was not monitored.

Procedure

For the first 180 s, participants were instructed to fixate gaze on a fixation cross located at the center of a blank gray screen. After 180 s an auditory alerting cue (500 hz) indicated an upcoming test face. A morphed test face was then presented for 1 s followed by a question mark for 1.5 s. While the question mark was displayed, participants judged if the face appeared happy or angry using the laptop keyboard; pressing the ‘z’ key for faces judged happy and the ‘x’ key for faces judged angry. Across trials, test faces were presented randomly and between each test image a blank screen with a fixation cross was presented for 8 s. The baseline block consisted of 64 total trials, eight trials for each happy and each angry probe image (40%, 20%, 10% and neutral), except for the 80% happy and 80% angry probe images where only four trials were presented for each of the eight unique facial identities. Figure 1 depicts the experimental methods.

FIGURE 1
www.frontiersin.org

FIGURE 1. Experimental procedure. Participants judged a series of morphed male and female test images (eight unique face identities, four male and four female; each identity morphed along an emotional continuum from angry to neutral to happy), which were selected at random, as either happy or angry. A fixation cross appeared at screen center (180 s), which participants were asked to fixate. Then a brief auditory cue (500 hz) alerted participants to an upcoming morph test face, which was displayed for 1 s, followed by a question mark (1.5 s), during which time participants judged if the previously displayed test face was happy or angry. After the question mark a fixation cross appeared at screen center (8 s).

Data Analysis

Quantifying Biases in the Perception of Angry and Happy Male and Female Faces

We calculated each participant’s unique neutral point, or PSE, by fitting percent correct data points with a cumulative normal function and determining the percent morph that would support 50% happy/angry judgments performance on our task.

At the PSE, the participant is equally likely to judge a face as happy or angry. In other words, the PSE is the percent face morph that is emotionally ambiguous, judged as either happy or angry at chance levels, thus providing us with each participant’s unique neutral face image. In order to examine responses to female and male faces, we plotted responses to male and female faces separately and fit each dataset to determine unique neutral points for male and female faces. Figure 2 depicts a hypothetical data set and the resulting fit and derived PSE using our analysis method. In this example, the PSE for male faces was at 15% happy, implying that to see a male face as neutral it needs more happiness in it, i.e., that male faces are perceptually biased to be seen as angrier. Likewise, in this example, the PSE for female faces was at 5% angry, implying that to see a female face as neutral it needs more anger in it, i.e., that female faces are perceptually biased to be seen as happier. Overall, for this hypothetical data from a single participant, male faces were perceived, on average, as 20% angrier than female test faces.

FIGURE 2
www.frontiersin.org

FIGURE 2. Determining point of subjective equality (PSE) and theoretical predictions. The x-axis represents the morphed face continuum from angry to happy, with 0 being the standard neutral from the NimStim dataset. The y-axis represents the percentage of happy responses. Data points were fit using a cumulative normal function. The solid black line represents hypothetical responses to female faces and the dotted line represent hypothetical responses to male faces. We determined each participant’s PSE, by measuring what morph supported 50% happy judgments, where the face was equally likely to be judged as happy or angry, for both male and female faces. Arrows represent hypothetical PSEs for male and female test faces. We predicted male faces would have a more positive PSE than female faces, indicating that more happiness is required to see the male face as neutral, suggesting male faces are perceived as angrier. We predicted female faces would have a more negative PSE than male faces, indicating that more anger is required to see the female face as neutral, suggesting female face are perceived as happier. The area shaded in gray indicates PSE values suggestive of a negative or angry bias.

We determined perceptual biases using the PSE as our measure, which allows us to quantify each participant’s unique neutral point in perceiving the emotion in a face. To compare and contrast this measure with a more common measure, we also determined biases in percent of judgments for a given emotion to the standard neutral face, as defined by the NimStim database (this is represented as the zero point along our morph continuum).

Quantifying Biases in Reaction Times to Happy and Angry Male and Female Faces

Reaction time was quantified as the time, in msec, needed to judge the previously presented face as angry or happy via button press, limited to the window in time when the question mark was displayed (1.5 s). Although our task was not a speeded reaction time task, as participants did not have to respond as quickly as possible, there was nonetheless a limited window of time during which responses could be made. If participants responded too early, before the question mark was displayed, or if they failed to respond in the allotted time during which the question mark was displayed, 1.5 s, the next trail commenced. Such missed trials were discarded, not scored as incorrect. Thus, response time was constrained and it should be possible to tease out reaction time biases for responses in our experimental design.

For each participant, we quantified the reaction time of responses uniquely for each pairing of gender and emotion, male and female happy faces and male and female angry faces. We only considered responses to the most extreme exemplars of emotion in our stimulus set, the 80% face morphs, as it is expected that biases in reaction time should be strongest when the emotional valence of stimuli is strongest (e.g., Marmolejo-Ramos and Dunn, 2013).

Parametric statistics were used for analysis as our data was normally distributed, with no concerning values of skew or kurtosis. We considered our data normally distributed if skew/kurtosis were between -1.5 and +1.5 (e.g., Tabachnick and Fidell, 2013). This was true with the exception of three vectors of data: values for negative affect, slope estimates for male faces, and reaction times measures for happy female faces. These data vectors were transformed to be normally distributed (see Marmolejo-Ramos and Gonzalez-Burgos for a useful comparison of normality tests). We applied an inverse transformation to negative affect and slope measures male as well as female faces, since these measures had to be compared to each other. We applied a square root transformation to reaction time for happy female as well as happy male faces since these values had to be compared to each other.2 In the statistics reported in the results section, these transformed variables were used to conduct analyses of our data using parametric statistics. All values for skewness and kurtosis are outlined below in Table 2, including the before and after measures for transformed data vectors for slope for male faces, reaction times to happy female faces and measures for negative affect (see Table 2B).

TABLE 2A
www.frontiersin.org

TABLE 2A. Normality of data vectors.

TABLE 2B
www.frontiersin.org

TABLE 2B. Normality of data vectors pre- and post-normalization.

Data were analyzed using a two-tailed paired t-test for the PSE (unique neutral point), the judgments at the standard neutral point, and for reaction time measures. We also conducted a correlation analysis to examine the relationship between perceptual biases, (for unique neutral and standard neutral) and current state affect, as assessed by the negative and positive composite affect measures of the PANAS. As an additional post hoc analysis to consider the influence of gender of the participant, we not only considered our entire data sample of 126 participants (89 females), but also a subset including equal numbers of female and male participants matched in mean age and age range. This subsample consisted of 33 males (mean age: 21.97 years; SEM 0.52, range 18–28 years) and 33 females (mean age: 22 years, SEM: 0.53; age range: 18–28 years).

Results

Of the 64 trials presented (32 female test faces and 32 male test faces), our 127 participants completed an average of 29.38 male test trials (SEM: 0.246) and 29.10 female test trials (SEM: 0.276). Data for male test faces included 3,732 trials and for female test faces included 3,696 trials across participants. Trials not completed were excluded, not counted as incorrect, and were the result of failure of the participant to respond in the allotted time.

Data from a single representative participant is shown in Figure 3. The morph test face continuum is plotted on the x-axis, with males on the right and females on the left. For a given gender, angry emotions are plotted to the left of the neutral face and happy emotions are plotted to the right of the neutral face. For this participant, the male faces judged to be happy 50% of the time contained 12.703% happy, whereas the female faces judged 50% happy contained 3.192% angry. This demonstrates that male faces required almost 13% more happiness to be perceived as perceptually neutral, indicating that a mathematically neutral male face (the zero point) was perceived as angry. Likewise, for this participant, female faces required 3% more anger to be perceived as perceptually neutral, indicating that a mathematically neutral female face was perceptually biased to appear happy.

FIGURE 3
www.frontiersin.org

FIGURE 3. Single participant sample data and psychometric fits. Data and PSE estimates from fits with a cumulative normal function are shown for a single participant for male (left) and female (right) test faces. The x-axis depicts the morph continuum from 80% angry to 80% happy for a given face gender, with the gray shaded area highlighting an angry bias and neutral highlighting the standard neutral face as defined by the NimStim dataset. The y-axis depicts percent correct for happy judgments. The black curve is a fit to the data, with each datapoint showing percent happy judgments for a given face morph. Chance performance is at 50%, and values less than 50% indicate a judgment of angry. For this sample participant, the PSE for male test faces was 12.703% happy (shown on the right) and 3.193% angry for female test faces (shown on the left). This suggests that, for this participant, male faces required more happiness to be perceived as neutral, while female faces required less happiness to be perceived as neutral.

Across participants, perceptual biases in the unique neutral point, as determined by the PSE, are plotted in Figure 4A. A paired two-tailed t-test was used to test our main hypotheses that there would be a difference in PSE between male and female test images. We expected that male test faces would be judged more negatively than female test faces. There was a significant main effect for the within subjects factor, with male test faces eliciting a more positive PSE, compared to female test faces [t(125) = 3.190, p = 0.002], indicating that a happy male morph was considered perceptually neutral, an overall negative, angry, bias in perceiving male faces. Post hoc analyses revealed that the male face judged as neutral, the morph equally likely to be judged as happy or angry (the PSE), was significantly differed from zero, the “neutral” face defined by the NimStim Faceset [two-tailed t-test male faces: t(125) = 3.899, p < 0.000]; the female face judged neutral was not significantly different from zero [t(125) = 1.160, p = 0.248]. Interestingly, we found no interaction of the gender of the participant with PSE [F(2,124) = 1.062, p = 0.305, ηp2 = 0.008; Bonferroni corrected]. The same pattern of results reported above were found for both male and female participants for a subset of our data including the same number of age-matched male and female participants [F(1,65) = 0.358, p = 0.552, ηp2 = 0.006].

FIGURE 4
www.frontiersin.org

FIGURE 4. Perceptual biases across participants: average unique neutral point (PSE) and average standard neutral. Perceptual biases, as assessed by PSE, unique neutral, are displayed on the left (A). The x-axis depicts the gender of the test face, while the y-axis depicts the mean PSE, the percent morphed judged affectively neutral) (±SEM across participants). A value of 0 would indicate no bias (the PSE equals the standard neutral) with the gray shaded area indicating a positive value and an angry bias. Overall, the PSE for male test faces is more positive, happier, than for female test faces, suggesting that male faces require more happiness to be perceived as neutral and are biased to be perceived as angrier. Perceptual biases, as assessed by judgments of the standard neutral (as defined in the NimStim dataset), are displayed on the right (B). The x-axis depicts the gender of the test face, while the y-axis depicts the mean percent correct for happy judgments (±SEM across participants). A value of 50% would indicate no bias, with the gray shaded area highlighting an angry bias. Overall, the percent of happy judgments for male test faces is significantly smaller than for female test faces, suggesting that male faces are biased to be perceived as angrier (∗∗p < 0.01, ∗∗∗p < 0.001).

Our estimate of the PSE provides us with a single value, where a given face feature, emotion, is truly neutral. We can also assess the rate of change in judging features of a face, the slope of our fits to the data. A steeper slope would indicate judgments of emotion in a face are more categorical, with participants judging most faces as either angry or happy, while a shallower slope would indicate that judgments of emotion in a face are more changing more gradually. We found no significant difference in the rate of change for emotional judgments (as estimated by slope) between male or female faces [t(125) = -1.009, p = 0.315; data not shown].

Given that most studies reporting biases in perceived emotion look at biases in judgments of ‘neutral’ faces, as defined by a standardized dataset, rather than the unique neutral point for each participant, we also examined biases in responses to standard neutral faces (see Figure 4B). A paired two-tailed t-test found a significant main effect of face gender [t(125) = -4.581, p = 0.000], with male test faces being rated angrier compared to female test faces. Post hoc analyses revealed that both male and female test faces were judged significantly different from chance, 50% [two-tailed t-test male faces: t(125) = -7.041, p = 0.000; female faces: t(125) = -2.391, p = 0.018]. Post hoc MANOVA analyses revealed a significant interaction of participant gender with judgments of the standard neutral [F(2,124) = 5.190, p = 0.024, ηp2 = 0.040; Bonferroni corrected]: male participants judged standard female neutral faces to be significantly happier than female participants did [F(1,124) = 4.200, p = 0.043]. A similar pattern of results, a significant interaction of participant gender with judgments of the standard neutral were present in the subset of data including the same number of age-matched male and female participants [F(1,65) = 8.905, p = 0.006, ηp2 = 0.112]. In this smaller dataset we found the same non-significant trend: male participants tended to judge female neutral faces as happier than female participants did.

A Pearson correlation was used to test the relationship between positive affect and perceptual biases at the unique neutral point (PSE) as a function of face gender (see Figure 5A). We found a significant, albeit weak, negative correlation between positive affect and happy judgments to female (r = -0.370, p = 0.000) faces, with a marginal trend in the same direction for male faces (r = -0.151, p = 0.093). Essentially, as one’s positive affect increases, judgments for female faces are biased to be happier and the PSE becomes more negative. We found no significant correlation (data not shown) between negative affect and perceptual biases in the judgment of emotional male (r = -0.084, p = 0.347) and female faces (r = 0.046, p = 0.61). In terms of correlations between positive affect and the rate of change of perceptual judgments around unique neutral (slope), we found a significant, albeit weak, positive correlation for female faces (r = 0.242, p = 0.006), with no significant correlation for male faces (r = 0.062, p = 0.492). This suggests that as positive affect increases, the perceptual distinction between happy and angry female faces becomes more distinct or categorical. A consideration of gender of the participant suggests that the correlation between positive affect and the perception of emotional faces, as assessed by the PSE, is driven by female participants; the correlation is not significant in male participants. If we consider our entire sample of 89 female participants, the correlation is significant between positive affect and perceptual judgments of female faces (r = -0.382, p = 0.000) as well as male faces (r = -0.265, p = 0.012), whereas, if we consider the smaller subset of 33 age-matched female participants, the correlation is significant between positive affect and perceptual judgments but only for male faces (r = -0.457, p = 0.007; female faces: (r = -0.302, p = 0.088). However, the effect size for our subset of female participants remains medium sized.

FIGURE 5
www.frontiersin.org

FIGURE 5. Correlations between Positive State Affect and Perceptual Biases. (A) Correlations between each participant’s unique neutral (PSE) and their positive affect, as assessed by the PANAS, are shown on the top for male faces (left) and female faces (right). Each data-point reflects joint measures from a unique participant. The x-axis depicts positive affect scores, while the y-axis depicts PSE. As positive affect increases the PSE for female faces becomes significantly more negative, suggesting that female faces were biased to be perceived as happier, with trends in the same direction for make faces. (B) Correlations between each participant’s judgment of the standard neutral and positive affect are shown on the bottom, for male faces (left) and female faces (right). The x-axis depicts positive affect scores, while the y-axis depicts ratings of the standard neutral face. As positive affect increases the standard neutral female face was judged significantly happier, with trends in the same direction for the standard neutral male face. In each case the gray shaded area depicts a bias toward angry, with either 0 (top) or 50% (bottom) indicating no bias in judging emotions.

We also examined the correlation between positive affect and perceptual biases of the standard ‘neutral’ face as a function of face gender (see Figure 5B). We found a significant, albeit weak, positive correlation between positive affect and happy judgments to female faces stimuli (r = 0.248, p = 0.005) and no significant trends for male faces (r = 0.170, p = 0.057). Essentially, as one’s positive affect increases, judgments to ‘neutral’ female faces are biased to be happier. We found no significant correlation (data not shown) between negative affect and perceptual biases in the judgment of emotional male (r = 0.105, p = 0.242) and female faces (r = -0.016, p = 0.863). As in the above analysis, a consideration of gender of the participant suggests that the correlation between positive affect and the perception of emotional faces here is driven by female participants; there is no significant correlation in male participants. If we consider our entire sample of 89 female participants, the correlation is significant between positive affect and perceptual judgments of female faces (r = -0.382, p = 0.000) as well as male faces (r = -0.265, p = 0.012), whereas, if we consider the smaller subset of 33 age-matched female participants, the correlation is significant between positive affect and perceptual judgments but only for male faces [r = -0.362, p = 0.038; female faces: (r = -0.152, p = 0.397)].

To test whether gender of the face differentially biased reaction times to angry and happy faces, we used a paired two-tailed t-test. Figure 6 plots overall mean reaction times to angry faces as well as happy faces, broken down by face gender. Mean reaction times were significantly slower to angry male faces compared to angry female faces [t(125) = 2.366, p = 0.020]. We found no significant differences in mean reaction time to happy male vs. female faces [t(125) = -1.752, p = 0.082]. Confirming previous findings in the literature (i.e., angry vs. happy: Becker et al., 2007; fearful vs. happy: Palermo and Coltheart, 2004), we also found a significant effect of reaction time as a function of positive vs. negative emotional valence, such that mean reaction times to angry faces, male or female, were slower relative to mean reaction times to happy faces, male or female [t(125) = 2.289, p = 0.024]. Finally, Post hoc analyses revealed a significant interaction of the gender of the participant with reaction time [F(2,124) = 15.349, p = 0.000, ηp2 = 0.110; Bonferroni corrected], such that males showed overall slower responses, compared to females, regardless of the emotion or gender of the face. The same pattern of results reported above, with significant differences between male and female participants, was also found for a subset of our data including the same number of age-matched male and female participants [F(1,65) = 4.269, p = 0.043, ηp2 = 0.063].

FIGURE 6
www.frontiersin.org

FIGURE 6. Reaction time results across participants. Data plots mean reaction time for all judgments to 80% angry male and female (left) and 80% happy male and female (right) face morphs. The x-axis depicts the emotion and gender pair, while the y-axis represents mean reaction time, in ms (±SEM across participants). While significant reaction time differences were observed between angry male and angry female faces, no significant reaction time differences were observed between happy male and happy female faces (p < 0.05; ns indicates results are not significantly different).

Discussion

Our experiment implemented a novel approach to quantify biases in the perception of emotion, angry vs. happy, in male and female faces. We used a morphed face psychophysical task to quantify the strength of associating male faces with angry emotions and female faces with happy emotions. We further sought to compare and contrast our measure of unique neutral across participants with previously reported biases in processing emotion as a function of the gender of the face, namely biases in reaction time and biases in judging standard neutral faces. Finally, despite the common use of assessing current state affect and examining influences on emotional processing in clinical populations, or the common use of explicitly inducing mood and examining influences on emotional processing in non-clinical populations, to the best of our knowledge, ours is the second study to examine the influence of current state affect on emotional processing in a cohort of non-clinical controls (see Jackson and Arlegui-Prieto, 2016, for a related study using a dynamically morphing face paradigm). On an additional note, for some analyses we find interesting, but not always consistent, effects of gender of the participant. Further research will be needed to fully delineate such gender effects.

We confirm and extend previous findings highlighting that male faces are biased to be perceived as angrier than female faces (Hofmann et al., 2006; Becker et al., 2007). Our results reveal that male faces are biased to be perceived as angrier, requiring an average of 4.5% more happiness to be perceived as emotionally neutral. While this may seem like a small bias, this finding implies that males are subtly being seen as more angry than they may be intending to portray. This subtle bias may be compounded by previous findings that men tend to display more anger than women (Fabes and Martin, 1991).

However, more research is needed to determine the factors that may lead to participants interpreting faces as angrier. Interestingly, we did not find that female faces were perceptually biased to be perceived as happier; rather, they simply required less happiness to appear perceptually neutral compared to male test faces, and thus were less biased to be seen as angry. This finding, that women are seen as less angry, could have important implications for the extent to which anger is expressed in women, as women are often judged negatively if they express anger (Brescoll and Uhlmann, 2008). Interestingly, expressions of anger have been shown to bias gender neutral faces to be judged as more masculine, while expressions of happy or fear have been shown to bias gender neutral faces to be judged as more feminine (Hess et al., 2009). Thus, the interactions between face emotion and face gender are bidirectional and interrelated. However, in a recent study, Harris and Ciaramitaro (2016) found that certain combinations of features of a face are more susceptible to contingent adaptation than others, highlighting a special status for angry male faces. Thus, angry male faces were found to be resistant to the effects of adaptation, revealing that select pairings of emotion and gender may show asymmetric effects and, at least in the case of adaptation effects, are not necessarily equally effective in either direction.

More explicitly, Harris and Ciaramitaro (2016) used a psychophysical face adaptation task (see Webster and MacLeod, 2011 for review), where participants were repeatedly exposed, or adapted, to unique combinations of gender-emotion pairings (i.e., angry female and happy male faces). Results revealed that the categories of gender and emotion are capable of being processed jointly, though only for certain stimulus combinations. Thus, repeated exposure, or adaptation, to angry female and happy male faces led to contrasting and opposite aftereffects with female faces judged happier and male faces judged angrier, suggesting jointly tuned mechanisms for processing face gender and emotion. However, repeated exposed to angry males and happy females led to female faces judged angrier, while male faces did not adapt, and rather than being judged happier, were judged even angrier. The authors postulated that the salience of angry male faces may have biased the strength of adaptation, due to their adaptive significance. The results from the present study add to the findings of Harris and Ciaramitaro (2016), confirming and extending evidence for association of males with anger.

Perceptual Biases: Unique Neutral (PSE) vs. Standard Neutral

While it is beyond the scope of the current paper, it is of interest that the perceptual effects measured by quantifying unique neutral (PSE) vs. assessing judgments of the standard neutral are complementary, albeit in opposite directions. More specifically, judgments of standard neutral faces would be biased toward angry if participants judge faces to be angrier. However, measures of the PSE would indicate a bias toward judging faces as angrier if the PSE is shifted toward happier face morphs, indicating that more happiness is needed to perceive a face as neutral, i.e., more happiness is needed to offset the negative bias.

One additional factor of interest that quantifying the PSE affords us is an assessment of the rate of change, or slope, in judgments of how perceptually distinct emotionally ambiguous faces appear. A steeper slope suggests a more categorical division of emotion compared to a shallower slope. Though we do not find significant differences in slope between judgments of male and female faces, we find a weak positive correlation between positive affect and slope. These results suggest that as one feel more positive, their judgments of emotion become more categorically distinct.

The Influence of Current State Affect on Perceptual Biases

We find it interesting that state affect is a measure often taken into consideration for clinical studies, while mostly ignored in non-clinical cohorts. Given that explicitly inducing mood in non-clinical cohorts can alter biases in the perception of emotion, it stands to reason that current state affect should also be considered as a moderating factor for the processing of emotional information.

As a case in point, our study demonstrates that a participant’s state affect can bias their perception of emotional information in a face. We found that more positive state affect was correlated with more positive biases in emotional perception for both male and females faces. This finding implies that faces are interpreted differently depending on the moment by moment changes in a person’s affect. Interestingly, and similar to the results of Jackson and Arlegui-Prieto (2016) on perceptual sensitivity, the correlation we find between state affect and perceptual judgments only held true for positive state affect, not negative state affect. In our study, this may be because we had an unselected sample and so the range of negative affect was more restricted, compared to samples of individuals who are clinically depressed as seen in some of the previous literature.

Reaction Time Biases

Similar to findings from Becker et al. (2007), we find overall slower reaction times to angry compared to happy faces and no difference in reaction times to happy male vs. happy female faces. Unlike the results of Becker et al. (2007), we find slower reaction times to angry male vs. angry female faces.

It is important to note that our study was not optimized to measure reaction time effects since participants were not instructed to respond as quickly as possible, as in traditional reaction time tasks. Given that we nonetheless found significant effects on reaction time, this suggests that reaction time effects may have been even stronger if participants had been instructed to respond as quickly as possible. The directionality of our effects, longer reaction times for more threatening stimuli, may arise from the more cognitive demands of our task, requiring participants to discriminate whether a given face morph was more angry or more happy, rather than detect an emotion and react as quickly as possible.

Significance

Our results deepen our understanding of the perceptual mechanisms and differences between the processing of emotion in male and female faces. Aligning with the ecological perspective of face processing, associative learning or socialization may drive the association bias we find that males are perceptually biased to be seen as angrier. It has been suggested that constructs of dominance and affiliation, which are associated with masculinity vs. femininity, might drive biases in social perception more than masculinity and femininity, per se. To further understand how this bias emerges, implementing this same methodology along the life-span may elucidate when these associations develop as well as reveal historical indicators which moderate these effects. Implementing this psychophysical approach to studying perceptual biases could be potentially used with clinical populations, both for research and practice. It is also possible that such biases are not driven by learning and socialization, but by inherent morphometric differences in structural features that bias male faces to be perceived as angrier than female faces. For example, as others have highlighted, faces perceived as more masculine are more likely to have square jaws and thicker eyebrows, features which have been associated with dominance (i.e., Keating et al., 1981; Keating, 1985; Zebrowitz, 1997; Senior et al., 1999) and unpleasant and negative associations (i.e., Palumbo et al., 2015; Salgado-Montejo et al., 2015; Velasco et al., 2015; Bertamini et al., 2016). Conversely, faces perceived as more feminine are more likely to have rounded baby-faces and large eyes, which have been associated with approachability (Berry and Brownlow, 1989; Brown and Perrett, 1993; Burton et al., 1993) and pleasant and positive associations (i.e., Palumbo et al., 2015; Salgado-Montejo et al., 2015; Velasco et al., 2015; Bertamini et al., 2016).

Furthermore, our results highlight the importance of measures of state affect when studying the processing of emotional information, pointing to the potential importance of matching participants on measures of state affect given the significant influence of current mood on processing the information conveyed by facial expression. Matching participants on current affective state could be beneficial for studies involving non-clinical cohorts, as well as studies involving clinical cohorts. Clinical studies often consider both state and trait affect, but matching on state affect may allow for cleaner comparisons between non-clinical and clinical samples.

Limitations

As with all research, this study has a number of limitations. In our attempt to have distinct experimental conditions, we had to limit the emotions represented in that there was a forced choice of two emotions rather than capturing emotions on a continuum or allowing for the presence of more than one emotion simultaneously. Similarly, faces were identified as male or female without taking into account faces that are more androgynous to represent the full continuum of gender and not just the poles of the gender binary. Additionally, our undergraduate sample of 126 participants was largely female. Although we did not find a significant effect of gender of the participant, we cannot exclude the possibility that the lack of a significant effect of participant gender could in part be attributed to low statistical power. We acknowledge a broad literature demonstrating a female advantage in emotional face perception (see Kret and De Gelder, 2012, for review). Finally, because our measure of affect was based on self-report there is the possibility that participants may have been influenced by social desirability; however, to reduce this possibility we had participants submit these ratings into a folder to keep the experimenter from directly seeing their ratings.

Author Contributions

Toward this project, DH contributed to stimulus generation, data collection, data analysis and interpretation, and writing of the manuscript. SH-S contributed to experimental design, data interpretation and writing of the manuscript. VC contributed to experimental design, stimulus presentation, data analysis and interpretation, and writing of the manuscript.

Funding

This work was supported by the UMass Boston Dean’s Research Fund and the UMass Boston Department of Psychology Research Fund to VC and SH-S and by UMass Boston undergraduate research funds.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank a wonderful and dedicated team of undergraduate research assistants for all their hard work and help with data collection and analysis, especially Anh Phan, Brandon Mui, and Sarah Izen. We also wish to thank Daniel Paulus, Annalisa Groth, and two anonymous reviewers for helpful feedback on earlier versions of this manuscript.

Footnotes

  1. ^Please note that this research is based on averages and that not all men and women hold these characteristics associated with their gender group.
  2. ^Of note, a Kolmogorov–Smirnov test for normality confirmed that we could not reject the null hypothesis: reaction time measures were normally distributed for happy female faces (p = 0.264) and happy male faces: (p = 0.665).

References

Aguado, L., Garcia-Gutierrez, A., and Serrano-Pedraza, I. (2009). Symmetrical interaction of sex and expression in face classification tasks. Atten. Percept. Psychophys. 71, 9–25. doi: 10.3758/APP.71.1.9

CrossRef Full Text | Google Scholar

American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders, 5th Edn. Arlington, VA: American Psychiatric Association.

Google Scholar

Anderson, A. K., Christoff, K., Panitz, D., De Rosa, E., and Gabrieli, J. D. E. (2003). Neural correlates of the automatic processing of threat facial signals. J. Neurosci. 23, 5627–5633.

Google Scholar

Andrew, R. J. (1963). Evolution of facial expression. Science 142, 1034–1041. doi: 10.1126/science.142.3595.1034

CrossRef Full Text | Google Scholar

Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., and Wheelwright, S. (2003). The systemizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philos. Trans. R. Soc. B Biol. Sci. 358, 361–374. doi: 10.1098/rstb.2002.1206

CrossRef Full Text | Google Scholar

Becker, D. V., Kenrick, D. T., Neuberg, S. L., Blackwell, K. C., and Smith, D. M. (2007). The confounded nature of angry men and happy women. J. Pers. Soc. Psychol. 92, 179–190. doi: 10.1037/0022-3514.92.2.179

CrossRef Full Text | Google Scholar

Berry, D. S., and Brownlow, S. (1989). Were the physiognomists right? Personality correlates of facial babyishness. Pers. Soc. Psychol. Bull. 15, 266–279. doi: 10.1177/0146167289152013

CrossRef Full Text | Google Scholar

Bertamini, M., Palumbo, L., Gheorghes, T. N., and Galatsidas, M. (2016). Do observers like curvature or do they dislike angularity? Br. J. Psychol. 107, 154–178. doi: 10.1111/bjop.12132

CrossRef Full Text | Google Scholar

Blaesi, S., and Wilson, M. (2010). The mirror reflects both ways: action influences perception of others. Brain Cogn. 72, 306–309. doi: 10.1016/j.bandc.2009.10.001

CrossRef Full Text | Google Scholar

Bouhuys, A. L., Bloem, G. M., and Groothuis, T. G. (1995). Induction of depressed and elated mood by music influences the perception of facial emotional expressions in healthy subjects. J. Affect. Disord. 33, 215–226. doi: 10.1016/0165-0327(94)00092-N

CrossRef Full Text | Google Scholar

Bouhuys, A. L., Geerts, E., and Gordijn, M. C. (1999). Depressed patients’ perceptions of facial emotions in depressed and remitted states are associated with relapse: a longitudinal study. J. Nerv. Ment. Dis. 187, 595–602. doi: 10.1097/00005053-199910000-00002

CrossRef Full Text | Google Scholar

Brainard, D. H. (1997). The psychophysics toolbox. Spat. Vis. 10, 433–436. doi: 10.1163/156856897X00357

CrossRef Full Text | Google Scholar

Brescoll, V. L., and Uhlmann, E. L. (2008). Can an angry woman get ahead? Status conferral, gender, and expression of emotion in the workplace. Psychol. Sci. 19, 268–275. doi: 10.1111/j.1467-9280.2008.02079.x

CrossRef Full Text | Google Scholar

Brown, E., and Perrett, D. I. (1993). What gives a face its gender? Perception 22, 829–840. doi: 10.1068/p220829

CrossRef Full Text | Google Scholar

Burton, A. M., Bruce, V., and Dench, N. (1993). What’s the difference between men and women? Evidence from facial measurement. Perception 22, 153–176.

Google Scholar

Chevalier-Skolnikoff, S. (1973). Ethnological Studies of Child Behaviour. N. BLURTON JONES. Am. Anthropol. 75, 1786–1787. doi: 10.1525/aa.1973.75.6.02a00090

CrossRef Full Text | Google Scholar

Daly, M., and Wilson, M. (1994). “Evolutionary psychology of male violence,” in Male Violence, ed. J. Archer (New York, NY: Routledge), 253–288.

Google Scholar

Darwin, C. (1872). The Expression of Emotion in Man and Animals. London: Murray.

Google Scholar

de Valk, J. M., Wijnen, J. G., and Kret, M. E. (2015). Anger fosters action. Fast responses in a motor task involving approach movements toward angry faces and bodies. Front. Psychol. 6:1240. doi: 10.3389/fpsyg.2015.01240

CrossRef Full Text | Google Scholar

Dimberg, U., and Öhman, A. (1996). Behold the wrath: psychophysiological responses to facial stimuli. Mot. Emot. 20, 149–182. doi: 10.1007/BF02253869

CrossRef Full Text | Google Scholar

Eagly, A. H., and Crowley, M. (1986). Gender and helping behavior: a meta-analytic review of the social psychological literature. Psychol. Bull. 100, 283–308. doi: 10.1037/0033-2909.100.3.283

CrossRef Full Text | Google Scholar

Eastwood, J. D., Smilek, D., and Merikle, P. (2003). Negative facial expression captures attention and disrupts performance. Percept. Psychophys. 65, 352–358. doi: 10.3758/BF03194566

CrossRef Full Text | Google Scholar

Ekman, P., and Friesen, W. V. (1971). Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17, 124–129. doi: 10.1037/h0030377

CrossRef Full Text | Google Scholar

Fabes, R. A., and Martin, C. L. (1991). Gender and age stereotypes of emotionality. Pers. Soc. Psychol. Bull. 17, 532–540. doi: 10.1177/0146167291175008

CrossRef Full Text | Google Scholar

Fox, E., Lester, V., Russo, R., Bowles, R. J., Pichler, A., and Dutton, K. (2000). Facial expressions of emotion: are angry faces detected more efficiently? Cogn. Emot. 14, 61–92. doi: 10.1080/026999300378996

CrossRef Full Text | Google Scholar

García-Blanco, A. C., Perea, M., and Livianos, L. (2013). Mood-congruent bias and attention shifts in the different episodes of bipolar disorder. Cogn. Emot. 27, 1114–1121. doi: 10.1080/02699931.2013.764281

CrossRef Full Text | Google Scholar

Gasper, K., and Clore, G. L. (2002). Attending to the big picture: mood and global versus local processing of visual information. Psychol. Sci. 13, 34–40. doi: 10.1111/1467-9280.00406

CrossRef Full Text | Google Scholar

Gibson, J. J. (1979). The Ecological Approach to Visual Perception. Boston: Houghton Mifflin.

Google Scholar

Harris, D. A., and Ciaramitaro, V. M. (2016). Interdependent mechanisms for processing gender and emotion: the special status of angry male faces. Front. Psychol. 7:1046. doi: 10.3389/fpsyg.2016.01046

CrossRef Full Text | Google Scholar

Haselton, M. G., and Buss, D. M. (2000). Error management theory: a new perspective on biases in cross-sex mind reading. J. Pers. Soc. Psychol. 78, 81–91. doi: 10.1037/0022-3514.78.1.81

CrossRef Full Text | Google Scholar

Hess, U., Adams, R. B., Grammer, K., and Kleck, R. E. (2009). Face gender and emotion expression: are angry women more like men? J. Vis. 9, 19.1–8. doi: 10.1167/9.12.19

CrossRef Full Text | Google Scholar

Hofmann, S. G., Suvak, M., and Litz, B. T. (2006). Sex differences in face recognition and influence of facial affect. Pers. Individ. Dif. 40, 1683–1690. doi: 10.1016/j.paid.2005.12.014

CrossRef Full Text | Google Scholar

Isaacowitz, D. M., Toner, K., Goren, D., and Wilson, H. R. (2008). Looking while unhappy: mood-congruent gaze in young adults, positive gaze in older adults. Psychol. Sci. 19, 848–853. doi: 10.1111/j.1467-9280.2008.02167.x

CrossRef Full Text | Google Scholar

Isaacowitz, D. M., Toner, K., and Neupert, S. D. (2009). Use of gaze for real-time mood regulation: effects of age and attentional functioning. Psychol. Aging 24, 989–994. doi: 10.1037/a0017706

CrossRef Full Text | Google Scholar

Jackson, M. C., and Arlegui-Prieto, M. (2016). Variation in normal mood state influences sensitivity to dynamic changes in emotional expression. Emotion 16, 145–149. doi: 10.1037/emo0000126

CrossRef Full Text | Google Scholar

James, W. (1890). The Principles of Psychology. New York, NY: Holt.

Google Scholar

Joormann, J., and Gotlib, I. H. (2006). Is this happiness I see? Biases in the identification of emotional facial expressions in depression and social phobia. J. Abnorm. Psychol. 115, 705–714. doi: 10.1037/0021-843X.115.4.705

CrossRef Full Text | Google Scholar

Kahneman, D. (1973). Attention and Effort. Englewood Cliffs, NJ: Prentice-Hall.

Google Scholar

Keating, C. F. (1985). Gender and the physiognomy of dominance and attractiveness. Soc. Psychol. Q. 48, 61–70. doi: 10.2307/3033782

CrossRef Full Text | Google Scholar

Keating, C., Mazur, A., and Segall, M. (1981). A cross-cultural exploration of physiognomic traits of dominance and happiness. Ethol. Sociobiol. 2, 41–48. doi: 10.1016/0162-3095(81)90021-2

CrossRef Full Text | Google Scholar

Kret, M. E., and De Gelder, B. (2012). A review of sex differences in processing emotional signals. Neuropsychologia 50, 1211–1221. doi: 10.1016/j.neuropsychologia.2011.12.022

CrossRef Full Text | Google Scholar

Liu, J., Li, J., Feng, L., Li, L., Tian, J., and Lee, K. (2014). Seeing Jesus in toast: neural and behavioral correlates of face pareidolia. Cortex 53, 60–77. doi: 10.1016/j.cortex.2014.01.013

CrossRef Full Text | Google Scholar

Mackinnon, A., Jorm, A. F., Christensen, H., Korten, A. E., Jacomb, P. A., and Rodgers, B. (1999). A short form of the positive and negative affect schedule: evaluation of factorial validity and invariance across demographic variables in a community sample. Pers. Individ. Dif. 27, 405–416. doi: 10.1016/S0191-8869(98)00251-7

CrossRef Full Text | Google Scholar

Marmolejo-Ramos, F., and Dunn, J. (2013). On the activation of sensorimotor systems during the processing of emotionally-laden stimuli. Universitas Psychol. 12, 1511–1542. doi: 10.11144/Javeriana.UPSY12-5.assp

CrossRef Full Text | Google Scholar

McArthur, L. Z., and Baron, R. M. (1983). Toward an ecological theory of social perception. Psychol. Rev. 90, 215–238. doi: 10.1037/0033-295X.90.3.215

CrossRef Full Text | Google Scholar

Meltzoff, A. N., and Moore, M. K. (1983). Newborn infants imitate adult facial gestures. Child Dev. 54, 702–709. doi: 10.2307/1130058

CrossRef Full Text | Google Scholar

Niedenthal, P. M., Halberstadt, J. B., Margolin, J., and Innes-Ker, ÅH. (2000). Emotional state and the detection of change in facial expression of emotion. Eur. J. Soc. Psychol. 30, 211–222. doi: 10.1002/(SICI)1099-0992(200003/04)30:2<211::AID-EJSP988>3.0.CO;2-3

CrossRef Full Text | Google Scholar

Palermo, R., and Coltheart, M. (2004). Photographs of facial expression: accuracy, response times, and ratings of intensity. Behav. Res. Methods, Instrum. Comput. 36, 634–638. doi: 10.3758/BF03206544

CrossRef Full Text | Google Scholar

Palumbo, L., Ruta, N., and Bertamini, M. (2015). Comparing angular and curved shapes in terms of implicit associations and approach/avoidance responses. PLoS ONE 10:e0140043. doi: 10.1371/journal.pone.0140043

CrossRef Full Text | Google Scholar

Pelli, D. G. (1997). The videotoolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437–442. doi: 10.1163/156856897X00366

CrossRef Full Text | Google Scholar

Reed, E. S. (1996). Encountering the World: Toward an Ecological Psychology. New York, NY: Oxford University Press.

Google Scholar

Salgado-Montejo, A., Alvarado, J. A., Velasco, C., Salgado, C. J., Hasse, K., and Spence, C. (2015). The sweetest thing: the influence of angularity, symmetry, and the number of elements on shape-valence and shape-taste matches. Front. Psychol. 6:1382. doi: 10.3389/fpsyg.2015.01382

CrossRef Full Text | Google Scholar

Sanchez, A., Vazquez, C., Gomez, D., and Joormann, J. (2014). Gaze-fixation to happy faces predicts mood repair after a negative mood induction. Emotion 14, 85–94. doi: 10.1037/a0034500

CrossRef Full Text | Google Scholar

Santos, A., Mier, D., Kirsch, P., and Meyer-Lindenberg, A. (2011). Evidence for a general face salience signal in human amygdala. Neuroimage 54, 3111–3116. doi: 10.1016/j.neuroimage.2010.11.024

CrossRef Full Text | Google Scholar

Schmid, P. C., Schmid Mast, M., Bombari, D., Mast, F. W., and Lobmaier, J. S. (2011). How mood states affect information processing during facial emotion recognition: an eye tracking study. Swiss J. Psychol. 70, 223–231. doi: 10.1024/1421-0185/a000060

CrossRef Full Text | Google Scholar

Schwarz, N., and Clore, G. L. (1983). Mood, misattribution, and judgments of well-being: informative and directive functions of affective states. J. Pers. Soc. Psychol. 45, 513–523. doi: 10.1037/0022-3514.45.3.513

CrossRef Full Text | Google Scholar

Schwarz, N., and Clore, G. L. (2003). Mood as information: 20 years later. Psychol. Inq. 14, 296–303. doi: 10.1080/1047840X.2003.9682896

CrossRef Full Text | Google Scholar

Senior, C., Phillips, M. L., Barnes, J., and David, A. S. (1999). An investigation into the perception of dominance from schematic faces: a study using the World-Wide Web. Behav. Res. Methods Instrum. Comput. 31, 341–346. doi: 10.3758/BF03207730

CrossRef Full Text | Google Scholar

Shiota, M. N., Campos, B., Keltner, D., and Hertenstein, M. J. (2004). Positive Emotion and the Regulation of Interpersonal Relationships. Berlin: ResearchGate.

Google Scholar

Tabachnick, B. G., and Fidell, L. S. (2013). Using Multivariate Statistics, 6th Edn. Upper Saddle River, NJ: Pearson Education.

Google Scholar

Tay, P. K. C. (2015). The adaptive value associated with expressing and perceiving angry-male and happy-female faces. Front. Psychol. 6:851. doi: 10.3389/fpsyg.2015.00851

CrossRef Full Text | Google Scholar

Todd, P. M., Hertwig, R., and Hoffrage, U. (2005). “Evolutionary cognitive psychology,” in The Handbook of Evolutionary Psychology, ed. D. M. Buss (Hoboken, NY: John Wiley & Sons, Inc), 776–802.

Google Scholar

Tottenham, N., Tanaka, J. W., Leon, A. C., Mccarry, T., Nurse, M., Hare, T. A., et al. (2009). The NimStim set of facial expressions: judgments from untrained research participants. Psychiatry Res. 168, 242–249. doi: 10.1016/j.psychres.2008.05.006

CrossRef Full Text | Google Scholar

United States Department of Justice (2010). Homicide Trends in the United States, 1980–2008. Washington, DC: United States Department of Justice.

Google Scholar

Velasco, C., Woods, A. T., Deroy, O., and Spence, C. (2015). Hedonic mediation of the crossmodal correspondence between taste and shape. Food Qual. Prefer. 41, 151–158. doi: 10.1016/j.foodqual.2014.11.010

CrossRef Full Text | Google Scholar

Vuilleumier, P., Armony, J. L., Driver, J., and Dolan, R. J. (2003). Distinct spatial frequency sensitivities for processing faces and emotional expressions. Nat. Neurosci. 6, 624–631. doi: 10.1038/nn1057

CrossRef Full Text | Google Scholar

Watson, D., Clark, L. A., and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54, 1063–1070. doi: 10.1037/0022-3514.54.6.1063

CrossRef Full Text | Google Scholar

Webster, M. A., and MacLeod, D. I. (2011). Visual adaptation and face perception. Philos. Trans. R. Soc. Lond. B Biol. Sci. 366, 1702–1725. doi: 10.1098/rstb.2010.0360

CrossRef Full Text | Google Scholar

Wood, A., Lupyan, G., Sherrin, S., and Niedenthal, P. (2016). Altering sensorimotor feedback disrupts visual discrimination of facial expressions. Psychon. Bull. Rev. 23, 1150–1156. doi: 10.3758/s13423-015-0974-5

CrossRef Full Text | Google Scholar

Zebrowitz, L. A. (1997). Reading Faces: Window to The Soul? Boulder, CO: Westview Press.

Google Scholar

Keywords: face perception, emotion, gender, perceptual bias, state affect, PANAS

Citation: Harris DA, Hayes-Skelton SA and Ciaramitaro VM (2016) What’s in a Face? How Face Gender and Current Affect Influence Perceived Emotion. Front. Psychol. 7:1468. doi: 10.3389/fpsyg.2016.01468

Received: 06 July 2016; Accepted: 12 August 2016;
Published: 28 September 2016.

Edited by:

Anna M. Borghi, University of Bologna, Italy

Reviewed by:

Fernando Marmolejo-Ramos, Stockholm University, Sweden
Thomas Edward Gladwin, Ministry of Defense, Netherlands

Copyright © 2016 Harris, Hayes-Skelton and Ciaramitaro. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Vivian M. Ciaramitaro, vivian.ciaramitaro@umb.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.