Skip to main content

ORIGINAL RESEARCH article

Front. Syst. Neurosci., 16 March 2015
Volume 9 - 2015 | https://doi.org/10.3389/fnsys.2015.00038

A new measure for the revised reinforcement sensitivity theory: psychometric criteria and genetic validation

  • 1Department of Psychology, University of Bonn, Bonn, Germany
  • 2Laboratory of Neurogenetics, University of Bonn, Bonn, Germany
  • 3Center of Economics and Neuroscience, University of Bonn, Bonn, Germany
  • 4Department of Psychology, Goldsmiths, University of London, London, UK
  • 5Melbounre School of Psychological Sciences, The University of Melbourne, Melbourne, VIC, Australia
  • 6Department of Psychology, University of Ulm, Ulm, Germany

Jeffrey Gray's Reinforcement Sensitivity Theory (RST) represents one of the most influential biologically-based personality theories describing individual differences in approach and avoidance tendencies. The most prominent self-report inventory to measure individual differences in approach and avoidance behavior to date is the BIS/BAS scale by Carver and White (1994). As Gray and McNaughton (2000) revised the RST after its initial formulation in the 1970/80s, and given the Carver and White measure is based on the initial conceptualization of RST, there is a growing need for self-report inventories measuring individual differences in the revised behavioral inhibition system (BIS), behavioral activation system (BAS) and the fight, flight, freezing system (FFFS). Therefore, in this paper we present a new questionnaire measuring individual differences in the revised constructs of the BIS, BAS and FFFS in N = 1814 participants (German sample). An English translated version of the new measure is also presented and tested in N = 299 English language participants. A large number of German participants (N = 1090) also filled in the BIS/BAS scales by Carver and White (1994) and the correlations between these measures are presented. Finally, this same subgroup of participants provided buccal swaps for the investigation of the arginine vasopressin receptor 1a (AVPR1a) gene. Here, a functional genetic polymorphism (rs11174811) on the AVPR1a gene was shown to be associated with individual differences in both the revised BIS and classic BIS dimensions.

Introduction

The Reinforcement Sensitivity Theory (RST) of personality has in recent years become one of the most prominent biologically oriented theories in personality psychology (Corr, 2008; Smillie et al., 2011). At the core of the classic form of this theory are the behavioral activation and behavioral inhibition systems (BAS and BIS, respectively). These systems regulate approach toward appetitive stimuli and avoidance/withdrawal of aversive stimuli. Individual differences in the functioning of the BIS and BAS are thought to provide the biological foundation for complex personality traits (see also Montag et al., 2013). Gray proposed that the BAS is anchored in mesolimbic dopaminergic pathways (e.g., Pickering and Gray, 2001), thereby sharing similar ideas with Panksepp's SEEKing system (Panksepp and Moskal, 2008) and Depue's Behavioral Faciliation System (e.g., Depue and Collins, 1999). Here, mesolimbic dopamine function is thought to underpin energized approach behavior toward appetitive stimuli (Schultz, 2007). Individuals with stronger dopaminergic firing in these brain regions might be characterized as full of energy, having a tendency toward outgoing explorative behavior, and being more motivated to pursue rewards (e.g., Leyton et al., 2002). In contrast, individuals with a more reactive BIS might be characterized as more anxious, avoidant, and more motivated to avoid threat or punishment1. According to the original conceptualization of RST, the BIS is hypothesized to be anchored around a core network comprising the septo-hippocampal-system (e.g., Gray, 1982).

A major revision to RST has resulted in a somewhat updated understanding of the systems described above (Gray and McNaughton, 2000; McNaughton and Corr, 2004), with particularly notable implications for the role of the BIS and what has now been termed the Fight Flight Freezing system (FFFS, reflecting Fear2). The first major change from the “classic” to the “revised” RST is the removal of the distinction between conditioned and unconditioned stimuli (see McNaughton and Corr, 2004). In the classic version of the RST, the BAS and BIS were thought to be activated only by conditioned rewarding and punishing stimuli, respectively. In the revised RST, the BAS is proposed to be responsive to all rewarding and appetitive stimuli, while the FFFS is proposed to be responsive to all punishing and threatening stimuli. Conversely, the BIS is now thought to be activated by instances of goal conflict, such as when a threatening stimulus must be approached, or when mixed signals of reward and punishment are present. In rodent models, such conflict is well represented by a rodent being placed in an experimental setting prepared with cat odor. While the visual information clearly indicates that no cat is in close proximity, the olfactory senses of the rodent suggest otherwise. Such experiments have been conducted in a setting called the visible burrow system by Blanchard and Blanchard (1989) and Blanchard et al. (1993, 2001), among others. Activation of the BIS is still equated with the experience of anxiety, although this is now attributed to goal conflict, and is grounded in the “concurrent activity in the amygdala and septo-hippocampal system” (Gray and McNaughton, 2000, pp. 122–123). Observable behavior accompanying BIS activation is thought to include careful and slow approach behavior toward the potentially dangerous stimuli, and risk assessment behaviors (e.g., visual scanning of the environment). This careful approach behavior in a potentially dangerous situation is important, because it can generate new information to help solve the conflict (is a cat near, or not?) resulting either in activation of the BAS (hence, exploration behavior e.g., to seek for food), or activation of the FFFS, triggering withdrawal behavior such as fight, flight or freezing.

As outlined above, both the hippocampus and the amygdala have been outlined as playing an important role for the BIS (Gray and McNaughton, 2000; pp. 122–123). This idea has already received support from studies in the human neuroscience literature. For example, a study by Barrós-Loscertales et al. (2006) observed a positive correlation between gray matter volumes of the hippocampus and amygdala, and scores on a questionnaire measuring BIS reactivity. Supporting these findings, Cherbuin et al. (2008) were also able to observe a positive correlation between BIS scores and hippocampus volume. Of note, these studies administered self-report inventories which were originally developed to measure the classic BIS and BAS dimensions. Moreover, a review by our own group showed that similar personality constructs, such as Neuroticism or Harm Avoidance3, have also been linked to the hippocampus, but in the opposite direction—that is, a negative association between negative emotionality and gray matter volume in structures of the temporal lobe is also plausible (Montag et al., 2013).

One of the most pressing issues in personality psychology when dealing with the revised RST is the measurement of individual differences in the BIS (reflecting anxiety) and the FFFS (reflecting fear) in terms of the changes made to the theory. There already exists a first questionnaire, the Reinforcement Sensitivity Questionnaire (RSQ), measuring the revised RST, but the items were only published in a Serbian book chapter and not in English language. However, the authors have published an article on validation data of their RSQ where the principles of the questionnaire construction are described (Smederevac et al., 2014). In the RSQ the BAS is conceptualized with a focus on behaviors indicating sensitivity to signals of reward rather than on those indicating sensitivity to reward. The BIS is defined as conflict between worries (arising from the scanning of internal resources) and the outcome/feedback of real situations. The FFFS is represented by three distinct scales: Fight items include aggressive reactions to the emotion of fear caused by present threats, Freeze items express the inability to articulate necessary verbal responses to threat and Flight is defined as reaction to real danger which can be avoided. It is important to mention that the questionnaire construction and data collection of the RSQ and the Reuter and Montag rRST-Q happened parallel in time so that we had no chance to profit from the ideas and results of Smederevac et al. Theoretical overlap and difference between the RSQ and our rRST-Q are described in the Discussion section.

On this basis, the first aim of the present study is to provide a new measurement tool for the revised RST, with a particular focus on disentangling measurement of the BIS and FFFS constructs. In this initial investigation, we employ molecular genetic methods to investigate the validity of our new measure.

Of particular importance to the present study is that the emotion of anxiety is influenced by a large number of neurotransmitters, including gamma amino butyric acid (GABA; e.g., Nemeroff, 2002), and classic monoamines such as dopamine (e.g., Montag et al., 2012) and serotonin (Lesch et al., 1996). In addition to these classic “anxiety molecules,” recent years have seen a rise in studies investigating neuropeptides such as oxytocin and arginine vasopressin (AVP) to help better understand negative emotionality and personality (for an overview see Montag and Reuter, 2014). The nonapeptide oxytocin has become a major research focus as it seems to play an important role in social cognition and has been associated with trust behavior (Kosfeld et al., 2005). Kirsch et al. (2005) demonstrated that the nasal administration of oxytocin reduces amygdala activity while processing pictures depicting unpleasant content. Similar effects have been observed by Domes et al. (2007), who reported a down-regulation of the amygdala while processing emotional faces after administration of oxytocin. As noted above, Kosfeld et al. (2005) found that meeting a trusted person could trigger oxytocin secretion, which results in the dampening of alarm signals usually elicited by the amygdala when encountering a stranger. Therefore, oxytocin could be of particular relevance for understanding the emotion of (social) anxiety, elicited by uncertainty when meeting and engaging with strangers.

There has been even less social neuroscience research on the role of the nonapeptide vasopressin in the context of social anxiety. The initial studies in this area with humans point toward an equally important role for vasopressin in social cognition (Zink and Meyer-Lindenberg, 2012). Of particular importance is the study by Zink et al. (2010), reporting that the subgenual anterior cingulate cortex was more strongly activated under the influence of vasopressin, compared to placebo, when humans participated in a classic face matching paradigm using fearful and angry faces. During fear processing strong subcortical signals can be observed, putatively due to a lack of inhibition by the prefrontal cortex (Mobbs et al., 2007). Arginine-Vasopressin (AVP) could counteract these fear (or anxiety) effects by strengthening the PFC activity as a top-down fear/anxiety regulator. Further evidence for a role of AVP in anxiety/fear comes from animal research. Among others, Appenrodt et al. (1998) observed that the administration of AVP in septal regions attenuates anxiety-related behavior in the form of longer time spent in the open arms of the elevated plus maze test in rats. The major target of AVP for cell signaling is the arginine vasopressin receptor 1 a (AVPR1a). Consequently, knocking out the gene coding for AVPR1a could be associated with a reduction in anxiety, as measured by the elevated plus maze test mentioned above (Egashira et al., 2007). In order to translate these interesting findings to humans, molecular genetic association studies have already investigated genetic variants on the AVPR1A and AVPR1B4 genes in relation to individual differences in a vast range of human behaviors, including anxiety related personality traits (Meyer-Lindenberg et al., 2009; Kazantseva et al., 2014), altruistic behavior (Avinun et al., 2011), musical aptitude (Ukkola et al., 2009), pair bonding (Walum et al., 2008), and autism (Yirmiya et al., 2006; Yamasue, 2013).

In the present study, we hypothesized that genetic variation on the AVPR1a gene would be related to individual differences in measures of BIS (both the classic and revised form), but should not be associated with our measure of FFFS. We focused on the single nucleotide polymorphism (SNP) rs11174811 on the AVPR1a gene (located on chromosome 12q), because not only has it been associated with phenotypes related to anxiety/negative emotionality [e.g., stress reactivity, drug addiction, blood pressure, partnership satisfaction, and aggressive behavior (Maher et al., 2011; Nossent et al., 2011; Levran et al., 2014; Malik et al., 2014)], but also the functionality of this gene variant has been demonstrated by means of mRNA expression in postmortem brain tissue. Expression levels in samples homozygous for the major C-allele (genotype CC) were significantly lower than in samples with at least one minor A-allele (genotypes AA or CA; Maher et al., 2011).

In sum, the main aims of the present research are as follows: First, we report on the development of a new questionnaire measuring individual differences in the revised constructs of Gray and McNaughton's BAS, BIS and FFFS dimensions. Second, this new questionnaire, called Reuter and Montag's rRST-Q, is cross-validated against the widely used Carver and White BIS/BAS scales, in order to examine the convergent and divergent validity of the new questionnaire. We would expect only moderate correlations between the same constructs measured across the two self-report-inventories given the differences between the classic and revised models of RST, as outlined above. We would also expect only low to moderate correlations between the revised FFFS measure in the rRST-Q and the BIS scale from the Carver and White scale, on the same basis. The third aim of the study was to examine whether a genetic variant is associated with individual differences in the BIS. As AVP has been understudied in the context of anxiety (although the first evidence points toward such an association, as outlined above) so far, we tested for a link between rs11174811 and the BIS, as measured by both the Reuter and Montag and the Carver and White scale. Given the small number of studies dealing with the functional polymorphism on the AVPR1a gene in the context of negative emotionality, we have not provided a directional hypothesis for this potential effect.

Methods

Participants

The results of this study will be presented across three sections. The German version of the rRST-Q reported on in the first section of the results was completed by N = 1814 participants (n = 704 males and n = 1110 females, mean-age: 24.86, SD = 7.28). The English translated version of the rRST-Q, also reported on in this first section, was filled in by N = 299 participants (n = 79 males and n = 220 females, mean-age: 24.12, SD = 8.49). The participants were predominantly university students in both the German and English samples. In the last two sections of the results, N = 1090 participants (n = 325 males and n = 765 females; mean-age: 25.27, SD = 8.09), from the German sample described above, filled in Reuter and Montag rRST-Q as well as Carver and White's (1994) BIS/BAS scales, and also provided buccal swaps for genotyping a genetic variation of the AVPR1a gene. The study was approved by the psychology ethics committee of the University of Bonn, Germany.

Measures

Two questionnaires were administered to measure individual differences in RST-relevant personality constructs. We administered a new questionnaire called Reuter and Montag's rRST-Q to measure individual differences in the revised BAS, BIS, and FFFS constructs. Additionally, most of the German participants also completed the most widely used RST self-report measure, the Carver and White BIS/BAS scale, developed using the original RST model.

Reuter and Montag's rRST-Q

Reuter and Montag's rRST-Q consists of 31 items, with a four point Likert scale ranging from “strongly disagree” to “strongly agree.” The BAS is measured by eight items, the BIS by 11 items and the FFFS by 12 items. The original item pool for the rRST-Q consisted of 34 items; three items were excluded during the development process to improve both the factor structure and the internal consistencies of the scale. The German version of the scale was translated into English by a bilingual German-English speaker; the translated items were then checked by a native English speaker and some minor modifications were made to several of the items. This version was then back-translated to German by a different bilingual German-English speaker, and the resultant back-translated German items were checked against the original German items for consistency. Tables 1, 2 present all items from Reuter and Montag's rRST-Q in German and English.

TABLE 1
www.frontiersin.org

Table 1. German version of Reuter and Montag's rRST-Q; Likert scaling: ① trifft für mich gar nicht zu, ② trifft für mich eher nicht zu, ③ trifft für mich eher zu, ④ trifft für mich genau zu.

TABLE 2
www.frontiersin.org

Table 2. English version of Reuter and Montag's rRST-Q; Likert scaling: ① strongly disagree, ② disagree, ③ agree, ④ strongly agree.

The following theoretical considerations form the basis for the construction of Reuter and Montag's rRST-Q:

Revised BAS

Higher BAS activity should be associated with energetic arousal and approach behavior toward appetitive stimuli, consistent with the BAS and similar systems being described as a “Go get it!” system (Panksepp, 1998). The BAS dimension in this scale has item content measuring approach and goal-directed behavior; those who score high on this BAS scale could be described as bold, adventurous and may show stronger energy and drive when approaching appetitive stimuli.

Revised BIS

Higher BIS activity should reflect responses to goal conflict and situations of uncertainty, including hesitation, risk assessment or wary behavior. As proposed by Gray and McNaughton (2000), three kinds of conflict are possible in principle (i.e., approach–approach, approach–avoidance, and avoidance–avoidance). Individuals with a more reactive BIS will tend to have difficulty making decisions when two equally attractive or unattractive options are presented and one option needs to be chosen (e.g., in situations where conflict is apparent).

Revised FFFS

In revised RST, the FFFS is associated with three kind of defensive or avoidant responses, namely Fight, Flight, and Freezing. Accordingly, in the rRST-Q, high overall trait FFFS is characterized by low fight, high flight and high freezing behavior. This may appear at odds with the notion of defensive attack (e.g., fight behavior) as a classic fear response, as observed in nearly all mammalian organisms. However, in the revised RST fight behavior is only observable if the distance between predator and prey is close to zero, leaving no option for flight or freezing. The probability of such situations occurring for human beings is extremely low (Corr et al., 2013). Furthermore, particularly fearful individuals are perhaps least likely to find themselves in a situation in which there is zero distance between them and a source of threat. As a consequence, and in line with the notion that activity of the FFFS is associated with withdrawal behavior in broad terms, we would characterize a high trait FFFS individual as high in flight and freezing behavior, but a low scorer on fight behavior. A person who is not willing to fight when being attacked might typically withdraw more quickly from unpleasant situations, compared to a person who is more willing to fight when threatened. Clearly when filling in a questionnaire such as this, asking a person to reflect on his or her behavior can only represent an indirect approach to understanding subcortical brain activity in the brain systems of the revised RST. In addition, operationalizing the FFFS as described here putatively leads to positive inter-correlations between all three FFFS subscales.

Carver and White BIS/BAS Scale

The Carver and White BIS/BAS scale consists of 24 items. The BIS scale consists of seven items and the BAS scales comprise thirteen items. The BAS scale can be split in to three subscales: BAS drive (four items), BAS fun seeking (four items) and BAS reward responsiveness (five items). Four filler items are presented to participants, but not analyzed. The German translation of the Carver and White BIS/BAS scale by Strobel et al. (2001) was administered to the German participants in this study. The internal consistencies for the scales derived from the present data set (and contrasted with the data presented by Strobel et al., 2001) are presented in the Results section (see Table 5).

Genetic Analyses

DNA was extracted from buccal cells. Automated purification of genomic DNA was conducted by means of the MagNA Pure® LC system using a commercial extraction kit (MagNA Pure LC DNA isolation kit; Roche Diagnostics, Mannheim, Germany). Genotyping of the AVPR1a SNP rs11174811 was performed by means of MALDI-TOF (Matrix-Assisted Laser Desorption/Ionization—Time of Flight) mass spectrometry using The Sequenom MassARRAY® system (Agena Bioscience).

Results

The Results section of the study is split into three sections. The first section presents descriptive data as well as psychometric data (reliabilities) for both a German and an English version of Reuter and Montag's rRST-Q. In addition, confirmatory factor analyses (CFAs) are presented that test the revised RST model (e.g., its factor structure). The second section of the results reports correlations between the German version of the rRST-Q and a German version of Carver and White's BIS/BAS questionnaire, the latter being the most widely used questionnaire in RST research to date. The third section of the results reports a genetic validation of the new RST questionnaire, with a specific focus on the potential relation between BIS sensitivity and the AVPR1a gene.

Section 1: Psychometric Analysis of Reuter and Montag's rRST-Q

In Table 3, means and standard deviations for the German version of Reuter and Montag's rRST-Q are provided, including descriptive statistics for the male and female participants separately.

TABLE 3
www.frontiersin.org

Table 3. Means and standard deviations for the full German sample and males and females separately for the different scales of Reuter and Montag's rRST-Q (data of the present study).

The internal consistencies in terms of Cronbach's Alpha for BIS, BAS and FFFS were good in the German as well as in the English version. The rather low reliabilities for the FFFS subscales are due to the small number of items per scale (see Table 4). However, this is similar for the BAS subscales of the classic BIS/BAS questionnaire by Carver and White (see Table 5).

TABLE 4
www.frontiersin.org

Table 4. Internal consistencies (Cronbach's Alpha) for the scales of Reuter and Montag's rRST-Q in the German and English sample (data of the present study).

TABLE 5
www.frontiersin.org

Table 5. Internal consistencies (Cronbach's Alpha) for the Carver and White BIS/BAS scales in the German sample of the present study and the initial translation paper by Strobel et al. (2001).

In order to test if the factor structure of the Revised Reinforcement Sensitivity Theory Questionnaire (rRST-Q) is in accordance with our theoretical assumptions, we ran CFAs using the LISREL software package (LISREL 8.80 by Jöreskog and Sorböm (1996); Science Software International, Inc). Given the ordinal nature of the questionnaire data (a 4-point Likert scale), the CFAs were based on polychoric covariance matrices and asymptotic covariance matrices. Parameter estimates were calculated using the Robust Diagonally Weighted Least Squares (DWLS) method. As indicated by the fit indices, the data showed good fit to our theoretical model in the German (Chi2 = 4061.72, df = 431, p < 0.0001; RMSEA = 0.069; CFI = 0.92; see Figure 1), and in the English sample (Chi2 = 871.27, df = 431, p < 0.0001: RMSEA = 0.060; CFI = 0.93).

FIGURE 1
www.frontiersin.org

Figure 1. Results for the CFA in the German sample (N = 1749). Fit indices were as follows: Chi2 = 4061.72, df = 431, p < 0.0001; RMSEA = 0.069; CFI = 0.92. A similar fit could be observed for the English sample (N = 286): Chi2 = 871.27, df = 431, p < 0.0001: RMSEA = 0.060; CFI = 0.93. Recoded items are marked in bold letters.

Section 2: Associations between Reuter and Montag's rRST-Q and the Carver and White BIS/BAS Scale

In Table 6, the inter-correlations between the Reuter and Montag rRST-Q dimensions and Carver and White's BIS/BAS scales are provided. Of note, the shared variance between the classic BAS from the Carver and White scale and the revised BAS from the new inventory is about 25%. Similarly, the shared variance between the classic BIS scale and its revised form was also around 25%. In Table 7 we include additional information on the correlations between the subscales of the FFFS, and the revised BIS and BAS scales; Table 8 provides correlations between the FFFS subscales and Carver and White's BIS/BAS.

TABLE 6
www.frontiersin.org

Table 6. Correlations between the Carver and White BIS/BAS scales and the Reuter and Montag rRST-Q (N = 1090).

TABLE 7
www.frontiersin.org

Table 7. Correlations between the FFFS dimension and its subscales and the rBIS/rBAS (German sample; N = 1090).

TABLE 8
www.frontiersin.org

Table 8. Correlations between Reuter and Montag's FFFS subscales and Carver and White's BIS/BAS scales (German sample; N = 1090).

Section 3: Analysis of the Genetic Variation of the AVPR1a Gene in Relation to the Behavioral Inhibition System

In this third section of the results, we explored the relation of the AVPR1a gene and its functional polymorphism rs11174811 with both the classic and revised BIS scales. From the total sample described above in Section 1 of the results, a subgroup of n = 1090 participants provided buccal swaps for genotyping rs11174811. The genotype distribution was as follows: CC = 840, CA = 230, AA = 20 (Hardy Weinberg Equilibrium: Chi2 = 0.84, df = 1, n.s.). A MANCOVA with the Carver and White BIS/BAS dimensions (and the BAS subscales) and with Reuter and Montag's scales revealed a significant effect of rs11174811 on both the classic and the revised BIS dimensions [F(2, 1087) = 7.93, p < 0.001 vs. F(2, 1087) = 5.03, p = 0.007, respectively]. As both of the BIS dimensions correlated with age (BIS: r = −0.14, p < 0.001 vs. rBIS: r = −0.19, p < 0.001), and with gender, with females having significantly higher scores [BIS: F(1, 1088) = 143.30, p < 0.001 vs. rBIS: F(1, 1088) = 69.15, p < 0.001], we undertook additional analyses, including gender as a second independent variable and age as a covariate. No gender by gene interaction effects could be observed on the BIS scales. The inclusion of age as a covariate did not change the significant influence of rs11174811 on the BIS. A post-hoc test revealed that the contrast for the genotypes CC vs. CA was significant. The group consisting of AA carriers was excluded from further interpretation at this point, because of the small group showing no clear trend in either the AA or AC direction (n = 20; see also Figures 2, 3). As shown in Tables 9, 10, no significant effect of rs11174811 could be detected on our measure of FFFS, nor on any of the other RST dimensions across both personality inventories.

FIGURE 2
www.frontiersin.org

Figure 2. Association of genetic variation of the AVPR1a gene and anxiety measured with the revised BIS scale of Reuter and Montag rRST-Q (Means and SEMs are depicted; *the contrast is significant at p = 0.002 level).

FIGURE 3
www.frontiersin.org

Figure 3. Association of genetic variation of the AVPR1a gene and anxiety measured with the BIS scale of Carver and White (Means and SEMs are depicted, *contrast is significant at p < 0.001 level).

TABLE 9
www.frontiersin.org

Table 9. Means and standard deviations of Reuter and Montag's rRST-Q scales depending on AVPR1a's rs11174811.

TABLE 10
www.frontiersin.org

Table 10. Mean and standard deviations of Carver and White's BIS/BAS scale depending on AVPR1a's rs11174811.

Discussion

This study had three key aims. First, we sought to develop a new self-report measure for the revised RST in order to better distinguish between aspects of personality concerned with fear and anxiety. The most widely used self-report measure in RST research, the Carver and White BIS/BAS scales, was developed under the classic model of RST, and the BIS scale in that measure arguably conflates processes related to the BIS and FFFS in the item content. Given the putative separation of the FFFS and the BIS in the revised RST in terms of behavioral functioning and their neuropsychopharmacological bases, self-report measures that seek to separate the FFFS and BIS are desirable. On that basis, and in line with revised RST, the new inventory attempts to disentangle the emotions of fear and anxiety by including separate scales for the revised BIS (reflecting anxiety) and for the FFFS (reflecting the emotion of fear). Of note, we designed the BIS scale to measure hesitation and cautious behavior in conflict situations, such as deciding between two (even potentially positive) options (e.g., “If I have the choice between two appealing options, I have difficulty deciding on one.”). As well as difficulties in behavioral choice, cognitions related to tolerance of uncertainty are also reflected in the revised BIS in our questionnaire (e.g., “I find it hard to bear uncertainty.”). The scale for the FFFS, measuring individual differences in fear tendencies, comprises the most important classes of behavioral fear responses, namely Fight, Flight, and Freezing. Finally, the BAS scale is designed to measure individual differences in reward-seeking, drive and energy (e.g., “I'm a spontaneous person.” or “Most of the time I have a thirst for action.”).

Despite some similarities in the conceptualization of the revised RST between the RSQ by Smederevac et al. (2014) and Reuter and Montag's rRST-Q there are also apparent differences. With respect to the BIS, the rRST-Q concentrates on conflicts without focusing on irrational interpretations of stimuli as the RSQ does. The conceptualization of the BAS is broader in the rRST-Q than in the RSQ: besides sensitivity to signals of reward, drive, energy and risk taking are also included.

The correlations between the dimensions within Reuter and Montag's rRST-Q show that the BAS is negatively associated with both the BIS and FFFS. As activation of the BAS is clearly associated with approach behavior or “wanting,” this is not surprising, as BIS activation reflects orienting and risk assessment behavior (e.g., careful approach behavior, which can switch to activation of the FFFS in the presence of more overt and physically closer threats—ergo, avoidance behavior). In line with this, both the BIS and the FFFS are positively correlated and can be positioned on the side of negative emotionality. Importantly, from a psychometric point of view, our new inventory shows good internal consistencies across the scales and good model fit when using CFA to model the latent variables of the questionnaire. It should be noted that the internal consistencies of the Flight and Freezing subscales are potentially a little lower than ideal, however they are each comprised of only several items, and so this may be expected.

The second aim of the study was to cross validate Reuter and Montag's rRST-Q with the Carver and White BIS/BAS scale. The results of this cross validation show that both the classic BAS and revised BAS, and also the classic BIS and revised BIS scale, correlate to about.50—hence 25% of the variance of these constructs overlap. This obviously also makes clear that a large portion of the variance does not overlap (75%), and so as a consequence the Reuter and Montag's rRST-Q are clearly measuring something related to yet distinct from the Carver and White dimensions. Future studies including both Carver and White's BIS/BAS scale and Reuter and Montag's rRST-Q are needed, particularly studies examining processes related to fear and anxiety in the context of revised RST, but also those studies examining BAS-related processes and functions. Establishing whether the Reuter and Montag's rRST-Q has incremental and/or divergent validity in relation to existing RST-related measures is clearly an important next step.

The final aim of this study was to examine individual differences of the BIS in relation to a genetic variation on the AVPR1a gene. In line with the previous literature, we showed that the gene coding for vasopressin 1a receptor is involved in human anxiety. Carriers of the CC variant of rs11174811 showed significantly elevated anxiety scores, measured in terms of Gray's Behavioral Inhibition System. As already described above, expression levels in homozygous C-allele carriers (genotype CC) have been reported to be significantly lower compared to carriers of at least one minor A-allele (genotypes AA or CA; Maher et al., 2011). As a consequence, a putatively lower number of vasopressin 1a receptors are associated with elevated anxiety levels, because the anxiety lowering effects of vasopressin (Appenrodt et al., 1998) cannot unfold completely due to lower binding possibilities. But: This interpretation would be against the findings from genetic animal research showing that knocking out the AVPR1a gene is associated with lower anxiety (Egashira et al., 2007).

Interestingly, rs11174811 showed a significant effect on both the BIS measured with the Carver and White scale, as well as on the revised BIS measured with Reuter and Montag's rRST-Q. Given the correlation of 0.45 between the classic BIS and the revised BIS shown above, the genetic variation of the AVPR1a gene clearly targets the shared variance of both constructs. How can this be explained? When comparing Carver and White's BIS and Reuter and Montag's BIS scale it is apparent that Carver and White's BIS is a little more multifaceted compared to our revised BIS scale. More specifically, Carver and White included a wide range of BIS items in their questionnaire, ranging from explicitly feeling anxious (e.g., item 2 of their scale), to restlessness when being confronted with an unpleasant event (item 16 of their scale). In contrast, the revised BIS scale of our newly designed questionnaire includes no item explicitly referring to feeling anxious. Instead, Reuter and Montag's revised BIS scale describes being unable to bear uncertainty or often being indecisive, which targets one major issue in the revised RST. From our point of view, the overlap between the scales (and the genetic effect targeting the shared variance) could possibly be explained by the aspect of restlessness when being confronted with an unpleasant event (in the Carver and White questionnaire), which is close to our concept of being indecisive or overly careful when confronted with uncertainty.

Importantly, the genetic effect of rs11174811 was only significant in the context of BIS sensitivity; no significant effect was observed on the FFFS scale, measuring individual differences in fear and avoidance tendencies, nor any other RST scales on either of the questionnaires administered. The genetic variant investigated in this study seems to target anxiety, but not fear, in terms of the conceptualization of Reuter and Montag's rRST-Q. This finding supports the divergent validity of the BIS and FFFS dimensions in the rRST-Q, a key aim in the development of this questionnaire, and is potentially of wider importance for the revised model of RST, in terms of identifying neurobiological markers that reliably distinguish between trait measures of these constructs. Clearly, the genetic finding in this study represents a beginning point in this process, but an important beginning point nonetheless.

It should be noted that there are existing attempts to develop self-report measures in the context of revised RST (e.g., the “Jackson-5”; Jackson, 2009), and also attempts to modify the psychometric structure of measures designed under the classic RST in line with revised RST. For example, Heym et al. (2008) suggested the original Carver and White BIS scale could be decomposed into separate BIS and FFFS dimensions, based on an evaluation of the item wording and results of confirmatory factor analysis. Despite this, the research so far using these new or modified measures has tended to focus on validation using other psychometric self-report measures, laboratory-based behavioral tasks or “real-world” behaviors, and there has been limited research on the neurobiological markers associated with these new scales, particularly in terms of separating the BIS and FFFS. Thus, the genetic data reported in this study represents a relatively novel and important step in this endeavor.

Conclusion

Reuter and Montag's rRST-Q is a new self-report measure, developed in line with theoretical assumptions derived from Gray and McNaughton's RST (2000). The psychometric properties of the scale, including its factorial structure and internal consistencies were supported in both a German and English language version of the measure. Correlations between Reuter and Montag's rRST-Q and an existing RST measure, the Carver and White BIS/BAS scales, showed that the new scale dimensions correlated in the expected direction with the Carver and White dimensions, but the correlations were not large enough to suggest high redundancy in the new dimensions. A first validation study using a molecular genetic approach found a significant association between a functional polymorphism on the AVPR1a gene (rs11174811) and the BIS. The genetic association was shown with respect to the BIS dimension in both the Carver and White BIS/BAS questionnaire and in the rRST-Q. Further, the genetic association was not shown for the FFFS dimension in the rRST-Q, supporting the divergent validity of the BIS and FFFS dimensions in this scale, and highlighting a potentially useful genetic marker that could be used to evaluate existing or new measures developed under the revised RST. This study should clearly be seen as a first step in the validation of this new revised RST measure. In particular, no validation of the revised BAS scale was attempted in this study, and this may be a focus for future work on this scale. More broadly, future studies will be needed to search for further genetic, endocrinological and brain imaging validation of this new inventory. In addition, this new tool will also need to be further evaluated in relation to other self-report measures and using theoretically relevant behavioral and experimental laboratory tasks.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The position of CM is funded by a Heisenberg grant awarded to him by the German Research Foundation (DFG-MO 2363/3-1).

Footnotes

1. ^The important distinction between the emotions of fear and anxiety came with revised RST and will be discussed in the light of withdrawal/avoidance behavior further on.

2. ^The FFFS was already included in the original version of the RST as the so called FFS and was activated by unconditioned unpleasant stimuli.

3. ^BIS correlates with Harm Avoidance and Neuroticism at about 0.55–0.59 (Montag et al., 2013).

4. ^These two genes code for the vasopressin 1a or 1b receptors. Of note, the gene coding for the 1b receptor has not been the major focus of research until now.

References

Appenrodt, E., Schnabel, R., and Schwarzberg, H. (1998). Vasopressin administration modulates anxiety-related behavior in rats. Physiol. Behav. 64, 543–547. doi: 10.1016/S0031-9384(98)00119-X

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Avinun, R., Israel, S., Shalev, I., Gritsenko, I., Bornstein, G., Ebstein, R. P., et al. (2011). AVPR1A variant associated with preschoolers' lower altruistic behavior. PLoS ONE 6:e25274. doi: 10.1371/journal.pone.0025274

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Barrós-Loscertales, A., Meseguer, V., Sanjuan, A., Belloch, V., Parcet, M. A., Torrubia, R., et al. (2006). Behavioral inhibition system activity is associated with increased amygdala and hippocampal gray matter volume: a voxel-based morphometry study. Neuroimage 33, 1011–1015. doi: 10.1016/j.neuroimage.2006.07.025

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Blanchard, R. J., and Blanchard, D. C. (1989). Antipredator defensive behaviors in a visible burrow system. J. Comp. Psychol. 103, 70. doi: 10.1037/0735-7036.103.1.70

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Blanchard, R. J., Yang, M., Li, C. I., Gervacio, A., and Blanchard, D. C. (2001). Cue and context conditioning of defensive behaviors to cat odor stimuli. Neurosci. Biobehav. Rev. 25, 587–595. doi: 10.1016/S0149-7634(01)00043-4

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Blanchard, R. J., Yudko, E. B., Rodgers, R. J., and Blanchard, D. C. (1993). Defense system psychopharmacology: an ethological approach to the pharmacology of fear and anxiety. Behav. Brain Res. 58, 155–165. doi: 10.1016/0166-4328(93)90100-5

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Carver, C. S., and White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales. J. Pers. Soc. Psychol. 67, 319. doi: 10.1037/0022-3514.67.2.319

CrossRef Full Text | Google Scholar

Cherbuin, N., Windsor, T. D., Anstey, K. J., Maller, J. J., Meslin, C., and Sachdev, P. S. (2008). Hippocampal volume is positively associated with behavioural inhibition (BIS) in a large community-based sample of mid-life adults: the PATH through life study. Soc. Cogn. Affect. Neurosci. 3, 262–269. doi: 10.1093/scan/nsn018

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Corr, P. J. (2008). “Reinforcement sensitivity theory (RST): introduction,” in The Reinforcement Sensitivity Theory of Personality, ed P. J. Corr (Cambridge: Cambridge University Press), 1–43.

Google Scholar

Corr, P. J., DeYoung, C. G., and McNaughton, N. (2013). Motivation and personality: a neuropsychological perspective. Soc. Personal. Psychol. Compass 7, 158–175. doi: 10.1111/spc3.12016

CrossRef Full Text | Google Scholar

Depue, R. A., and Collins, P. F. (1999). Neurobiology of the structure of personality: dopamine, facilitation of incentive motivation, and extraversion. Behav. Brain Sci. 22, 491–517. doi: 10.1017/S0140525X99002046

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Domes, G., Heinrichs, M., Gläscher, J., Büchel, C., Braus, D. F., and Herpertz, S. C. (2007). Oxytocin attenuates amygdala responses to emotional faces regardless of valence. Biol. Psychiatry 62, 1187–1190. doi: 10.1016/j.biopsych.2007.03.025

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Egashira, N., Tanoue, A., Matsuda, T., Koushi, E., Harada, S., Takano, Y., et al. (2007). Impaired social interaction and reduced anxiety-related behavior in vasopressin V1a receptor knockout mice. Behav. Brain Res. 178, 123–127. doi: 10.1016/j.bbr.2006.12.009

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Gray, J. A. (1982). The neuropsychology of anxiety: an inquiry into the functions of the septo-hippocampal system. Behav. Brain Sci. 5, 469–484. doi: 10.1017/S0140525X00013066

CrossRef Full Text

Gray, J. A., and McNaughton, N. (2000). The Neuropsychology of Anxiety: an Enquiry into the Functions of the Septo-Hippocampal System. New York, NY: Oxford University Press.

Heym, N., Ferguson, E., and Lawrence, C. (2008). An evaluation of the relationship between Gray's revised RST and Eysenck's PEN: distinguishing BIS and FFFS in Carver and White's BIS/BAS scales. Pers. Individ. Dif. 45, 709–715. doi: 10.1016/j.paid.2008.07.013

CrossRef Full Text | Google Scholar

Jackson, C. J. (2009). Jackson-5 scales of revised Reinforcement Sensitivity Theory (r-RST) and their application to dysfunctional real world outcomes. J. Res. Pers. 43, 556–569. doi: 10.1016/j.jrp.2009.02.007

CrossRef Full Text | Google Scholar

Jöreskog, K. G., and Sorböm, D. (1996). LISREL 8: User's Reference Guide. (Lincolnwood, IL: Scientific Software International, Inc).

Google Scholar

Kazantseva, A. V., Kutlumbetova, Y. Y., Malykh, S. B., Lobaskova, M. M., and Khusnutdinova, E. K. (2014). Arginine-vasopressin receptor gene (AVPR1A, AVPR1B) polymorphisms and their relation to personality traits. Russ. J. Genet. 50, 298–307. doi: 10.1134/S1022795414030041

CrossRef Full Text | Google Scholar

Kirsch, P., Esslinger, C., Chen, Q., Mier, D., Lis, S., Siddhanti, S., et al. (2005). Oxytocin modulates neural circuitry for social cognition and fear in humans. J. Neurosci. 25, 11489–11493. doi: 10.1523/JNEUROSCI.3984-05.2005

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Kosfeld, M., Heinrichs, M., Zak, P. J., Fischbacher, U., and Fehr, E. (2005). Oxytocin increases trust in humans. Nature 435, 673–676. doi: 10.1038/nature03701

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Lesch, K. P., Bengel, D., Heils, A., Sabol, S. Z., Greenberg, B. D., Petri, S., et al. (1996). Association of anxiety-related traits with a polymorphism in the serotonin transporter gene regulatory region. Science 274, 1527–1531. doi: 10.1126/science.274.5292.1527

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Levran, O., Peles, E., Randesi, M., Li, Y., Rotrosen, J., Ott, J., et al. (2014). Stress-related genes and heroin addiction: a role for a functional FKBP5 haplotype. Psychoneuroendocrinology 45, 67–76. doi: 10.1016/j.psyneuen.2014.03.017

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Leyton, M., Boileau, I., Benkelfat, C., Diksic, M., Baker, G., and Dagher, A. (2002). Amphetamine-induced increases in extracellular dopamine, drug wanting, and novelty seeking: a PET/[11C] raclopride study in healthy men. Neuropsychopharmacology 27, 1027–1035. doi: 10.1016/S0893-133X(02)00366-4

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Maher, B. S., Vladimirov, V. I., Latendresse, S. J., Thiselton, D. L., McNamee, R., Kang, M., et al. (2011). The AVPR1A gene and substance use disorders: association, replication, and functional evidence. Biol. Psychiatry 70, 519–527. doi: 10.1016/j.biopsych.2011.02.023

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Malik, A. I., Zai, C. C., Berall, L., Abu, Z., Din, F., Nowrouzi, B., et al. (2014). The role of genetic variants in genes regulating the oxytocin-vasopressin neurohumoral system in childhood-onset aggression. Psychiatr. Genet. 24, 201–210. doi: 10.1097/YPG.0000000000000044

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

McNaughton, N., and Corr, P. J. (2004). A two-dimensional neuropsychology of defense: fear/anxiety and defensive distance. Neurosci. Biobehav. Rev. 28, 285–305. doi: 10.1016/j.neubiorev.2004.03.005

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Meyer-Lindenberg, A., Kolachana, B., Gold, B., Olsh, A., Nicodemus, K. K., Mattay, V., et al. (2009). Genetic variants in AVPR1A linked to autism predict amygdala activation and personality traits in healthy humans. Mol. Psychiatry 14, 968–975. doi: 10.1038/mp.2008.54

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Mobbs, D., Petrovic, P., Marchant, J. L., Hassabis, D., Weiskopf, N., Seymour, B., et al. (2007). When fear is near: threat imminence elicits prefrontal-periaqueductal gray shifts in humans. Science 317, 1079–1083. doi: 10.1126/science.1144298

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Montag, C., and Reuter, M. (2014). Disentangling the molecular genetic basis of personality: from monoamines to neuropeptides. Neurosci. Biobehav. Rev. 43, 228–239. doi: 10.1016/j.neubiorev.2014.04.006

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Montag, C., Jurkiewicz, M., and Reuter, M. (2012). The role of the catechol-O-methyltransferase (COMT) gene in personality and related psychopathological disorders. CNS Neurol. Disord. Drug Targets 11, 236–250. doi: 10.2174/187152712800672382

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Montag, C., Reuter, M., Jurkiewicz, M., Markett, S., and Panksepp, J. (2013). Imaging the structure of the human anxious brain: a review of findings from neuroscientific personality psychology. Rev. Neurosci. 24, 167–190. doi: 10.1515/revneuro-2012-0085

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Nemeroff, C. B. (2002). The role of GABA in the pathophysiology and treatment of anxiety disorders. Psychopharmacol. Bull. 37, 133–146.

PubMed Abstract | Full Text | Google Scholar

Nossent, A. Y., Hansen, J. L., Doggen, C., Quax, P. H., Sheikh, S. P., and Rosendaal, F. R. (2011). SNPs in microRNA binding sites in 3'-UTRs of RAAS genes influence arterial blood pressure and risk of myocardial infarction. Am. J. Hypertens. 24, 999–1006. doi: 10.1038/ajh.2011.92

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Panksepp, J. (1998). Affective neuroscience: The foundation of human and animal emotions. (London: Oxford University Press), 144–163.

Panksepp, J., and Moskal, J. (2008). “Dopamine and SEEKING: subcortical “reward” systems and appetitive urges,” in Handbook of Approach and Avoidance Motivation, ed A. J. Elliot (New York, NY: Psychology Press), 67–87.

Google Scholar

Pickering, A., and Gray, J. A. (2001). Dopamine, appetitive reinforcement, and the neuropsychology of human learning: an individual differences approach. Advances in Individual Differences Research, 113–149.

Google Scholar

Schultz, W. (2007). Behavioral dopamine signals. Trends Neurosci. 30, 203–210. doi: 10.1016/j.tins.2007.03.007

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Smederevac, S., Mitrovic, D., Colovic, P., and Nikolasevic, Z. (2014). Validation of the measure of revised reinforcement sensitivity theory constructs. J. Individ. Differ. 35, 12–21. doi: 10.1027/1614-0001/a000121

CrossRef Full Text | Google Scholar

Smillie, L. D., Loxton, N. J., and Avery, R. E. (2011). “Reinforcement sensitivity theory, research, applications, and future,” in The Wiley-Blackwell Handbook of Individual Differences, eds T. Chamorro-Premuzic, S. von Stumm, and A. Furnham (Oxford: Blackwell Publishing Ltd), 101–131.

Google Scholar

Strobel, A., Beauducel, A., Debener, S., and Brocke, B. (2001). Eine deutschsprachige Version des BIS/BAS-Fragebogens von Carver und White. Zeitschrift für Differentielle und Diagnostische Psychologie 22, 216–227. doi: 10.1024//0170-1789.22.3.216

CrossRef Full Text | Google Scholar

Ukkola, L. T., Onkamo, P., Raijas, P., Karma, K., and Järvelä, I. (2009). Musical aptitude is associated with AVPR1A-haplotypes. PLoS ONE 4:e5534. doi: 10.1371/journal.pone.0005534

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Walum, H., Westberg, L., Henningsson, S., Neiderhiser, J. M., Reiss, D., Igl, W., et al. (2008). Genetic variation in the vasopressin receptor 1a gene (AVPR1A) associates with pair-bonding behavior in humans. Proc. Natl. Acad. Sci. U.S.A. 105, 14153–14156. doi: 10.1073/pnas.0803081105

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Yamasue, H. (2013). Function and structure in social brain regions can link oxytocin-receptor genes with autistic social behavior. Brain Dev. 35, 111–118. doi: 10.1016/j.braindev.2012.08.010

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Yirmiya, N., Rosenberg, C., Levi, S., Salomon, S., Shulman, C., Nemanov, L., et al. (2006). Association between the arginine vasopressin 1a receptor (AVPR1a) gene and autism in a family-based study: mediation by socialization skills. Mol. Psychiatry 11, 488–494. doi: 10.1038/sj.mp.4001812

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Zink, C. F., and Meyer-Lindenberg, A. (2012). Human neuroimaging of oxytocin and vasopressin in social cognition. Horm. Behav. 61, 400–409. doi: 10.1016/j.yhbeh.2012.01.016

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Zink, C. F., Stein, J. L., Kempf, L., Hakimi, S., and Meyer-Lindenberg, A. (2010). Vasopressin modulates medial prefrontal cortex–amygdala circuitry during emotion processing in humans. J. Neurosci. 30, 7017–7022. doi: 10.1523/JNEUROSCI.4899-09.2010

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Keywords: reinforcement-sensitivity-theory, anxiety, fear, revised RST questionnaire, AVPR1a, rs11174811

Citation: Reuter M, Cooper AJ, Smillie LD, Markett S and Montag C (2015) A new measure for the revised reinforcement sensitivity theory: psychometric criteria and genetic validation. Front. Syst. Neurosci. 9:38. doi: 10.3389/fnsys.2015.00038

Received: 05 August 2014; Accepted: 23 February 2015;
Published: 16 March 2015.

Edited by:

Daniela Laricchiuta, IRCCS, Santa Lucia Foundation, Italy

Reviewed by:

Joseph Kambeitz, University of Munich, Germany
Fabio Ferlazzo, Sapienza University of Rome, Italy

Copyright © 2015 Reuter, Cooper, Smillie, Markett and Montag. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Martin Reuter, Department of Psychology, University of Bonn, Kaiser-Karl-Ring 9, 53111 Bonn, Germany martin.reuter@uni-bonn-diff.de

Download