Skip to main content

ORIGINAL RESEARCH article

Front. Behav. Neurosci., 28 February 2014
Sec. Learning and Memory
Volume 8 - 2014 | https://doi.org/10.3389/fnbeh.2014.00032

Fear conditioning of SCR but not the startle reflex requires conscious discrimination of threat and safety

  • 1Department of Clinical Psychology, Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, Netherlands
  • 2Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
  • 3Faculty of Psychology and Educational Sciences, Department of Psychology, University of Leuven, Leuven, Belgium

There is conflicting evidence as to whether awareness is required for conditioning of the skin conductance response (SCR). Recently, Schultz and Helmstetter (2010) reported SCR conditioning in contingency unaware participants by using difficult to discriminate stimuli. These findings are in stark contrast with other observations in human fear conditioning research, showing that SCR predominantly reflects contingency learning. Therefore, we repeated the study by Schultz and Helmstetter and additionally measured conditioning of the startle response, which seems to be less sensitive to declarative knowledge than SCR. While we solely observed SCR conditioning in participants who reported awareness of the contingencies (n = 16) and not in the unaware participants (n = 18), we observed startle conditioning irrespective of awareness. We conclude that SCR but not startle conditioning depends on conscious discriminative fear learning.

Introduction

There is a long-standing debate whether fear learning can occur without awareness of the relationship between the conditioned stimulus (CS) and the unconditioned stimulus (US). Some studies showed that conditioned skin conductance response (SCR) can take place in absence of contingency awareness (Esteves et al., 1994; Bechara et al., 1995; Knight et al., 2003, 2006). However, other studies showed that SCR conditioning can only be observed in parallel with the conscious expectancy of the CS to be followed by the US (Dawson and Biferno, 1973; Dawson and Furedy, 1976; Hamm and Vaitl, 1996; Purkis and Lipp, 2001; Lovibond and Shanks, 2002; Hamm and Weike, 2005; Weike et al., 2007). Importantly, under conditions that prevent both awareness and conditioning of SCR, conditioned startle potentiation could still be observed (Hamm and Vaitl, 1996; Weike et al., 2005, 2007).

The startle fear response is an automatic defensive reflex. It is potentiated in response to a CS that is associated with a US of negative valence (electrical stimulation), and can typically not be observed with USs of neutral valence (vibrotactile stimulation, reaction time task) (Lipp et al., 1994; Hamm and Vaitl, 1996). In contrast, affective valence of the US does not modify SCR conditioning, since it can occur irrespective of the valence of the US (Lipp et al., 1994; Hamm and Vaitl, 1996). As such, SCR is considered a non-specific measure of anticipatory arousal. In addition to the studies that show that SCR conditioning requires contingency learning (Dawson and Biferno, 1973; Dawson and Furedy, 1976; Hamm and Vaitl, 1996; Purkis and Lipp, 2001; Lovibond and Shanks, 2002; Hamm and Weike, 2005; Weike et al., 2005, 2007), both pharmacological and cognitive manipulations revealed that SCR is strongly related to expectancy learning. That is, propranolol administered before or after fear memory reactivation left both expectancy and SCR responding intact but reduced the startle response (Soeter and Kindt, 2010, 2011; Sevenster et al., 2012a). Moreover, the simple instruction that the CS would no longer be followed by the US eliminated both differential US-expectancy ratings and SCR (Hugdahl and Öhman, 1977; Hugdahl, 1978; Lipp and Edwards, 2002; Sevenster et al., 2012b) but not the startle fear response (Sevenster et al., 2012b). These results suggest that SCR responding appears to mirror expectancy beliefs (see also Lovibond, 2004), whereas the startle response can act independent from cognitive knowledge. In sum, there is conflicting evidence on the relation between contingency learning and SCR. One line of evidence shows that SCR does not require expectancy learning (Esteves et al., 1994; Bechara et al., 1995; Knight et al., 2003, 2006), while other evidence shows that SCR conditioning requires conscious knowledge of the contingencies (Dawson and Biferno, 1973; Dawson and Furedy, 1976; Hamm and Vaitl, 1996; Purkis and Lipp, 2001; Lovibond and Shanks, 2002; Lovibond, 2004; Hamm and Weike, 2005; Weike et al., 2005, 2007). Most evidence that SCR dissociates from expectancy learning comes from studies using a distractor task or subliminal presentation of the stimuli. These tasks often rely on post-conditioning questionnaires and can therefore not decisively demonstrate that contingency awareness was actually absent during the conditioning session (Dawson and Schell, 1985).

Recent findings (Schultz and Helmstetter, 2010) are in line with previous studies showing that SCR does not depend on expectancy learning and challenged the observed correspondence between contingency learning and SCR responding in other labs (Hamm and Vaitl, 1996; Lovibond, 2003; Weike et al., 2005, 2007; Soeter and Kindt, 2010; Sevenster et al., 2012b, 2013). Schultz and Helmstetter (2010) manipulated contingency awareness by constructing pairs of stimuli (CS+ and CS−) that were either easy or difficult to discriminate (see Figure 1). The easy condition involved a traditional fear discrimination procedure in which the participants were aware of the contingencies, whereas in the difficult condition the participants were supposedly unaware of the contingencies. US-expectancy and SCR were registered concurrently during the conditioning session. Differential US-expectancy ratings were observed in the easy but not in the difficult condition, whereas differential SCR was observed in both the easy and difficult discrimination condition. These findings indeed suggest that SCR conditioning does not depend on contingency awareness.

FIGURE 1
www.frontiersin.org

Figure 1. The conditioned stimuli (CS+ and CS−) were either easy (Easy condition) or difficult to discriminate (Difficult condition).

The dissociation between expectancy learning and SCR conditioning observed by Schultz and Helmstetter (2010) is remarkable in the light of the typical strong convergence between expectancy learning and SCR conditioning. One explanation may be that the manipulations employed in those previous studies are simply not appropriate for dissociating the two conditioned response systems. Alternatively, studies that do not find SCR conditioning among unaware participants often use post-conditioning questionnaires (Hamm and Vaitl, 1996; Weike et al., 2005, 2007). Retrospective ratings of awareness are susceptible to forgetting or interference and may be insensitive to subtle discrimination of the CSs (Knight et al., 2003; Smith et al., 2005). The concurrent measurements of US-expectancy ratings and psychophysiological conditioned responding—a strong feature of the study by Schultz and Helmstetter (2010)—clearly overcomes this limitation. However, a shortcoming of the study by Schultz and Helmstetter (2010) is that more than half of the participants who were meant to be unaware of the learned association (difficult discrimination condition) actually demonstrated a certain degree of awareness of the CS-US contingencies. That is, a more tolerant criterion for contingency awareness revealed that more than half of the remaining, supposedly unaware participants (6 out of 10) did achieve some level of contingency knowledge in the difficult discrimination condition. The follow-up analyses showed that the six aware and the four unaware participants did not differ in SCR conditioning; it was therefore concluded that the results were not confounded by the participants’ contingency awareness. However, the small sample sizes (n = 4 vs. n = 6) make the observation of a significant difference between those two groups unlikely.

To further investigate the role of awareness in conditioned responding, we repeated the study by Schultz and Helmstetter (2010), but we increased sample sizes to allow investigation of differential SCR in participants who unintentionally acquired a certain degree of awareness and participants who were strictly unaware within the difficult condition. We expected differential SCR in the easy condition and for the difficult condition only in the participants who became aware of the contingencies during fear conditioning. Given the previously observed dissociation between US-expectancy learning and the fear potentiated startle response, we additionally tested whether conditioning of the startle response would occur irrespective of contingency awareness. A recent replication study demonstrated that trial sequence might account for the apparently unaware SCR conditioning (Singh et al., 2013). Singh et al. (2013) tested the effect of trial sequence because in previous research unaware conditioning effects could be explained by predictable trial sequence (Wiens et al., 2003). They observed that despite being classified as being unaware of the contingencies, participants in the difficult condition reported greater shock expectancy and SCR to CS+ compared to CS− on alternating trials. This effect was significantly reversed (greater responding to CS− than CS+) on non-alternating trials. Given that trial sequence effects can thus provide an alternative explanation for supposedly unaware conditioning effects, we additionally explored the effect of predictable stimulus presentation on SCR and startle conditioning.

Materials and Methods

Participants

Thirty-seven (20 male; 17 female) healthy undergraduate students participated in the study, ranging in age between 18 and 27 years (M = 21.73, SD = 2.31). Participants received either partial course credit or a small amount of money for their participation. All participants gave informed consent and were notified that they could withdraw from participation at any time. Participants were medically screened to assure they were free from a physical (i.e., heart disease or epilepsy) or psychiatric disorder. The Ethics Committee of the University of Amsterdam approved the study. Participants (n = 37) were randomly assigned to either the easy (n = 18) or the difficult condition (n = 19). Two unaware participants in the easy condition and one aware participant in the difficult condition were excluded from analysis, resulting in n = 16 in the easy and n = 18 participants in the difficult condition.

Apparatus

Stimuli

The conditioned stimuli (CS) were adapted from Schultz and Helmstetter (2010) and consisted of two pairs of complex sine wave gratings, composed of high and low frequency components (Figure 1). The high frequency component was equal for all stimuli. The low frequency components were adjusted so as to create conditions in which the two stimuli would be easy (easy condition) or difficult (difficult condition) to discriminate. Electrical stimulation of 2 ms was delivered through a pair of Ag electrodes of 20 by 25 mm with a fixed inter-electrode mid-distance of 45 mm, attached to the wrist, not the ankle (Schultz and Helmstetter, 2010). Shock deliverance was controlled by a Digitimer DS7A constant current stimulator (Hertfordshire, UK). Between the electrodes and the skin a conductive gel (Signa, Parker) was applied. US-intensity level was determined by gradually increasing shock intensity (starting at 1 mA) until subjects indicated the shock to be “uncomfortable though not painful”. Note that in the procedure used by Schultz and Helmstetter (2010) 7.5 mA was the maximum possible output current. Mean US-intensity is therefore likely to be higher in the current study. However, US-duration was substantially shorter in our study (2 vs. 500 ms), decreasing the impact of the US.

Fear potentiated startle

Startle response was measured through electromyography (EMG) of the right orbicularis oculi muscle. Two 6 mm sintered Ag/AgCl electrodes filled with a conductive gel (Signa, Parker) were positioned approximately 1 cm under the pupil and 1 cm below the lateral canthus, respectively; a ground electrode was placed on the forehead, 1 cm below hairline (Blumenthal et al., 2005). The startle probe was a 40 ms duration noise burst (104 dB) with a rise/fall time shorter than 1 ms, which was presented binaurally through headphones (Sennheiser, model HD 25-1 II). The EMG signal was amplified in two stages. The input stage had an input resistance of 10 MOhm, a frequency response of DC-1500 Hz and an amplification factor of 200. A 50-Hz notch filter was used to reduce interference of the mains noise. The second stage amplified the signal with a variable amplification factor of 0–100 x. The raw EMG signal was sampled at 1000 Hz and band-pass filtered (28–500 Hz, Butterworth, 4th order; Blumenthal et al., 2005) to obtain the cleanest possible data without affecting response amplitude. After rectifying and contour following (time constant = 10 ms) the peak amplitude was found by analyzing the first derivative of the resulting signal in a 30–150 ms interval following probe onset.

Skin conductance response

Electrodermal activity was measured using an input device with a sine-shaped excitation voltage (1 V peak-peak) of 50 Hz, which was derived from the mains frequency. Two Ag/AgCl electrodes of 20 by 16 mm were attached with adhesive tape to the medial phalanges of the first and third fingers of the non-preferred hand. The skin conductance level (SCL) signal from the input device was converted to 0.2 V/uS by a current to voltage converter. Startle response and electrodermal activity were recorded with the software program VSSRP98 at 1000 Hz. SCL was determined at 0.5 s intervals, both in the −2–0 s baseline window and the 0–7 s window after CS onset. Scores for the entire-interval response (EIR) were calculated by subtracting the mean SCL for the 2 s baseline immediately preceding CS onset from the highest SCL value recorded during the 0–7 s window after CS onset (Pineles et al., 2009), before the onset of the startle probe. This is a well-established approach of examining electrodermal reactivity (SCR) and has been used extensively in human psychophysiological research (Orr and Lanzetta, 1980; Pitman and Orr, 1986; Orr et al., 2000; Milad et al., 2005; Pineles et al., 2009; Raes et al., 2011).

Online unconditioned stimulus (US)-expectancy ratings

US-expectancy was measured continuously (5 samples/s), on an 11-point scale ranging from “certainly no electric stimulus” (−5) through “uncertain” (0) to “certainly an electric stimulus” (5). The scale was placed at the bottom of the screen. Participants rated US-expectancy levels by shifting the cursor on the scale with use of the mouse. Subjects were not informed about CS-US contingencies and were instructed to update their US-expectancy throughout the experiment. Continuous US-expectancy ratings during the last 4 s of CS presentation were averaged for each CS presentation. Ratings were converted to a 0–100 scale to be consistent with Schultz and Helmstetter (2010).

Subjective assessments

Evaluation of the US was assessed on an 11-point scale ranging from “unpleasant” (−5) to “pleasant” (5). General level of anxiety was measured with the Trait Anxiety Inventory (STAI-T; Spielberger et al., 1970) to control for general level of anxiety.

Procedure

After giving informed consent participants were seated in front of a computer screen in a sound-attenuated room. The EMG, SCR and shock electrodes were attached and US-intensity level was determined by gradually increasing shock intensity (starting at 1 mA) until subjects indicated the shock to be “uncomfortable though not painful”. The experiment started with 10 startle habituation trials to stabilize baseline startle reactivity. To assess baseline startle responding during the experimental phase, startle probes alone (Noise Alone; NA) were presented in addition to the CS presentations. Throughout the entire conditioning phase participants continuously rated their US-expectancy.

Fear conditioning

The testing procedure was adapted from Schultz and Helmstetter (2010). In the current study NA trials were presented in addition to the CS presentations. Stimuli (CS+, CS−, NA) were presented randomly in a block of three trials. The CSs consisted of two different images depicting complex sine wave gratings. Both CSs were presented eight times, with a duration of 8 s. The experiment consisted of eight consecutive blocks. One of the images (CS+) was paired with a mild shock to the wrist (US) on all the eight trials, whereas the other picture was never paired with a shock (CS−). A startle probe (40 ms; 104 dB) was delivered 7 s after CS onset, followed by the US after another 500 ms. The US consisted of an electrical stimulus (2 ms). Note that delivery of neither the startle probe nor the US interfered with measurement of SCR as maximum SCR score was determined during 7 s following stimulus onset before the startle probe and the US onset. Intertrial intervals (ITI) varied from 15 s to 25 s with an average of 20 s. The stimuli that were easy to discriminate served as CSs in the easy condition and the stimuli that were difficult to discriminate served as CSs in the difficult condition (Figure 1). Participants did not receive information about the CS-US relationship. They were instructed to continuously place the cursor of the mouse on the position on the scale corresponding to their US-expectancy, ranging from “certainly no electric stimulus” (−5) through “uncertain” (0) to “certainly an electric stimulus” (5). After conclusion of the experimental phase, participants filled in the trait anxiety (STAI-T) questionnaire and rated US-pleasantness.

Awareness

Continuous US-expectancy ratings during the last 4 s of CS duration were averaged for each CS presentation. Awareness was defined according to the two criteria set by Schultz and Helmstetter (2010). First, participants were classified as aware when in a sliding window of five consecutive CS presentations ratings to the CS+ were higher than 75 and ratings to the CS− were lower than 25 with at least two trials of each CS type. In the second series of analyses the effect of trial sequence on conditioned responding in the easy and difficult condition was taken into account. Second, participants were classified as aware according to the more tolerant criterion for contingency awareness when in a sliding window of four consecutive CS presentations ratings to the CS+ were higher than 50 and ratings to the CS− were lower than 50 with at least two trials of each CS type.

Data Analysis

US-intensity, US-evaluation and STAI-T scores were subjected to ANOVAs with condition (easy vs. difficult) as between-subjects factor. Startle and skin conductance response outliers were defined by means of within-participants Z-scores (Z > 3) and replaced by linear trend at point. SCRs were mean corrected, to equalize the opportunity for each subject to contribute to the group mean (Lovibond et al., 1988). The mean value used for correction was based on the eight conditioning trials. US-expectancy, skin conductance and startle potentiation data were averaged over all eight conditioning trials, resulting in a single mean response to the CS+ and a single mean response to the CS−. US-expectancy ratings, startle responses and electrodermal activity were then subjected to a mixed analysis of variance for repeated measures (ANOVA) with condition (easy vs. difficult) as between-subjects factor and stimulus (CS+ vs. CS−) and trial sequence (alternating vs. non-alternating) as within-subjects factor. The alpha level was set at 0.05 for statistical analyses.

Results

Easy vs. Difficult

First, we analyzed the data according to Schultz and Helmstetter (2010). Awareness was defined as five consecutive CS presentations during which US-expectancy ratings to the CS+ were higher than 75 and US-expectancy ratings to the CS− were lower than 25. Based on this criterion two unaware participants in the easy condition and one aware participant in the difficult condition were excluded from further analysis, resulting in n = 16 in the easy and n = 18 participants in the difficult condition. The individually set shock intensity ranged from 6 to 40 mA (M = 19.09, SD = 8.83). There was no difference in US-intensity, US-evaluation and reported trait anxiety (Fs < 1) between the aware and unaware participants (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Mean values (SD) of the US-intensity, US-evaluation, and trait anxiety (STAI-T) for the Easy (n = 16) and Difficult conditions (n = 18).

Unconditioned stimulus (US)-expectancy ratings

Analysis revealed a difference between conditions in differential US-expectancy (stimulus x condition; F(1, 32) = 173.43, p < 0.001, ηp2=0.84). US-expectancy ratings to the CS+ were higher compared to the CS− in the easy condition (main effect stimulus; F(1, 15) = 311.99, p < 0.001, ηp2=0.95), while this difference was absent in the difficult condition (main effect stimulus; F(1, 17) < 1) (Figure 2A).

FIGURE 2
www.frontiersin.org

US-expectancy ratings (A), skin conductance responses (B) and startle responses (C) to the CS+ and CS− for the Easy (n = 16) and Difficult (n = 18) conditions. Error bars represent s.e.m.

Skin conductance response

We observed a near-significant difference in SCR conditioning between the easy and difficult condition (stimulus × condition; F(1, 32) = 2.99, p < 0.094, ηp2=0.09) (Figure 2B). In line with the US-expectancies, we found higher SCR to the CS+ compared to the CS− in the easy condition (main effect stimulus; F(1, 15) = 5.55, p < 0.032, ηp2=0.27), while we did not observe such differential responding in the difficult condition (main effect stimulus; F(1, 17) < 1). Thus in contrast to Schultz and Helmstetter (2010), we found that contingency awareness is a prerequisite for SCR conditioning.

Startle fear response

The easy and difficult condition differed neither on startle habituation (trials 1–10; stimulus × condition; F(4.78, 152.99) < 1) nor on startle responding during the ITI (trials 1–8; stimulus × condition; F(5.03, 161) < 1.12). Even though the easy and difficult condition did not differ in conditioning of differential startle fear response (stimulus × condition; F(1, 32) < 1), we observed general startle conditioning evidenced by stronger startle potentiation to the CS+ compared to the CS− (main effect stimulus; F(1, 32) = 5.84, p < 0.022, ηp2=0.15) (Figure 2C). Follow-up analyses showed that conditioning of the startle was present in the difficult condition (main effect stimulus; F(1, 17) = 4.78, p < 0.043, ηp2=0.22) but not in the easy condition (main effect stimulus; F(1, 15) < 1.66). Note that while startle conditioning was absent on the first trial (main effect stimulus; F(1, 15) < 1), there was a significant effect of differential responding during the second to the fifth trial of early conditioning in the easy condition (trials 2–5; main effect stimulus; F(1, 15) = 4.61, p < 0.05, ηp2=0.24). This effect collapsed towards the end of conditioning (trials 6–8; main effect stimulus; F(1, 15) < 1).

Tolerant Criterion of Awareness

Schultz and Helmstetter (2010) adjusted the contingency criterion to divide the difficult condition into participants who approached the criteria for awareness and participants who did not approach awareness. They argued that by this means it could be ensured that differential SCR in the difficult condition was not influenced by a few participants who may have achieved some level of contingency knowledge. Participants were classified as approaching contingency knowledge when they rated the CS+ over 50 and the CS− under 50 on four consecutive trials in a sliding window. We applied a similar criterion to the difficult condition in the current study which resulted in a small sample (n = 4 unaware). Note that we did not further analyze within the difficult group. First, in contrast to Schultz and Helmstetter (2010) we do not need to exclude that differential SCR for the difficult condition was influenced by a few participants, given that differential SCR was absent in the difficult condition. Second, as mentioned in the introduction, comparing groups of n = 4 with n = 15 makes it unlikely to find any group differences.

Easy vs. Difficult: Trial Sequence

A recent study showed that stimulus presentation sequence could account for unaware differential SCR (Singh et al., 2013). Thus, what initially appeared to be unaware differential SCR conditioning could also be explained by expectancy “learning”, arising from a predictable trial sequence. In the current study we presented the stimuli (CS+, CS−, NA) randomly within a block, for eight consecutive blocks. Similar to the Schultz and Helmstetter study, this presentation scheme increases the probability of shock deliverance when a preceding trial is not reinforced. In contrast, when a preceding trial is reinforced the probability of shock deliverance decreases. Therefore, we re-analyzed the data with trial sequence (alternating vs. non-alternating) as an additional within subjects factor. Following Singh et al. (2013) we separately averaged conditioned responses (US-expectancy, SCR, startle response) for CS+ and CS− trials that were preceded by an opposite CS type (e.g., CS− followed by CS+; alternating trial) or a similar CS type (e.g., CS+ followed by CS+; non-alternating trial). The first two trials were not included in the analyses, since expectancies based on trial sequence could not yet have been formed for those trials (Singh et al., 2013). Note that trial sequences were not fixed, since stimulus presentation (CS+, CS−, NA) was randomized within a block of 3 trials, resulting in minimally 3 and maximally 7 alternating trials and minimally 0 and maximally 4 non-alternating trials.

Unconditioned stimulus (US)-expectancy ratings

Differential ratings were greater in the easy condition compared to the difficult condition on both alternating (stimulus × condition; F(1, 32) = 83.82, p < 0.001, ηp2=0.72) and non-alternating trials (stimulus × condition; F(1, 28) = 54.36, p < 0.001, ηp2=0.66) (Figure 3A). Both on alternating (main effect stimulus; F(1, 15) = 350.20, p < 0.001, ηp2=0.96) and non-alternating trials (main effect stimulus; F(1, 12) = 78.71, p < 0.001, ηp2=0.87) responding to the CS+ was higher compared to the CS− in the easy condition. Participants in the difficult condition capitalized on trial sequence, evidenced by higher ratings to the CS+ compared to the CS− on alternating trials (main effect stimulus; F(1, 17) = 6.56, p < 0.020, ηp2=0.28), while on non-alternating trials this pattern was reversed with higher responding to the CS− compared to the CS+ (main effect stimulus; F(1, 16) = 6.06, p < 0.026, ηp2=0.28). Thus, in line with previous findings (Singh et al., 2013), we found that trial sequence can result in US-expectancy learning when stimuli are in fact difficult to discriminate.

FIGURE 3
www.frontiersin.org

US-expectancy ratings (A), skin conductance responses (B) and startle responses (C) to the CS+ and CS− on alternating and non-alternating trials for the Easy (n = 16) and Difficult (n = 18) conditions. Error bars represent s.e.m. * p < 0.05.

Skin conductance response

Differential responding was greater in the easy condition compared to the difficult condition on the alternating trials (stimulus × condition; F(1, 32) = 7.38, p < 0.011, ηp2=0.19) (Figure 3B). Indeed, responding to the CS+ was higher compared to the CS− in the easy condition on alternating trials (main effect stimulus; F(1, 15) = 11.00, p < 0.001, ηp2=0.42). Contrary to the previous findings (Singh et al., 2013), this effect was not observed in the difficult condition (main effect stimulus; F(1, 17) < 1). The easy and difficult condition did not differ on SCR on non-alternating trials (stimulus × condition; F(1, 28) < 1). Follow-up analyses confirmed that differential SCR was absent in both conditions on non-alternating trials (main effect stimulus; Fs < 1.05).

Startle fear response

The easy and difficult condition did not differ on startle response on both alternating and non-alternating trials (stimulus × condition; Fs < 1) (Figure 3C). There was near-significantly more startle responding to the CS+ compared to the CS− on both alternating (main effect stimulus; F(1, 32) = 3.50, p < 0.071, ηp2=0.10) and non-alternating trials (main effect stimulus; F(1, 28) = 2.96, p < 0.096, ηp2=0.10). In sum, we replicated the US-expectancy results of Singh et al. (2013). Predictable trial sequence did facilitate expectancy learning in spite of difficult to discriminate stimuli. However, trial sequence only facilitated differential SCR in the easy but not in the difficult condition. Differential startle responding was not affected by trial sequence.

Discussion

The aim of the present study was to investigate whether startle and SCR conditioning correspond with contingency awareness. First, the main finding was that startle conditioning can occur independent of contingency awareness. We observed differential conditioning of the fear potentiated startle, in spite of difficult to discriminate CS. While the easy and difficult conditions did not differ in startle responding, we unexpectedly did not observe startle conditioning in the easy condition. Thus, startle responding to the CS+ was not higher than startle responding to the CS− when analyzing the eight conditioning trials together. However, participants in the easy condition showed startle conditioning at the beginning of the fear acquisition phase, but this effect was no longer present by the end of conditioning. Visual inspection of the graphs suggests a similar pattern of conditioning over trials for the startle response in the difficult condition and SCR in the easy condition. The observation of a transient physiological conditioning effect contrasts with our previous studies in which we did observe SCR and startle conditioning during late acquisition (Kindt et al., 2009; Soeter and Kindt, 2010; Sevenster et al., 2012a). In these studies we used fear-relevant stimuli, while in the current study CSs consisted of neutral pictures. The absence of differential psychophysiological responding at the end of conditioning in the current study might be explained by faster habituation to neutral CSs than to fear-relevant stimuli (Lovibond et al., 1994).

Second, SCR appeared to covary with the US-expectancy ratings, demonstrated by differential SCR conditioning in the easy but not in the difficult condition. While Schultz and Helmstetter (2010) found more electrodermal responding to the CS+ compared to the CS−, irrespective of the difficulty to perceptually discriminate these stimuli, we did not replicate these findings. More than half of the participants in the difficult condition showed contingency awareness according to the tolerant criterion in their study, but only 4 out of the 19 participants in the difficult condition met the same awareness criterion in the current study. Therefore, SCR conditioning in the study by Schultz and Helmstetter (2010) can arguably be attributed to the relatively large sample of participants who unintentionally acquired some level of contingency awareness in the difficult condition. It is hard to explain the differences in proportion of aware vs. unaware subjects between the study by Schultz and Helmstetter and the current study. We might therefore question the reliability of this approach to assess contingency awareness. Note, however, that the validity of the currently used approach is higher relative to the use of post-experimental questionnaires, as the online measurement of expectancy learning overcomes many of the limitations of retrospective contingency assessment (see Lovibond and Shanks, 2002; Schultz and Helmstetter, 2010).

A previously proposed alternative explanation for the findings by Schultz and Helmstetter (2010) is that participants classified as aware in the difficult condition could have capitalized on the trial sequence to predict the occurrence of the US, as was convincingly argued in a recent replication study (Singh et al., 2013). When presentation of the CS+ and CS− followed an alternating sequence, participants not only showed higher US-expectancy to the CS+ compared to the CS−, but also differential SCR. Thus, although incapable of discriminating the two CSs, predictable trial sequence may have resulted in unintended “contingency awareness” and subsequent differential SCR conditioning. We partly replicated this effect, by showing that expectancy “learning” occurred on alternating but not on non-alternating trials when stimuli were difficult to discriminate. If unintended contingency awareness indeed results in SCR conditioning, as demonstrated by Singh et al. (2013), SCR conditioning should have been present on alternating trials, irrespective of condition. However, while we observed differential SCR on alternating trials in the easy condition, expectancy “learning” did not result in differential SCR in the difficult condition. In the current study participants in the difficult condition did apparently not benefit from a predictable trial sequence. Our design differed from Singh et al. (2013) in that their conditioning procedure was extended with two more blocks of CS presentations. These additional trials might have been essential for the participants to capitalize on rules about the trial sequence. Surprisingly, we found that differential SCR was affected by trial sequence in aware participants. This shows that awareness may be required but not necessarily sufficient for differential SCR to occur, since SCR was absent for the non-alternating trials in participants who reported awareness of the contingency. This stresses the urge to control for trial sequence in fear conditioning research, especially when using SCR as a measure of conditioned responding. Notably, differential startle responding occurred irrespective of condition and trial sequence.

Fear is considered to be characterized by both high arousal and negative valence (Lang, 1995). While it would be tempting to speculate on the differential role of valence and arousal in SCR and startle conditioning (Bradley and Vrana, 1993; Bradley et al., 1993; Lang, 1995), it is hard to actually dissociate valence and arousal by means of these psychophysiological measures. Potentiation of the startle reflex is generally associated with valence and SCR with arousal. But the startle reflex is also modulated by arousal: negative pictures evaluated as most arousing produce greatest startle potentiation, while positive pictures evaluated as most arousing produce greatest startle inhibition. In contrast, an increase of SCR has been demonstrated for both negative and positive pictures which are evaluated as most arousing (Cuthbert et al., 1996). Thus, negative valence engages the defensive system and arousal in turn modulates the degree of activation of the defensive system. In sum, it is hard to distinguish between the influence of valence and arousal on startle conditioning under circumstances that induce both as is probably the case in fear conditioning. Nevertheless, given that valence is a necessary condition for startle potentiation to occur while SCR can be established independent from negative valence, the startle response does seem a more specific index of fear than SCR.

In line with previous evidence, the current study shows that the startle response does not mirror expectancy learning and SCR. The dissociation between the response systems raises important questions concerning the function of unaware startle conditioning. Remarkably, the unaware startle conditioning effect seems to be of a transient nature, since it is no longer observed during an extinction phase immediately following conditioning (Weike et al., 2007). Imaging research already showed that conditioning-related neural responses can take place in absence of awareness and SCR conditioning (Tabbert et al., 2011). It would be interesting to see whether evidence for an intact memory representation of unaware conditioning can still be observed at a later retention test. If there is no indication that the immediately developed unaware conditioned responding outlasts the conditioning phase—either behaviorally or neurally—the question is whether there is any adaptive value in the online but transient development of automatic conditioned responding.

The current findings are not easily reconciled with a single-process model of fear learning. This account would predict that contingency awareness affects the startle response to a similar degree as expectancy learning and SCR. Yet, we demonstrated that, contrary to the startle response, acquisition of both US-expectancy and SCR no longer takes place when using difficult-to-discriminate stimuli. As such, the current findings suggest that fear learning involves at least two processes. The US-expectancy ratings and the closely associated SCR seem to reflect the propositional level of associative fear learning, whereas the startle response may be better explained in terms of a more automatic, low-level index of fear. The finding that the conditioned responses involved in associative learning rely on different neural circuits further challenges the single-process account. That is, declarative knowledge of the CS-US contingencies relies among other brain areas on the hippocampal complex (Hamm and Weike, 2005; Weike et al., 2005; Hunsaker and Kesner, 2013). In contrast, the startle response is an amygdala-initiated response and therefore considered to reflect the brain’s subcortical defense system (Walker and Davis, 2002; LeDoux, 2003) (for a more elaborate discussion on the single vs. dual process account and its neural underpinnings see Sevenster et al., 2012b).

Note that while we consider SCR not an optimal correlate for fear, we do not argue that SCR is not a suitable measure in human fear conditioning research. During standard fear conditioning and extinction procedures, the measures corresponding to different response systems generally converge into similar learning patterns (Vansteenwegen et al., 2005; Soeter and Kindt, 2010, 2011; Vervliet et al., 2010; Sevenster et al., 2012a,b). Only specific manipulations—either pharmacological or behavioral—may reveal the differences between these conditioned responses (Soeter and Kindt, 2010, 2011; Sevenster et al., 2012a,b, Sevenster et al., 2013). In human fear conditioning research, multiple indices of the behavioral expression of fear (e.g., US expectancies, distress ratings, SCR, startle potentiation) are usually obtained for reasons of cross-validation. Given that these measures of fear learning do not necessarily converge (Hamm and Weike, 2005; Kindt et al., 2009; Soeter and Kindt, 2010; Sevenster et al., 2012a,b, Sevenster et al., 2013; Beckers et al., 2013), future research should incorporate this apparent divergence by predicting a priori (differential) effects for the different dependent variables used to measure fear learning.

Author Contributions

Dieuwke Sevenster, Tom Beckers and Merel Kindt designed the study. Dieuwke Sevenster analyzed the data. Dieuwke Sevenster and Merel Kindt wrote the manuscript. Tom Beckers provided revision of the manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank B. Molenkamp for his technical assistance and F. Geurts for collecting the data. This study was funded by a Vici grant (Merel Kindt) from the Netherlands Organization for Scientific Research. Tom Beckers is supported by a Vidi grant from the Netherlands Organization for Scientific Research.

References

Bechara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., and Damasio, A. (1995). Double dissociation of conditioning and declarative knowledge relative to the amygdala and hippocampus in humans. Science 269, 1115–1118. doi: 10.1126/science.7652558

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Beckers, T., Krypotos, A., Boddez, Y., Effting, M., and Kindt, M. (2013). What’s wrong with fear conditioning? Biol. Psychol. 92, 90–96. doi: 10.1016/j.biopsycho.2011.12.015

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Blumenthal, T. D., Cuthbert, B. N., Filion, D. L., Hackley, S., Lipp, O. V., and Boxtel, A. V. (2005). Committee report: guidelines for human startle eyeblink electromyographic studies. Psychophysiology 42, 1–15. doi: 10.1111/j.1469-8986.2005.00271.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Bradley, M. M., Lang, P. J., and Cuthbert, B. N. (1993). Emotion, novelty and the startle reflex: habituation in humans. Behav. Neurosci. 107, 970–980. doi: 10.1037/0735-7044.107.6.970

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Bradley, M. M., and Vrana, S. R. (1993). “The startle probe in the study of emotion and emotional disorders,” in The Structure of Emotion, eds N. Birbaumer and A. Ohman (Toronto: Hogrefe-Huber), 270–287.

Cuthbert, B. N., Bradley, M. M., and Lang, P. J. (1996). Probing picture perception: activation and emotion. Psychophysiology 33, 103–111. doi: 10.1111/j.1469-8986.1996.tb02114.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Dawson, M. E., and Biferno, M. A. (1973). Concurrent measurement of awareness and electrodermal classical conditioning. J. Exp. Psychol. 101, 55–62. doi: 10.1037/h0035524

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Dawson, M. E., and Furedy, J. J. (1976). The role of awareness in human differential autonomic classical conditioning: the necessary-gate hypothesis. Psychophysiology 13, 50–53. doi: 10.1111/j.1469-8986.1976.tb03336.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Dawson, M. E., and Schell, A. M. (1985). Information processing and human autonomic classical conditioning. Adv. Psychophysiol. 1, 89–165

Esteves, F., Parra, C., Dimberg, U., and Öhman, A. (1994). Nonconscious associative learning: Pavlovian conditioning of skin conductance responses to masked fear-relevant facial stimuli. Psychophysiology 31, 375–385. doi: 10.1111/j.1469-8986.1994.tb02446.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Hamm, A. O., and Vaitl, D. (1996). Affective learning: awareness and aversion. Psychophysiology 33, 698–710. doi: 10.1111/j.1469-8986.1996.tb02366.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Hamm, A. O., and Weike, A. I. (2005). The neuropsychology of fear learning and fear regulation. Int. J. Psychophysiol. 57, 5–14. doi: 10.1016/j.ijpsycho.2005.01.006

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Hugdahl, K. (1978). Electrodermal conditioning to potentially phobic stimuli: effects of instructed extinction. Behav. Res. Ther. 16, 315–321. doi: 10.1016/0005-7967(78)90001-3

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Hugdahl, K., and Öhman, A. (1977). Effects of instruction on acquisition and extinction of electrodermal responses to fear-relevant stimuli. J. Exp. Psychol. Hum. Learn. 3, 608–618. doi: 10.1037//0278-7393.3.5.608

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Hunsaker, M. R., and Kesner, R. P. (2013). The operation of pattern separation and pattern completion processes associated with different attributes or domains of memory. Neurosci. Biobehav. Rev. 37, 36–58. doi: 10.1016/j.neubiorev.2012.09.014

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Kindt, M., Soeter, M., and Vervliet, B. (2009). Beyond extinction: erasing human fear responses and preventing the return of fear. Nat. Neurosci. 12, 256–258. doi: 10.1038/nn.2271

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Knight, D. C., Nguyen, H. T., and Bandettini, P. A. (2003). Expression of conditional fear with and without awareness. Proc. Natl. Acad. Sci. U S A 100, 15280–15283. doi: 10.1073/pnas.2535780100

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Knight, D. C., Nguyen, H. T., and Bandettini, P. A. (2006). The role of awareness in delay and trace fear conditioning in humans. Cogn. Affect. Behav. Neurosci. 6, 157–162. doi: 10.3758/cabn.6.2.157

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lang, P. J. (1995). The emotion probe: studies of motivation and attention. Am. Psychol. 50, 372–385. doi: 10.1037//0003-066X.50.5.372

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

LeDoux, J. E. (2003). The emotional brain, fear and the amygdala. Cell. Mol. Neurobiol. 23, 727–738. doi: 10.1023/A:1025048802629

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lipp, O. V., and Edwards, M. S. (2002). Effect of instructed extinction on verbal and autonomic indices of Pavlovian learning with fear-relevant and fear-irrelevant conditional stimuli. J. Psychophysiol. 16, 176–186. doi: 10.1027//0269-8803.16.3.176

CrossRef Full Text

Lipp, O. V., Sheridan, J., and Siddle, D. A. T. (1994). Human blink startle during aversive and nonaversive Pavlovian conditioning. J. Exp. Psychol. Anim. Behav. Process. 20, 380–388. doi: 10.1037//0097-7403.20.4.380

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lovibond, P. F. (2003). Causal beliefs and conditioned responses: retrospective revaluation induced by experience and by instruction. J. Exp. Psychol. Learn. Mem. Cogn. 29, 97–106. doi: 10.1037/0278-7393.29.1.97

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lovibond, P. F. (2004). Cognitive processes in extinction. Learn. Mem. 11, 495–500. doi: 10.1101/lm.79604

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lovibond, P. F., Hanna, S. K., Siddle, D. A. T., and Bond, N. W. (1994). Electrodermal and subjective reactions to fear-relevant stimuli under threat of shock. Aust. J. Psychol. 46, 73–80. doi: 10.1080/00049539408259476

CrossRef Full Text

Lovibond, P. F., and Shanks, D. R. (2002). The role of awareness in Pavlovian conditioning: empirical evidence and theoretical implications. J. Exp. Psychol. Anim. Behav. Process. 28, 3–26. doi: 10.1037//0097-7403.28.1.3

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lovibond, P. F., Siddle, D. A. T., and Bond, N. (1988). Insensitivity to stimulus validity in human Pavlovian conditioning. Q. J. Exp. Psychol. B 40, 377–410.

Pubmed Abstract | Pubmed Full Text

Milad, M. R., Orr, S. P., Pitman, R. K., and Rauch, S. L. (2005). Context modulation of memory for fear extinction in humans. Psychophysiology 42, 456–464. doi: 10.1111/j.1469-8986.2005.00302.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Orr, S. P., and Lanzetta, J. T. (1980). Facial expressions of emotion as conditioned stimuli for human autonomic responses. J. Pers. Soc. Psychol. 38, 278–282. doi: 10.1037/0022-3514.38.2.278

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Orr, S. P., Metzger, L. J., Lasko, N. B., Macklin, M. L., Peri, T., and Pitman, R. K. (2000). De novo conditioning in trauma-exposed individuals with and without posttraumatic stress disorder. J. Abnorm. Psychol. 109, 290–298. doi: 10.1037/0021-843x.109.2.290

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Pineles, S. L., Orr, M. R., and Orr, S. P. (2009). An alternative scoring method for skin conductance responding in a differential fear conditioning paradigm with a long-duration conditioned stimulus. Psychophysiology 46, 984–995. doi: 10.1111/j.1469-8986.2009.00852.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Pitman, R. K., and Orr, S. P. (1986). Test of the conditioning model of neurosis: differential aversive conditioning of angry and neutral facial expressions in anxiety disorder patients. J. Abnorm. Psychol. 95, 208–213. doi: 10.1037/0021-843x.95.3.208

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Purkis, H. M., and Lipp, O. V. (2001). Does affective learning exist in the absence of contingency awareness? Learn. Motiv. 32, 84–99. doi: 10.1006/lmot.2000.1066

CrossRef Full Text

Raes, A. K., Houwer, J. D., Verschuere, B., and Raedt, R. D. (2011). Return of fear after retrospective inferences about the absence of an unconditioned stimulus during extinction. Behav. Res. Ther. 49, 212–218. doi: 10.1016/j.brat.2010.12.004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Schultz, D. H., and Helmstetter, F. J. (2010). Classical conditioning of autonomic fear responses is independent of contingency awareness. J. Exp. Psychol. Anim. Behav. Process. 36, 495–500. doi: 10.1037/a0020263

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Sevenster, D., Beckers, T., and Kindt, M. (2012a). Retrieval per se is not sufficient to trigger reconsolidation of human fear memory. Neurobiol. Learn. Mem. 97, 338–345. doi: 10.1016/j.nlm.2012.01.009

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Sevenster, D., Beckers, T., and Kindt, M. (2012b). Instructed extinction differentially affects the emotional and cognitive expression of associative fear memory. Psychophysiology 49, 1426–1435. doi: 10.1111/j.1469-8986.2012.01450.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Sevenster, D., Beckers, T., and Kindt, M. (2013). Prediction error governs pharmacologically induced amnesia for learned fear. Science 339, 830–833. doi: 10.1126/science.1231357

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Singh, K., Dawson, M. E., Schell, A. M., Courtney, C. G., and Payne, A. F. (2013). Can human autonomic classical conditioning occur without contingency awareness? The critical importance of the trial sequence. Biol. Psychol. 93, 197–205. doi: 10.1016/j.biopsycho.2013.02.007

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Smith, C. N., Clark, R. E., Manns, J. R., and Squire, L. R. (2005). Acquisition of differential delay eyeblink classical conditioning is independent of awareness. Behav. Neurosci. 119, 78. doi: 10.1037/0735-7044.119.1.78

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Soeter, M., and Kindt, M. (2010). Dissociating response systems: erasing fear from memory. Neurobiol. Learn. Mem. 94, 30–41. doi: 10.1016/j.nlm.2010.03.004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Soeter, M., and Kindt, M. (2011). Disrupting reconsolidation: pharmacological and behavioral manipulations. Learn. Mem. 18, 357–366. doi: 10.1101/lm.2148511

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Spielberger, C. D., Gorsuch, R. L., and Lushene, R. E. (1970). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.

Tabbert, K., Merz, C. J., Klucken, T., Schweckendiek, J., Vaitl, D., Wolf, O. T., et al. (2011). Influence of contingency awareness on neural, electrodermal and evaluative responses during fear conditioning. Soc. Cogn. Affect. Neurosci. 6, 495–506. doi: 10.1093/scan/nsq070

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Vansteenwegen, D., Hermans, D., Vervliet, B., Francken, G., Beckers, T., Baeyens, F., et al. (2005). Return of fear in a human differential conditioning paradigm caused by a return to the original acquistion context. Behav. Res. Ther. 43, 323–336. doi: 10.1016/j.brat.2004.01.001

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Vervliet, B., Vansteenwegen, D., and Hermans, D. (2010). Unpaired shocks during extinction weaken the contextual renewal of a conditioned discrimination. Learn. Motiv. 41, 22–31. doi: 10.1016/j.lmot.2009.08.001

CrossRef Full Text

Walker, D. L., and Davis, M. (2002). The role of amygdala glutamate receptors in fear learning, fear-potentiated startle, and extinction. Pharmacol. Biochem. Behav. 71, 379–392. doi: 10.1016/s0091-3057(01)00698-0

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Weike, A. I., Hamm, A. O., Schupp, H. T., Runge, U., Schroeder, H. W., and Kessler, C. (2005). Fear conditioning following unilateral temporal lobectomy: dissociation of conditioned startle potentiation and autonomic learning. J. Neurosci. 25, 11117–11124. doi: 10.1523/jneurosci.2032-05.2005

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Weike, A. I., Schupp, H. T., and Hamm, A. O. (2007). Fear acquisition requires awareness in trace but not delay conditioning. Psychophysiology 44, 170–180. doi: 10.1111/j.1469-8986.2006.00469.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wiens, S., Katkin, E. S., and Öhman, A. (2003). Effects of trial order and differential conditioning on acquisition of differential shock expectancy and skin conductance conditioning to masked stimuli. Psychophysiology 40, 989–997. doi: 10.1111/1469-8986.00117

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Keywords: fear conditioning, awareness, skin conductance response, fear potentiated startle, contingency learning

Citation: Sevenster D, Beckers T and Kindt M (2014) Fear conditioning of SCR but not the startle reflex requires conscious discrimination of threat and safety. Front. Behav. Neurosci. 8:32. doi: 10.3389/fnbeh.2014.00032

Received: 25 November 2013; Accepted: 21 January 2014;
Published online: 28 February 2014.

Edited by:

Oliver T. Wolf, Ruhr University Bochum, Germany

Reviewed by:

Christian J. Merz, Ruhr University Bochum, Germany
Armita Golkar, Karolinska Institutet, Sweden

Copyright © 2014 Sevenster, Beckers and Kindt. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Merel Kindt, Department of Clinical Psychology, Faculty of Social and Behavioural Sciences, University of Amsterdam, Weesperplein 4, 1018 XA Amsterdam, Netherlands e-mail: m.kindt@uva.nl

Download