Skip to main content

ORIGINAL RESEARCH article

Front. Neurosci., 07 November 2017
Sec. Auditory Cognitive Neuroscience

Electrical Neuroimaging of Music Processing Reveals Mid-Latency Changes with Level of Musical Expertise

  • 1School of Health Sciences, University of Applied Sciences and Arts Western Switzerland, Geneva, Switzerland
  • 2Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
  • 3Neuroscience Center, University of Geneva, Geneva, Switzerland
  • 4Department of Education and Culture of the Canton of Thurgau, Frauenfeld, Switzerland
  • 5Functional Brain Mapping Lab, Department of Fundamental Neurosciences, University of Geneva, Geneva, Switzerland
  • 6Center for Biomedical Imaging (CIBM), Lausanne, Switzerland
  • 7Neurology Unit, Medicine Department, Faculty of Sciences, University of Fribourg, Fribourg, Switzerland

This original research focused on the effect of musical training intensity on cerebral and behavioral processing of complex music using high-density event-related potential (ERP) approaches. Recently we have been able to show progressive changes with training in gray and white matter, and higher order brain functioning using (f)MRI [(functional) Magnetic Resonance Imaging], as well as changes in musical and general cognitive functioning. The current study investigated the same population of non-musicians, amateur pianists and expert pianists using spatio-temporal ERP analysis, by means of microstate analysis, and ERP source imaging. The stimuli consisted of complex musical compositions containing three levels of transgression of musical syntax at closure that participants appraised. ERP waveforms, microstates and underlying brain sources revealed gradual differences according to musical expertise in a 300–500 ms window after the onset of the terminal chords of the pieces. Within this time-window, processing seemed to concern context-based memory updating, indicated by a P3b-like component or microstate for which underlying sources were localized in the right middle temporal gyrus, anterior cingulate and right parahippocampal areas. Given that the 3 expertise groups were carefully matched for demographic factors, these results provide evidence of the progressive impact of training on brain and behavior.

Introduction

The current research applied high-density EEG (electroencephalography) to investigate the impact of musical training on brain and behavioral processing of complex classical music in non-musicians, amateur pianists, and professional pianists. All pianists were trained in the western classical repertoire.

The musical brain is “food for neuroscience” (Zatorre and McGill, 2005) and, at present, a prevalent way to study functional and structural brain plasticity (Pantev and Herholz, 2011). Several reasons may explain this. First, musical training intensity in the general population is not disparate, but a continuum, going from passive exposure, which already leads to some implicit learning and plasticity (Koelsch et al., 2000; Tillmann et al., 2000; Bigand, 2003), to people spending the major part of their active life training on their musical instrument (Pascual-Leone, 2001; Jancke, 2009; Wan and Schlaug, 2010). Second, presenting rich and complex musical stimuli in neuroimaging settings provides an efficient way to investigate the fruit of musical training. Finally, because musical training is multi-modal and involves practically all human cognitive functions (Pantev and Herholz, 2011; Herholz and Zatorre, 2012), indications are accumulating that the benefits of musical training extend beyond the musical domain (Moreno et al., 2009; Parbery-Clark et al., 2009; Schon and Francois, 2011; Kraus et al., 2012; Barrett et al., 2013; Miendlarzewska and Trost, 2013; Oechslin et al., 2013a,b).

Whether more training leads to enhanced expertise is, of course, a matter of debate; however, until further research is undertaken, the amount of practice is the only valid predictor of performance level in musicians (Ericsson et al., 1993; Sloboda et al., 1996).

The best approach to evaluate the impact of long-term, high-level musical training on brain processing and structure would be a longitudinal one. Several longitudinal studies extending more than 6 months could show the impact on brain structure and function following musical training in children (Hyde et al., 2009a,b; Moreno et al., 2009; Ellis et al., 2013; Habibi et al., 2016). However, following groups of future professional, amateur and non-musicians from childhood over a period of at least 10 years, the minimum time it takes to become an expert musician (Ericsson et al., 1993; Sloboda et al., 1996), is a costly if not impossible operation. A good alternative is a cross sectional study on groups with distinct levels of expertise with strict matching of the different groups (Jancke, 2009). In the series of experiments we conducted (Oechslin et al., 2013a,b, 2017; James et al., 2014; Jenni et al., 2017), we matched 3 groups with different expertise levels for age, gender, education level, age of training onset, training intensity and fluid intelligence, resulting in three rigorously controlled distinct and progressive levels of musical expertise and proficiency. In these studies, we were able to show gradual brain function and structure development with increasing musical expertise and training. The current study is part of that series and investigated the same participant groups.

The crux of our series of studies partially relies on the stimuli used. By conducting behavioral pilot studies and engaging a professional composer and sound engineer, we managed to create expressive realistic musical stimuli containing refined in-key transgressions of musical chord structure or syntax at musical closure. These stimuli allowed us to perfectly separate levels of expertise by means of behavioral appraisal responses. In contrast, the well-known Gordon's AMMA (“Advanced Measures of Music Audiation”; Gordon, 1989) could not do so well. In the AMMA test, participants must detect either tonal or rhythmic differences between pairs of melodies; the tonal subtest taps into processing that is partially similar to our paradigm. Applying AMMA to our population, differences between amateurs and non-musicians did not reach significance for the tonal subtest, only between experts and both other groups, so the intermediate position of the amateurs could not be evidenced (see Figure 6C in Oechslin et al., 2013b). Moreover, using polyphonic realistic musical stimuli in all 24 tonalities and in different classical music styles allows for drawing more general conclusions on the processing of western tonal music.

Here, we used high-density EEG to investigate the influence of musical training on processing of complex music in the exact same population as in our previous (f)MRI studies (Oechslin et al., 2013a,b, 2017; James et al., 2014). Electrical neuroimaging may shed additional light on this issue because it adds information on the time course of brain processing with millisecond precision, accompanied by concurring source localizations. Periods of interest showing a significant effect of experimental manipulations and expertise on brain processing were identified using microstate analysis.

The concept of “microstates” derives from the insight that evoked potentials manifest as stable voltage topographies over time, lasting tens to hundreds of milliseconds, separated by brief periods of transition (Lehmann et al., 1987; Murray et al., 2008; Brunet et al., 2011). These microstates reflect, as their name suggests, “microstates of information processing,” i.e. basic physiological units of cognition (Lehmann et al., 1987), that correspond to a time window of coherent synchronized activation of large-scale neuronal networks (Brunet et al., 2011). Microstate analysis or spatio-temporal ERP analysis enables extracting these stable scalp voltage topographies over time in a multivariate way, comprising all electrodes, all groups and all conditions in one unified analysis, thus conserving the major part of the variance in the data. In contrast, the isolated amplitude analysis of an array of single electrode sites only uses a small part of the variance in the data and moreover ignores the spatial dimension of high-density EEG (Michel and Murray, 2012). In the context of our complex experimental plan, microstate analysis is therefore highly appropriate, especially to analyze processing states of acoustic musical stimuli with high temporal resolution, and compare the underlying brain sources with the results of our earlier fMRI study (Oechslin et al., 2013b). By physical laws, changes of scalp voltage topographies, or microstates, indicate a change in the configuration of the active cerebral sources (Vaughan, 1982; Michel and Murray, 2012). Therefore, microstate analysis is a precursor for EEG source imaging (Michel and Murray, 2012).

Whereas EEG directly measures neural activity with millisecond precision, fMRI measures neural activity indirectly via the BOLD (blood-oxygen-level dependent) response. In consequence, the temporal resolution of fMRI is limited to several seconds (Menon and Crottaz-Herbette, 2005). Although fMRI resolution is an order of magnitude better than that of EEG, with millimeter vs. centimeter precision (Martuzzi et al., 2009; Plomp et al., 2010; Birot et al., 2014), electrical source imaging methods using scalp EEG similar to the ones used in the current study have been successfully applied in different experimental and clinical domains (James et al., 2008, 2015; Britz et al., 2009, 2014; Plomp et al., 2010, 2013; Knebel et al., 2011; Rihs et al., 2013; De Meo et al., 2015). The validity and precision of source localizations based on high-density EEG (more than 100 electrodes), when using sophisticated source and head models, are generally underestimated (Michel et al., 2004; Plomp et al., 2010; Michel and Murray, 2012). Other imaging methods or direct intracranial recordings validated the correctness and precision of these EEG source localizations (Lantz et al., 2001; Tse and Penney, 2008; Megevand et al., 2014; Centeno et al., 2017). Finally, ERP source imaging adds the millisecond range temporal dimension.

There is a linear relationship between stimulus-driven local field potentials and the BOLD response (Logothetis et al., 2001; Martuzzi et al., 2009). EEG and fMRI activations in response to identical experimental stimulations may show both overlap and differences as they reflect different aspects of neuronal activity (Disbrow et al., 2000; Plomp et al., 2010). In a combined EEG-fMRI study on semantical priming (Geukes et al., 2013), EEG source imaging was able to detect specific sources of the N400. In contrast, fMRI reflected a general effect of task in areas comprising the EEG N400 sources. In this study, ERP source imaging appeared more sensitive to subtle cognitive effects. In a face processing task, fMRI and EEG source imaging results also partially overlapped (Corrigan et al., 2009).

In conclusion, our experimental setting allowed to test the following hypotheses (1) ERP analyses will confirm gradual impact of training intensity on musical processing; (2) Given the refined nature of the transgressions, the time window of these differences will reflect later cognitive processing; (3) Specific microstates will appear as a function of expertise and transgression level, evidencing differential processing; (4) The underlying brain sources may partially correspond to those found with fMRI.

Material and Methods

Participants

The participants of this experiment were the same individuals as in our previous 3 studies (Oechslin et al., 2013a,b; James et al., 2014). All pianists received training in classical music.

EEG was always recorded after fMRI to control for learning effects on the performance of the musical task. By keeping the same order for all participants, we ensured that the amount of practice of the musical task before the EEG session was the same for everyone. We started with the fMRI recording because it included fewer stimuli (n = 30) than during the EEG recording (n = 90), thus minimizing this learning effect.

The local faculty ethics commission (Commission d'éthique de la Faculté de Psychologie et des Sciences de l'Education de l'Université de Genève) approved the protocol, and 59 right-handed (“Edinburgh Inventory”; Oldfield, 1971) volunteers consented to participate and received financial compensation. All participants reported normal hearing and no history of neurological illnesses. Three groups with distinct training patterns were recruited, and consisted of 19 non-musicians (Non-musicians, 24.0 ± 4.5 years; 9 women), 20 amateur pianists (Amateurs, 22.2 ± 3.1 years; 11 women) and 20 expert pianists (Experts, 24.5 ± 4.5 years; 10 women). No significant differences occurred for gender, age [F(2, 56) = 2.2, p = 0.12] or fluid intelligence measured by Raven's Advanced Progressive Matrices [F(2, 58) = 1.2, p = 0.31].

All Non-musicians and Amateurs were academic students, except for one secondary school student and one academic. Experts were principally advanced conservatory students, but a minority were already performing artists and/or teachers; they had received training at the Conservatoires of Geneva, Lausanne, Paris and Zurich. Following our inclusion/exclusion criteria, Non-musicians had not received any extracurricular musical education and had never practiced a musical instrument; Amateurs' practice had never exceeded 10 h of training per week and was not interrupted between childhood and the moment of testing; the latter rule also applied to the Experts. Musicians (Amateurs and Experts) began piano practice before the age of ten. Age of training onset did not significantly differ [t(38) = 1.5, p = 0.19] between Amateurs (7.0 ± 1.4 years) and Experts (6.2 ± 1.9 years).

Training intensities in different age brackets were assessed by means of a retrospective questionnaire. For the first two age brackets (6–8 and 8–10 years), no significant differences occurred, whereas the subsequent age periods showed a consistently increasing difference between Amateurs and Experts for training hours per week (see Table 1). Levels of expertise were confirmed by distinct behavioral responses from the 3 groups to our musical test [see Experimental procedure and in-house musical test (during EEG)].

TABLE 1
www.frontiersin.org

Table 1. Training intensities of Amateurs (A) and Experts (E).

Experimental Procedure and In-House Musical Test (during EEG)

A professional composer and sound engineer (see section Acknowledgements) composed 120 expressive string quartets in classical style for our experiments, with an average duration of 10 seconds, equally distributed over all 24 minor and major tonalities. The expressive pieces varied strongly in character and classical style (from baroque to romanticism). The music was arranged using the Sibelius software (Avid Technology, Inc.) and “Logic Pro” (Apple Inc.); natural instrumental timbres were implemented (Garritan Personal Orchestra). Of this material 30 items served as stimuli for sparse sampling fMRI (Oechslin et al., 2013b), and the remaining 90 for the current EEG study.

Each of the stimuli appeared in 3 versions, with regular (R), subtly transgressed (Tsub) and apparently transgressed (Tapp) closure. The harmonic1 transgressions were syntactical in nature and consisted respectively of R endings: tonic chords in root position (I), Tsub endings: tonic chords in first inversion (I6) and Tapp endings: subdominant or IVth degree chords in first inversion (for an example score, see Figure 1; for the corresponding sound files, see Supplementary Material; for more music examples and comprehensive explanations of the choice of the violations used, refer to Oechslin et al. (2013b) and Jenni et al. (2017).

FIGURE 1
www.frontiersin.org

Figure 1. Examples of Stimuli. A composition for string quartet in E major (Left) and another in G minor (Right; 2 out of 90 in total). Three versions of each were presented, each of which featured a Regular Ending (Tonic chord in root position), a Subtly Transgressed Ending (Tsub; Tonic chord in first inversion) or an Apparently Transgressed Ending (Tapp; Subdominant in first inversion).

The concept of musical syntax is now well established and defined as a hierarchical structure hosting nested nonlocal dependencies (Koelsch et al., 2013). However, some controversy legitimately exists regarding the degree of similarity of musical vs. language syntax (Asano and Boeckx, 2015), but this issue is not relevant in the present context, because we only investigated music processing.

The syntactic transgressions used here represent nonlocal dependencies as the expectation of the tonic chord at closure is built up throughout the piece. Thus, the paradigm used is expectation violation.

We converted the original stereo sound files to mono in order to prevent left vs. right ear bias. The terminal chords of all pieces were cut off 1,400 ms after onset and linearly faded over the last 150 ms to create stimuli of identical length (using Adobe Audition 3.0, Adobe Systems Corp., California, USA). All stimuli were normalized to an identical amplitude envelope (-5 dB). Stimuli were presented binaurally with E-Prime 1.0 software (Psychology Software Tools, Pittsburgh, PA) via EEG compatible earphones (Etymotic Research, Elk Grove Village, IL, USA). We do not report mean intensity of stimulus presentation because we let each individual determine optimal loudness. As a function of the size and shape of the ear cup and canal, the insert earphones entered more or less deeply in the ear canal, and the distance to the eardrum strongly influences perceived loudness.

EEG triggers (scripted in milliseconds in E-Prime) indicated the onset of each sound file, the onset of each terminal chord and the ending of each sound file. The onset of the terminal chords (stimulus onset) were automatically marked with Adobe Audition 3.0 using a burst criterion “find beats” if an increase of minimum 8 dB occurred within 14 ms (best criterion for our stimuli). Bursts were then verified one by one by eyeballing the triggers in the magnified sound files while listening to the stimuli. Synchronization of EEG recordings and stimulus presentation by E-Prime (i.e., correct placement of the triggers in the EEG recordings) was certified by comparing the simultaneous sound output and EEG output. For that purpose, we connected the sound output plug (to be plugged into the earphones) with a subset of the electrodes in a conductive medium; differences were kept below 5 ms, by means of corrections of the E-prime script.

Identical written task explanations were provided to all participants, independently of expertise level, before the experiment. Once the EEG material mounted, three example stimuli that did not occur in the test were appraised in the final EEG setting, just before starting the recordings. If necessary, instructions were explained again using the same terminology for all three groups, avoiding musical jargon in order so as not to benefit the musicians. To prevent facilitation and biasing of the task, we did not inform the participants about the double nature of the transgressions. Participants responded YES if they appraised the stimuli as “satisfactory” or “correct” and NO otherwise. Correct answers were thus YES in response to R and NO in response to both Tsub and Tapp. They responded by means of pressing buttons with the index and middle finger of the right hand on a button box. To prevent motor contamination of the EEG signal, participants were asked to postpone their response until a prompt (“please respond”) appeared on the computer screen, 1,900 ms after the onset of the terminal chord of the musical piece. Therefore, we do not report reaction times.

Participants were installed in a cabin with electromagnetic and sound shielding, in a comfortable chair, and eye-screen distance was around 1 m. The stimuli (n = 3*90) were presented in 5 blocks, separated by breaks. Because the total duration of the presentation of all stimuli was approximately one hour without breaks, the participants were in control of launching each stimulus, enabling them to take brief pauses during the blocks. With this approach, we prevented fatigue and movement during stimulus presentation. Before beginning the experiment, we explained to the participants that their movement and muscular tension would compromise the EEG signal and showed them the EEG signal while they moved, blinked, etc. We encouraged them to blink, stretch, yawn and change their position in between the stimuli. Then, we asked them to avoid blinking, movement or muscle tension after the music ended until the prompt (“please respond”) appeared. During presentation of the stimuli, participants looked at a fixation cross in the middle of a light gray computer screen to prevent eye strain; they received the instruction not to close their eyes while the music played. The order of the stimuli was pseudo-randomized, preventing different versions of the same stimulus being presented in succession. To avoid sequential effects, a version with reversed order of all stimuli was used in alternation for half of the subjects in each group.

First, we computed the percent correct for the binary responses (YES/NO) to R, Tsub and Tapp endings. Based on these binary results, we computed d-prime values for Tsub and Tapp. The d-prime parameter derives from signal detection theory (Macmillan and Creelman, 1997) and prevents impact of response bias, taking into account false alarms, i.e., “NO” responses to R endings. D-prime represents sensitivity to the transgressions: Higher d-prime values reflect better discrimination between transgressed and regular endings; negative d-prime values, which indicate a lack of sensitivity to the transgressions, may occur if more false alarms occur than “hits” (correct detection of transgression, NO in response to Tsub or Tapp). Finally, a 2-way ANOVA comparing d-prime values for Tsub and Tapp for all groups was performed (see Results for specification of the ANOVA), and pertinent Bonferroni corrected contrasts were computed.

EEG Acquisition and Raw Data Processing

Continuous EEG was recorded, with vertex reference, at a sampling rate of 1,000 Hz at 256 electrode sites with a HydroCel Geodesic Sensor Net (Electrical Geodesics Inc., Eugene, OR, USA).

Measuring the inion-nasion distance for each individual allowed us to place the electrode net in such a way that equivalents of midline electrodes Fz, Cz (the vertex) and Pz corresponded to the international 10/10 system (Luu and Ferree, 2005). The tension structure and the choice of the size of the net warranted even distribution of all electrodes over the scalp, at uniform positions across participants.

We kept impedances below 30 Ω. We excluded the sensors at the cheeks and in the lower neck that are prone to artifacts and only used the remaining 204 electrodes for analysis (Rihs et al., 2013; Britz et al., 2014). After recording, data were average-referenced, band-pass filtered (0.25–30 Hz) with a 2nd-order Butterworth filter (−12 dB/octave roll-off; Brunet et al., 2011), and down-sampled to 250 Hz to speed up data analyses. Noisy channels were interpolated (4.7% ± 2.2 of all channels) with a 3D spherical spline (Perrin et al., 1989; Brunet et al., 2011). We removed artifacts by means of a combination of an automated threshold criterion (100 μV) and visual inspection for oculomotor and other artifacts of all individual epochs (Michel and Brandeis, 2009; Brunet et al., 2011). On average, 70 ± 8 (out of 90) artifact-free epochs per condition and per group were averaged into ERPs from −200 up to 750 ms after stimulus onset (onset of the terminal chord of the musical piece). For waveform analyses, ERPs were baseline corrected (“pre-stimulus” baseline from −200 ms to stimulus onset) to enable comparison to the literature. This data processing was performed with the Cartool software, developed by Denis Brunet (brainmapping.unige.ch/cartool).

ERP Analyses

We analyzed the ERPs in 3 consecutive steps

Step 1: ERP Waveform Analyses

We performed waveform analyses on 2 midline electrodes, Fz and Cz. First, these 2 electrodes are the most frequently used sites for auditory evoked potentials because sources in the Sylvian sulcus project maximally to the top of the head (Hall, 2007). Second, the P300 auditory evoked potential in response to deviant stimuli is classically reported at Fz and Cz (Duarte et al., 2009). In addition, in studies that reported the ERAN (early right anterior negativity) in response to musical syntactic transgressions, this component clearly manifested at Fz and Cz (Koelsch et al., 2001, 2007). Finally, because we used the Geodesic 256 Sensor Net, Cz and Fz are among the most reliable to be placed according to the 10/10 system. To compare the 3 expertise levels for all transgression conditions, we computed Bonferroni corrected contrasts (t-tests) for independent samples on mean voltage amplitude over time between grand-average ERPs of Non-musicians, Amateurs and Experts, over the full −200 to 750 ms window, applying a minimum time constraint of 28 consecutive milliseconds (7 time frames at 250 Hz) for all 3 transgression conditions at both electrodes.

Because our main goal for ERP analyses consisted of microstate analyses comprising all electrodes (see Step 2 for an explanation) as a function of expertise level (EX) and syntactic transgression (T), the waveform analyses principally served to enable comparison to the literature.

Step 2: Microstate Analyses

The insight that spontaneous EEG and evoked potentials manifest over time as stable voltage topographies lasting tens to hundreds of milliseconds, separated by short periods of transition, led to the concept of “microstates” (Lehmann et al., 1987; Murray et al., 2008; Brunet et al., 2011). Microstate analysis enables studying these stable scalp voltage topographies over time, comprising all recorded electrodes of different groups and conditions in one unified analysis, resulting in a more global assessment than with classical ERP waveform analyses. Such a multivariate approach is particularly suited in the context of a complex experimental design, such as in the current study, with 3 groups, 3 experimental conditions and 204 electrodes. Indeed, it condenses a great amount of information into one series of microstates, while conserving a maximum of the variance present in the data. One of the benefits of this approach is that these different microstates can be compared between groups and conditions in a multifactorial manner.

In the first stage, a k-means cluster analysis on topographic dissimilarity served to segment the grand-mean ERP data of all 204 electrodes of all 3 groups and all 3 transgression conditions over time into one series of k microstates or scalp topographies (brainmapping.unige.ch/cartool). The time frame of analysis extended from 0 to 750 ms after stimulus onset (onset of the terminal chord of the musical piece). Topographic dissimilarity in the context of surface EEG is an indicator of spatial difference between 2 voltage scalp configurations (Murray et al., 2008). An optimal choice of k is essential in order to build meaningful clusters (Fischer, 2011). For that matter, we used cross-validation criteria, minimizing residual variance, as well as a modified Krzanowski–Lai criterion, which provides a quality measure for each clustering (Krzanowski and Lai, 1988; Pascual-Marqui et al., 1995; Tibshirani and Walther, 2005; Murray et al., 2008; Michel and Brandeis, 2009; Brunet et al., 2011). This approach generated an a priori hypothesis in the form of a microstate series occurring over time, based on this multivariate analysis of grand mean ERPs of all groups and conditions.

In the second stage, this a priori hypothesis on the appearance of microstates over time was statistically verified by means of a procedure that fits the microstates to the time series of each individual over a certain time period during which differences occur (Murray et al., 2008; Brunet et al., 2011). The result consists of measures of microstate presence or “duration” (in milliseconds) that can be statistically compared between groups and conditions. Moreover, such an analysis of changes in scalp voltage topographies directly informs on underlying generators in the brain. By physical laws, changes of scalp voltage topographies indicate a change of underlying generators (Vaughan, 1982). Therefore, the time periods during which different microstates appear simultaneously in different groups or conditions provide us with proper time windows to estimate and compare neuronal generators between groups or conditions. We only retained microstates manifesting over periods longer than 28 ms (7 time frames at 250 Hz) because processing of cognitive information in time intervals shorter than several tens of milliseconds is not plausible (Lehmann et al., 1987; Koenig et al., 2002; Brunet et al., 2011).

Microstate durations compared over conditions and groups are commonly not normally distributed. For example, in a certain group, a certain microstate may occur only sporadically, and in some individuals, it may not occur at all, which may constitute simply an experimental effect because a specific stage of information processing may strongly differ as a function of expertise level or transgression condition. Therefore, we applied nonparametric analyses (Kruskal-Wallis, one-way ANOVAs on ranks and Mann-Whitney U-tests).

Step 3: Electrical Source Imaging

Because the inverse problem is underdetermined with scalp EEG (multiple solutions would be possible), a priori constraints are necessary to reduce this dimensionality (Michel et al., 2004; Grech et al., 2008). Distinct microstates that occur simultaneously in different groups or experimental conditions, if statistically verified, provide such a priori constraints. We therefore performed the estimation and statistical comparison of underlying neuronal generators over a time window during which significant differences occurred in the presence (duration in milliseconds) of the microstates between the different groups and conditions. Refer to the Results section for precise information on this time window.

The electrical source imaging analysis comprised 2 stages.

In the first stage, we estimated the intracranial current density (CD) distribution (in micro amperes per cubic millimeter; μA/mm3) for the evoked potential of each participant and condition, averaged over a time window that manifested strong microstate differences as a function of expertise level (EX) and syntactic transgression (T), deriving from the second stage of the microstate analyses (see Results section). These source estimations were computed from averaged ERP waveforms over this time window at all 204 electrodes into a solution space represented by a 3D grid composed of 3005 nodes. These 3005 nodes were selected from a 6 × 6 × 6 mm grid equally distributed over the gray matter of the average brain provided by the Montreal Neurological Institute.

From these average ERPs expressed in microvolts (μV), we computed the CD (μA/mm3) in each node of the 3005 3D grid solution space, using a depth-weighted minimum norm (WMN) distributed linear inverse solution (Hamalainen and Ilmoniemi, 1994; Michel et al., 2004). After applying a homogeneous transformation operation to the volume that rendered it to the best fitting sphere (Spherical Model with Anatomical Constraints, SMAC; Spinelli et al., 2000) we used a 3-shell spherical head model to compute the lead field for the 204 electrodes and the inverse solution based on the WMN constraint.

In the second stage, we compared these brain sources by means of statistical parametric mapping (SPM), i.e., comparing the CD for each voxel/node of the 3D grid of the brain between groups and conditions. We computed an ANOVA EX (3, inter) × T (3, intra) at all nodes of the 3D-grid representing the grey matter of the brain using the Statistical Toolbox for Electrical Neuroimaging (STEN; http://www.unil.ch/line/en/home/menuinst/about-the-line/software--analysis-tools.html). To cope with multiple comparisons, only globular clusters composed of minimum 10 contiguous nodes with an individual p-value of < 0.005 met our significance criterion (Knebel et al., 2011; De Meo et al., 2015). Moreover, the spatial criterion of 10 contiguous nodes was verified using the AlphaSim program (http://afni.nimh.nih.gov) under the assumption of a spatial smoothing of 7 mm FWMH (full width at half maximum) and a maximum cluster connection radius of 10 mm in combination with the node p-value of < 0.005 that we applied. After 10,000 Monte Carlo iterations, globular clusters of 10 nodes appeared with a cluster-level likelihood of p < 0.001, and a corresponding node-level p-value of p < 0.00001. Our significance criterion may therefore be considered conservative.

Additional Behavioral Measures

In order to verify the effects of general cognition, we also performed a 3-back visual working memory (WM) task on letters (Ludwig et al., 2008) and measured fluid intelligence using Raven's Advanced Progressive Matrices (Raven and Court, 2003 updated 2004). Because these tests were also used in the study by Oechslin et al. (2013b), refer to this communication for details on their features.

Results

Behavioral Results of the In-House Musical Test (during EEG)

First, we performed a 2-way ANOVA on d-prime for Tapp and Tsub with the factors Expertise (EX) and Transgression (T): EX (3, inter) × T (2, intra). The results of this ANOVA, with main effects for EX and T, as well as interaction EX × T, are reported in Table 2. Both main effects and the interaction effect yielded p-values < 0.0001. Figure 2 depicts these results, in Figures 2A,B by displaying all individual d-prime scores for Tsub and Tapp, and in Figure 2C, by displaying histograms representing d-prime group means for both transgression conditions.

TABLE 2
www.frontiersin.org

Table 2. ANOVA results on d-prime: EX (3, inter) × T (2, intra).

FIGURE 2
www.frontiersin.org

Figure 2. Behavioral Results. (A,B) Show individual d-prime scores of all participants for Tsub and Tapp, according to Expertise group; (C) depicts the mean d-prime scores for each group for both transgression conditions. The main effects of the ANOVA are provided in Table 2. Asterisks indicate Bonferroni corrected contrasts between the groups. *p < 0.05, **p < 0.01, ***p < 0.001.

Main effects for both EX and T are increased d-prime values, with expertise and prominence of transgression, respectively. Main effect contrasts were verified by means of Bonferroni corrected t-tests for independent samples between the groups and depicted in Figure 2C; asterisks represent significant p-values. For both Tapp and Tsub all comparisons between the groups reached significance.

Hardly any negative d-prime values occurred, showing that almost all participants were sensitive to the transgressions to some extent. Also Non-musicians displayed, albeit moderately, positive d-prime scores in response to both transgressions (3 negative scores on 19 for Tsub, mean score 0.49 ± 0.52; a single negative score for Tapp, mean score 1.57 ± 1.09; cf. Figures 2A,B).

The interaction effect indicated that for Tapp and Tsub the effect of expertise manifested differently. To check for the exact nature of the interaction effect, we computed simple effects by comparing d-prime values for Tapp and Tsub for each group by means of Bonferroni corrected t-tests for dependent samples. Differences for Amateurs [t(19) = 10.84, p < 0.001; mean Tsub = 1.54, mean Tapp = 3.68] and Non-musicians [t(18) = 7.23, p < 0.001; mean Tsub = 0.49, mean Tapp = 1.60] reached significance, with higher values for both groups in response to Tapp than to Tsub. Responses from Experts did not differ significantly between Tapp and Tsub and were at ceiling for both.

Although, the behavioral results of our in-house musical test are very similar to those from Oechslin et al. (2013b), the results here are slightly different, insofar as all hierarchical contrasts between the groups (Experts > Amateurs > Non-musicians) reached significance for both transgression conditions, whereas in Oechslin et al. (2013b), for Tapp, responses from Amateurs and Experts were not significantly different. Contrasts comparing the EEG vs. fMRI d-prime score for all groups in response to Tapp confirmed that for Experts only, the d-prime score for the musical test during EEG was higher than during the preceding fMRI [Experts: t(19) = 2.59, p = 0.018; Amateurs: t(19) = 1.37, p = 0.188, Non-musicians: t(18) = 0.68, p = 0.508]. Therefore, apparently, only in Experts, a learning effect took place during the fMRI session that affected d-prime scores collected during EEG.

EEG Analyses

Step 1: ERP Waveform Analyses

The ERP curves for all groups and conditions are shown in Figure 3 for the central electrodes Fz and Cz. Color-coded bars represent significant Bonferroni corrected contrasts over time between grand-average ERPs of Non-musicians, Amateurs and Experts, with a minimum time constraint of 28 consecutive milliseconds for all 3 transgression conditions for both electrodes. Differences occurred between approximately 200 and 600 ms after stimulus onset but most often between 300 and 500 ms. Experts systematically displayed more positive voltages, but in response to Tapp, Amateurs' waveforms overlapped those of the Experts at Cz. These positive waveforms are reminiscent of extended P300/P3b ERPs. Interestingly, these results resemble the behavioral d-prime values, showing the largest differences between Experts vs. Non-musicians and Amateurs for Tsub and between Experts and Amateurs vs Non-musicians for Tapp. The exact time periods of significant differences are provided in Supplementary Table 1.

FIGURE 3
www.frontiersin.org

Figure 3. ERP Results at Fz and Cz. Color-coded bars (see legend at the bottom of the graphs) indicate Bonferroni corrected contrasts between the Expertise groups for each Transgression Condition, with a minimum time constraint of 28 consecutive ms.

Step 2: Microstate Analyses

A k-means cluster analysis yielded 7 ERP microstates that together explained 92.75% of the ERP data variance for all groups and conditions.

Figure 4A depicts the results of the first stage of the microstate analyses. The occurrence of the microstates over time is represented by color coded segments below the 9 global field power (GFP) curves, one for each condition and group. GFP provides a single, positive, reference free value of neural response strength all over the brain by taking into account the absolute voltages of all electrodes (Murray et al., 2008). On the right, Figure 4B shows the scalp potential topographies of the 7 microstates, framed by color codes corresponding to panel A.

FIGURE 4
www.frontiersin.org

Figure 4. Results of spatio-temporal ERP analysis: functional microstates. (A) Color-coded segments below the GFP curve represent the periods of strongest occurrence of the microstates (1–7) in the grand means. (B) Scalp potential topographies of ERP microstates, framed in corresponding color-code. N-R, Non-musicians, Regular Endings; A-R, Amateurs, Regular Endings; E-R, Experts, Regular Endings; N-Tsub, Non-musicians, Subtly Transgressed Endings; A-Tsub, Amateurs, Subtly Transgressed Endings; E-Tsub, Experts, Subtly Transgressed Endings; N-Tapp, Non-musicians, Apparently Transgressed Endings; A-Tapp, Amateurs, Apparently Transgressed Endings; E-Tapp, Experts, Apparently Transgressed Endings. GFP, global field power.

Between 295 and 480 ms, strong differences occurred between microstates as a function of expertise level and transgression level (cf. Figure 4A). These observed differences were statistically tested in the second stage, comparing the duration (in milliseconds) of Microstates 4, 5, 6, and 7 between all 59 individuals as a function of group and condition. The results of this statistical fitting procedure can be found in Figure 5.

FIGURE 5
www.frontiersin.org

Figure 5. Results of the fitting procedure. Mean duration (in ms) of microstates 4, 5, 6, and 7 compared by means of Kruskal-Wallis ANOVAs between Expertise groups and Transgression conditions for the 295–480 ms period deriving from the spatio-temporal ERP analysis (Figure 4). Additional Bonferroni corrected contrasts using Mann-Whitney U-tests are shown in the left bottom table for each microstate. The Expertise groups for each Transgression Condition are compared in the case of significant ANOVA results only.

For each microstate, we performed Kruskal-Wallis one-way ANOVAs on ranks to evaluate whether significant differences occurred between the three expertise groups, which were run separately for each of the three conditions (R, Tsub, and Tapp). In the case of significant ANOVA results only, we performed Bonferroni corrected Mann-Whitney U-tests to systematically explore differences between expertise levels. We present the results of these tests in the panels of Figure 5 in a hierarchical way (Experts vs. Amateurs vs. Non-musicians), corresponding to our hypothesis on gradual change with expertise level.

Analyses of durations of Microstates 4 and 7 yielded significant differences for all 3 transgression conditions (R, Tsub, and Tapp). All of these differences were gradual changes as a function of expertise level, with systematic significant or marginal differences for Experts vs. Non-musicians and Amateurs vs. Non-musicians. Moreover, for Microstate 4, a highly significant difference between Experts and Amateurs occurred for Tsub. Microstate 4 clearly represents non-musician and amateur processing, showing the longest durations for Non-musicians, intermediate durations for Amateurs, and minimal durations for Experts. Microstate 7 shows the opposite, although Amateurs and Experts showed similar durations for Tapp. Microstate 5, which yielded duration differences between expertise levels for R and Tsub reflects expertise level, with the longest average durations for Experts. Although mean duration for Tapp increased gradually with expertise level for Microstate 5, this difference was not statistically significant due to large variance. Durations for Microstate 6, which seems to be an amateur-specific processing stage based on the fact that Amateurs had the highest values in response to R and Tsub endings, did not yield any significant differences.

The overall conclusion is that for maps 4, 5, and 7, gradual differences manifested as a function of expertise, with Non-musicians showing the highest values for Microstate 4, and Experts showing the highest values for Microstates 5 and 7. These “expert” microstates are centro-parietal positivities with extended P300/P3b-like configurations.

Step 3: Electrical Source Imaging

Within the time period of significant difference determined in stage 2 of the microstate analyses (295–480 ms), we performed an ANOVA EX (3, inter) × T (3, intra) on CD for all nodes of the 3D grid, which were labeled according to the Talairach atlas. The results are provided in Table 3. For the statistical thresholds used, we refer to the methods section. The F-values and Talairach coordinates in the table correspond to the local maxima of each listed area.

TABLE 3
www.frontiersin.org

Table 3. Results of the ANOVA EX (3, inter) × T (3, intra) on current density.

Figure 6 displays the brain clusters showing significant Expertise × Transgression interaction (Figure 6A), main effects of Expertise (Figure 6B), and main effects of Transgression (Figure 6C), with bar graphs representing the associated CD for the peakvoxel of each Talairach label. Because the main effect of Transgression yielded widely distributed clusters, we only displayed bar graphs for a subset of representative areas, after noting that all brain areas showed a similar CD pattern as a function of transgression condition, i.e., stronger CD values for Tapp as compared to R and Tsub. In order to explore the directionality of the effects, we computed post-hoc analyses using Fisher's least significant difference (LSD) correction for multiple comparisons. Fishers' LSD restricts family-wise error rate to alpha in the special case of 3 groups (Howell, 2014; chapter 8). Significant results of these contrasts are shown by asterisks in the bar graphs in Figure 6.

FIGURE 6
www.frontiersin.org

Figure 6. Statistical parametric mapping of distributed electrical source estimations over the time-period after stimulus onset resulting from the microstate analyses (295–480 ms). Results are depicted for Expertise × Transgression interaction (A), main effect of Expertise (B), and main effect of Transgression (C). The bar graphs on the right depict the current densities of the peakvoxels indicated on the left by means of white crosses. N, Non-musicians; A, Amateurs; E, Experts; R, Regular; Tsub, Subtle transgression; Tapp, Apparent transgression. Asterisks indicate LSD-corrected contrasts between the groups. *p < 0.05, **p < 0.01, ***p < 0.001.

The Expertise × Transgression interaction yielded differences exclusively in a cluster within the right posterior middle temporal gyrus, close to the lateral occipital complex. The peakvoxel occurred in Brodmann area (BA) 37 (rMTG, Talairach 43, −67, 17, see Figure 6A). No significant differences between the 3 groups occurred for R endings (although a gradual increase of mean CD can be clearly perceived). The post hoc tests indicated stronger CD in this brain area in Experts than in Non-musicians and Amateurs in response to Tsub. In contrast, in response to Tapp, the post hoc tests evidenced stronger CD in both Experts and Amateurs as compared to Non-musicians. In other words, Tsub yielded stronger CD in experts than in all non-experts, and Tapp induced stronger CD in all musicians than in non-musicians.

The main effect of Expertise indicated differences within clusters in the bilateral anterior cingulate gyrus, medial frontal gyrus and right parahippocampal gyrus. In all these brain areas, the post-hoc tests displayed stronger CD for Amateurs and Experts than for Non-musicians. In the ACC cluster identified by our analyses, mainly rostral but also dorsal parts of the ACC are present (see Figure 6Bi). The cluster in the right parahippocampal gyrus (see Figure 6Bii) also contained solution points in the amygdala and in the hippocampus proper.

The main effect of Transgression yielded differences in widely distributed brain clusters, including, in order of decreasing F-values, the bilateral anterior cingulate gyrus and medial frontal gyrus (see Figures 6Cii,iii,viii,ix), inferior frontal gyrus (see Figures 6Ci,vii), and parahippocampal gyrus (see Figures 6Cv,vi). In these brain areas and all others, the post hoc tests indicated stronger CD for Tapp than for both R and Tsub. The enhanced activations in response to transgression salience in the bilateral inferior frontal cortex clusters (BA 47, see Figures 6Ci,vii) are situated in the vicinity of the Broca area (BA 44 & 45) and its right hemisphere homolog.

Additional Behavioral Measures

In this section, we solely repeat earlier reported findings from Oechslin et al. (2013b). For a visual WM n-back task on letters (Ludwig et al., 2008), we performed Bonferroni corrected t-tests for independent samples. Experts (mean = 84.4 [SD = 7.1]) scored significantly better than Non-musicians [mean = 72.1 [SD = 19.7]; t(38) = 2.6, p < 0.05], but no significant differences occurred with Amateurs (mean = 75.8 [SD = 19]), who held intermediate scores (see Figure 6A in Oechslin et al., 2013b).

For the fluid intelligence test, the Raven's Advanced Progressive Matrices, we did not find any significant differences between the groups.

Discussion

The key result of this study resides in the gradual influence of musical training and proficiency on processing of musical transgression at the behavioral, ERP, microstate, and source analyses levels. This confirms earlier fMRI, EEG and structural brain data results of the same population (Oechslin et al., 2013b, 2017; James et al., 2014; Jenni et al., 2017). Given the very strict inclusion and exclusion criteria we used, matching for gender, age, age of training onset, instrument practiced, education level and fluid intelligence, and controlling for number of practice hours, we can draw some concrete conclusions on the progressive impact of piano training on brain and behavior. Compellingly, all brain data resembled the pattern of the behavioral d-prime responses of our in-house music test, with the strongest differences occurring between Experts and non-experts (Non-musicians and Amateurs) for responses to subtle transgressions (Tsub), and between all musicians (Amateurs and Experts) and Non-musicians for responses to apparent transgressions (Tapp).

All EEG, waveform, microstate, and source imaging results that characterized expertise, which was expressed in a mid-latency time window, seem to relate to context-based memory updating. During processing, the actual musical closure is compared with an internal learned model of musical expectancy, which is reinforced with increased training and proficiency. Processing expresses on the waveform level as a P3b-like positivity and on the microstate level as stable centro-parietal positivities with extended P300/P3b like configurations (microstates 5 & 7). These scalp surface configurations are supported at the source level by the right posterior middle temporal gyrus, the bilateral anterior cingulate cortex, as well as by the right parahippocampal complex. In addition, working memory is enhanced in experts.

Behavioral Results of the In-House Musical Test (during EEG)

Altogether, our in-house test on musical harmony and syntax transgression perfectly separated the groups on the behavioral level, confirming that different levels of musical training intensity yield corresponding levels of musical proficiency, thus mutually validating the composition of our groups and the sensitivity of the in-house musical test.

The crux of the 2-fold transgression detection used here resides in the presentation of subtle and apparent transgressions that are both in-key and do not contain any sensory dissonances as compared to the regular endings. Therefore, they both represent refined transgressions of musical syntax. Such chords would make perfect sense if the music continued, but as an ending they violate the rule system of Western tonal music, which only allows a tonic chord in root position (with the first note of the scale in the bass) at closure. Although the d-prime values for both Tsub and Tapp in Figure 2C gave rise to significant differences between all 3 expertise levels, the Expertise × Transgression interaction effect most likely resulted from the distinct sensitivity of Experts vs. non-experts for Tsub, and of musicians vs. Non-musicians for Tapp. Indeed, we can clearly observe that for Tsub, Experts were by far more sensitive; i.e., they display much higher d-prime scores than non-experts (i.e., both Non-musicians and Amateurs), and for Tapp, the d-prime values of both musician/pianist groups (Experts and Amateurs) are relatively close and both groups are very proficient (see Figure 2C). In our fMRI study (Oechslin et al., 2013b), during which we presented one third of the quantity of stimuli presented here, the difference between Amateurs and Experts for Tapp did not reach significance. The fact that differences between Amateurs and Experts also reached significance for Tapp in the current EEG study can be explained by the fact that three times as many stimuli were used for the EEG part, providing higher statistical power, but also by a test-retest or learning effect that manifested for Tapp in Experts only (see section Results). The professionals apparently comprehensively captured the exact nature of the transgressions during the preceding fMRI session, as evidenced by their post-hoc accurate oral testimonies.

In summary, moderate training is sufficient to detect apparent transgressions very well. In contrast, only Experts rated at ceiling the very subtly transgressed Tsub endings (tonic chords in first inversion). In the case of dissonant or out-of-key chords, the Non-musicians would probably have rated them equally well as Amateurs or even Experts, as “non-musicians are musical” (Koelsch et al., 2000). However, because the Non-musicians grew up in a context of western tonal music, and therefore implicitly learned the western tonal rule system, most of the Non-musicians exhibited modestly positive d-prime scores for Tsub, expressing a certain degree of sensitivity to the transgressions. Furthermore, it is highly interesting to observe that the “best” Non-musicians reached the d-prime level of the “worst” Experts for Tapp (Figure 2B). In other terms, the final performance results are like in most domains the fruit of the interplay between nature and nurture for individuals of all expertise levels.

Additional Behavioral Measures

In Oechslin et al. (2013b) we already extensively discussed the benefit of musical training at expert level for visual working memory (WM).

Practicing or performing music is highly demanding concerning WM in the auditory, as well as the visual domain to prevent and quickly correct errors. Within an ongoing musical context, elements should be continuously compared with preceding and upcoming ones, and incongruous events -with respect to the musical syntax and score- should be detected and corrected rapidly. WM function enables such comparisons within an ongoing context. Both Experts and Amateurs regularly train and thus enhance their WM function, yet Experts do so much more extensively, and even more so because stage performance puts an extra strain on WM. This may explain why only differences between Experts and Non-musicians reached significance, although the scores of Amateurs were situated in between those of Non-musicians and Experts.

ERP Waveform Results

The waveforms at Fz and Cz shown in Figure 3 show enhanced P3b-like positive voltages with increasing expertise between 300 and 500 ms after stimulus onset in response to the transgressions in particular. The P3b is a subcomponent of the P300 that is involved in context-based memory updating, or “template-matching” (Kok, 2001; Polich and Criado, 2006).

The voltage patterns as a function of expertise, resemble to some extent the pattern of the d-prime values of the musical test. Overlapping curves for Amateurs and Experts occurred in response to Tapp at Cz, which completely dissociate from the Non-musician group. For Tsub, we can observe the opposite effect, with differences showing between Experts and the 2 non-expert groups at Fz, the latter of which practically overlap. Therefore, we again observe a 2-by-2 grouping of values in which Non-musicians and Amateurs are associated for Tsub, and Experts and Amateurs are associated for Tapp. However, all contrasts between expertise levels were significant for the d-prime scores, which is not the case for the waveforms.

The absence of an ERAN-like (Koelsch et al., 2001, 2007) early negativity in response to the transgressions may be explained by the refined in-key incongruities used here, with an absence of any marked dissonance or other sensory cue marking the transgressions (Poulin-Charronnat et al., 2006; James et al., 2008, 2015). Our conclusion of the absence of an ERAN is based on the lack of any kind of negative voltage deflection in response to the transgressions in any group around 200 ms (Koelsch et al., 2007). Other studies using more salient violations first observed an ERAN, then a P3b in non-musicians and musicians (Koelsch et al., 2007; Carrion and Bly, 2008).

Finally, the most essential periods of significant micro-volt differences between the groups (~300–500 ms) coincide with the period retained for the microstate analyses, indicating that these observations are not bound to Fz and Cz, but represent a general mechanism involving the whole scalp topography.

Microstate Results

The statistical testing of the microstates (fitting procedure, see Figure 5) confirmed that Microstate 4, a frontal negativity with right hemisphere dominance, characterized Non-musicians' processing. Given that the Non-musician group spent almost no time in microstate 5 or 7 and spent the same moderate amount of time as the Experts group in Microstate 6, these naïve listeners seem to adopt an intrinsically different way of processing the here used musical stimuli between 300 and 500 ms. In written testimonies that were requested after participants passed the musical test, the Non-musician participants expressed themselves using affective terms to describe the differences they experienced between satisfactory and non-satisfactory closures, using negative terminology for the transgressions. As the Non-musician group had relatively low d-prime scores on average for the Tsub stimuli, which they considered fairly “correct,” these testimonies concern mainly the Tapp stimuli. Apparently, Non-musicians responded to these stimuli based on subjective feeling. In contrast, Expert participants used technical terms related to music theory. Most of them could exactly describe and identify both manipulations used (Tsub and Tapp) and even evoke specific stimuli. Amateurs held an intermediate position for Microstate 4, but not for the apparent transgressions. As in the behavioral results, measures for Amateurs and Experts were quite close for Tapp.

Microstates 5 and 7, which were centro-parietal positivities, manifested longer durations with increasing expertise. They show an extended P300/P3b like voltage configuration with more posterior positivity for Microstate 7, likely reflecting top-down cognitive processing, during which the expert listener compares the previously perceived closure with an internal model (Kok, 2001; Polich and Criado, 2006; Carrion and Bly, 2008). The phenomenon of progressively more posterior positivity over time -Microstate 7 appeared on average after Microstate 5 (cf. Figure 4)- in musicians in response to similar transgressions in piano pieces was previously observed in a study comparing expert pianists to non-musicians in a similar time window (see Figure 3 in James et al., 2008).

Electrical Source Imaging Results

Expertise × Transgression Interaction

The peakvoxel of interaction between expertise and transgression levels occurred in the right posterior middle temporal gyrus (rMTG) in BA 37. However, as observed for d-prime values, ERP and microstate results, Experts manifested higher (CD) than Non-musicians and Amateurs in response to Tsub, and Experts and Amateurs both displayed higher CD than Non-musicians in response to Tapp. This secondary auditory area is most likely involved in “sound-to-meaning-mapping” in language processing, operated via a connection from the posterior left MTG (lMTG) to the left inferior frontal areas via the ventral pathway (Hickok and Poeppel, 2004). The posterior MTG seems to function as an interface between the sound representations in the superior temporal gyrus and more abstract representations, which are largely distributed in the brain (Hickok and Poeppel, 2004). The lMTG can thus be considered the “gateway” to this processing chain in language processing. We recently showed the existence of a right hemisphere homologue of this white matter pathway for music processing in the same group of participants. The morphology of this pathway became gradually more concise as a function of expertise level, and this increased precision or “Tract Consistency” of the pathway correlated with higher d-prime values for Tsub and Tapp (Figure 3E in Oechslin et al., 2017). Such an analysis of the meaning of sound patterns seems most pertinent in the context of transgressed musical closure, and may be progressively enhanced following musical training. On the functional level, this connection between the right middle temporal gyrus and right inferior frontal areas via the ventral pathway, specifically implicated in the analysis of auditorily presented stimuli that transgress musical structure, has also been observed (Bianco et al., 2016).

Our preceding fMRI study on the same population (Oechslin et al., 2013b) also gave rise to an Expertise x Transgression interaction within the rMTG, although more anteriorly located. Even though the results cannot be directly compared, as we performed fMRI contrasts that subtracted brain regions that responded to R endings from areas responding to Tsub and Tapp, we nevertheless consider this compatible finding interesting. Indeed, identical groups and stimuli gave rise to an interaction effect with the peakvoxel in the rMTG in both fMRI and EEG settings, albeit at different locations. The peakvoxel found in the current experiment is situated in the vicinity of the angular gyrus and the temporal–parietal–occipital junction, and represents a good candidate for a sound-meaning interface (Hickok and Poeppel, 2000). Damage to the posterior MTG has been associated to pitch amusia in non-recovered lesion patients when occurring in the right hemisphere (Sihvonen et al., 2016), and to alexia and agraphia when occurring in the left hemisphere (Sakurai et al., 2008).

Music-syntactic processing, which relies on fine-grained pitch processing, is known to take place mostly in the right hemisphere (Zatorre, 2001; James et al., 2008; Cha et al., 2016; Oechslin et al., 2017).

Microstates 5 and 7, which are characterized by expert processing and context-based memory updating, may rely partially on the right MTG in this musical syntax processing paradigm. The P300/P3b components appear to have temporal-parietal origins as well as anterior cingulate and hippocampal sources (Polich and Criado, 2006; Polich, 2007).

Main Effect of Expertise

A main effect of expertise manifested in three different brain areas, systematically separating responses from musicians (both Experts and Amateurs) from Non-musicians. Musicians always showed substantially higher CD in these areas than Non-musicians. The fact that the three transgression conditions set intrinsically different requirements to the participants may explain why no significant differences occurred between Experts and Amateurs.

Detecting Tapp implies perceiving an explicit syntactic transgression of correct closure, as it presents a degree IV (Subdominant) instead of a degree I (Tonic). In contrast, Tsub provides the proper degree; i.e., all the notes of the appropriate tonic chord are present, only with the third in the bass instead of the root. Only experts recognized this very subtle transgression consistently. As observed for the behavioral, ERP, and microstate results, Tsub responses most strongly dissociated Experts from Non-musicians and Amateurs, and Tapp responses distinguished Experts & Amateurs from Non-musicians. It is therefore plausible that gradual differences between Amateurs and Experts did not appear for the main effect of expertise when all transgression conditions were collapsed. The observed increased CD rather shows a general effect of musical training and proficiency (for all levels of transgression), annihilating differences between Experts and Amateurs, which were primarily expressed for Tsub.

The bilateral anterior cingulate cortex (ACC; see Figure 6B and Table 3), that showed stronger CD in musicians, plays a role in executive functioning related to conflict monitoring and error detection (Bush et al., 2000; Iannaccone et al., 2015). It seems logical that trained pianists, who cope constantly with error detection and prevention during musical training, would develop a stronger conflict monitoring function. However, dorsal and rostral parts of the ACC appear differently involved the respective cognitive and emotional processes accompanying conflict monitoring and error detection, although a functional continuum between cognitive and affective processing is suggested rather than fully segregated operations (Mohanty et al., 2007). As mainly the rostral but also the dorsal parts of the ACC are present in the ACC cluster identified by our analyses, both cognitive and affective aspects may play a role in the processing of correctness of musical closure. Interestingly, the dorsal ACC appears to connect to prefrontal areas, whereas the rostral ACC connects to limbic zones (Mohanty et al., 2007), corresponding to the other two clusters (in the medial frontal cortex and parahippocampal gyrus) that manifested stronger CD in musicians. This supports our hypothesis on the double nature (emotional and cognitive) of closure congruity processing. After all, music represents an emotional stimulus, and deceptive cadences as used here induce -as the terminology suggests- a kind of deception, especially in trained musicians. But such non-conclusive endings also challenge cognitive processing of music. Magno et al. (2006) suggested an evaluative function of the ACC and found the highest ACC activity for error prevention.

The adjacent medial frontal gyrus may participate in this function of error monitoring and evaluation on the cognitive and affective levels (Ridderinkhof et al., 2007; Simons, 2010). Moreover, this area seems specifically associated to tonality processing, representing an interface of cognitive, affective, and mnemonic processing (Janata et al., 2002a).

The activations in the right parahippocampal gyrus, which also contains parts of the amygdala and the hippocampus proper, nicely match with earlier findings on expert pianists' responses to apparent in-key harmonic-syntactic incongruities in piano music (peaking between 350 and 400 ms after musical closure onset; James et al., 2008). Apart from the obvious “emotional” hypothesis, these right medial-temporal lobe structures are also involved in higher-order pitch and tonality processing. Indeed, patients with right-sided amygdala-hippocampectomy were severely hampered performing the Seashore musical aptitude test (Wieser, 2003; James et al., 2008), and healthy musically experienced persons processing tonality changes also activated their right hippocampus (Janata et al., 2002b). In the same vein, the amygdala has received the epithet “relevance detector” (Sander et al., 2003), because it seems implicated in the appraisal of relevant events. Now, musical congruity processing is highly relevant and a much-practiced skill for musically trained people.

If we compare the current results with the main effects of expertise in our fMRI study (Oechslin et al., 2013b), the peak value was also found in the right ACC, but in contrast to the current study, only right hemisphere expertise effects were found. However, as mentioned above, as we performed fMRI contrasts that subtracted brain regions that responded to R endings from areas responding to Tsub and Tapp, the results cannot be directly compared, and left-sided ACC in musicians may have been cancelled out by the fMRI contrasts. As for the rMTG cluster identified in the Expertise × Transgression interaction, the ACC may also partially underlie Microstates 5 and 7, and may underpin error detection and conflict monitoring, which are closely linked to context-based memory updating. Both error detection and conflict monitoring are necessary to detect an error or deviance with respect to an internal learned model.

Main Effect of Transgression

This experiment focused on gradual brain adaptations as a function of musical expertise and proficiency in the context of different levels of transgression saliency. Therefore, the main effect of Transgression is of the least interest in the current study, as all expertise levels were collapsed. Moreover, as the three transgression conditions set intrinsically different requirements for the participants, as explained in the second paragraph of the preceding subchapter Main Effect of Expertise, widely distributed brain clusters responded. Discussing all of them would lead us out of the scope of this study, which principally focuses on musical expertise.

However, the bilateral clusters in the ACC and medial frontal cortex as well as in the parahippocampal gyrus that contributed to the main effect of Transgression pertain to the same brain areas as those representing the main effect of Expertise and showed systematically higher CD in response to Tapp as compared to R and Tsub. In all participants, responses to apparent thus more salient transgressed endings evoked stronger responses in these brain areas than regular and subtly transgressed closures, independent of expertise level. As both Non-musicians and Amateurs appraised Tsub with relatively low d-prime values, the accurate appraisal by Experts seems to be annihilated by the collapsing of the groups. The explanations we provided for the involvement of the ACC, medial frontal cortex, and parahippocampal gyrus for the factor Expertise also hold for the Transgression condition without taking Expertise into account: all participants -to varying degrees- were involved in error monitoring and evaluation on the cognitive and affective levels and performed higher-order pitch analyses. However, it seems that when all expertise levels are collapsed, more involvement of d-ACC and thus the cognitive component of the error monitoring manifests for the main effect of transgression discussed in this subchapter than for the main effect of expertise (see Figure 6Ciii). This may be explained by the fact that the task becomes progressively easier with increasing expertise, demanding less cognitive effort and likewise, requiring less error prevention.

The stronger activations in the infero-frontal regions, close to the Broca area, can be explained by their participation in musical syntax processing (Maess et al., 2001; Zatorre, 2001; Levitin and Menon, 2003; Tillmann et al., 2006; James et al., 2008; Koelsch et al., 2013) as well as in working memory function (Janata et al., 2002b; Oechslin et al., 2017). Both explanations are plausible in the context of detecting transgressions while appraising the endings of rich polyphonic musical pieces.

Comparing the current results with the main effects of transgression in our fMRI study (Oechslin et al., 2013b), no overlapping activations occurred. Again, apart from the different neural mechanisms involved, this may be due to the fMRI contrasts used, specifically for the effect of transgression, as we subtracted brain regions that responded to R endings from areas responding to Tsub and Tapp.

Limitations of the Study

In the first place, as we only investigated classically trained pianists, all our conclusions must therefore be restrained to this subpopulation of musicians. This has some impact because pianists who perform the classical repertoire, reading and performing complex polyphonic scores, may show higher proficiency in syntax processing than musicians playing melodic instruments like the violin or the flute.

In addition, although electrical source imaging methods using spherical head models and template anatomical images similar to ours have been successfully applied in different cognitive and clinical domains (James et al., 2008, 2015; Britz et al., 2009, 2014; Corrigan et al., 2009; Knebel et al., 2011; Geukes et al., 2013; Plomp et al., 2013; Rihs et al., 2013; De Meo et al., 2015), they can only guarantee centimeter spatial accuracy (Plomp et al., 2010).

Finally, as we did not use digitized electrode positions, or individual T1 anatomical images, we lose around 10% in sensitivity of source localization (Brodbeck et al., 2011) compared to recent studies that applied these individualized approaches (Birot et al., 2014; Megevand et al., 2014; Plomp et al., 2015).

Conclusion

The main conclusion resides in the confirmation of gradual impact of musical training on brain and behavior, which is now for the first time also supported by EEG methods with millisecond precision.

In a time window from approximately 300–500 ms, non-musicians, amateur musicians and professional musicians responded differently to realistic complex musical stimuli at the behavioral, ERP, microstate, and brain source levels. With increasing expertise, enhanced processing proficiency allowed comparing the previously perceived musical closure with a learned internal model, implicating top-down cognitive processing, as evidenced by extended P300/P3b-like configurations, that expressed on the waveform and the microstate level, supported by the posterior rMTG, bilateral ACC and right parahippocampus. In addition, the right middle temporal gyrus may represent the gateway of sound-to-meaning-mapping, a processing chain in music processing from the rMTG toward frontal areas via the ventral stream.

Methodologically, it is compelling to note that peakvoxels for the main effect of Expertise (ACC) and Expertise × Transgression interaction (rMTG) were situated in the same brain areas, albeit at different locations, when EEG source imaging data and fMRI were applied and identical stimuli and participants were examined.

Given the strict matching of the 3 expertise groups, these results provide evidence on the progressive impact of training on brain and behavior.

Author Contributions

CEJ conceived the study, performed the data collection together with MSO, realized a first draft of all analyses, conceived the outlines of all figures and wrote and edited the manuscript. MSO performed the data collection together with CEJ, and contributed to the preprocessing of the data. Then he contributed importantly to the final editing of the manuscript. He was involved in all other studies pertaining to Swiss National Science Foundation (100014–12505 to CEJ, see Funding). CMM participated by means of his expertise in the microstate and source analyses, and also performed a depth reading of the manuscript. MD realized the final ERP analyses and figures and contributed importantly to the final editing of the manuscript.

Funding

This work was supported by the Swiss National Science Foundation (no. 100014–125050 to CEJ) and is part of a multimodal brain-imaging project entitled “Behavioral, neuro-functional, and neuro-anatomical correlates of experience dependent music perception.” CMM was also supported by the Swiss National Science Foundation (no. 320030_159705).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The Cartool software (brainmapping.unige.ch/cartool) was programmed by Denis Brunet from the Functional Brain Mapping Laboratory, Geneva, Switzerland, and supported by the Center for Biomedical Imaging (CIBM) of Geneva and Lausanne. The STEN toolbox (http://www.unil.ch/line/home/menuinst/about-the-line/software--analysis-tools.html) was programmed by Jean-François Knebel, from the Laboratory for Investigative Neurophysiology (the LINE), Lausanne, Switzerland, and supported by the Center for Biomedical Imaging (CIBM) of Geneva and Lausanne and by the National Center of Competence in Research project “SYNAPSY—The Synaptic Bases of Mental Disease”; project no. 51AU40_125759. We thank Dr. Andres Posada and Dr. Juliane Britz for helpful advice concerning the EEG recordings. We also thank Prof. Patrik Vuilleumier for the use of the Brain and Behavior Laboratory. Finally, we thank Bruno Pietri for the beautiful compositions.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2017.00613/full#supplementary-material

Footnotes

1. ^Harmony refers to the rule system of chord structure in Western music.

References

Asano, R., and Boeckx, C. (2015). Syntax in language and music: what is the right level of comparison? Front. Psychol. 6:942. doi: 10.3389/fpsyg.2015.00942

PubMed Abstract | CrossRef Full Text | Google Scholar

Barrett, K. C., Ashley, R., Strait, D. L., and Kraus, N. (2013). Art and science: how musical training shapes the brain. Front. Psychol. 4:713. doi: 10.3389/fpsyg.2013.00713

PubMed Abstract | CrossRef Full Text | Google Scholar

Bianco, R., Novembre, G., Keller, P. E., Kim, S. G., Scharf, F., Friederici, A. D., et al. (2016). Neural networks for harmonic structure in music perception and action. Neuroimage 142, 454–464. doi: 10.1016/j.neuroimage.2016.08.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Bigand, E. (2003). More about the musical expertise of musically untrained listeners. Ann. N.Y. Acad. Sci. 999, 304–312. doi: 10.1196/annals.1284.041

PubMed Abstract | CrossRef Full Text | Google Scholar

Birot, G., Spinelli, L., Vulliemoz, S., Megevand, P., Brunet, D., Seeck, M., et al. (2014). Head model and electrical source imaging: a study of 38 epileptic patients. Neuroimage Clin. 5, 77–83. doi: 10.1016/j.nicl.2014.06.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Britz, J., Diaz Hernandez, L., Ro, T., and Michel, C. M. (2014). EEG-microstate dependent emergence of perceptual awareness. Front. Behav. Neurosci. 8:163. doi: 10.3389/fnbeh.2014.00163

PubMed Abstract | CrossRef Full Text | Google Scholar

Britz, J., Landis, T., and Michel, C. M. (2009). Right parietal brain activity precedes perceptual alternation of bistable stimuli. Cereb. Cortex 19, 55–65. doi: 10.1093/cercor/bhn056

PubMed Abstract | CrossRef Full Text | Google Scholar

Brodbeck, V., Spinelli, L., Lascano, A. M., Wissmeier, M., Vargas, M. I., Vulliemoz, S., et al. (2011). Electroencephalographic source imaging: a prospective study of 152 operated epileptic patients. Brain 134(Pt 10), 2887–2897. doi: 10.1093/brain/awr243

PubMed Abstract | CrossRef Full Text | Google Scholar

Brunet, D., Murray, M. M., and Michel, C. M. (2011). Spatiotemporal analysis of multichannel EEG: CARTOOL. Comput. Intell. Neurosci. 2011:813870. doi: 10.1155/2011/813870

PubMed Abstract | CrossRef Full Text | Google Scholar

Bush, G., Luu, P., and Posner, M. I. (2000). Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn. Sci. 4, 215–222. doi: 10.1016/S1364-6613(00)01483-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Carrion, R. E., and Bly, B. M. (2008). The effects of learning on event-related potential correlates of musical expectancy. Psychophysiology 45, 759–775. doi: 10.1111/j.1469-8986.2008.00687.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Centeno, M., Tierney, T. M., Perani, S., Shamshiri, E. A., St Pier, K., Wilkinson, C., et al. (2017). Combined electroencephalography-functional magnetic resonance imaging and electrical source imaging improves localization of pediatric focal epilepsy. Ann. Neurol. 82, 278–287. doi: 10.1002/ana.25003

PubMed Abstract | CrossRef Full Text

Cha, K., Zatorre, R. J., and Schonwiesner, M. (2016). Frequency selectivity of voxel-by-voxel functional connectivity in human auditory cortex. Cereb. Cortex 26, 211–224. doi: 10.1093/cercor/bhu193

PubMed Abstract | CrossRef Full Text | Google Scholar

Corrigan, N. M., Richards, T., Webb, S. J., Murias, M., Merkle, K., Kleinhans, N. M., et al. (2009). An investigation of the relationship between fMRI and ERP source localized measurements of brain activity during face processing. Brain Topogr. 22, 83–96. doi: 10.1007/s10548-009-0086-5

PubMed Abstract | CrossRef Full Text | Google Scholar

De Meo, R., Bourquin, N. M., Knebel, J. F., Murray, M. M., and Clarke, S. (2015). From bird to sparrow: Learning-induced modulations in fine-grained semantic discrimination. Neuroimage 118, 163–173. doi: 10.1016/j.neuroimage.2015.05.091

PubMed Abstract | CrossRef Full Text | Google Scholar

Disbrow, E. A., Slutsky, D. A., Roberts, T. P. L., and Krubitzer, L. A. (2000). Functional MRI at 1.5 tesla: A comparison of the blood oxygenation level-dependent signal and electrophysiology. Proc. Natl. Acad. Sci. U.S.A. 97, 9718–9723. doi: 10.1073/pnas.170205497

PubMed Abstract | CrossRef Full Text | Google Scholar

Duarte, J. L., Alvarenga, K. D. F., Banhara, M. R., de Melo, A. D. P., Sás, R. M., and Filho, O. A. C. (2009). P300- long-latency auditory evoked potential in normal hearing subjects: simultaneous recording value in Fz and Cz. Brazil. J. Otorhinolaryngol. 75, 231–236. doi: 10.1016/S1808-8694(15)30783-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Ellis, R. J., Bruijn, B., Norton, A. C., Winner, E., and Schlaug, G. (2013). Training-mediated leftward asymmetries during music processing: a cross-sectional and longitudinal fMRI analysis. Neuroimage 75, 97–107. doi: 10.1016/j.neuroimage.2013.02.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A., Krampe, R. T., and Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 363–406. doi: 10.1037/0033-295X.100.3.363

CrossRef Full Text | Google Scholar

Fischer, A. (2011). On the number of groups in clustering. Statist. Probab. Lett. 81, 1771–1781. doi: 10.1016/j.spl.2011.07.005

CrossRef Full Text | Google Scholar

Geukes, S., Huster, R. J., Wollbrink, A., Junghofer, M., Zwitserlood, P., and Dobel, C. (2013). A large N400 but no BOLD effect–comparing source activations of semantic priming in simultaneous EEG-fMRI. PLoS ONE 8:e84029. doi: 10.1371/journal.pone.0084029

PubMed Abstract | CrossRef Full Text | Google Scholar

Gordon, E. E. (1989). Manual for the Advanced Measures of Muscial Audiation. Chicago, IL: GIA Publications.

Grech, R., Cassar, T., Muscat, J., Camilleri, K. P., Fabri, S. G., Zervakis, M., et al. (2008). Review on solving the inverse problem in EEG source analysis. J. Neuroeng. Rehabil. 5:25. doi: 10.1186/1743-0003-5-25

PubMed Abstract | CrossRef Full Text | Google Scholar

Habibi, A., Cahn, B. R., Damasio, A., and Damasio, H. (2016). Neural correlates of accelerated auditory processing in children engaged in music training. Dev. Cogn. Neurosci. 21, 1–14. doi: 10.1016/j.dcn.2016.04.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Hall, J. W. (2007). New handbook of auditory evoked responses. Boston, MA: Pearson.

Hamalainen, M. S., and Ilmoniemi, R. J. (1994). Interpreting magnetic fields of the brain: minimum norm estimates. Med. Biol. Eng. Comput. 32, 35–42. doi: 10.1007/BF02512476

PubMed Abstract | CrossRef Full Text | Google Scholar

Herholz, S. C., and Zatorre, R. J. (2012). Musical training as a framework for brain plasticity: behavior, function, and structure. Neuron 76, 486–502. doi: 10.1016/j.neuron.2012.10.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Hickok, G., and Poeppel, D. (2000). Towards a functional neuroanatomy of speech perception. Trends Cogn. Sci. 4, 131–138. doi: 10.1016/S1364-6613(00)01463-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Hickok, G., and Poeppel, D. (2004). Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92, 67–99. doi: 10.1016/j.cognition.2003.10.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Howell, D. C. (2014). Fundamental Statistics for the Behavioral Sciences. Belmont, CA: Wadsworth, Cengage Learning.

Hyde, K. L., Lerch, J., Norton, A., Forgeard, M., Winner, E., Evans, A. C., et al. (2009a). The effects of musical training on structural brain development: a longitudinal study. Ann. N. Y. Acad. Sci. U.S.A. 1169, 182–186. doi: 10.1111/j.1749-6632.2009.04852.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hyde, K. L., Lerch, J., Norton, A., Forgeard, M., Winner, E., Evans, A. C., et al. (2009b). Musical training shapes structural brain development. J. Neurosci. 29, 3019–3025. doi: 10.1523/JNEUROSCI.5118-08.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Iannaccone, R., Hauser, T. U., Staempfli, P., Walitza, S., Brandeis, D., and Brem, S. (2015). Conflict monitoring and error processing: new insights from simultaneous EEG-fMRI. Neuroimage 105, 395–407. doi: 10.1016/j.neuroimage.2014.10.028

PubMed Abstract | CrossRef Full Text | Google Scholar

James, C. E., Britz, J., Vuilleumier, P., Hauert, C. A., and Michel, C. M. (2008). Early neuronal responses in right limbic structures mediate harmony incongruity processing in musical experts. Neuroimage 42, 1597–1608. doi: 10.1016/j.neuroimage.2008.06.025

PubMed Abstract | CrossRef Full Text | Google Scholar

James, C. E., Cereghetti, D. M., Roullet Tribes, E., and Oechslin, M. S. (2015). Electrophysiological evidence for a specific neural correlate of musical violation expectation in primary-school children. Neuroimage 104, 386–397. doi: 10.1016/j.neuroimage.2014.09.047

PubMed Abstract | CrossRef Full Text | Google Scholar

James, C. E., Oechslin, M. S., Van De Ville, D., Hauert, C. A., Descloux, C., and Lazeyras, F. (2014). Musical training intensity yields opposite effects on grey matter density in cognitive vs. sensorimotor networks. Brain Struct. Funct. 219, 353–366. doi: 10.1007/s00429-013-0504-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Janata, P., Birk, J. L., Van Horn, J. D., Leman, M., Tillmann, B., and Bharucha, J. J. (2002a). The cortical topography of tonal structures underlying Western music. Science 298, 2167–2170. doi: 10.1126/science.1076262

PubMed Abstract | CrossRef Full Text | Google Scholar

Janata, P., Tillmann, B., and Bharucha, J. J. (2002b). Listening to polyphonic music recruits domain-general attention and working memory circuits. Cogn. Affect. Behav. Neurosci. 2, 121–140. doi: 10.3758/CABN.2.2.121

PubMed Abstract | CrossRef Full Text | Google Scholar

Jancke, L. (2009). Music drives brain plasticity. F1000 Biol. Rep. 1:78. doi: 10.3410/B1-78

PubMed Abstract | CrossRef Full Text | Google Scholar

Jenni, R., Oechslin, M. S., and James, C. E. (2017). Impact of major and minor mode on EEG frequency range activities of music processing as a function of expertise. Neurosci. Lett. 647, 159–164. doi: 10.1016/j.neulet.2017.03.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Knebel, J. F., Javitt, D. C., and Murray, M. M. (2011). Impaired early visual response modulations to spatial information in chronic schizophrenia. Psychiatry Res. 193, 168–176. doi: 10.1016/j.pscychresns.2011.02.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Koelsch, S., Gunter, T., Friederici, A. D., and Schroger, E. (2000). Brain indices of music processing: “nonmusicians” are musical. J. Cogn. Neurosci. 12, 520–541. doi: 10.1162/089892900562183

PubMed Abstract | CrossRef Full Text | Google Scholar

Koelsch, S., Gunter, T. C., Schroger, E., Tervaniemi, M., Sammler, D., and Friederici, A. D. (2001). Differentiating ERAN and MMN: an ERP study. Neuroreport 12, 1385–1389. doi: 10.1097/00001756-200105250-00019

PubMed Abstract | CrossRef Full Text | Google Scholar

Koelsch, S., Jentschke, S., Sammler, D., and Mietchen, D. (2007). Untangling syntactic and sensory processing: an ERP study of music perception. Psychophysiology 44, 476–490. doi: 10.1111/j.1469-8986.2007.00517.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Koelsch, S., Rohrmeier, M., Torrecuso, R., and Jentschke, S. (2013). Processing of hierarchical syntactic structure in music. Proc. Natl. Acad. Sci. U.S.A. 110, 15443–15448. doi: 10.1073/pnas.1300272110

PubMed Abstract | CrossRef Full Text | Google Scholar

Koenig, T., Prichep, L., Lehmann, D., Sosa, P. V., Braeker, E., Kleinlogel, H., et al. (2002). Millisecond by millisecond, year by year: normative EEG microstates and developmental stages. Neuroimage 16, 41–48. doi: 10.1006/nimg.2002.1070

PubMed Abstract | CrossRef Full Text | Google Scholar

Kok, A. (2001). On the utility of P3 amplitude as a measure of processing capacity. Psychophysiology 38, 557–577. doi: 10.1017/S0048577201990559

PubMed Abstract | CrossRef Full Text | Google Scholar

Kraus, N., Strait, D. L., and Parbery-Clark, A. (2012). Cognitive factors shape brain networks for auditory skills: spotlight on auditory working memory. Ann. N.Y. Acad. Sci. 1252, 100–107. doi: 10.1111/j.1749-6632.2012.06463.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Krzanowski, W. J., and Lai, Y. T. (1988). A criterion for determining the number of groups in a data set using sum-of-squares clustering. Biometrics 44, 23–34. doi: 10.2307/2531893

CrossRef Full Text | Google Scholar

Lantz, G., Grave de Peralta Menendez, R., Gonzalez Andino, S., and Michel, C. M. (2001). Noninvasive localization of electromagnetic epileptic activity. II. Demonstration of sublobar accuracy in patients with simultaneous surface and depth recordings. Brain Topogr. 14, 139–147. doi: 10.1023/A:1012996930489

PubMed Abstract | CrossRef Full Text | Google Scholar

Lehmann, D., Ozaki, H., and Pal, I. (1987). EEG alpha map series: brain micro-states by space-oriented adaptive segmentation. Electroencephalogr. Clin. Neurophysiol. 67, 271–288. doi: 10.1016/0013-4694(87)90025-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Levitin, D. J., and Menon, V. (2003). Musical structure is processed in “language” areas of the brain: a possible role for Brodmann Area 47 in temporal coherence. Neuroimage 20, 2142–2152. doi: 10.1016/j.neuroimage.2003.08.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., and Oeltermann, A. (2001). Neurophysiological investigation of the basis of the fMRI signal. Nature 412, 150–157. doi: 10.1038/35084005

PubMed Abstract | CrossRef Full Text | Google Scholar

Ludwig, C., Chicherio, C., Terraneo, L., Magistretti, P., de Ribaupierre, A., and Slosman, D. (2008). Functional imaging studies of cognition using 99mTc-HMPAO SPECT: empirical validation using the n-back working memory paradigm. Eur. J. Nucl. Med. Mol. Imaging 35, 695–703. doi: 10.1007/s00259-007-0635-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Luu, P., and Ferree, T. (2005). Determination of the Geodesic Sensor Nets' Average Electrode Positions and their 10–10 International Equivalents (Revised). Eugene, OR: Electrical Geodesics Inc.

Google Scholar

Macmillan, N. A., and Creelman, C. D. (1997). d'plus: A program to calculate accuracy and bias measures from detection and discrimination data. Spat. Vis. 11, 141–143.

PubMed Abstract | Google Scholar

Maess, B., Koelsch, S., Gunter, T. C., and Friederici, A. D. (2001). Musical syntax is processed in Broca's area: an MEG study. Nat. Neurosci. 4, 540–545. doi: 10.1038/87502

PubMed Abstract | CrossRef Full Text | Google Scholar

Magno, E., Foxe, J. J., Molholm, S., Robertson, I. H., and Garavan, H. (2006). The Anterior Cingulate and Error Avoidance. J. Neurosci. 26, 4769–4773. doi: 10.1523/JNEUROSCI.0369-06.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

Martuzzi, R., Murray, M. M., Meuli, R. A., Thiran, J. P., Maeder, P. P., Michel, C. M., et al. (2009). Methods for determining frequency- and region-dependent relationships between estimated LFPs and BOLD responses in humans. J. Neurophysiol. 101, 491–502. doi: 10.1152/jn.90335.2008

PubMed Abstract | CrossRef Full Text | Google Scholar

Megevand, P., Spinelli, L., Genetti, M., Brodbeck, V., Momjian, S., Schaller, K., et al. (2014). Electric source imaging of interictal activity accurately localises the seizure onset zone. J. Neurol Neurosurg. Psychiatry 85, 38–43. doi: 10.1136/jnnp-2013-305515

PubMed Abstract | CrossRef Full Text | Google Scholar

Menon, V., and Crottaz-Herbette, S. (2005). “Combined EEG and fMRI studies of human brain function,” in International Review of Neurobiology, ed M. Glabus (San Diego, CL; London, UK: Elsevier Academic Press), 291–321. Available online at: http://www.sciencedirect.com/science/article/pii/S0074774205660102?via%3Dihub

Google Scholar

Michel, C. M., and Brandeis, D. (2009). “Data acquisition and pre-processing standards for electrical neuroimaging,” in Electrical Neuroimaging, eds C. M. Michel, T. Koenig, D. Brandeis, L. R. R. Gianotti, and J. Wackermann (Cambridge: Cambridge University Press), Cambridge.

Michel, C. M., and Murray, M. M. (2012). Towards the utilization of EEG as a brain imaging tool. Neuroimage 61, 371–385. doi: 10.1016/j.neuroimage.2011.12.039

PubMed Abstract | CrossRef Full Text | Google Scholar

Michel, C. M., Murray, M. M., Lantz, G., Gonzalez, S., Spinelli, L., and Grave de Peralta, R. (2004). EEG source imaging. Clin. Neurophysiol. 115, 2195–2222. doi: 10.1016/j.clinph.2004.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Miendlarzewska, E. A., and Trost, W. J. (2013). How musical training affects cognitive development: rhythm, reward and other modulating variables. Front. Neurosci. 7:279. doi: 10.3389/fnins.2013.00279

PubMed Abstract | CrossRef Full Text | Google Scholar

Mohanty, A., Engels, A. S., Herrington, J. D., Heller, W., Ho, M. H., Banich, M. T., et al. (2007). Differential engagement of anterior cingulate cortex subdivisions for cognitive and emotional function. Psychophysiology 44, 343–351. doi: 10.1111/j.1469-8986.2007.00515.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Moreno, S., Marques, C., Santos, A., Santos, M., Castro, S. L., and Besson, M. (2009). Musical training influences linguistic abilities in 8-year-old children: more evidence for brain plasticity. Cereb. Cortex 19, 712–723. doi: 10.1093/cercor/bhn120

PubMed Abstract | CrossRef Full Text | Google Scholar

Murray, M. M., Brunet, D., and Michel, C. M. (2008). Topographic ERP analyses: a Step-by-Step tutorial review. Brain Topogr. 20, 249–264. doi: 10.1007/s10548-008-0054-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Oechslin, M. S., Descloux, C., Croquelois, A., Chanal, J., Van De Ville, D., Lazeyras, F., and James, C. E. (2013a). Hippocampal volume predicts fluid intelligence in musically trained people. Hippocampus 23, 552–558. doi: 10.1002/hipo.22120

PubMed Abstract | CrossRef Full Text | Google Scholar

Oechslin, M. S., Gschwind, M., and James, C. E. (2017). Tracking training-related plasticity by combining fMRI and DTI: the right hemisphere ventral stream mediates musical syntax processing. Cereb. Cortex 1–10. doi: 10.1093/cercor/bhx033. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Oechslin, M. S., Van De Ville, D., Lazeyras, F., Hauert, C. A., and James, C. E. (2013b). Degree of musical expertise modulates higher order brain functioning. Cereb. Cortex 23, 2213–2224. doi: 10.1093/cercor/bhs206

PubMed Abstract | CrossRef Full Text | Google Scholar

Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113. doi: 10.1016/0028-3932(71)90067-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Pantev, C., and Herholz, S. C. (2011). Plasticity of the human auditory cortex related to musical training. Neurosci. Biobehav. Rev. 35, 2140–2154. doi: 10.1016/j.neubiorev.2011.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Parbery-Clark, A., Skoe, E., and Kraus, N. (2009). Musical experience limits the degradative effects of background noise on the neural processing of sound. J. Neurosci. 29, 14100–14107. doi: 10.1523/JNEUROSCI.3256-09.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Pascual-Leone, A. (2001). The brain that plays music and is changed by it. Ann. N.Y. Acad. Sci. 930, 315–329. doi: 10.1111/j.1749-6632.2001.tb05741.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Pascual-Marqui, R. D., Michel, C. M., and Lehmann, D. (1995). Segmentation of brain electrical activity into microstates: model estimation and validation. IEEE Trans. Biomed. Eng. 42, 658–665. doi: 10.1109/10.391164

PubMed Abstract | CrossRef Full Text | Google Scholar

Perrin, F., Pernier, J., Bertrand, O., and Echallier, J. F. (1989). Spherical splines for scalp potential and current density mapping. Electroencephalogr. Clin. Neurophysiol. 72, 184–187. doi: 10.1016/0013-4694(89)90180-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Plomp, G., Hervais-Adelman, A., Astolfi, L., and Michel, C. M. (2015). Early recurrence and ongoing parietal driving during elementary visual processing. Sci. Rep. 5:18733. doi: 10.1038/srep18733

PubMed Abstract | CrossRef Full Text | Google Scholar

Plomp, G., Michel, C. M., and Herzog, M. H. (2010). Electrical source dynamics in three functional localizer paradigms. Neuroimage 53, 257–267. doi: 10.1016/j.neuroimage.2010.06.037

PubMed Abstract | CrossRef Full Text | Google Scholar

Plomp, G., Roinishvili, M., Chkonia, E., Kapanadze, G., Kereselidze, M., Brand, A., et al. (2013). Electrophysiological evidence for ventral stream deficits in schizophrenia patients. Schizophr. Bull. 39, 547–554. doi: 10.1093/schbul/sbr175

PubMed Abstract | CrossRef Full Text | Google Scholar

Polich, J. (2007). Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol. 118, 2128–2148. doi: 10.1016/j.clinph.2007.04.019

PubMed Abstract | CrossRef Full Text | Google Scholar

Polich, J., and Criado, J. R. (2006). Neuropsychology and neuropharmacology of P3a and P3b. Int. J. Psychophysiol. 60, 172–185. doi: 10.1016/j.ijpsycho.2005.12.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Poulin-Charronnat, B., Bigand, E., and Koelsch, S. (2006). Processing of musical syntax tonic vs. subdominant: an event-related potential study. J. Cogn. Neurosci. 18, 1545–1554. doi: 10.1162/jocn.2006.18.9.1545

CrossRef Full Text | Google Scholar

Raven, J., and Court, J. (2003 updated 2004). Manual for Raven's Progressive Matrices and Vocabulary Scales. San Antonio, TX: Harcourt Assessment.

Ridderinkhof, K. R., Nieuwenhuis, S., and Braver, T. S. (2007). Medial frontal cortex function: an introduction and overview. Cogn. Affect Behav. Neurosci. 7, 261–265. doi: 10.3758/CABN.7.4.261

PubMed Abstract | CrossRef Full Text | Google Scholar

Rihs, T. A., Tomescu, M. I., Britz, J., Rochas, V., Custo, A., Schneider, M., et al. (2013). Altered auditory processing in frontal and left temporal cortex in 22q11.2 deletion syndrome: a group at high genetic risk for schizophrenia. Psychiatry Res. 212, 141–149. doi: 10.1016/j.pscychresns.2012.09.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Sakurai, Y., Mimura, I., and Mannen, T. (2008). Agraphia for kanji resulting from a left posterior middle temporal gyrus lesion. Behav. Neurol. 19, 93–106. doi: 10.1155/2008/393912

PubMed Abstract | CrossRef Full Text | Google Scholar

Sander, D., Grafman, J., and Zalla, T. (2003). The human amygdala: an evolved system for relevance detection. Rev. Neurosci. 14, 303–316. doi: 10.1515/REVNEURO.2003.14.4.303

PubMed Abstract | CrossRef Full Text | Google Scholar

Schon, D., and Francois, C. (2011). Musical expertise and statistical learning of musical and linguistic structures. Front. Psychol. 2:167. doi: 10.3389/fpsyg.2011.00167

PubMed Abstract | CrossRef Full Text | Google Scholar

Sihvonen, A. J., Ripolles, P., Leo, V., Rodriguez-Fornells, A., Soinila, S., and Sarkamo, T. (2016). Neural basis of acquired amusia and its recovery after stroke. J. Neurosci. 36, 8872–8881. doi: 10.1523/JNEUROSCI.0709-16.2016

PubMed Abstract | CrossRef Full Text | Google Scholar

Simons, R. F. (2010). The way of our errors: theme and variations. Psychophysiology 47, 1–14. doi: 10.1111/j.1469-8986.2009.00929.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Sloboda, J. A., Davidson, J. W., Howe, M. J. A., and Moore, D. G. (1996). The role of practice in the development of performing musicians. Br. J. Psychol. 87, 287–309. doi: 10.1111/j.2044-8295.1996.tb02591.x

CrossRef Full Text | Google Scholar

Spinelli, L., Andino, S. G., Lantz, G., Seeck, M., and Michel, C. M. (2000). Electromagnetic inverse solutions in anatomically constrained spherical head models. Brain Topogr. 13, 115–125. doi: 10.1023/A:1026607118642

PubMed Abstract | CrossRef Full Text | Google Scholar

Tibshirani, R., and Walther, G. (2005). Cluster validation by prediction strength. J. Computat. Graph. Statist. 14, 511–528. doi: 10.1198/106186005X59243

CrossRef Full Text | Google Scholar

Tillmann, B., Bharucha, J. J., and Bigand, E. (2000). Implicit learning of tonality: a self-organizing approach. Psychol. Rev. 107, 885–913. doi: 10.1037/0033-295X.107.4.885

PubMed Abstract | CrossRef Full Text | Google Scholar

Tillmann, B., Koelsch, S., Escoffier, N., Bigand, E., Lalitte, P., Friederici, A. D., et al. (2006). Cognitive priming in sung and instrumental music: activation of inferior frontal cortex. Neuroimage 31, 1771–1782. doi: 10.1016/j.neuroimage.2006.02.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Tse, C. Y., and Penney, T. B. (2008). On the functional role of temporal and frontal cortex activation in passive detection of auditory deviance. Neuroimage 41, 1462–1470. doi: 10.1016/j.neuroimage.2008.03.043

PubMed Abstract | CrossRef Full Text | Google Scholar

Vaughan, H. G. Jr. (1982). The neural origins of human event-related potentials. Ann. N.Y. Acad. Sci. 388, 125–138. doi: 10.1111/j.1749-6632.1982.tb50788.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Wan, C. Y., and Schlaug, G. (2010). Music making as a tool for promoting brain plasticity across the life span. Neuroscientist 16, 566–577. doi: 10.1177/1073858410377805

PubMed Abstract | CrossRef Full Text | Google Scholar

Wieser, H. G. (2003). Music and the brain. Lessons from brain diseases and some reflections on the “emotional” brain. Ann. N.Y. Acad. Sci. 999, 76–94. doi: 10.1196/annals.1284.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Zatorre, R., and McGill, J. (2005). Music, the food of neuroscience? Nature 434, 312–315. doi: 10.1038/434312a

PubMed Abstract | CrossRef Full Text | Google Scholar

Zatorre, R. J. (2001). Neural specializations for tonal processing. Ann. N.Y. Acad. Sci. 930, 193–210. doi: 10.1111/j.1749-6632.2001.tb05734.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: musical training, musical syntax transgression, microstate analysis, ERP source imaging, middle temporal gyrus, anterior cingulate gyrus

Citation: James CE, Oechslin MS, Michel CM and De Pretto M (2017) Electrical Neuroimaging of Music Processing Reveals Mid-Latency Changes with Level of Musical Expertise. Front. Neurosci. 11:613. doi: 10.3389/fnins.2017.00613

Received: 22 June 2017; Accepted: 20 October 2017;
Published: 07 November 2017.

Edited by:

Daniela Sammler, Max Planck Institute for Human Cognitive and Brain Sciences (MPG), Germany

Reviewed by:

Yun Nan, Beijing Normal University, China
Psyche Loui, Wesleyan University, United States

Copyright © 2017 James, Oechslin, Michel and De Pretto. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Clara E. James, clara.james@hesge.ch

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.