Interaction between perceptual and cognitive processing well acknowledged in perceptual expertise research
Alan C.-N. Wong
Yetta K. Wong- 1Perception and Experience Laboratory, Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
- 2Department of Applied Social Studies, City University of Hong Kong, Hong Kong, China
To understand the neural correlates of expert object recognition, Harel et al. (2013) proposed the use of an existing theoretical framework (Mahon et al., 2007; Martin, 2007) that emphasizes the interaction between different parts of the visual pathway as well as between the visual and other cognitive systems. While we agree that focusing more on the role of these interactions in expertise acquisition is a fruitful research direction, we would like to clarify the position of perceptual expertise researchers1. In fact, perceptual expertise researchers never regard face-selective areas as the only neural substrates important for expert object recognition. Nor do they deny the role of interaction between the visual system and other cognitive systems. Instead, perceptual expertise researchers have been considering the interaction between perceptual and cognitive processing as an important component in understanding perceptual expertise for different objects. It is therefore unnecessary to create the debate between the so-called “perceptual view” and “interactive view” of expert object recognition, as the interaction between perceptual and cognitive processing has been well accommodated in perceptual expertise research. We elaborate on this idea through the following two points:
Perceptual Expertise Researchers do Emphasize the Role of Attentional and Higher-Level Cognitive Factors in Expertise Acquisition and Expression
Harel et al. (2013) states that according to perceptual expertise researchers, “expert processing… is automatic and stimulus-driven, with little impact of attentional, task demands or other higher-level cognitive factors” (p.2). Unfortunately, this characterization of the views of perceptual expertise researchers is inaccurate. Palmeri and Gauthier (2004), for example, proposes the abandoning of the strict distinction between perceptual and cognitive processes in understanding expert object recognition. Bukach et al. (2006), another landmark paper detailing the perceptual expertise framework, affirms that there are different kinds of perceptual expertise for different objects, and to distinguish between them both physical and conceptual (e.g., functional knowledge) properties should be considered.
Research has shown the importance of task demands in the development as well as expression of expertise in object recognition. Task demand during training is always a major factor determining whether or what kind of expertise would be formed (e.g., Tanaka et al., 2005; Scott et al., 2006; Krigolson et al., 2009; Wong et al., 2009a,b, 2012). Task demand during testing also affects whether and how much expertise effects can be observed (Wong et al., 2009b, 2012, 2014). For example, in Wong et al. (2009b), two groups of observers learned to categorize the same set of artificial objects (ziggerins) in different ways, leading to different changes of neural selectivity patterns for the trained objects. Importantly, the neural changes were better observed when the testing task matched the training task. Even the FFA shows higher activity to different objects in tasks that requires more attention such as old/new recognition than passive viewing (Rhodes et al., 2004). Therefore, using Harel et al.'s (2013) terms (their footnote 2), both “task-specific learning effects” and “task dependence following expertise training” have been well identified among perceptual expertise researchers (see also Box 2 of Bukach et al., 2006).
Perceptual expertise researchers put a lot of emphasis on the engagement of non-visual factors and the involvement of visual and non-visual areas outside the FFA (James and Gauthier, 2003, 2004, 2006; James and Atwood, 2009; James and Cree, 2010; Wong and Gauthier, 2010a; Bilalić et al., 2011a, 2010, 2012; Behrmann and Plaut, 2013; Kersey and James, 2013). For example, Wong and Gauthier (2010a) found that expert perception of musical notes engages not only higher visual regions that are distinct from the face- or letter-selective regions, but also bilateral early retinotopic cortex, and a wide range of multimodal regions including auditory, audiovisual, somatosensory, motor, parietal, frontal, and various subcortical areas. Similarly, a distributed network of areas including the motor and inferior frontal cortices is also engaged selectively for visual judgments of letters (James and Gauthier, 2006). A wide range of brain regions in the occipital, temporal, and frontal regions has also been found to be more active when chess experts performed visual judgment of chess pieces on chessboards (Bilalić et al., 2010; JEPG).
Training studies also show clearly the engagement of a widespread neural network of areas for expert object processing. When comparing the neural training effects of two traditions of visual perceptual training protocols (namely perceptual learning and perceptual expertise training), a wide range of brain regions has been investigated, including the recruitment and disengagement of early retinotopic cortex, higher visual cortex, parietal cortex, and the superior temporal sulcus (Wong et al., 2012). James and Gauthier (2003, 2004) also found that participants who verbally learned to associate artificial objects with conceptual features showed activations in non-visual areas during subsequent, perceptual judgment on these objects, including superior temporal gyrus (hearing), inferior frontal gyrus (semantics), etc.
Perceptual expertise researchers often emphasize that experts tend to automatically process their objects of expertise in a certain way (e.g., holistically, at a subordinate level of abstraction) or by recruiting certain brain areas even without explicit task instructions or requirements (e.g., Gauthier et al., 2000; Wong et al., 2009a,b). Importantly, however, this does not mean that such processes cannot be influenced or even overridden by higher-level cognitive processing2. On the contrary, as described above, both training studies and studies with real-world expertise demonstrate that cognitive processing (e.g., attention shaped by the current task demand, multimodal integration, and semantics) is often engaged even in tasks requiring only perceptual judgments.
Furthermore, it has been postulated that non-visual processing not only is engaged but also plays a crucial role in shaping neural selectivity for expert object categories. For example, writing training is found to be more effective than visual practice in contributing to the formation of letter selectivity in the fusiform gyrus, indicating a close interaction between motor and perceptual areas (James and Atwood, 2009; Kersey and James, 2013). Recently, Behrmann and Plaut (2013) propose that, the selective engagement of the left and right fusiform gyri for word and face processing respectively may originate from the constraint to keep the connections between visual word processing areas and language processing areas (both left-lateralized) as short as possible. Therefore, even when accounting for selectivity in visual areas, a distributed network of brain areas should be and have been considered.
Early Perceptual Expertise Research Focuses more on the Face-Selective Areas in Order to Address the “Face Modularity” Debate, but that does not Necessitate that Researchers Regard Face-Selective Areas as the Only Brain Regions Important for Expert Object Recognition
Despite the abundant research on the interaction between visual and cognitive processing in expert object recognition, why may perceptual expertise researchers be regarded as face-centric, as in Harel et al. (2013; p.4)? It has to do with the “face modularity debate” that heat up from the late 90's in the field of face perception.
The face modularity debate concerns the nature of the fusiform face area (FFA) in face processing: Is the FFA a module specialized for face recognition, or is it responsible for expert subordinate-level recognition of any objects? As stated in Bukach et al. (2006) and McGugin et al. (2012), the degree to which FFA activity is exclusive for faces lies in the center of the debate. In support of the latter view, perceptual expertise researchers have shown that acquisition of expertise with various object categories (e.g., cars, birds, “Digimon” cartoon characters, chess, and artificial objects like greebles) either leads to or is associated with increased selectivity in the FFA (Bilalić et al., 2011b; e.g., Gauthier et al., 1999, 2000; Grelotti et al., 2005; Xu, 2005). The modularity vs. expertise debate, however, is still ongoing (e.g., McGugin et al., 2012; Rezlescu et al., 2014). Therefore, a more accurate depiction of the field of expert object recognition is that, researchers (including those holding the modular and expertise views) have been focusing a lot on the FFA due to their research question concerning face modularity.
It is important to note that, although early perceptual expertise research focuses more on the face-selective areas in order to address the “face modularity” debate, that does not necessitate that researchers regard face-selective areas as the only brain regions important for expert object recognition. As an analogy, that one focuses on studying expert object recognition does not mean that one regards expert object recognition as the only important function of vision. As detailed in our first point, perceptual expertise researchers have been tackling issues other than the face modularity debate in recent years, and have expanded their investigations to different domains of perceptual expertise in a widespread network of brain areas.
Conclusion
Perceptual expertise researchers have been actively investigating the neural changes associated with expertise both inside and outside of the visual cortex. Tackling the face modularity debate, the majority of early effort has been put into clarifying the nature of the FFA. However, much work has since been devoted to studying the role of other high-level cognitive factors, including the effects of task demand on both the development and expression of expertise, the involvement of visual and non-visual areas in expert object recognition, the effects of conceptual associations, the way non-visual processes helps determine the pattern of visual object selective activity, etc. In sum, there is no such thing as a rivalry between the so-called “perceptual view” and “interactive view” of expert object recognition, and the interaction between perceptual and cognitive processing has been well accommodated in perceptual expertise research.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1. ^Here “perceptual expertise researchers” refer to those who investigate perceptual expertise in object recognition. To evaluate our interpretation of the position taken by perceptual expertise researchers in general, we encourage readers to refer to the papers we cited, including mainly but not limited to the works of researchers from the Perceptual Expertise Network (PEN).
2. ^Take as an example the composite task frequently used to measure holistic processing in expert object recognition (e.g., Richler et al., 2008; Wong and Gauthier, 2010b; Wong et al., 2011). A typical observer would spontaneously process all parts of an object of expertise even though the task instruction requires the observer to focus on one part, leading to imperfect performance. However, the performance is mostly well above chance, indicating that one can override their natural tendency of holistic processing at least to a certain extent to fulfill task requirement.
References
Behrmann, M., and Plaut, D. C. (2013). Distributed circuits, not circumscribed centers, mediate visual cognition. Trends Cogn. Sci. 17, 210–219. doi: 10.1016/j.tics.2013.03.007
Bilalić, M., Kiesel, A., Pohl, C., Erb, M., and Grodd, W. (2011a). It takes two–skilled recognition of objects engages lateral areas in both hemispheres. PLoS ONE 6:e16202. doi: 10.1371/journal.pone.0016202
Bilalić, M., Langner, R., Erb, M., and Grodd, W. (2010). Mechanisms and neural basis of object and pattern recognition – a study with chess experts. J. Exp. Psychol. Gen. 134, 728–742. doi: 10.1037/a0020756
Bilalić, M., Langner, R., Ulrich, R., and Grodd, W. (2011b). Many faces of expertise: fusiform face area in chess experts and novices. J. Neurosci. 31, 10206–10214. doi: 10.1523/JNEUROSCI.5727-10.2011
Bilalić, M., Turella, L., Campitelli, G., Erb, M., and Grodd, W. (2012). Expertise modulates the neural basis of context dependent recognition of objects and their relations. Hum. Brain Mapp. 33, 2728–2740. doi: 10.1002/hbm.21396
Bukach, C. M., Gauthier, I., and Tarr, M. J. (2006). Beyond faces and modularity: the power of an expertise framework. Trends Cogn. Sci. 10, 159–166. doi: 10.1016/j.tics.2006.02.004
Gauthier, I., Skudlarski, P., Gore, J. C., and Anderson, A. W. (2000). Expertise for cars and birds recruits brain areas involved in face recognition. Nat. Neurosci. 3, 191–197. doi: 10.1038/72140
Gauthier, I., Tarr, M. J., Anderson, A. W., Skudlarski, P., and Gore, J. C. (1999). Activation of the middle fusiform ‘face area’ increases with expertise in recognizing novel objects. Nat. Neurosci. 2, 568–573. doi: 10.1038/9224
Grelotti, D. J., Klin, A. J., Gauthier, I., Skudlarski, P., Cohen, D. J., Gore, J. C., et al. (2005). fMRI activation of the fusiform gyrus and amygdala to cartoon characters but not to faces in a boy with autism. Neuropsychologia 43, 373–385. doi: 10.1016/j.neuropsychologia.2004.06.015
Harel, A., Kravitz, D., and Baker, C. I. (2013). Beyond perceptual expertise: revisiting the neural substrates of expert object recognition. Front. Hum. Neurosci. 7:885. doi: 10.3389/fnhum.2013.00885
James, K. H., and Atwood, T. O. (2009). The role of sensorimotor learning in the perception of letter-like forms: tracking the causes of neural specialization for letters. Cogn. Neuropsychol. 26, 91–110. doi: 10.1080/02643290802425914
James, K. H., and Gauthier, I. (2006). Letter processing automatically recruits a sensory-motor brain network. Neuropsychologia 44, 2937–2949. doi: 10.1016/j.neuropsychologia.2006.06.026
James, T. W., and Cree, G. (2010). “Perceptual and conceptual interactions in object recognition and expertise,” in Perceptual Expertise: Bridging Brain and Behavior, eds I. Gauthier, M. J. Tarr, and D. Bub (New York, NY: Oxford University Press), 333–352.
James, T. W., and Gauthier, I. (2003). Auditory and action semantic feature types activate sensory-specific perceptual brain regions. Curr. Biol. 13, 1792–1796. doi: 10.1016/j.cub.2003.09.039
James, T. W., and Gauthier, I. (2004). Brain areas engaged during visual judgments by involuntary access to semantic information. Vision Res. 44, 429–439. doi: 10.1016/j.visres.2003.10.004
Kersey, A. J., and James, K. H. (2013). Brain activation patterns resulting from learning letter forms through active self-production and passive observation in young children. Front. Cogn. Sci. 4:567. doi: 10.3389/fpsyg.2013.00567
Krigolson, O. E., Pierce, L. J., Holroyd, C. B., and Tanaka, J. (2009). Learning to become an expert: reinforcement learning and the acquisition of perceptual expertise. J. Cogn. Neurosci. 21, 1833–1840. doi: 10.1162/jocn.2009.21128
Mahon, B. Z., Milleville, S. C., Negri, G. A. L., Rumiati, R. I., Caramazza, A., and Martin, A. (2007). Action-related properties shape object representations in the ventral stream. Neuron 55, 507. doi: 10.1016/j.neuron.2007.07.011
Martin, A. (2007). The representation of object concepts in the brain. Ann. Rev. Psychol. 58, 25–45. doi: 10.1146/annurev.psych.57.102904.190143
McGugin, R. W., Gatenby, J. C., Gore, J. C., and Gauthier, I. (2012). High-resolution imaging of expertise reveals reliable object selectivity in the fusiform face area related to perceptual performance. Proc. Natl. Acad. Sci. U.S.A. 109, 17063–17068. doi: 10.1073/pnas.1116333109
Palmeri, T. J., and Gauthier, I. (2004). Visual object understanding. Nat. Rev. Neurosci. 5, 291–303. doi: 10.1038/nrn1364
Rezlescu, C., Barton, J. S., Pitcher, D., and Duchaine, B. (2014). Normal acquisition of expertise with greebles in two cases of acquired prosopagnosia. Proc. Natl. Acad. Sci. U.S.A. 111, 5123–5128. doi: 10.1073/pnas.1317125111
Rhodes, G., Byatt, G., Michie, P. T., and Puce, A. (2004). Is the fusiform face area specialized for faces, individuation, or expert individuation? J. Cogn. Neurosci. 16, 189–203. doi: 10.1162/089892904322984508
Richler, J. J., Tanaka, J. W., Brown, D. D., and Gauthier, I. (2008). Why does selective attention fail in face processing? J. Exp. Psychol. Learn. Mem. Cogn. 34, 1356–1368. doi: 10.1037/a0013080
Scott, L. S., Tanaka, J. W., Sheinberg, D. L., and Curran, T. (2006). A reevaluation of the electrophysiological correlates of expert object processing. J. Cogn. Neurosci. 18, 1453–1465. doi: 10.1162/jocn.2006.18.9.1453
Tanaka, J. W., Curran, T., and Sheinberg, D. L. (2005). The training and transfer of real-world perceptual expertise. Psychol. Sci. 16, 145–151. doi: 10.1111/j.0956-7976.2005.00795.x
Wong, A. C.-N., Bukach, C. M., Yuen, C., Yang, L., Leung, S., and Greenspon, E. (2011). Holistic processing of words modulated by reading experience. PLoS ONE 6:e20753. doi: 10.1371/journal.pone.0020753
Wong, A. C.-N., Palmeri, T. J., and Gauthier, I. (2009a). Conditions for face-like expertise with objects: becoming a Ziggerin expert - but which type? Psychol. Sci. 20, 1108–1117. doi: 10.1111/j.1467-9280.2009.02430.x
Wong, A. C.-N., Palmeri, T. J., Rogers, B. P., Gore, J. C., and Gauthier, I. (2009b). Beyond shape: how you learn about objects affects how they are represented in visual cortex. PLoS ONE 4:e8405. doi: 10.1371/journal.pone.0008405
Wong, Y. K., Folstein, J. R., and Gauthier, I. (2012). The nature of experience determines object representations in the visual system. J. Exp. Psychol. Gen. 141, 682–698. doi: 10.1037/a0027822
Wong, Y. K., and Gauthier, I. (2010a). A multimodal neural network recruited by expertise with musical notation. J. Cogn. Neurosci. 22, 695–713. doi: 10.1162/jocn.2009.21229
Wong, Y. K., and Gauthier, I. (2010b). Holistic processing of musical notation: dissociating failures of selective attention in experts and novices. Cogn. Affect. Behav. Neurosci. 10, 541–551. doi: 10.3758/CABN.10.4.541
Wong, Y. K., Peng, C., Fratus, K. N., Woodman, G. F., and Gauthier, I. (2014). Perceptual expertise and top-down expectation of musical notation engages the primary visual cortex. J. Cogn. Neurosci. doi: 10.1162/jocn_a_00616. [Epub ahead of print].
Keywords: perceptual expertise, object recognition, modularity, visual training, review
Citation: Wong AC-N and Wong YK (2014) Interaction between perceptual and cognitive processing well acknowledged in perceptual expertise research. Front. Hum. Neurosci. 8:308. doi: 10.3389/fnhum.2014.00308
Received: 22 January 2014; Paper pending published: 21 February 2014;
Accepted: 25 April 2014; Published online: 20 May 2014.
Edited by:
Merim Bilalic, Alpen Adria University Klagenfurt, AustriaReviewed by:
Guillermo Campitelli, Edith Cowan University, AustraliaAssaf Harel, National Institutes of Health, USA
Copyright © 2014 Wong and Wong. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: alanwong@cuhk.edu.hk; yetta.wong@cityu.edu.hk