Response: Commentary: Viewing photos and reading nouns of natural graspable objects similarly modulate motor responses
Giovanni Buccino
Barbara F. M. Marino- 1Dipartimento di Scienze Mediche e Chirurgiche, Università “Magna Graecia” di Catanzaro, Catanzaro, Italy
- 2IRCCS Neuromed, Pozzilli, Italy
- 3Dipartimento di Psicologia, University Bicocca, Milano, Italy
A commentary on
“Commentary: Viewing photos and reading nouns of natural graspable objects similarly modulate motor responses”
by Makris, S. (2015). Front. Hum. Neurosci. 9:337. doi: 10.3389/fnhum.2015.00337
In two behavioral experiments, Marino et al. (2014) investigated the modulation of the motor cortex during the semantic processing of graspable and non-graspable objects, presented either as photos or written nouns. They used scrambled images and pseudowords as control stimuli. At 150 ms after stimulus presentation, participants had to respond when the stimulus referred to a real object with their right (experiment 1) or left (experiment 2) index finger, and refrain from responding when a scrambled image or a pseudoword was presented. Participants' responses related to photos or nouns of graspable objects were slower than those related to non-graspable ones, independent of the responding hand. According to the authors, these findings support the notion that the semantic processing of photos and written nouns referring to graspable objects, is due to common neural substrates, crucially involving the motor system. Specifically, they forward that, to solve the requested semantic task, participants relied on the motor representations of potential hand interactions with the object depicted in the photo (affordance as described by Gibson, 1977) or expressed by the verbal label. In this way, the motor system was engaged in two tasks, that is processing stimuli and performing a motor response (pressing the button), at the same time. Participants therefore paid a cost as revealed by the slowing down of their motor responses.
Some previous papers (Tucker and Ellis, 2004; Makris et al., 2011) support the notion that the recruitment of the motor system (affordance effect) during the visual presentation of objects appears later than 150 ms after stimulus presentation. Based on that, in his commentary Makris (2015) proposes an alternative explanation of the experimental findings reported by Marino et al. (2014), namely as due to an attentional effect. The author proposes that graspable objects suddenly appearing on screen can automatically grab exogenous attention (Yantis and Jonides, 1984) and then for a rapid period after stimulus onset (~100–150 ms) a withdrawal of attention from the objects in display occurs, leading to a rebalance of the affordance-driven motor plans. According to Makris, it could be that 150 ms after the presentation of the stimuli, exogenous-like attention was withdrawn only from the graspable, but not the non-graspable, objects. This way, participants would have to re-direct their attention to the graspable objects in order to resolve the semantic task and this process would have some cost in the timing of their responses. According to the author, this account would fit with a theoretical model known as the affordance competition hypothesis proposed by Cisek (2007).
In principle, one cannot rule out the attentional hypothesis, as an alternative explanation to the findings of Marino et al. (2014). However, even admitting a specific role of attention in explaining the data, in the commentary by Makris it is not clear why, at difference with non-graspable objects, the processing of graspable ones would require the withdrawal of attention at about 150 ms after stimulus presentation and the subsequent reallocation of attention to solve the semantic task. It is worth keeping in mind that also non-graspable objects were presented abruptly and therefore they could potentially grab exogenous attention as graspable objects did. Moreover, the affordance competition hypothesis does not seem to support this time course of attention allocation since in this account action selection and specification are parallel and not serial processes. That said, it is worth stressing as Makris himself admits, that it is difficult to disentangle between attentional and motor processes. Based on several studies, one may argue that there is no need to postulate two control mechanisms, one for action and one for attention. Rather, attention derives from the activity of the sensorimotor circuits devoted to interact with objects (e.g., Corbetta et al., 1998; Craighero et al., 1999).
The time course of the recruitment of the motor system during semantic processing of objects and nouns is still a matter of debate. However, there is increasing evidence of an early involvement of the motor system during semantic tasks involving language material. Neurophysiological studies (for review see Pulvermüeller et al., 2009) support a recruitment of the motor system during language processing of words related to action within the first 200 ms after stimulus onset. In the same time window, behavioral studies have shown that participants give slower hand motor responses when they have to process language material expressing hand actions or hand related objects (as for nouns, see Marino et al., 2013). In a very recent paper (Klepp et al., 2015), by means of magnetoencephalography, it has been assessed that this early slowing down of motor responses is due to a suppression of beta rhythm weaker than that found during the preparation and execution of actual movements. Taken together, these findings may lead to the conclusion that the modulation of the motor system during language processing may change over time, moving from an early interference, operating between 100 and 200 ms after stimulus onset, to a subsequently facilitation, operating later than 200 ms after stimulus presentation (Chersi et al., 2010). As for seen objects, the recruitment of the motor system (affordance effect), has been clearly shown at 200 ms after stimulus presentation (Buccino et al., 2009), that is quite earlier than 300 ms found by Makris et al. (2011). In addition, the findings of Marino et al. (2014) strongly suggest that there is a specific modulation of motor responses during the processing of photos depicting graspable objects already 150 ms after stimulus presentation. This modulation parallels the one occurring during the processing of language material expressing the same object category. Hence the proposal that the neural substrates devoted to processing photos depicting graspable objects and nouns referring to the same object category may be shared and crucially involve the motor system. Future studies should assess at what extent the semantic processing of seen objects and nouns overlap.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Buccino, G., Sato, M., Cattaneo, L., Rodà, F., and Riggio, L. (2009). Broken affordances, broken objects: a TMS study. Neuropsychologia 47, 3074–3078. doi: 10.1016/j.neuropsychologia.2009.07.003
Chersi, F., Thill, S., Ziemke, T., and Borghi, A. M. (2010). Sentence processing: linking language to motor chains. Front. Neurorobot. 4:4. doi: 10.3389/fnbot.2010.00004
Cisek, P. (2007). Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. B 362, 1585–1599. doi: 10.1098/rstb.2007.2054
Corbetta, M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Ollinger, J. M., Drury, H. A., et al. (1998). A common network of functional areas for attention and eye movements. Neuron 21, 761–773. doi: 10.1016/S0896-6273(00)80593-0
Craighero, L., Fadiga, L., Rizzolatti, G., and Umiltà, C. (1999). Action for perception: a motor-visual attentional effect. J. Exp. Psychol. Hum. Percept. Perform. 25:1673–1692. doi: 10.1037/0096-1523.25.6.1673
Gibson, J. J. (1977). “The theory of affordances,” in Perceiving, Acting and knowing, eds R. Shaw and J. Bransford (Hillsdale, MI: Erlbaum), 67–82.
Klepp, A., Niccolai, V., Buccino, G., Schnitzler, A., and Biermann-Ruben, K. (2015). Language-motor interference reflected in MEG beta oscillations. Neuroimage 109, 438–448. doi: 10.1016/j.neuroimage.2014.12.077
Makris, S. (2015). Commentary: viewing photos and reading nouns of natural graspable objects similarly modulate motor responses. Front. Hum. Neurosci. 9:337. doi: 10.3389/fnhum.2015.00337
Makris, S., Hadar, A. A., and Yarrow, K. (2011). Viewing objects and planning actions: on the potentiation of grasping behaviours by visual objects. Brain Cogn. 77, 257–264. doi: 10.1016/j.bandc.2011.08.002
Marino, B. F., Gough, P. M., Gallese, V., Riggio, L., and Buccino, G. (2013). How the motor system handles nouns: a behavioral study. Psychol. Res. 77, 64–73. doi: 10.1007/s00426-011-0371-2
Marino, B. F., Sirianni, M., Dalla Volta, R., Magliocco, F., Silipo, F., Quattrone, A., et al. (2014). Viewing photos and reading nouns of natural graspable objects similarly modulate motor responses. Front. Hum. Neurosci. 8:968. doi: 10.3389/fnhum.2014.00968
Pulvermüeller, F., Shtyrov, Y., and Hauk, O. (2009). Understanding in an instant: neurophysiological evidence for mechanistic language circuits in the brain. Brain Lang. 110, 81–94. doi: 10.1016/j.bandl.2008.12.001
Tucker, M., and Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychol. (Amst.) 116, 185–203. doi: 10.1016/j.actpsy.2004.01.004
Keywords: nouns, affordance, objects, embodiment and grounded cognition, semantics
Citation: Buccino G and Marino BFM (2015) Response: Commentary: Viewing photos and reading nouns of natural graspable objects similarly modulate motor responses. Front. Hum. Neurosci. 9:524. doi: 10.3389/fnhum.2015.00524
Received: 23 July 2015; Accepted: 10 September 2015;
Published: 24 September 2015.
Edited by:
Anna M. Borghi, University of Bologna & Institute of Cognitive Sciences and Technologies (ISTC), ItalyCopyright © 2015 Buccino and Marino. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Giovanni Buccino, buccino@unicz.it