An Eye in the Palm of Your Hand: Alterations in Visual Processing Near the Hand, a Mini-Review
Carolyn J. Perry
Prakash Amarasooriya
Mazyar Fallah- 1Visual Perception and Attention Laboratory, York University, Toronto, ON, Canada
- 2Centre for Vision Research, York University, Toronto, ON, Canada
- 3School of Kinesiology and Health Science, York University, Toronto, ON, Canada
- 4Canadian Action and Perception Network, York University, Toronto, ON, Canada
Feedback within the oculomotor system improves visual processing at eye movement end points, also termed a visual grasp. We do not just view the world around us however, we also reach out and grab things with our hands. A growing body of literature suggests that visual processing in near-hand space is altered. The control systems for moving either the eyes or the hands rely on parallel networks of fronto-parietal regions, which have feedback connections to visual areas. Since the oculomotor system effects on visual processing occur through feedback, both through the motor plan and the motor efference copy, a parallel system where reaching and/or grasping motor-related activity also affects visual processing is likely. Areas in the posterior parietal cortex, for example, receive proprioceptive and visual information used to guide actions, as well as motor efference signals. This trio of information channels is all that would be necessary to produce spatial allocation of reach-related visual attention. We review evidence from behavioral and neurophysiological studies that support the hypothesis that feedback from the reaching and/or grasping motor control networks affects visual processing while noting ways in which it differs from that seen within the oculomotor system. We also suggest that object affordances may represent the neural mechanism through which certain object features are selected for preferential processing when stimuli are near the hand. Finally, we summarize the two effector-based feedback systems and discuss how having separate but parallel effector systems allows for efficient decoupling of eye and hand movements.
Introduction
Accumulating behavioral evidence has shown that visual processing is altered near the hand. Speeded target detection and figure-ground assignment (Reed et al., 2006, 2010; Jackson et al., 2010), improvements in working memory (Tseng and Bridgeman, 2011), orientation processing (Craighero et al., 1999; Bekkering and Neggers, 2002; Hannus et al., 2005; Gutteling et al., 2011, 2013), target discrimination (Deubel et al., 1998), and in reaching and grasping precision (Brown et al., 2008), are just some of the effects seen when a reach places a hand near a visual stimulus. In addition, these alterations are seen whether the hand is nearby due to a sustained reach or if the hand is moved towards the visual stimulus during each trial in a more active manner. What remains a topic of debate is the mechanism by which these alterations in visual processing occur. A number of studies suggest that visual processing near the hand is altered through spatial attention selection mechanisms (di Pellegrino and Frassinetti, 2000; Schendel and Robertson, 2004; Reed et al., 2006, 2010; Abrams et al., 2008). These studies have hypothesized that populations of fronto-parietal bimodal neurons underlie enhanced visual selection in near-hand space; however, these neurons are also thought to influence near-hand processing in the absence of spatial attention influences (Brown et al., 2008). More recently, enhanced magnocellular processing has been postulated as an alternative explanation for the near-hand effect (Gozli et al., 2012). For this review, we investigate the hypothesis that these effects are driven by a novel, effector specific, attentional selection mechanism that is different from either oculomotor-driven visual spatial or feature-based attention, and is mediated by feedback from fronto-parietal regions involved in reaching and grasping networks. We will first review the anatomical similarities between the oculomotor and the reaching/grasping networks, and provide evidence of feedback influences within the oculomotor system. We will then compare the neurophysiological alterations in visual processing near the hand to alterations in visual processing due to the oculomotor system and provide supporting evidence of feedback influences in the reaching and grasping system. We suggest that links between the visual system and the motor systems could drive enhanced processing of action-relevant object features, but that de-coupled eye and hand movements indicate the need for separate, effector-based selection mechanisms.
Neural Circuitry
The reaching, grasping, and oculomotor systems all involve parallel networks of fronto-parietal areas (Figure 1). A dorsomedial stream, projecting from visual area V6 (Rizzolatti and Matelli, 2003; Passarelli et al., 2011), consisting of the medial intraparietal (MIP) area and area V6A in the superior parietal lobule (SPL), along with the dorsal premotor cortex (PMd) in the frontal lobe, which forms what is thought to be the neural network for reaching in the non-human primate (Caminiti et al., 1996; Culham et al., 2006; Filimon, 2010), with homologs in humans (Culham et al., 2006; Filimon, 2010). As with reaching, it has been suggested that there is a parallel dorsolateral circuit specialized for grasping (Fagg and Arbib, 1998; Luppino et al., 2001; Filimon, 2010) that projects from visual area MT/V5 (Rizzolatti and Matelli, 2003), and that this circuit is mainly dependent upon connections between the anterior intraparietal (AIP) region in the inferior parietal lobule (IPL) and the ventral premotor cortex (PMv), with homologous areas in humans (Fagg and Arbib, 1998; Culham et al., 2003, 2006; Frey et al., 2005). The reaching and grasping circuits however, appear to not be as completely functionally distinct as once thought as recent work has also found grasping related activity in the dorsomedial stream in non-human primate (Raos et al., 2003, 2004; Fattori et al., 2009, 2010, 2012) and human populations (Gallivan et al., 2011; Monaco et al., 2011). In fact, it has been suggested that the visual, somatosensory, and motor properties of V6A indicate a role for this area in the online error control for all of prehension, including reaching and grasping (Fattori et al., 2015). For movements of the eyes, the cortical oculomotor system in non-human primates and humans is comprised of the lateral intrapariental area (LIP)/parietal eye fields (PEF) and the frontal eye fields (FEF; Goldberg and Segraves, 1989; Bisley and Goldberg, 2003; Culham and Valyear, 2006; Culham et al., 2006). Due to the similarity between the anatomical components of these systems, we suggest that it is possible that oculomotor feedback mechanisms enhancing visual processing, could be replicated by the reaching and grasping networks to alter visual processing near the hand.
Figure 1. Reach, grasp, and oculomotor control brain regions in the macaque. Shown are the cortical brain regions associated with the reach (in red), grasp (in blue), oculomotor (in green), and visual (in black) systems. Not pictured are anatomical cross-talk connections between the reaching and grasping networks (i.e., between V6A and anterior intraparietal (AIP)/Ventral premotor cortex (PMv), see Fattori et al., 2015).
Feedback in the Oculomotor System
The influence of feedback, from fronto-parietal motor related areas, on visual processing is already well-supported for the oculomotor system. Early psychophysical work established an indirect link between alterations in visual processing due to shifts in attention and saccade motor planning (Rizzolatti et al., 1987; Kowler et al., 1995; Sheliga et al., 1994; Deubel and Schneider, 1996; Kustov and Robinson, 1996; Nobre et al., 2000; Castet and Montagnini, 2006; van der Stigchel and Theeuwes, 2006; Baldauf and Deubel, 2008). In general, visual processing was improved when a visual target coincided with the endpoint of a planned saccade suggesting a close relationship between the oculomotor system and attention related changes in visual processing. These studies led to investigations that more causally associated activations of eye-movement related brain regions to shifts in spatial attention and consequently alterations in visual processing at the end points of planned saccades (Moore and Fallah, 2001, 2004; Moore and Armstrong, 2003; Müller et al., 2005; Neggers et al., 2007; Van Ettinger-Veenstra et al., 2009; Gutteling et al., 2010; Bosch et al., 2013). For example, subthreshold microstimulation of the FEF resulted in increased visual sensitivity at the end-point of the unactivated motor plan behaviorally (Moore and Fallah, 2001, 2004) and within area V4 (Moore and Armstrong, 2003). This would suggest that recurrent connections between FEF and V4 allow for signals from FEF to feed back into the occipital lobe to influence subsequent visual processing (Armstrong et al., 2006; Armstrong and Moore, 2007; Ekstrom et al., 2008, 2009; Squire et al., 2012). Further evidence in primates comes from a study by Supèr et al. (2004) who found that in primary visual cortex neural activity corresponding to the location of the saccade target was enhanced approximately 100 ms before the onset of memory and visually-guided saccades. Studies in humans using transcranial magnetic stimulation (TMS) provide additional support for oculomotor feedback modulating visual processing. A single TMS pulse activates neurons in the targeted area. As such single pulse TMS over FEF enhances visual processing (Grosbras and Paus, 2003; Ruff et al., 2008; Van Ettinger-Veenstra et al., 2009) presumably by activating the feedback connections to visual processing areas. In contrast, a triple pulse disrupts the normal processing in an area. Triple pulse TMS used to disrupt the FEF results in impaired discrimination of a subsequently presented target (Neggers et al., 2007) suggesting that oculomotor feedback is necessary for spatial attention. Both the primate microstimulation studies and the human TMS studies support oculomotor feedback producing spatial attention effects behaviorally and within visual neurons. This would require attention signals to occur in the frontal lobe and propagate back to the occipital lobe. This is indeed what Van Ettinger-Veenstra et al. (2009) showed with EEG neuroimaging. They found that frontal activity associated with a saccade-go signal preceded activity in the occipital cortex associated with the appearance of a visual target. Thus, feedback projections from oculomotor-related frontal areas alter processing in posteriorly located visual areas.
Visual Processing Near the Hand
As mentioned previously, behavioral studies have provided indirect evidence suggesting that the space near the hand is prioritized. One prevailing theory suggests that alterations in visual processing occur as a result of attentional selection of near-hand space (di Pellegrino and Frassinetti, 2000; Schendel and Robertson, 2004; Reed et al., 2006, 2010; Abrams et al., 2008; Brown et al., 2008). Much like visual processing at the end point of a saccade is altered, the parallel within the reaching and grasping system would be a change in visual processing that occurs at the end point of a reach or grasp, i.e., in the workspace near the hand. One can imagine the benefit of this type of mechanism. This is especially true when reaching for an object while simultaneously viewing something in a different location that draws oculomotor driven spatial attention away from the object to be picked up. The underlying neural mechanisms that would drive altered visual processing near the hand have, as yet, not been well studied. A very recent neurophysiological study however, has shed light on the neural underpinnings of near-hand visual processing (Perry et al., 2015). Neuronal activity was recorded from area V2 which is an area that is known to be selective for orientation (Motter, 1993), a feature important for reaching and grasping (Murata et al., 2000; Raos et al., 2004; Fattori et al., 2009), modulated by attention (Motter, 1993; Luck et al., 1997), and directly linked to fronto-parietal reaching and grasping areas (Gattass et al., 1997; Passarelli et al., 2011; Fattori et al., 2015). Instead of allocating classic visual spatial attention with a cue (Moran and Desimone, 1985; Motter, 1993; McAdams and Maunsell, 1999; Treue and Martinez-Trujillo, 1999), Perry et al. (2015) used the presence or absence of a nearby hand to determine the effects of near-hand attention on neuronal responses in area V2. Under these conditions, there was a significant increase in response at the preferred orientation when the hand was nearby. This is consistent with classic visual spatial studies which produce a “gain-modulation” of neuronal responses: responses are multipled by the same factor regardless of selectivity (McAdams and Maunsell, 1999; Seidemann and Newsome, 1999; Treue and Martinez-Trujillo, 1999; McAdams and Reid, 2005). This results in a scaling of the tuning curve. However in contrast to gain modulation, there was no corresponding increase at the orthogonal orientation when the hand was near. Consequently, this produced a sharpening, instead of a scaling, of the orientation tuning curves when the hand was near, suggesting a different underlying mechanism than for oculomotor driven spatial attention. Sharpening of orientation tuning curves would result in greater orientation selectivity.
In addition to spatial attention, neuronal enhancement is also found with feature-based attention, where attending to a feature (such as a vertical bar) enhances processing of that specific feature (vertical), which aids greatly in visual search. Feature-based attention is described by the feature-similarity gain model of attention which predicts that enhancement of neuronal responses are strongest when the orientation of the grasp target (attended feature) and the orientation of the visual stimulus are matched, falling off as the difference in their orientations increased (Treue and Martinez-Trujillo, 1999). No such relationship was found. These results (Perry et al., 2015) suggest then that the attentional prioritization of near-hand space does not conform to known spatial or feature-based attentional mechanisms and that a novel, effector based, mechanism exists. This mechanism would preferentially process features (such as orientation) necessary for grasping, which would then improve the accuracy of an upcoming grasp.
Evidence for Feedback in the Reaching and Grasping Systems
While the effects of near-hand attention are seen in early visual areas, behaviorally these effects cannot be driven by the oculomotor system. The control system for near-hand attention, albeit separate from the oculomotor system, would likely be driven through the parallel feedback from fronto-parietal motor planning areas. It has been shown that neuronal response variability is reduced in premotor cortex during reaching (Churchland et al., 2010) and in the FEF during oculomotor preparation (Purcell et al., 2012). Notably, neurons in V4 undergo a reduction in neuronal response variability prior to the onset of a saccade (Steinmetz and Moore, 2010). This suggests that reductions in oculomotor response variability propagate back to posteriorly located visual processing regions. If feedback from fronto-parietal reaching and grasping networks is the method through which neurons in V2 undergo alterations in their response properties (such as sharpened tuning—Perry et al., 2015), it would be expected that response variability would also be reduced. This is, in fact, what was found (Perry et al., 2015). Thus, both oculomotor and near-hand spatial attention rely on feedback projections which concomitantly reduce response variability.
In human populations, this premise of feedback connections mediating changes in visual response properties was tested by Gutteling et al. (2013). They investigated whether activation of the anterior portion of the intraparietal sulcus (aIPS) prior to a grasping or pointing movement improved orientation perception. aIPS has been shown to be part of a network of fronto-parietal areas that are involved in the control of grasping movements (Taira et al., 1990; Gallese et al., 1994; Sakata et al., 1995). Furthermore, aIPS has been shown to be selective for the orientation of the object to be grasped (Murata et al., 2000) and connected to occipital visual areas (Nakamura et al., 2001; Ruff et al., 2008; Blankenburg et al., 2010), including ventral stream regions (Borra et al., 2008) that would be sensitive to changes in orientation. Activation of aIPS during action preparation (Gutteling et al., 2013) improved orientation sensitivity, suggesting that aIPS is involved in modulating visual information during action planning. In addition, compared to pointing, grasping a 3-dimensional oriented bar, has been shown with electroencephalography to strengthen the N1 component and associated selection negativity in lateral occipital regions suggesting that the plan to grasp influences early ventral stream visual processing (orientation) of action-relevant features (Van Elk et al., 2010). Improved sensitivity and strengthened selection negativity is consistent with improved orientation tuning found in non-human primate V2 neurons when a hand is nearby (Perry et al., 2015).
Area V6A is another candidate area whose feedback could sharpen orientation tuning, as it has been found to be sensitive to the orientation of the wrist (Fattori et al., 2009), selective for grip type (Fattori et al., 2010), contains cells selective for orientation (Gamberini et al., 2011), and has direct connections to early visual processing areas (Passarelli et al., 2011). In addition, activity in V6A has been shown to be modulated by shifts in covert, oculomotor driven, spatial attention (Galletti et al., 2010), suggesting that it may play a similar role in hand driven attention.
Recurrent feedback loops between fronto-parietal and early visual processing areas (e.g., V2) would provide relevant corollary motor discharge information to enhance visual information relevant to reaching and grasping objects (i.e., sharpened orientation tuning) that would then update ongoing motor plans. As a movement progresses, sharpened orientation tuning information could be used to improve or correct hand shaping and wrist orientation resulting in improved reach and grasp accuracy. Given that V6A is thought to be involved in online error control of both reaching and grasping (Fattori et al., 2015), recurrent feedback loops between V2 and V6A are the likely candidate mechanism to underlie this process.
Affordances
Orientation is considered to be part of the processing that occurs in the ventral stream that results in object recognition. It is not thought to be necessary for processes in the dorsal stream that culminate in knowing where something is, for computations of complex motion of an object, or for execution of movement. Why then would orientation processing in V2 be improved simply because the hand is near? Close links between the visual and motor systems have been at the core of the affordance literature for years. Gibson (1979) suggested that one of the key functions of the visual system was to provide information to the motor system about the possible actions that could be implemented, or alternatively, the possible actions that the visual information affords. Since then, Tucker and Ellis (1998, 2001) and Ellis and Tucker (2001) have argued that the motor system itself could extract visually pertinent information that would produce affordances. In fact, they have used the term micro-affordances to refer to object properties that are action-relevant and could be used to inform subsequent movements to interact with the object of interest (Tucker and Ellis, 2001). Orientation is an object feature that informs the “graspability” of an object. For example, object orientation can either facilitate or impede response times depending on whether the object orientation produces a motor affordance (Tucker and Ellis, 1998). In other words, the orientation of an object informs the grasp that needs to be planned. Regions within the parietal lobe, integral to reaching and grasping movements, show selectivity for the size, shape and orientation of an object both during fixation and grasping movements (Taira et al., 1990; Gallese et al., 1994; Murata et al., 2000; Fattori et al., 2009, 2010, 2012; Breveglieri et al., 2015), suggesting these areas play a key role in the integration of visual and motor information and object affordances. Therefore, orientation is a feature necessary to grasp objects accurately and is processed within the fronto-parietal grasping network, especially within area AIP.
Even if there is not a representation of the object as a whole in the dorsal stream, the vision for action theory (Goodale and Milner, 1992; Goodale, 2008, 2013) would also suggest that there are features of an object that are action relevant and therefore worthy of preferential processing, or attentional selection, by the dorsal stream action system. Patients with visual agnosia, who can still scale and orient their hand to an object to be grasped in spite of being unable to recognize the object they are grasping, speak to this point (Goodale et al., 1991, 1994; Milner et al., 2012). Given that object features such as orientation have been shown to affect subsequent motor affordances, and that object properties are extracted to inform the scale and orientation of the hand in patients who cannot recognize objects, it logically follows that orientation be an object feature preferentially processed within the dorsal stream in parallel to its processing within the ventral stream for object recognition.
Advantages of Separate Effector Mechanisms
Being able to separate the deployment of attention between effectors allows for the decoupling of actions. Many examples exist of instances where we reach for one thing while looking elsewhere. In fact, optic ataxia, in which there is an inability to reach to peripheral targets, results from damage to the posterior parietal cortex (Milner and Goodale, 1995; Carey et al., 1997; Jackson et al., 2005). It has been shown that reaching to centrally located targets activates the MIP sulcus and PMd, while reaching to peripherally located targets additionally activates the parietal occipital junction and more rostral parts of PMd. These differentiated networks support dissociation between where gaze and grasp are deployed (Prado et al., 2005). Furthermore, recent work has shown that when a sequence of reaching movements are planned, visual discrimination is significantly enhanced not just at the first movement goal but also at the second (Baldauf et al., 2006; Baldauf and Deubel, 2008, 2009). So while an eye movement would be planned and then executed to the first target, the second is already enhanced suggesting that reach execution is separate from oculomotor planning and in turn, that movement planning and execution in the posterior parietal cortex already accommodates separate representations of gaze and reach targets (Jackson et al., 2009). These decoupled eye and hand movements are supported by the presence of neuronal populations in parietal areas that produce multiple types of reference frame transformations to encode targets in eye-centered or hand-/body-centered frames of reference (Lacquaniti et al., 1995; Batista et al., 1999, 2007; Buneo et al., 2002, 2008; Cohen and Andersen, 2002; Marzocchi et al., 2008; Chang et al., 2009; Chang and Snyder, 2010; McGuire and Sabes, 2011). As populations encoding targets in either eye- or hand-centered reference frames support decoupled movements, it follows then that there should exist separate effector-based attentional mechanisms.
Conclusion
We have reviewed literature in support of the hypothesis that there exist parallel, but separate, effector-based attentional systems. Whereas the oculomotor system enhances visual responses through gain modulation, near-hand attention sharpens orientation tuning and, potentially, other features relevant to reaching and grasping. Thus, these effector-based systems may be specialized for the actions those effectors can perform. We suggest that improved orientation processing is a feature important for accurate reaching and grasping, and that separate effector-based attentional mechanisms allow for the decoupling of visual enhancements associated with eye and hand movements. Future investigations are needed to further support this hypothesis for example, by systematically testing grasp-relevant and irrelevant features. In addition, testing whether both the reaching and grasping or grasping alone is involved in near-hand attention which will provide details regarding which fronto-parietal networks may be involved and what other object features may be preferentially processed.
Author Contributions
CJP, PA, and MF all contributed to the writing and revision of this article.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
CJP was supported by a Doctoral NSERC Alexander Graham Bell Canadian Graduate Scholarship.
References
Abrams, R. A., Davoli, C. C., Du, F., Knapp, W. H., and Paull, D. (2008). Altered vision near the hands. Cognition 107, 1035–1047. doi: 10.1016/j.cognition.2007.09.006
Armstrong, K. M., Fitzgerald, J. K., and Moore, T. (2006). Changes in the visual receptive fields with microstimulation of the frontal cortex. Neuron 50, 791–798. doi: 10.1016/j.neuron.2006.05.010
Armstrong, K. M., and Moore, T. (2007). Rapid enhancement of visual cortical response discriminability by microstimulation of the frontal eye field. Proc. Natl. Acad. Sci. USA 104, 9499–9504. doi: 10.1073/pnas.0701104104
Baldauf, D., and Deubel, H. (2008). Properties of attentional selection during the preparation of sequential saccades. Exp. Brain Res. 184, 411–425. doi: 10.1007/s00221-007-1114-x
Baldauf, D., and Deubel, H. (2009). Attentional selection of multiple goal positions before rapid hand movement sequences: An ERP study. J. Cogn. Neurosci. 21, 18–29. doi: 10.1162/jocn.2008.21021
Baldauf, D., Wolf, M., and Deubel, H. (2006). Deployment of visual attention before sequences of goal-directed hand movements. Vision Res. 46, 4355–4374. doi: 10.1016/j.visres.2006.08.021
Batista, A. P., Buneo, C. A., Snyder, L. H., and Andersen, R. A. (1999). Reach plans in eye-centered coordinates. Science 285, 257–260. doi: 10.1126/science.285.5425.257
Batista, A. P., Santhanam, G., Yu, B. M., Ryu, S. I., Afshar, A., and Shenoy, K. V. (2007). Reference frames for reach planning in macaque dorsal premotor cortex. J. Neurophysiol. 98, 966–983. doi: 10.1152/jn.00421.2006
Bekkering, H., and Neggers, F. S. W. (2002). Visual search is modulated by action intentions. Psychol. Sci. 13, 370–374. doi: 10.1111/j.0956-7976.2002.00466.x
Bisley, J. W., and Goldberg, M. E. (2003). The role of the parietal cortex in the neural processing of saccadic eye movements. Adv. Neurol. 93, 141–157.
Blankenburg, F., Ruff, C. C., Bestmann, S., Bjoertomt, O., Josephs, O., Deichmann, R., et al. (2010). Studying the role of human parietal cortex in visuospatial attention with concurrent TMS-fMRI. Cereb. Cortex 20, 2702–2711. doi: 10.1093/cercor/bhq015
Borra, E., Belmalih, A., Calzavara, R., Gerbella, M., Murata, A., Rozzi, S., et al. (2008). Cortical connections of the macaque anterior intraparietal (AIP) area. Cereb. Cortex 18, 1094–1111. doi: 10.1093/cercor/bhm146
Bosch, S. E., Neggers, S. F. W., and van der Stigchel, S. (2013). The role of the frontal eye fields in oculomotor competition: image-guided TMS enhances contralateral target selection. Cereb. Cortex 23, 824–832. doi: 10.1093/cercor/bhs075
Breveglieri, R., Galletti, C., Bosco, A., Gamberini, M., and Fattori, P. (2015). Object affordance modulates visual responses in the macaque medial posterior parietal cortex. J. Cogn. Neurosci. 27, 1447–1455. doi: 10.1162/jocn_a_00793
Brown, L. E., Kroliczak, G., Demonet, J. F., and Goodale, M. A. (2008). A hand in blindsight: hand placement near target improves size perception in the blind visual field. Neuropsychologia 46, 786–802. doi: 10.1016/j.neuropsychologia.2007.10.006
Buneo, C. A., Batista, A. P., Jarvis, M. R., and Andersen, R. A. (2008). Time-invariant reference frames for parietal reach activity. Exp. Brain Res. 188, 77–89. doi: 10.1007/s00221-008-1340-x
Buneo, C. A., Jarvis, M. R., Batista, A. P., and Andersen, R. A. (2002). Direct visuomotor transformations for reaching. Nature 416, 632–636. doi: 10.1038/416632a
Caminiti, R., Ferraina, S., and Johnson, P. B. (1996). The sources of visual information to the primate frontal lobe: a novel role for the superior parietal lobule. Cereb. Cortex 6, 319–328. doi: 10.1093/cercor/6.3.319
Carey, D. P., Coleman, R. J., and Della Sala, S. (1997). Magnetic misreaching. Cortex 33, 639–652. doi: 10.1016/s0010-9452(08)70722-6
Castet, J. S., and Montagnini, A. (2006). Dynamics of attentional deployment during saccadic programming. J. Vis. 6, 196–212. doi: 10.1167/6.3.2
Chang, S. W., Papadimitriou, C., and Snyder, L. H. (2009). Using a compound field to compute a reach plan. Neuron 64, 744–755. doi: 10.1016/j.neuron.2009.11.005
Chang, S. W., and Snyder, L. H. (2010). Idiosyncratic and systematic aspects of spatial representations in the macaque parietal cortex. Proc. Natl. Acad. Sci. U S A 107, 7951–7956. doi: 10.1073/pnas.0913209107
Churchland, M. M., Yu, B. M., Cunningham, J. P., Sugrue, L. P., Cohen, M. R., Corrado, G. S., et al. (2010). Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat. Neurosci. 13, 369–378. doi: 10.1038/nn.2501
Cohen, Y. E., and Andersen, R. A. (2002). A common reference frame for movement plans in the posterior parietal cortex. Nat. Rev. Neurosci. 3, 553–562. doi: 10.1038/nrn873
Craighero, L., Fadiga, L., Rizzolatti, G., and Umiltà, C. (1999). Action for perception: a motor-visual attentional effect. J. Exp. Psychol. Hum. Percept. Perform. 25, 1673–1692. doi: 10.1037/0096-1523.25.6.1673
Culham, J. C., Cavina-Pratesi, C., and Singhal, A. (2006). The role of parietal cortex in visuomotor control: what have we learned from neuroimaging? Neuropsychologia 44, 2668–2684. doi: 10.1016/j.neuropsychologia.2005.11.003
Culham, J. C., Danckert, S. L., DeSouza, J. F., Gati, J. S., Menon, R. S., and Goodale, M. A. (2003). Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas. Exp. Brain Res. 153, 180–189. doi: 10.1007/s00221-003-1591-5
Culham, J. C., and Valyear, K. F. (2006). Human parietal cortex in action. Curr. Opin. Neurobiol. 16, 205–212. doi: 10.1016/j.conb.2006.03.005
Deubel, H., and Schneider, W. X. (1996). Saccade target selection and object recognition-evidence for a common attentional mechanism. Vision Res. 36, 1827–1837. doi: 10.1016/0042-6989(95)00294-4
Deubel, H., Schneider, W. X., and Paprotta, I. (1998). Selective dorsal and ventral processing: Evidence for a common attentional mechanism in reaching and perception. Vis. Cogn. 5, 81–107. doi: 10.1080/713756776
di Pellegrino, G., and Frassinetti, F. (2000). Direct evidence from parietal extinction of enhancement of visual attention near a visible hand. Curr. Biol. 10, 1475–1477. doi: 10.1016/s0960-9822(00)00809-5
Ekstrom, L. B., Roelfsema, P. R., Arsenault, J. T., Bonmassar, G., and Vanduffel, W. (2008). Bottom-up dependent gating of frontal signals in early visual cortex. Science 321, 414–417. doi: 10.1126/science.1153276
Ekstrom, L. B., Roelfsema, P. R., Arsenault, J. T., Kolster, H., and Vanduffel, W. (2009). Modulation of the contrast response function by electrical microstimulation of the macaque frontal eye field. J. Neurosci. 29, 10683–10694. doi: 10.1523/jneurosci.0673-09.2009
Ellis, R., and Tucker, M. (2001). Micro-affordance: The potentiation of components of action by seen objects. Br. J. Psychol. 91, 451–471. doi: 10.1348/000712600161934
Fagg, A. H., and Arbib, M. A. (1998). Modeling parietal-premotor interactions in primate control of grasping. Neural Netw. 11, 1277–1303. doi: 10.1016/s0893-6080(98)00047-1
Fattori, P., Breveglieri, R., Bosco, A., Gamberini, M., and Galletti, C. (2015). Vision for prehension in the medial parietal cortex. Cereb. Cortex [Epub ahead of print] doi: 10.1093/cercor/bhv302
Fattori, P., Breveglieri, R., Marzocchi, N., Filippini, D., Bosco, A., and Galletti, C. (2009). Hand orientation during reach-to-grasp movements modulates neuronal activity in the medial posterior parietal area V6A. J. Neurosci. 29, 1928–1936. doi: 10.1523/jneurosci.4998-08.2009
Fattori, P., Breveglieri, R., Raos, V., Bosco, A., and Galletti, C. (2012). Vision for action in the macaque medial posterior parietal cortex. J. Neurosci. 32, 3221–3234. doi: 10.1523/jneurosci.5358-11.2012
Fattori, P., Raos, V., Breveglieri, R., Bosco, A., Marzocchi, N., and Galletti, C. (2010). The dorsomedial pathway is not just for reaching: Grasping neurons in the medial parieto-occipital cortex of the macaque monkey. J. Neurosci. 30, 342–349. doi: 10.1523/jneurosci.3800-09.2010
Filimon, F. (2010). Human cortical control of hand movements: parieto-frontal networks for reaching, grasping and pointing. Neuroscientist 16, 388–407. doi: 10.1177/1073858410375468
Frey, S. H., Vinton, D., Norlund, R., and Grafton, S. T. (2005). Cortical topography of human anterior intraparietal cortex active during visually guided grasping. Brain Res. Cogn. Brain Res. 23, 397–405. doi: 10.1016/j.cogbrainres.2004.11.010
Gallese, V., Murata, A., Kaseda, M., Niki, N., and Sakata, H. (1994). Deficit of hand preshaping after muscimol injection in monkey parietal cortex. Neuroreport 5, 1525–1529. doi: 10.1097/00001756-199407000-00029
Galletti, C., Breveglieri, R., Lappe, M., Bosco, A., Ciavarro, M., and Fattori, P. (2010). Covert shift of attention modulates the ongoing neural activity in a reaching area of the macaque dorsomedial visual stream. PLoS One 5:e15078. doi: 10.1371/journal.pone.0015078
Gallivan, J. P., McLean, D. A., Valyear, K. F., Pettypiece, C. E., and Culham, J. C. (2011). Decoding action intentions from preparatory brain activity in human parieto-frontal networks. J. Neurosci. 31, 9599–9610. doi: 10.1523/jneurosci.0080-11.2011
Gamberini, M., Galletti, C., Bosco, A., Breveglieri, R., and Fattori, P. (2011). Is the medial posterior parietal area V6A a single functional area? J. Neurosci. 31, 5145–5157. doi: 10.3410/f.11420956.12442054
Gattass, R., Sousa, A. P., Mishkin, M., and Ungerleider, L. G. (1997). Cortical projections of area V2 in the macaque. Cereb. Cortex 7, 110–129. doi: 10.1093/cercor/7.2.110
Goldberg, M. E., and Segraves, M. A. (1989). “The visual and frontal cortices,”, in The Neurobiology of Saccadic Eye Movements, Reviews of Oculomotor Research Series Vol. 3, (Amsterdam: Elsevier) eds Goldberg M. E. and Wurtz R. H. 283–313.
Goodale, M. A. (2008). Action without perception in human vision. Cogn. Neuropsychol. 25, 891–919. doi: 10.1080/02643290801961984
Goodale, M. A. (2013). Separate visual systems for perception and action: a framework for understanding cortical visual impairment. Dev. Med. Child Neurol. 55, 9–12. doi: 10.1111/dmcn.12299
Goodale, M. A., Meenan, J. P., Bulthoff, H. H., Nicolle, D. A., Murphy, K. J., and Racicot, C. I. (1994). Separate neural pathways for the visual analysis of object shape in perception and prehension. Curr. Biol. 4, 604–610. doi: 10.1016/s0960-9822(00)00132-9
Goodale, M. A., and Milner, A. D. (1992). Separate visual pathways for perception and action. Trends Neurosci. 15, 20–25.
Goodale, M. A., Milner, A. D., Jakobson, L. S., and Carey, D. P. (1991). A neurological dissociation between perceiving objects and grasping them. Nature 349, 154–156.
Gozli, D. G., West, G. L., and Pratt, J. (2012). Hand position alters vision by biasing processing through different visual pathways. Cognition 124, 244–250. doi: 10.1016/j.cognition.2012.04.008
Grosbras, M. H., and Paus, T. (2003). Transcranial magnetic stimulation of the human frontal eye field facilitates visual awareness. Eur. J. Neurosci. 18, 3121–3126. doi: 10.1111/j.1460-9568.2003.03055.x
Gutteling, T. P., Kenemans, J. L., and Neggers, S. F. (2011). Grasping preparation enhances orientation change detection. PLoS One 6:e17675. doi: 10.1371/journal.pone.0017675
Gutteling, T. P., Park, S. Y., Kenemans, J. L., and Neggers, S. F. W. (2013). TMS of the anterior intraparietal area selectively modulates orientation change detection during action preparation. J. Neurophysiol. 110, 33–41. doi: 10.1152/jn.00622.2012
Gutteling, T. P., van Ettinger-Veenstra, H. M., Kenemans, J. L., and Neggers, S. F. W. (2010). Lateralized frontal eye field activity precedes occipital activity shortly before saccades: evidence for cortico-cortical feedback as a mechanism underlying covert attention shifts. J. Cogn. Neurosci. 22, 1931–1943. doi: 10.1162/jocn.2009.21342
Hannus, A., Cornelissen, F. W., Lindemann, O., and Bekkering, H. (2005). Selection-for-action in visual search. Acta. Psychol. 118, 171–191. doi: 10.1016/j.actpsy.2004.10.010
Jackson, C. P., Miall, R. C., and Balsev, D. (2010). Spatially valid proprioceptive cues improve the detection of visual stimulus. Exp. Brain Res. 205, 31–40. doi: 10.1007/s00221-010-2330-3
Jackson, S. R., Newport, R., Husain, M., Fowlie, J. E., O’Donoghue, M., and Bajaj, N. (2009). There may be more to reaching than meets the eye: re-thinking optic ataxia. Neuropsychologia 47, 1397–1408. doi: 10.1016/j.neuropsychologia.2009.01.035
Jackson, S. R., Newport, R., Mort, D., and Husain, M. (2005). Where the eye looks, the hand follows; limb-dependent magnetic misreaching in optic ataxia. Curr. Biol. 15, 42–46. doi: 10.1016/j.cub.2004.12.063
Kowler, E., Anderson, E., Dosher, B., and Blaser, E. (1995). The role of attention in the programming of saccades. Vis. Res. 35, 1897–1916. doi: 10.1016/0042-6989(94)00279-u
Kustov, A. A., and Robinson, D. L. (1996). Shared neural control of attentional shifts and eye movements. Nature 384, 74–77. doi: 10.1038/384074a0
Lacquaniti, F., Guigon, E., Blanchi, L., Ferraina, S., and Caminiti, R. (1995). Representing spatial information for limb movement: role of area 5 in the monkey. Cereb. Cortex 5, 391–409. doi: 10.1093/cercor/5.5.391
Luck, S. J., Chelazzi, L., Hillyard, S. A., and Desimone, R. (1997). Neural mechanisms of spatial selective attention in areas V1, V2 and V4 of macaque visual cortex. J. Neurophysiol. 77, 24–42.
Luppino, G., Calzavara, R., Rozzi, S., and Matelli, M. (2001). Projections from the superior agranular frontal cortex in the temporal sulcus to the macaque. Eur. J. Neurosci. 14, 1035–1040. doi: 10.1046/j.0953-816x.2001.01734.x
Marzocchi, N., Breveglieri, R., Galletti, C., and Fattori, P. (2008). Reaching activity in parietal area V6A of macaque: eye influence on arm activity or retinocentric coding of reaching movement? Eur. J. Neurosci. 27, 775–789. doi: 10.1111/j.1460-9568.2008.06021.x
McAdams, C. J., and Maunsell, J. H. (1999). Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J. Neurosci. 19, 431–441.
McAdams, C. J., and Reid, R. C. (2005). Attention modulates the responses of simple cells in monkey primary visual cortex. J. Neurosci. 25, 11023–11033. doi: 10.1523/jneurosci.2904-05.2005
McGuire, L. M., and Sabes, P. M. (2011). Heterogeneous representations in the superior parietal lobule are common across reaches to visual and proprioceptive targets. J. Neurosci. 31, 6661–6673. doi: 10.1523/jneurosci.2921-10.2011
Milner, A. D., Ganel, T., and Goodale, M. A. (2012). Does grasping in patient D.F. depend on vision? Trends Cogn. Sci. 16, 256–257. doi: 10.1016/j.tics.2012.03.004
Monaco, S., Cavina-Pratesi, C., Sedda, A., Fattori, P., Galletti, C., and Culham, J. C. (2011). Functional magnetic resonance adaptation reveals the involvement of the dorsomedial stream in hand orientation for grasping. J. Neurophysiol. 106, 2248–2263. doi: 10.1152/jn.01069.2010
Moore, T., and Armstrong, K. M. (2003). Selective gating of visual signals by microstimulation of frontal cortex. Nature 421, 370–373. doi: 10.1038/nature01341
Moore, T., and Fallah, M. (2001). Control of eye movements and spatial attention. Proc. Natl. Acad. Sci. USA 98, 1273–1276. doi: 10.1073/pnas.021549498
Moore, T., and Fallah, M. (2004). Microstimulation of the frontal eye field and its effects on covert spatial attention. J. Neurophysiol. 91, 152–162. doi: 10.1152/jn.00741.2002
Moran, J., and Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science 229, 782–784. doi: 10.1126/science.4023713
Motter, B. C. (1993). Focal attention produces spatially selective processing in visual cortical areas V1, V2 and V4 in the presence of competing stimuli. J. Neurophysiol. 70, 909–919.
Müller, J. R., Philiastides, M. G., and Newsome, W. T. (2005). Microstimulation of the superior colliculus focuses attention without moving the eyes. Proc. Natl. Acad. Sci. USA 102, 524–529. doi: 10.1073/pnas.0408311101
Murata, A., Gallese, V., Luppino, G., Kaseda, M., and Sakata, H. (2000). Selectivity for the shape, size and orientation of objects for grasping in neurons of monkey parietal area AIP. J. Neurophysiol. 83, 2580–2601.
Nakamura, H., Kuroda, T., Wakita, M., Kusunoki, M., Kato, A., Mikami, A., et al. (2001). From three-dimensional space vision to prehensile hand movements: the lateral intraparietal area links the area V3A and the anterior intraparietal area in macaques. J. Neurosci. 21, 8174–8187.
Neggers, S. F., Huijbers, W., Vrijlandt, C. M., Vlaskamp, B. N., Schutter, D. J., and Kenemans, J. L. (2007). TMS pulses on the frontal eye fields break coupling between visuospatial attention and eye movements. J. Neurophysiol. 98, 2765–2778. doi: 10.1152/jn.00357.2007
Nobre, A. C., Sebestyen, G. N., and Miniussi, M. (2000). The dynamics of shifting visuospatial attention revealed by event-related potentials. Neuropsychologia 38, 964–974. doi: 10.1016/s0028-3932(00)00015-4
Passarelli, L., Rosa, M. G., Gamberini, M., Bakola, S., Burman, K. J., Fattori, P., et al. (2011). Cortical connections of area V6Av in the macaque: a visual-input node to the eye/hand coordination system. J. Neurosci. 31, 1790–1801. doi: 10.1523/jneurosci.4784-10.2011
Perry, C. J., Sergio, L. E., Crawford, J. D., and Fallah, M. (2015). Hand placement near the visual stimulus improves orientation selectivity in V2 neurons. J. Neurophysiol. 113, 2859–2870. doi: 10.1152/jn.00919.2013
Prado, J., Clavagnier, S., Otzenberger, H., Scheiber, C., Kennedy, H., and Perenin, M. T. (2005). Two cortical systems for reaching in central and peripheral vision. Neuron 48, 849–858. doi: 10.1016/j.neuron.2005.10.010
Purcell, B. A., Heitz, R. P., Cohen, J. Y., and Schall, J. D. (2012). Response variability of frontal eye field neurons modulates with sensory input and saccade preparation but not visual search salience. J. Neurophysiol. 108, 2737–2750. doi: 10.1152/jn.00613.2012
Raos, V., Franchi, G., Gallese, V., and Fogassi, L. (2003). Somatotopic organization of the lateral part of area F2 (dorsal premotor cortex) of the macaque monkey. J. Neurophysiol. 89, 1503–1518. doi: 10.1152/jn.00661.2002
Raos, V., Umiltá, M. A., Gallese, V., and Fogassi, L. (2004). Functional properties of grasping- related neurons in the dorsal premotor area F2 of the macaque monkey. J. Neurophysiol. 92, 1990–2002. doi: 10.1152/jn.00154.2004
Reed, C. L., Betz, R., Garza, J. P., and Roberts, R. J. (2010). Grab it! Biased attention in functional hand tool space. Atten. Percept. Psychophys. 72, 236–245. doi: 10.3758/app.72.1.236
Reed, C. L., Grubb, J. D., and Steele, C. (2006). Hands up: attentional prioritization of space near the hand. J. Exp. Psychol. Hum. Percept. Perform. 32, 166–177. doi: 10.1037/0096-1523.32.1.166
Rizzolatti, G., and Matelli, M. (2003). Two different streams from the dorsal visual system: anatomy and functions. Exp. Brain Res. 153, 146–157. doi: 10.1007/s00221-003-1588-0
Rizzolatti, G., Riggio, L., Dascola, I., and Umilta, C. (1987). Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention. Neuropsychologia 25, 31–40. doi: 10.1016/0028-3932(87)90041-8
Ruff, C. C., Bestmann, S., Blankenburg, F., Bjoertomt, O., Josephs, O., Weiskopf, N., et al. (2008). Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS-fMRI. Cereb. Cortex 18, 817–827. doi: 10.1093/cercor/bhm128
Sakata, H., Taira, M., Murata, A., and Mine, S. (1995). Neural mechanisms of visual guidance of hand action in the parietal cortex of the monkey. Cereb. Cortex 5, 429–438. doi: 10.1093/cercor/5.5.429
Schendel, K., and Robertson, L. C. (2004). Reaching out to see: arm position can attenuate human visual loss. J. Cogn. Neurosci. 16, 935–943. doi: 10.1162/0898929041502698
Seidemann, E., and Newsome, W. T. (1999). Effect of spatial attention on the responses of area MT neurons. J. Neurophysiol. 81, 1783–1794.
Sheliga, B. M., Riggio, L., and Rizzolatti, G. (1994). Orienting of attention and eye movements. Exp. Brain Res. 98, 507–522.
Squire, R. F., Steinmetz, N. A., and Moore, T. (2012). Frontal eye field. Scholarpedia 7:5341. doi: 10.4249/scholarpedia.5341
Steinmetz, N. A., and Moore, T. (2010). Changes in the response rate and response variability of area V4 neurons during the preparation of saccadic eye movements. J. Neurophysiol. 103, 1171–1178. doi: 10.1152/jn.00689.2009
Supèr, H., van der Togt, C., Spekreijse, H., and Lamme, V. A. (2004). Correspondence of presaccadic activity in the monkey primary visual cortex with saccadic eye movements. Proc. Natl. Acad. Sci. USA 101, 3230–3235. doi: 10.1073/pnas.0400433101
Taira, M., Mine, S., Georgopoulos, A. P., Murata, A., and Sakata, H. (1990). Parietal cortex neurons of the monkey related to the visual guidance of hand movement. Exp. Brain Res. 83, 29–36.
Treue, S., and Martinez-Trujillo, J. C. (1999). Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399, 575–579.
Tseng, P., and Bridgeman, B. (2011). Improved change detection with nearby hands. Exp. Brain Res. 209, 257–269. doi: 10.1007/s00221-011-2544-z
Tucker, M., and Ellis, R. (1998). On the relations between seen objects and components of potential actions. J. Exp. Psychol. Hum. Percept. Perform. 24, 830–846. doi: 10.1037/0096-1523.24.3.830
Tucker, M., and Ellis, R. (2001). The potentiation of grasp types during visual object categorization. Vis. Cogn. 8, 769–800. doi: 10.1080/13506280042000144
van der Stigchel, S., and Theeuwes, J. (2006). Our eyes deviate away from a location where a distractor is expected to appear. Exp. Brain Res. 169, 338–349. doi: 10.1007/s00221-005-0147-2
Van Elk, M., Van Schie, H. T., Neggers, S. F., and Bekkering, H. (2010). Neural and temporal dynamics underlying visual selection for action. J. Neurophysiol. 104, 972–983. doi: 10.1152/jn.01079.2009
Van Ettinger-Veenstra, H. M., Huijbers, W., Gutteling, T. P., Vink, M., Kenemans, J. L., and Neggers, S. F. (2009). fMRI-guided TMS on cortical eye fields: the frontal but not intraparietal eye fields regulate the coupling between visuospatial attention and eye movements. J. Neurophysiol. 102, 3469–3480. doi: 10.1152/jn.00350.2009
Keywords: attention, vision, sensorimotor integration, reaching and grasping, peripersonal space
Citation: Perry CJ, Amarasooriya P and Fallah M (2016) An Eye in the Palm of Your Hand: Alterations in Visual Processing Near the Hand, a Mini-Review. Front. Comput. Neurosci. 10:37. doi: 10.3389/fncom.2016.00037
Received: 15 December 2015; Accepted: 01 April 2016;
Published: 18 April 2016.
Edited by:
Hong Qiao, Chinese Academy of Sciences, ChinaReviewed by:
Patrizia Fattori, University of Bologna, ItalyBritt Anderson, University of Waterloo, Canada
Copyright © 2016 Perry, Amarasooriya and Fallah. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Carolyn J. Perry, ccjgo@yorku.ca