This article is a commentary on:
Internally- and externally-driven network transitions as a basis for automatic and strategic processes in semantic priming: theory and experimental validation
Alberto Bernacchia
Giancarlo La Camera
Frédéric Lavigne- 1School of Engineering and Science, Jacobs University Bremen gGmbH, Bremen, Germany
- 2Department of Neurobiology and Behavior and Program in Neuroscience, State University of New York at Stony Brook, Stony Brook, NY, USA
- 3Laboratoire Bases, Corpus, Langage, UMR 7320 CNRS, Université de Nice - Sophia Antipolis, Nice, France
by Lerner, I., and Shriki, O. (2014). Front. Psychol. 5:314. doi: 10.3389/fpsyg.2014.00314
Semantic priming is the phenomenon for which presenting a word (“prime”) to a subject can influence the processing of a second word (“target”), such as in the “lexical decision task” (is the target a word or a non-word?) or in the out-loud pronunciation of the target word (“naming task”). Performance and response times are affected by the strength of the prime-target association (for example, “dog” and “cat” are more strongly associated than “dog” and “goat”), the delay between prime and target, and other factors (McNamara, 2005). Lerner and Shriki (2014) review and provide novel evidence for a model of semantic priming that accounts for many of the empirical findings and makes clear predictions on two new experiments conducted by the authors.
The Lerner and Shriki model combines the idea of distributed coding of concepts (Masson, 1991, 1995; Plaut, 1995) with the idea of “latching dynamics” in neural networks possessing attractor states—i.e., stable distributed activation patterns across units (Treves, 2005; Moreno-Bote et al., 2007). In attractor networks, correlated attractors that share units in the same activation states code for semantically related concepts. These networks generate priming effects by, e.g., speeding up the convergence to the attractor state coding for a target when the latter shares units with the prime. The ingredient added by Lerner and Shriki to this modeling framework is that their network is in an ever present dynamical regime: the state of the network does not dwell on a given attractor concept for long and tends to jump between attractors due to short-term synaptic depression. In their modeling approach, the authors explore a number of interesting ideas in the context of semantic priming. In doing so, they facilitate the convergence of the dominant connectionist style of modeling toward a neurobiological understanding of semantic priming.
First, by introducing latching dynamics between related concepts—one cued by the prime, the other leading to the target—their model embraces the idea that neural representations may be understood not only in terms of static patterns of neural activation, but also in terms of temporal dynamics of those patterns, where the dynamics can be adjusted to make correct (or faster) decisions. Recent evidence suggests that cognitive functions unfold on a variety of timescales, and so does the underlying neural activity. For example, working memory is dynamic: memorized items are intrinsically unstable and they may jump in and out of memory (Amit et al., 2003). The process of making a sensorimotor decision is also dynamic, being mediated by the dynamical integration of sensory evidence by neurons in parietal and prefrontal cortex (Wang, 2008). This applies to fast decisions (of the order of hundreds of milliseconds) based on immediate sensory evidence as well as to slower decisions (order of minutes) requiring careful evaluation of previous decisions and outcomes (Bernacchia et al., 2011). Finally, even after a decision is made, the production of the actual movement by motor cortical neurons seems best explained in the framework of dynamical systems, rather than from the more classical view of static population coding (Shenoy et al., 2013). The work of Lerner and Shriki fits into these lines of evidence and adds semantic priming to the repertoire of phenomena that can be explained in terms of the complex dynamic behavior of ensembles of cortical neurons.
Second, the authors introduce a role for intrinsically generated noise on priming effects in an original application of reinforcement learning. Well established in cortical models of decision-making (Wang, 2008) and reinforcement learning (where it allows exploration—see, e.g., Sutton and Barto, 1998), the role of neural noise in semantic priming has not been explored. In an interesting development, the authors introduce the idea of learning the intrinsic level of noise by reinforcing faster reaction times, so as to match the latter's strong empirical dependence on expectancy and other types of context. The authors consider this as the potential mechanism underlying controlled processing in semantic priming. Controlled processes are those modifiable by task demands (whereas automatic processes reflect the static associations between targets and primes). A more biological way of implementing this idea would be to perturb the membrane conductances of spiking neurons and thus change the background fluctuations in the network (Chance et al., 2002). This would change the response of a population of neurons by acting on the variance of the ongoing activity, rather than on the average input, in the presence of a priming cue. By “learning the variance rather than the mean,” the system would learn to respond differently in different contexts of the same task, rather than learning to perform the task itself—as is more customary. The feasibility of this approach should of course be tested in a detailed spiking neuron implementation.
Third, the Lerner and Shriki model shares some notable features with network models of working memory, bringing the connectionist framework closer to more biologically plausible cortical models. Following the connectionist tradition, however, in the Lerner and Shriki model the associations are generated ad hoc to define which pairs of concepts will generate priming effects. In cortical models, priming effects depend on learned values of synaptic strength between neurons coding for the more strongly vs. less strongly associated concepts (Brunel, 1996; Mongillo et al., 2003). These models can also maintain multiple items in working memory (Haarmann and Usher, 2001; Amit et al., 2003), and can accommodate “overlapping coding,” i.e., the random attribution of the neurons to the coding of the items in memory, whereby some neurons are activated by different concepts coded by different populations (Curti et al., 2004). However, random overlap between populations coding for different concepts cannot contribute to priming because every concept has equal overlap with the others, not allowing a concept to prime some but not all other concepts. One possible solution to this problem is to consider learning the overlap between populations from the relatedness among the concepts they code for, as in recent cortical network models where “mixed-selectivity” neurons are co-active during learning the co-occurrences of related items (Rigotti et al., 2010, 2013; Bourjaily and Miller, 2011; Lavigne et al., 2014). Endowing the Lerner and Shriki model with the ability to learn the semantic associations would take the model even closer to biological realism.
In conclusion, semantic priming is a broad area of research and illustrates how the context in which the given information is processed is key to cognition. The model by Lerner and Shriki is a welcome attempt at reconciling the many facets of semantic priming within a unified (and more biologically plausible) framework, one that resonates with several contemporary ideas of how the brain deals with learning representations for context-dependent decisions.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Amit, D. J., Bernacchia, A., and Yakovlev, A. (2003). Multiple-object working memory—a model for behavioral performance. Cereb. Cortex 13, 435–443. doi: 10.1093/cercor/13.5.435
Bernacchia, A., Seo, H., Lee, D., and Wang, X. J. (2011). A reservoir of time constants for memory traces in cortical neurons. Nat. Neurosci. 14, 366–372. doi: 10.1038/nn.2752
Bourjaily, M. A., and Miller, P. (2011). Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons. PLoS Comput. Biol. 7:e1001091. doi: 10.1371/journal.pcbi.1001091
Brunel, N. (1996). Hebbian learning of context in recurrent neural networks. Neural Comput. 8, 1677–1710. doi: 10.1162/neco.1996.8.8.1677
Chance, F. S., Abbott, L. F., and Reyes, A. D. (2002). Gain modulation from background synaptic input. Neuron 35, 773–782. doi: 10.1016/S0896-6273(02)00820-6
Curti, E., Mongillo, G., La Camera, G., and Amit, D. J. (2004). Mean field and capacity in realistic networks of spiking neurons storing sparsely coded random memories. Neural Comput. 16, 2597–2637. doi: 10.1162/0899766042321805
Haarmann, H., and Usher, M. (2001). Maintenance of semantic information in capacity-limited item short-term memory. Psychon. Bull. Rev. 8, 568–578. doi: 10.3758/BF03196193
Lavigne, F., Avnaï, M. F., and Dumercy, L. (2014). Inter-synaptic learning of combination rules in a cortical network model. Front. Cogn. Sci. 5:842. doi: 10.3389/fpsyg.2014.00842
Lerner, I., and Shriki, O. (2014). Internally- and externally-driven network transitions as a basis for automatic and strategic processes in semantic priming: theory and experimental validation. Front. Psychol. 5:314. doi: 10.3389/fpsyg.2014.00314
Masson, E. M. J. (1991). “A distributed memory model of context effects in word identification,” in Basic Processes in Reading: Visual Word Recognition, eds D. Besner and G. W. Humphreys (Hillsdale, NJ: Erlbaum), 233–263.
Masson, E. M. J. (1995). A distributed memory model of semantic priming. J. Exp. Psychol. Learn. Mem. Cogn. 21, 3–23. doi: 10.1037/0278-7393.21.1.3
McNamara, T. P. (2005). Semantic Priming. Perspectives from Memory and Word Recognition. New York, NY: Psychology Press Ltd.
Mongillo, G., Amit, D. J., and Brunel, N. (2003). Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network. Eur. J. Neurosci. 18, 2011–2024. doi: 10.1046/j.1460-9568.2003.02908.x
Moreno-Bote, R., Rinzel, J., and Rubin, N. (2007). Noise-induced alternations in an attractor network model of perceptual bistability. J. Neurophysiol. 98, 1125–1139. doi: 10.1152/jn.00116.2007
Plaut, D. C. (1995). “Semantic and associative priming in a distributed attractor network,” in 17th Annual Conference of the Cognitive Science Society (Pittsburgh, PA).
Rigotti, M., Barak, O., Warden, M. R., Wang, X. J., Daw, N. D., Miller, E. K., et al. (2013). The importance of mixed selectivity in complex cognitive tasks. Nature 497, 585–590. doi: 10.1038/nature12160
Rigotti, M., Ben Dayan Rubin, D., Morrison, S. E., Salzman, C. D., and Fusi, S. (2010). Attractor concretion as a mechanism for the formation of context representations. Neuroimage 52, 833–847. doi: 10.1016/j.neuroimage.2010.01.047
Shenoy, K. V., Sahani, M., and Churchland, M. M. (2013). Cortical control of arm movements: a dynamical systems perspective. Annu. Rev. Neurosci. 36, 337–359. doi: 10.1146/annurev-neuro-062111-150509
Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
Treves, A. (2005). Frontal latching networks: a possible neural basis for infinite recursion. Cogn. Neuropsychol. 22, 276–291. doi: 10.1080/02643290442000329
Keywords: coding, model, mixed selectivity, neural network, noise, reinforcement learning, semantic, working memory
Citation: Bernacchia A, La Camera G and Lavigne F (2014) A latch on priming. Front. Psychol. 5:869. doi: 10.3389/fpsyg.2014.00869
Received: 03 July 2014; Accepted: 21 July 2014;
Published online: 11 August 2014.
Edited and reviewed by: Richard P. Cooper, Birkbeck College, UK
Copyright © 2014 Bernacchia, La Camera and Lavigne. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: a.bernacchia@jacobs-university.de; giancarlo.lacamera@stonybrook.edu; frederic.lavigne@unice.fr
†These authors have contributed equally to this work.