How to build better memory training games
Jenni Deveau
Susanne M. Jaeggi
Victor Zordan
Calvin Phung
Aaron R. Seitz- 1Department of Psychology, University of California, Riverside, Riverside, CA, USA
- 2School of Education, University of California, Irvine, Irvine, CA, USA
- 3Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, USA
- 4Department of Computer Science, University of California, Riverside, Riverside, CA, USA
Can we create engaging training programs that improve working memory (WM) skills? While there are numerous procedures that attempt to do so, there is a great deal of controversy regarding their efficacy. Nonetheless, recent meta-analytic evidence shows consistent improvements across studies on lab-based tasks generalizing beyond the specific training effects (Au et al., 2014; Karbach and Verhaeghen, 2014), however, there is little research into how WM training aids participants in their daily life. Here we propose that incorporating design principles from the fields of Perceptual Learning (PL) and Computer Science might augment the efficacy of WM training, and ultimately lead to greater learning and transfer. In particular, the field of PL has identified numerous mechanisms (including attention, reinforcement, multisensory facilitation and multi-stimulus training) that promote brain plasticity. Also, computer science has made great progress in the scientific approach to game design that can be used to create engaging environments for learning. We suggest that approaches integrating knowledge across these fields may lead to a more effective WM interventions and better reflect real world conditions.
Introduction
As long as scientists have explored memory, they have strived, and often failed, to improve it. Most approaches to improve memory implement strategies, such as creating mnemonic devices (for example, the method of loci). However, despite evidence these techniques improve memory performance, they do not target underlying memory processes, and while they do have some influence on memory systems in the brain (Maguire et al., 2003), they typically fail to broadly generalize to untrained activities (Verhaeghen et al., 1992; Maguire et al., 2003; St Clair-Thompson et al., 2010). Recent research on “brain training” renews promise for improving memory and other cognitive skills. Here, we focus on working memory (WM), a limited-capacity system for storing and manipulating information in a given moment. WM underlies performance in virtually all complex cognitive tasks (Shah and Miyake, 1999). Recent approaches targeting skills related to WM (Klingberg et al., 2002, 2005; Jaeggi et al., 2008, 2010; Anguera et al., 2013; Goldin et al., 2014) have shown generalizing benefits to a wide number of non-trained cognitive tasks that are thought to rely on WM, including executive control and fluid reasoning (c.f. Au et al., 2014; Karbach and Verhaeghen, 2014 for recent meta-analyses).
Here we review recent WM training approaches discussing their strengths and limitations and suggest methods that are based on the principles of perceptual learning (PL) and game design to make them more effective. Off-the-shelf computer games and standard cognitive approaches each contain component properties that can benefit WM. We propose that integrating knowledge from psychology and neuroscience along with the science of video game design could critically inform the development of engaging, cognitively immersive challenges that will more optimally train WM memory processes.
Span Training
Span training targets WM capacity (Klingberg et al., 2002, 2005) typically relying on two types of tasks, simple and complex. Simple span tasks present sequences of stimuli that vary in set-size with participants typically reporting the items in (reverse) order of presentation. Research has shown that training on simple span tasks results in transfer in a variety of measures, such as non-trained WM tasks, response inhibition, and even fluid reasoning (Klingberg et al., 2002, 2005; Thorell et al., 2009).
In contrast to simple span tasks, which focus predominantly on WM storage, complex span tasks involve a secondary processing task. An example of a complex span task is Reading Span (Daneman and Carpenter, 1980) where participants judge the semantic content of a series of sentences and then later recall the last word of each sentence in order. Simple and complex span tasks used as interventions are typically adaptive, where the number of items to be recalled increases as training progresses. Adaptive complex span training leads to both near and far transfer in a variety of populations. Chein and Morrison (2010) showed that training on verbal and spatial complex span tasks improves verbal and spatial short-term memory, response inhibition, and reading comprehension in young and older adults (Richmond et al., 2011). In another series of studies, typically developing children (Loosli et al., 2012; Karbach et al., 2014) and older adults (Buschkuehl et al., 2008) were trained on complex span (see Figure 1B) demonstrating improved reading performance (Loosli et al., 2012; Karbach et al., 2014) and improved visual WM and episodic memory (Buschkuehl et al., 2008). Other groups have found similar effects from complex span training in older adults that were maintained several months after training completion (Borella et al., 2010, 2013, 2014).
Figure 1. (A) Diagram of an n-back task presented as a 2-back task (Jaeggi et al., 2008, 2010). Here, visual and auditory stimuli are presented simultaneously and participants have to respond to both modality streams independently. (B) Diagram of a complex span training task (Buschkuehl et al., 2008; Loosli et al., 2012). Animal pictures are presented sequentially, and participants respond to the orientation of each picture, and then reproduce the sequence in which the animals were presented. (C) Schematic of gamified n-back training task.
N-Back Training
Among the best known WM tasks used for training is the n-back task (Jaeggi et al., 2008; Smith et al., 2009; Buschkuehl and Jaeggi, 2010). Here, participants memorize and constantly update the serial positions “n steps back” in a continuous stimulus stream and report whether or not the current stimulus matches the stimulus n-items back in a sequence (Figure 1A). Task difficulty (equal to level of n) is adaptively adjusted in response to participants’ performance. N-back training-related improvements are wide-ranging, including non-trained WM functions (e.g., Lilienthal et al., 2013), executive functioning (e.g., Salminen et al., 2012), episodic memory (e.g., Rudebeck et al., 2012), and even fluid reasoning (Stephenson and Halpern, 2013). Effects are observed across the lifespan ranging from typically developing children (Jaeggi et al., 2011) to older adults (Stepankova et al., 2014). Both the amount of training (Stepankova et al., 2014) and achievement on the training task (Jaeggi et al., 2011) have been related to consequent improvements in the untrained fluid intelligence tasks. However, findings of far transfer (e.g., that WM training leads to improved performance on tasks unrelated to the training), are not ubiquitous in the literature (Shipstead et al., 2012). Some of these inconsistencies across studies may be explained by variations in training schedules, outcome measures, or individual differences (Jaeggi et al., 2012, 2014; Shah et al., 2012).
Mechanisms that Promote Learning
While there is growing evidence that WM training impacts performance in a wide variety of tasks, the mechanisms driving plasticity in WM systems remain unclear. However, research of PL has identified numerous mechanisms that promote the magnitude and generalization of learning. PL refers to a long lasting improvement in perceptual abilities as a result of experience. Interestingly, key approaches to working WM training, such as extended practice and adaptive procedures (the latter is to use computer algorithms to customize the challenge to each participant), were originally modeled after successful approaches in PL (Klingberg et al., 2002, 2005). Classically, a translational barrier to PL has been its high degree of specificity to trained stimulus features (Fahle, 2005), such as orientation (Fiorentini and Berardi, 1980), retinal location (Karni and Sagi, 1991) or the eye trained (Poggio et al., 1992; Seitz et al., 2009). This specificity to the training task and stimuli mirrors issues that face modern WM training. However, recent research illustrates how to overcome this “curse of specificity” with approaches that integrate many techniques (Deveau et al., 2014a,b) showing greater generalization of learning.
A key question is what mechanisms gate learning? Seitz and Dinse (2007) proposed a model of PL in which mechanisms including attention, reinforcement, optimal stimulation protocols, and multisensory facilitation interact to boost sensory signals over a learning threshold. This model and a host of empirical research on PL demonstrate that learning generalizes best when: (1) a larger set of stimulus features are trained (Xiao et al., 2008; Hung and Seitz, 2014); (2) using multisensory stimuli (Shams and Seitz, 2008); (3) using motivating tasks (Shibata et al., 2009); (4) participants are confident in their performance (Ahissar and Hochstein, 1997); and (5) consistent reinforcement to the training stimuli is used (Seitz and Watanabe, 2009). Combining these approaches increase the magnitude and generality of learning (Deveau et al., 2014a,b). In the following, we review some of the mechanisms that promote PL and discuss how they could be applied to WM training.
Attention and Reinforcement
Attention refers to a set of mental processes that selectively modulate the processing of relevant information over irrelevant information; attention influences decisions, guides memory processes and our executive functions to direct resources to act upon the world. Numerous studies show that attention gates learning (Shiu and Pashler, 1992; Ahissar and Hochstein, 1993; Schoups et al., 2001; Leclercq and Seitz, 2012b). For example, Schoups et al. (2001) found neuronal plasticity of V1 cells corresponding to attended stimuli but no plasticity for cells with receptive fields overlapping unattended stimuli, suggesting that attention selects what is learned and what is not. A key aspect of WM capacity entails the ability to avoid distraction and is positively correlated with performance on a variety of attention tasks (Engle, 2002; Hutchison, 2007). Furthermore, WM capacity is highly predictive for scholastic achievement (Gathercole et al., 2003) and it is among the major cognitive deficits of children with attention deficit hyperactivity disorder (ADHD; Klingberg et al., 2002). Using casual games found on the Internet, Baniqued et al. (2013) found that playing games focusing on attention/object tracking improved WM abilities, on the other hand, playing games that focused on WM did not improve measures of attention. These and other findings suggest a key role of attention in WM, and that proper engagement of attention during training may be a key factor in WM training success.
Also, reinforcement processes (rewards, punishments, motivation, etc.) have fundamental importance in guiding learning. For example, Seitz et al. (2009) found improved discrimination of orientation stimuli masked in noise after temporal-pairing between a liquid reward and a subliminal presentation of that orientation stimulus. Seitz and Watanabe (2005) suggested a model where learning is gated by reinforcement signals that trigger learning of aspects of the environment (even those for which the organism is not consciously aware) that are predictive or co-vary with the reinforcing event. They suggested that both attention and reinforcement operate in part through the release of neuromodulatory signals in the brain. For example, the orienting of attention, in the direction of the target-arrow, has been linked with the acetylcholine neuromodulatory system (Davidson and Marrocco, 2000). Of interest, cholinergic enhancement through the use of donepezil improves both the attentional processing (Rokem et al., 2010) as well as the magnitude (Rokem and Silver, 2010) and longevity (Rokem and Silver, 2013) of PL. Other neuromodulatory systems, such as dopamine and norepinephrine have also been linked to attention (Posner and Petersen, 1990; Fan et al., 2003), learning (Kilgard and Merzenich, 1998; Bao et al., 2001; Dalley et al., 2001; Blake et al., 2006) and WM (Brehmer et al., 2009; Bellander et al., 2011). These studies suggest that a good training approach should involve the direction of both attention and reinforcement in a coordinated manner to promote learning.
Multisensory Facilitation
The human brain has evolved to learn and operate optimally in natural environments in which behavior is guided by information integrated across multiple sensory modalities. Crossmodal interactions are ubiquitous in the nervous system and occur even at early stages of perceptual processing (Shimojo and Shams, 2001; Calvert et al., 2004; Schroeder and Foxe, 2005; Ghazanfar and Schroeder, 2006; Driver and Noesselt, 2008). For example, recent research shows that subjects trained with auditory-visual stimuli exhibit a faster rate of learning and a higher degree of improvement than found in subjects trained in silence (Seitz et al., 2006; Kim et al., 2008).
Both memory storage and retrieval involves multiple senses. For example, the smell of a loved one’s perfume (olfaction) can invoke memories of their face (vision), and so on. However, existing memory tasks, such as the dual n-back, often employ multiple (stimulus) modalities that are not coordinated, which research shows does not promote learning, and may in fact interfere with it (Seitz et al., 2005). Instead, we suggest a different approach where multisensory objects are incorporated into WM training. By defining objects through multi-modal feature sets, each sense can boost learning in the other. For example, an individual with limited visual capabilities will benefit from training utilizing concordant auditory stimuli.
Multistimulus Training
One way to overcome specificity of learning is by training with multiple stimuli, as demonstrated in PL (Dosher and Lu, 1998; Yu et al., 2004; Xiao et al., 2008; Deveau et al., 2014a,b). For example, the recently developed technique of “double training” found that classically specific learning effects can show broad transfer when more than one stimulus attribute is trained. Xiao et al. (2008) trained participants on a Vernier discrimination task at a specific orientation at a specific location in the visual field, which normally yields location and orientation specific learning (Poggio et al., 1992). However, subsequently training subjects a second orientation at a different spatial location, the training-induced changes for the second orientation transferred to the first location. This data suggests that WM training with a diverse stimulus set might lead to a greater degree of transfer to untrained tasks than training on a narrow set (Estes and Burke, 1953; Schmidt and Bjork, 1992).
Furthermore, PL shows that the arrangement of multiple task elements in space and time can play a pivotal role in determining learning. Poor arrangements, such as when different stimuli are presented in a random order, as opposed to fixed order (Zhang et al., 2008), lead to poor learning (Seitz et al., 2005). Similar rules operate in guiding memory where sudden onsets of task-related stimuli can disrupt memorization of objects paired with those images (Leclercq and Seitz, 2012a). This may explain the recent counter-intuitive finding of WM training where the addition of motivational features in a simple gamification of n-back training led to impaired learning (Katz et al., 2014; see Figure 2), by inadvertently leading to greater distraction. We suggest that greater congruence between training stimuli and motivational factors will lead to greater and broader learning from WM training. In the next section we describe how this may be achieved through game design principles.
Figure 2. Interference of learning by gamification. Motivational features such as scores, prizes, and scene-changes seem to interfere with learning. Specifically, training with all these features led to a lesser degree of learning compared to training without motivational features over the course of three sessions of n-back training (adapted from Katz et al., 2014).
Video Games
There are many examples of off-the-shelf video games leading to substantial improvements in a variety of perceptual and cognitive abilities. For example, Green and Bavelier (2003) found that training novices for 10 h on an action video game improved performance on enumeration, useful field of view, and attentional blink tasks when compared to participants trained with a non-action video game. Basak et al. (2008) found that playing a real-time strategy game improved executive control as measured by task switching, visual short-term memory, and reasoning in older adults. Another recent study (Shute et al., 2015) showed that an off-the-shelf video game (Portal 2) led to substantial improvements on measures of problem solving, spatial skills, and persistence (in fact, even more so than training with the popular brain training games of Lumosity). Furthermore, dyslexic children improved reading speed and attentional abilities after playing an action video game (Franceschini et al., 2013). Finally, Goldin et al. (2014) employed several computer games targeting executive control, and found improvements in attention, inhibitory control, and planning, which also translated to school performance (Goldin et al., 2014). Together these studies suggest that video games include important attributes that contribute to learning.
Given the attractive motivational features of video games, recent research in cognitive science is increasingly moving towards adding game-like elements to their assessments. However, without proper design these can impair task performance, and even weaken test quality and learning (Hawkins et al., 2013; Katz et al., 2014). We suggest a better approach is to create training software that will dovetail, and/or implement non-competing concepts from game design that support learning. The video-game field is maturing, proper design rules and constraints are becoming more refined and the practices of coordinated design are becoming better understood and documented (Rabin, 2005). For example, in order to optimally engage players games must establish clear goals and allow players to realize those goals through meaningful actions (Salen and Zimmerman, 2004). Successful game design has critical aspects that make software engaging, including its mechanics, interaction, visual/sensory experience, and progression (Gee, 2007).
Many game design criteria mirror components found to improve learning from the PL literature, and literature on deliberate practice (Ericsson et al., 1993). For example, consistent reinforcement to training stimuli (Seitz and Watanabe, 2009) maps directly to consistent player feedback, a key part of player-centric interface design (Adams, 2009). Adams says (of players) “most critically, they need information about whether their efforts are succeeding or failing, taking them closer to victory or closer to defeat”. Likewise, motivating tasks (Shibata et al., 2009) and ensuring subjects are confident of their performance (Ahissar and Hochstein, 1997) are consistent with good game-design principles such as establishing clear goals (Salen and Zimmerman, 2004) and balancing games challenges (related to the adaptive approaches used in PL and WM training) to match player performance (Adams, 2009). Applying video-game techniques purposefully into WM training can inject the cognitive benefits found from off-the-shelf video games into principled cognitive training, while also being fun to play.
Integrating Learning and Gaming Principles
Two relevant lines of research have made significant breakthroughs in brain training: (1) Studying incidental benefits of off-the-shelf video games; and (2) Transforming standard cognitive tasks into training tasks. We suggest that the most success will come from integrating knowledge of memory systems with that of brain plasticity and modern game-design principles.
As a first attempt to implement this approach, we created a prototype game that incorporates mechanics of the n-back into an engaging 3D space-themed game1 (see Figure 1C). Typically, the n-back task is very basic, e.g., selecting matches from a grid or a picture series. In contrast, our prototype is a space-themed “collection” game with navigation challenges and obstacles, multi-layered progression through levels, and rich, thematic visual and sound effects. The n-back task is integrated into the game mechanics, where players select the “right” fuel cells while avoiding decoys. Levels are designed to get progressively harder through increasing cognitive challenge (n-level) and other game challenges (such as obstacles). While the game is more difficult and attention is spread over more elements than the conventional n-back, participant’s control over their environment is anticipated to increase their engagement with the game.
The game also incorporates principles from PL, where participants are trained on multisensory (auditory and visual) features, where sounds and visuals are designed to facilitate each other, and where attention and reinforcement are carefully sculpted to lead to the best learning. While much work is still required to maximize the game’s efficacy, e.g., by incorporating a broader stimulus set, adding other memory tasks, and creating an even more compelling game framework, we put it forward as a first example of how to build such an integrative game. Initial piloting with our prototype indicates participants are engaged in the game and improve performance (n-level) across training sessions. However, more research is needed to make firm conclusions regarding its transfer potential.
In summary, we suggest that more integrative approaches will lead to better learning outcomes. We suggest that the general mechanisms that promote PL are shared across brain regions and will also promote WM. Furthermore, there is enough known about the aspects of conventional video games that lead to positive learning outcomes that these principles can be applied to achieve more effective WM training. Additionally, there are other principles, that were beyond the scope of the present review, such as deliberate practice (Ericsson et al., 1993), and many aspects of healthy lifestyles (Walsh, 2011; Sigman et al., 2014) that also promote cognitive fitness. Integrating these approaches with good design could lead to a more comprehensive impact on WM function that might ultimately transfer to real-world conditions.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
References
Ahissar, M., and Hochstein, S. (1993). Attentional control of early perceptual learning. Proc. Natl. Acad. Sci. U S A 90, 5718–5722. doi: 10.1073/pnas.90.12.5718
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Ahissar, M., and Hochstein, S. (1997). Task difficulty and the specificity of perceptual learning. Nature 387, 401–406. doi: 10.1038/387401a0
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Anguera, J. A., Boccanfuso, J., Rintoul, J. L., Al-Hashimi, O., Faraji, F., Janowich, J., et al. (2013). Video game training enhances cognitive control in older adults. Nature 501, 97–101. doi: 10.1038/nature12486
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., and Jaeggi, S. M. (2014). Improving fluid intelligence with training on working memory: a meta-analysis. Psychon. Bull. Rev. doi: 10.3758/s13423-014-0699-x. [Epub ahead of print].
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Baniqued, P. L., Lee, H., Voss, M. W., Basak, C., Cosman, J. D., Desouza, S., et al. (2013). Selling points: what cognitive abilities are tapped by casual video games? Acta Psychol. (Amst) 142, 74–86. doi: 10.1016/j.actpsy.2012.11.009
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Bao, S., Chan, V. T., and Merzenich, M. M. (2001). Cortical remodelling induced by activity of ventral tegmental dopamine neurons. Nature 412, 79–83. doi: 10.1038/35083586
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Basak, C., Boot, W. R., Voss, M. W., and Kramer, A. F. (2008). Can training in a real-time strategy video game attenuate cognitive decline in older adults? Psychol. Aging 23, 765–777. doi: 10.1037/a0013494
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Bellander, M., Brehmer, Y., Westerberg, H., Karlsson, S., Furth, D., Bergman, O., et al. (2011). Preliminary evidence that allelic variation in the LMX1A gene influences training-related working memory improvement. Neuropsychologia 49, 1938–1942. doi: 10.1016/j.neuropsychologia.2011.03.021
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Blake, D. T., Heiser, M. A., Caywood, M., and Merzenich, M. M. (2006). Experience-dependent adult cortical plasticity requires cognitive association between sensation and reward. Neuron 52, 371–381. doi: 10.1016/j.neuron.2006.08.009
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Borella, E., Carretti, B., Cantarella, A., Riboldi, F., Zavagnin, M., and De Beni, R. (2014). Benefits of training visuospatial working memory in young-old and old-old. Dev. Psychol. 50, 714–727. doi: 10.1037/a0034293
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Borella, E., Carretti, B., Riboldi, F., and De Beni, R. (2010). Working memory training in older adults: evidence of transfer and maintenance effects. Psychol. Aging 25, 767–778. doi: 10.1037/a0020683
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Borella, E., Carretti, B., Zanoni, G., Zavagnin, M., and De Beni, R. (2013). Working memory training in old age: an examination of transfer and maintenance effects. Arch. Clin. Neuropsychol. 28, 331–347. doi: 10.1093/arclin/act020
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Brehmer, Y., Westerberg, H., Bellander, M., Fürth, D., Karlsson, S., and Backman, L. (2009). Working memory plasticity modulated by dopamine transporter genotype. Neurosci. Lett. 467, 117–120. doi: 10.1016/j.neulet.2009.10.018
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Buschkuehl, M., and Jaeggi, S. M. (2010). Improving intelligence: a literature review. Swiss Med. Wkly 140, 266–272. doi: smw-12852
Buschkuehl, M., Jaeggi, S. M., Hutchison, S., Perrig-Chiello, P., Däpp, C., Müller, M., et al. (2008). Impact of working memory training on memory performance in old-old adults. Psychol. Aging 23, 743–753. doi: 10.1037/a0014342
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Calvert, G., Spence, C., and Stein, B. E. (2004). The Handbook of Multisensory Processes. Cambridge, MA: The MIT Press.
Chein, J. M., and Morrison, A. B. (2010). Expanding the mind’s workspace: training and transfer effects with a complex working memory span task. Psychon. Bull. Rev. 17, 193–199. doi: 10.3758/PBR.17.2.193
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Dalley, J. W., McGaughy, J., O’Connell, M. T., Cardinal, R. N., Levita, L., and Robbins, T. W. (2001). Distinct changes in cortical acetylcholine and noradrenaline efflux during contingent and noncontingent performance of a visual attentional task. J. Neurosci. 21, 4908–4914.
Daneman, M., and Carpenter, P. A. (1980). Individual differences in working memory and reading. J. Verbal Learn. Verbal Behav.r 19, 450–466. doi: 10.1016/s0022-5371(80)90312-6
Davidson, M. C., and Marrocco, R. T. (2000). Local infusion of scopolamine into intraparietal cortex slows covert orienting in rhesus monkeys. J. Neurophysiol. 83, 1536–1549.
Deveau, J., Lovcik, G., and Seitz, A. R. (2014a). Broad-based visual benefits from training with an integrated perceptual-learning video game. Vision Res. 99, 134–140. doi: 10.1016/j.visres.2013.12.015
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Deveau, J., Ozer, D. J., and Seitz, A. R. (2014b). Improved vision and on field performance in baseball through perceptual learning. Curr. Biol. 24, R146–R147. doi: 10.1016/j.cub.2014.01.004
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Dosher, B. A., and Lu, Z. L. (1998). Perceptual learning reflects external noise filtering and internal noise reduction through channel reweighting. Proc. Natl. Acad. Sci. U S A 95, 13988–13993. doi: 10.1073/pnas.95.23.13988
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on ’sensory-specific’ brain regions, neural responses and judgments. Neuron 57, 11–23. doi: 10.1016/j.neuron.2007.12.013
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Engle, R. W. (2002). Working memory capacity as executive attention. Curr. Dir. sychol. Sci. 11, 19–23. doi: 10.1111/1467-8721.00160
Ericsson, K. A., Krampe, R. T., and Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 363–406. doi: 10.1037//0033-295x.100.3.363
Estes, W. K., and Burke, C. J. (1953). A theory of stimulus variability in learning. Psychol. Rev. 60, 276–286. doi: 10.1037/h0055775
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Fahle, M. (2005). Perceptual learning: specificity versus generalization. Curr. Opin. Neurobiol. 15, 154–160. doi: 10.1016/j.conb.2005.03.010
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Fan, J., Fossella, J., Sommer, T., Wu, Y., and Posner, M. I. (2003). Mapping the genetic variation of executive attention onto brain activity. Proc. Natl. Acad. Sci. U S A 100, 7406–7411. doi: 10.1073/pnas.0732088100
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Fiorentini, A., and Berardi, N. (1980). Perceptual learning specific for orientation and spatial frequency. Nature 287, 43–44. doi: 10.1038/287043a0
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Franceschini, S., Gori, S., Ruffino, M., Viola, S., Molteni, M., and Facoetti, A. (2013). Action video games make dyslexic children read better. Curr. Biol. 23, 462–466. doi: 10.1016/j.cub.2013.01.044
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Gathercole, S. E., Brown, L., and Pickering, S. J. (2003). Working memory assessments at school entry as longitudinal predictors of national curriculum attainment levels. Educ. Child Psychol. 20, 109–122.
Gee, J. P. (2007). What Video Games have to Teach us about Learning and Literacy: Revised and Updated Edition. New York, NY: Macmillan.
Ghazanfar, A., and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Cogn. Sci. 10, 278–285. doi: 10.1016/j.tics.2006.04.008
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Goldin, A. P., Hermida, M. J., Shalom, D. E., Elias Costa, M., Lopez-Rosenfeld, M., Segretin, M. S., et al. (2014). Far transfer to language and math of a short software-based gaming intervention. Proc. Natl. Acad. Sci. U S A 111, 6443–6448. doi: 10.1073/pnas.1320217111
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Green, C. S., and Bavelier, D. (2003). Action video game modifies visual selective attention. Nature 423, 534–537. doi: 10.1038/nature01647
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Hawkins, G. E., Rae, B., Nesbitt, K. V., and Brown, S. D. (2013). Gamelike features might not improve data. Behav. Res. Methods 45, 301–318. doi: 10.3758/s13428-012-0264-3
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Hung, S. C., and Seitz, A. R. (2014). Prolonged training at threshold promotes robust retinotopic specificity in perceptual learning. J. Neurosci. 34, 8423–8431. doi: 10.1523/jneurosci.0745-14.2014
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Hutchison, K. A. (2007). Attentional control and the relatedness proportion effect in semantic priming. J. Exp. Psychol. Learn. Mem. Cogn. 33, 645–662. doi: 10.1037/0278-7393.33.4.645
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Jaeggi, S. M., Buschkuehl, M., Jonides, J., and Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. Proc. Natl. Acad. Sci. U S A 105, 6829–6833. doi: 10.1073/pnas.0801268105
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Jaeggi, S. M., Buschkuehl, M., Jonides, J., and Shah, P. (2011). Short- and long-term benefits of cognitive training. Proc. Natl. Acad. Sci. U S A 108, 10081–10086. doi: 10.1073/pnas.1103228108
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Jaeggi, S. M., Buschkuehl, M., Jonides, J., and Shah, P. (2012). Cogmed and working memory training—current challenges and the search for underlying mechanisms. J. Appl. Res. Mem. Cogn. 1, 211–213. doi: 10.1016/j.jarmac.2012.07.002
Jaeggi, S. M., Buschkuehl, M., Shah, P., and Jonides, J. (2014). The role of individual differences in cognitive training and transfer. Mem. Cognit. 42, 464–480. doi: 10.3758/s13421-013-0364-z
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Jaeggi, S. M., Studer-Luethi, B., Buschkuehl, M., Su, Y. F., Jonides, J., and Perrig, W. J. (2010). The relationship between n-back performance and matrix reasoning—implications for training and transfer. Intelligence 38, 625–635. doi: 10.1016/j.intell.2010.09.001
Karbach, J., Strobach, T., and Schubert, T. (2014). Adaptive working-memory training benefits reading, but not mathematics in middle childhood. Child Neuropsychol. doi: 10.1080/09297049.2014.899336. [Epub ahead of print]
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Karbach, J., and Verhaeghen, P. (2014). Making working memory work: a meta-analysis of executive-control and working memory training in older adults. Psychol. Sci. 25, 2027–2037. doi: 10.1177/0956797614548725
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Karni, A., and Sagi, D. (1991). Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. Proc. Natl. Acad. Sci. U S A 88, 4966–4970. doi: 10.1073/pnas.88.11.4966
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Katz, B., Jaeggi, S., Buschkuehl, M., Stegman, A., and Shah, P. (2014). Differential effect of motivational features on training improvements in school-based cognitive training. Front. Hum. Neurosci. 8:242. doi: 10.3389/fnhum.2014.00242
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Kilgard, M. P., and Merzenich, M. M. (1998). Cortical map reorganization enabled by nucleus basalis activity. Science 279, 1714–1718. doi: 10.1126/science.279.5357.1714
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Kim, R. S., Seitz, A. R., and Shams, L. (2008). Benefits of stimulus congruency for multisensory facilitation of visual learning. PLoS One 3:e1532. doi: 10.1371/journal.pone.0001532
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., et al. (2005). Computerized training of working memory in children with ADHD—a randomized, controlled trial. J. Am. Acad. Child Adolesc. Psychiatry 44, 177–186. doi: 10.1097/00004583-200502000-00010
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Klingberg, T., Forssberg, H., and Westerberg, H. (2002). Training of working memory in children with ADHD. J. Clin. Exp. Neuropsychol. 24, 781–791. doi: 10.1076/jcen.24.6.781.8395
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Leclercq, V., and Seitz, A. R. (2012a). Fast task-irrelevant perceptual learning is disrupted by sudden onset of central task elements. Vision Res. 61, 70–76. doi: 10.1016/j.visres.2011.07.017
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Leclercq, V., and Seitz, A. R. (2012b). The impact of orienting attention in fast task-irrelevant perceptual learning. Atten. Percept. Psychophys. 74, 648–660. doi: 10.3758/s13414-012-0270-7
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Lilienthal, L., Tamez, E., Shelton, J. T., Myerson, J., and Hale, S. (2013). Dual n-back training increases the capacity of the focus of attention. Psychon. Bull. Rev. 20, 135–141. doi: 10.3758/s13423-012-0335-6
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Loosli, S. V., Buschkuehl, M., Perrig, W. J., and Jaeggi, S. M. (2012). Working memory training improves reading processes in typically developing children. Child Neuropsychol. 18, 62–78. doi: 10.1080/09297049.2011.575772
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Maguire, E. A., Valentine, E. R., Wilding, J. M., and Kapur, N. (2003). Routes to remembering: the brains behind superior memory. Nat. Neurosci. 6, 90–95. doi: 10.1038/nn988
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Poggio, T., Fahle, M., and Edelman, S. (1992). Fast perceptual learning in visual hyperacuity. Science 256, 1018–1021. doi: 10.1126/science.1589770
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Posner, M. I., and Petersen, S. E. (1990). The attention system of the human brain. Annu. Rev. Neurosci. 13, 25–42. doi: 10.1146/annurev.neuro.13.1.25
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Richmond, L. L., Morrison, A. B., Chein, J. M., and Olson, I. R. (2011). Working memory training and transfer in older adults. Psychol. Aging 26, 813–822. doi: 10.1037/a0023631
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Rokem, A., Landau, A. N., Garg, D., Prinzmetal, W., and Silver, M. A. (2010). Cholinergic enhancement increases the effects of voluntary attention but does not affect involuntary attention. Neuropsychopharmacology 35, 2538–2544. doi: 10.1038/npp.2010.118
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Rokem, A., and Silver, M. A. (2010). Cholinergic enhancement augments magnitude and specificity of visual perceptual learning in healthy humans. Curr. Biol. 20, 1723–1728. doi: 10.1016/j.cub.2010.08.027
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Rokem, A., and Silver, M. A. (2013). The benefits of cholinergic enhancement during perceptual learning are long-lasting. Front. Comput. Neurosci. 7:66. doi: 10.3389/fncom.2013.00066
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Rudebeck, S. R., Bor, D., Ormond, A., O’Reilly, J. X., and Lee, A. C. (2012). A potential spatial working memory training task to improve both episodic memory and fluid intelligence. PLoS One 7:e50431. doi: 10.1371/journal.pone.0050431
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Salminen, T., Strobach, T., and Schubert, T. (2012). On the impacts of working memory training on executive functioning. Front. Hum. Neurosci. 6:166. doi: 10.3389/fnhum.2012.00166
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Schmidt, R. A., and Bjork, R. A. (1992). New conceptualizations of practice: common principles in three paradigms suggest new concepts for training. Psychol. Sci. 3, 207–217. doi: 10.1111/j.1467-9280.1992.tb00029.x
Schoups, A., Vogels, R., Qian, N., and Orban, G. (2001). Practising orientation identification improves orientation coding in V1 neurons. Nature 412, 549–553. doi: 10.1038/35087601
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Schroeder, C. E., and Foxe, J. (2005). Multisensory contributions to low-level, ‘unisensory’ processing. Curr. Opin. Neurobiol. 15, 454–458. doi: 10.1016/j.conb.2005.06.008
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A. R., and Dinse, H. R. (2007). A common framework for perceptual learning. Curr. Opin. Neurobiol. 17, 148–153. doi: 10.1016/j.conb.2007.02.004
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A. R., Kim, R., and Shams, L. (2006). Sound facilitates visual learning. Curr. Biol. 16, 1422–1427. doi: 10.1016/j.cub.2006.05.048
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A. R., Kim, D., and Watanabe, T. (2009). Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron 61, 700–707. doi: 10.1016/j.neuron.2009.01.016
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A., and Watanabe, T. (2005). A unified model for perceptual learning. Trends Cogn. Sci. 9, 329–334. doi: 10.1016/j.tics.2005.05.010
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A. R., and Watanabe, T. (2009). The phenomenon of task-irrelevant perceptual learning. Vision Res. 49, 2604–2610. doi: 10.1016/j.visres.2009.08.003
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Seitz, A. R., Yamagishi, N., Werner, B., Goda, N., Kawato, M., and Watanabe, T. (2005). Task-specific disruption of perceptual learning. Proc. Natl. Acad. Sci. U S A 102, 14895–14900. doi: 10.1073/pnas.0505765102
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Shah, P., Buschkuehl, M., Jaeggi, S., and Jonides, J. (2012). Cognitive training for ADHD: the importance of individual differences. J. Appl. Res. Mem. Cogn. 1, 204–205. doi: 10.1016/j.jarmac.2012.07.001
Shah, P., and Miyake, A. (1999). “Models of working memory: an introduction,” in Models of Working Memory: Mechanism of Active Maintenance and Executive Control, eds P. Shah and A. Miyake (New York: Cambridge University Press), 1–26.
Shams, L., and Seitz, A. R. (2008). Benefits of multisensory learning. Trends Cogn. Sci. 12, 411–417. doi: 10.1016/j.tics.2008.07.006
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Shibata, K., Yamagishi, N., Ishii, S., and Kawato, M. (2009). Boosting perceptual learning by fake feedback. Vision Res. 49, 2574–2585. doi: 10.1016/j.visres.2009.06.009
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Shimojo, S., and Shams, L. (2001). Sensory modalities are not separate modalities: plasticity and interactions. Curr. Opin. Neurobiol. 11, 505–509. doi: 10.1016/s0959-4388(00)00241-5
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Shipstead, Z., Hicks, K. L., and Engle, R. W. (2012). Cogmed working memory training: does the evidence support the claims? J. Appl. Res. Mem. Cogn. 1, 185–193. doi: 10.1016/j.jarmac.2012.06.003
Shiu, L. P., and Pashler, H. (1992). Improvement in line orientation discrimination is retinally local but dependent on cognitive set. Percept. Psychophys. 52, 582–588. doi: 10.3758/bf03206720
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Shute, V. J., Ventura, M., and Ke, F. (2015). The power of play: the effects of portal 2 and lumosity on cognitive and noncognitive skills. Comput. Educ. 80, 58–67. doi: 10.1016/j.compedu.2014.08.013
Sigman, M., Pñna, M., Goldin, A. P., and Ribeiro, S. (2014). Neuroscience and education: prime time to build the bridge. Nat. Neurosci. 17, 497–502. doi: 10.1038/nn.3672
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Smith, G. E., Housen, P., Yaffe, K., Ruff, R., Kennison, R. F., Mahncke, H. W., et al. (2009). A cognitive training program based on principles of brain plasticity: results from the Improvement in Memory with Plasticity-based Adaptive Cognitive Training (IMPACT) study. J. Am. Geriatr. Soc. 57, 594–603. doi: 10.1111/j.1532-5415.2008.02167.x
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
St Clair-Thompson, H., Stevens, R., Hunt, A., and Bolder, E. (2010). Improving children’s working memory and classroom performance. Educ. Psychol. 30, 203–219. doi: 10.1080/01443410903509259
Stepankova, H., Lukavsky, J., Buschkuehl, M., Kopecek, M., Ripova, D., and Jaeggi, S. M. (2014). Dose-response relationship of working memory training and improvements in fluid intelligence: a randomized controlled study in old adults. Dev. Psychol. 50, 1049–1059. doi: 10.1037/a0034913
Stephenson, C. L., and Halpern, D. F. (2013). Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence 41, 341–357. doi: 10.1016/j.intell.2013.05.006
Thorell, L. B., Lindqvist, S., Bergman Nutley, S., Bohlin, G., and Klingberg, T. (2009). Training and transfer effects of executive functions in preschool children. Dev. Sci. 12, 106–113. doi: 10.1111/j.1467-7687.2008.00745.x
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Verhaeghen, P., Marcoen, A., and Goossens, L. (1992). Improving memory performance in the aged through mnemonic training: a meta-analytic study. Psychol. Aging 7, 242–251. doi: 10.1037//0882-7974.7.2.242
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Walsh, R. (2011). Lifestyle and mental health. Am. Psychol. 66, 579–592. doi: 10.1037/a0021769
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Xiao, L. Q., Zhang, J. Y., Wang, R., Klein, S. A., Levi, D. M., and Yu, C. (2008). Complete transfer of perceptual learning across retinal locations enabled by double training. Curr. Biol. 18, 1922–1926. doi: 10.1016/j.cub.2008.10.030
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Yu, C., Klein, S. A., and Levi, D. M. (2004). Perceptual learning in contrast discrimination and the (minimal) role of context. J. Vis. 4, 169–182. doi: 10.1167/4.3.4
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Zhang, J. Y., Kuai, S. G., Xiao, L. Q., Klein, S. A., Levi, D. M., and Yu, C. (2008). Stimulus coding rules for perceptual learning. PLoS Biol 6:e197. doi: 10.1371/journal.pbio.0060197
Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar
Keywords: working memory, video games, brain training, perceptual learning, game design
Citation: Deveau J, Jaeggi SM, Zordan V, Phung C and Seitz AR (2015) How to build better memory training games. Front. Syst. Neurosci. 8:243. doi: 10.3389/fnsys.2014.00243
Received: 01 November 2014; Accepted: 11 December 2014;
Published online: 09 January 2015.
Edited by:
Mikhail Lebedev, Duke University, USAReviewed by:
Jyoti Mishra, University of California San Francisco, USAMariano Sigman, Universidad Torcuato Di Tella, Argentina
Copyright © 2015 Deveau, Jaeggi, Zordan, Phung and Seitz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Aaron R. Seitz, Department of Psychology, University of California, Riverside, 900 University Ave, Riverside, CA 92521, USA e-mail: aseitz@ucr.edu