What learning theories can teach us in designing neurofeedback treatments

Introduction

“Monkeys meditate for marshmallows”—this is the headline of a report published in the NewScientist in September 2011¹. Philippens and Vanwersch (2010) had trained marmorset monkeys to increase the sensorimotor rhythm (SMR) of their brains. This was the first time after the famous study of Wyrwicka and Sterman (1968) that it was shown that (even) animals are able to learn self-regulation of brain activity. The very latest neurofeedback studies with animals by Schafer and Moore (2011) and Koralek et al. (2012) will be mentioned below. In humans operant conditioning of electrophysiological brain activity was demonstrated by Kamiya (1966, 2011) who successfully taught subjects to increase and decrease the amount of alpha activity. The success of these trials is attributed to the principles of operant conditioning.

If we consider self-regulation as a skill as it is acknowledged in the brain-computer-interface (BCI) research (Lotte et al., 2013) not only operant conditioning but also classical conditioning, the 2 Process-Theory (Lacroix and Gowen, 1981; Lacroix, 1986) and motivational factors have to be taken into account. Table 1 depicts these paradigms, the involved mechanisms and important variables in skill learning. Section “Basics from Learning Theories to be Considered in Designing a Neurofeedback Protocol” refers to the important variables derived from learning theories and their use in designing neurofeedback protocols. If available, corresponding results from neurofeedback studies with clinical populations will be reported. The paper ends with a short glance at studies regarding the neuronal basis and the therapeutic framework of neurofeedback.

TABLE 1

Table 1. Factors involved in acquisition of a skill (after Neumann, 2001, extended and modified).

While the focus of this hypothesis and theory paper is on theoretical basics and clinical studies it has to be pointed to the growing amount of EEG-neurofeedback studies for optimizing performance. Three consecutive reviews report on the cognitive and affective outcomes in healthy adults (Gruzelier, 2014a), creativity (Gruzelier, 2014b) and on methodological and theoretical considerations (Gruzelier, 2014c).

Basics From Learning Theories to be Considered in Designing a Neurofeedback Protocol

This section will examine the “mechanisms” and “important variables” as depicted in Table 1 and describe their impact on the design of learning processes with the aim of self-regulation of physiological variables.

Feedback, Reinforcement and Knowledge of Results

Biofeedback in general is based on real-time feedback of voluntarily induced changes of certain physiological signals. A successful change according to the task is positively reinforced, while failure to change is punished. These basic operant conditioning aspects of biofeedback are harder to access in neurofeedback as there are no receptors to perceive the electrophysiological activity of the brain. The state of the brain can at best be reconstructed by cognitions and emotions. Therefore external feedback is indispensable and it is worth questioning whether self-regulation of brain activity will ever work without any external feedback. The answer can be derived from the animal studies mentioned above. One monkey who increased his SMR activity within 4 sessions of 30 min duration did not receive the reward in the last session. The video shows that he is expecting (and then missing) the marshmallow. He has developed an association between a certain brain activity and its consequences (Philippens and Vanwersch, 2010). Koralek et al. (2012) trained rodents to increase or decrease the pitch of an auditory cursor by 2 different cell assemblies in the primary motor cortex (M1) to either approach sugared water or a food pellet. The tone delivered a continuous feedback of brain activity, which could be rewarded either by food or by sugared water. The rate of correct responses decreased significantly when the feedback was not contingent or when the animals had had free access to the reinforcers before a training session. It was concluded that those “neuroprosthetic skills” were intentionally acquired and goal oriented. The animals changed their behavior (i.e., the activity of certain, distinct cell assemblies) dependent on the reinforcement value of its consequences. The importance of the reinforcement is underlined by Siniatchkin et al. (2000). Children were trained to regulate slow cortical potentials (SCP) and received online wrong feedback but were verbally praised if the trial was successful. From this study as well as from the animal study by Koralek et al. (2012) it may be concluded that positive reinforcement is more important than the operant component of the feedback given!

Contrary to this is what we can derive from the studies regarding the “knowledge of results” by Trowbridge and Cason (1932). Participants were asked to estimate the length of lines. The best results were obtained if quantitative feedback was given, followed by qualitative (“good”, “bad”) feedback. No feedback or senseless syllables yielded the worst results. The best solution is probably the combination of correct feedback and reinforcement. To prevent misunderstandings, the terms “feedback” and “reinforcement” should be differentiated from each other, knowing that feedback is reinforcing in itself. As a consequence a neurofeedback protocol should deliver continuous feedback as regards to the brain activity in question and a positive reinforcement in addition. By scheduling a feedback trial and the subsequent reinforcement the so-called “post-reinforcement synchronization” (PRS) has to be considered. PRS refers to a synchronization of the EEG that was observed in animals (see Sherlin et al., 2011) and in humans (Hallschmid et al., 2002) and is positively correlated with the outcome of learning. With regards to this mechanism, a neurofeedback training session should be discontinuous with many little breaks allowing PRS to take place. According to this, videos or games as feedback seem to be rather unfavorable.

A couple of basic studies, mostly for SCP-Feedback, tried to assess which modality (visual, auditory) and which timing promote learning and whether proportional or binary feedback are preferred. The evidence is rather clear: visual feedback is superior to auditory feedback (Kisil, 1992; Hinterberger et al., 2004), proportional feedback is superior to binary (Travis et al., 1974; Kisil, 1992) and feedback should be as immediate as possible (Kisil and Birbaumer, 1992).

Any of the abovementioned aspects refer not only to the development of the desired behavior but also for undesired behavior. If the system picks up and feeds back behaviors like breathing, eye movements or muscle activity then the patient will learn to demonstrate those behaviors! The outcome is even worse if non-physiological artifacts are fed back. In this case the patient will learn nothing at all because he cannot influence a signal produced e.g., by a faulty electrode. Even worse he will experience loss of control and may develop feelings and cognitions of learned helplessness. As a consequence a proper online artifact-control is mandatory for any equipment.

Shaping and the Question of Threshold Regulation

Shaping in the operant conditioning paradigm refers to the successive approximation to a new behavior, especially skills. Although claimed by authors the automatic threshold regulation in feedback protocols does not correspond to the prerequisites of a shaping process. Automatic threshold regulation was introduced to make sure that a patient is rewarded at least in 60% or 70% of trials (e.g., Lansbergen et al., 2011). By this in a session a performance may be rewarded that is worse than the performance the day before. From a patient’s perspective whatever he does, in 70% of the time or trials he gets positive reinforcement for sure, even if he is doing nothing. In order to establish a shaping process the final goals as well as the breakpoints on the way to the goal have to be defined. Finally a prognosis whether the achievement of the final goal will be enduring and generalize to similar albeit different situations in life. As an example learning to swim will be broken down in steps like overcoming any water fears, being able to imitate certain movements with help, being able to swim in deep water, being able to swim in deep water for at least 10 min…After this goal is reached parents may allow children to swim without their surveillance expecting that the child will not drown. Neither breakpoints nor final goals nor a prognosis are known for neurofeedback. At best norms are available regarding the amount of activity in a certain frequency band as it is assumed for the theta/beta ratio (Montgomery et al. in Demos 1998) but they were assessed during spontaneous EEG measurements, which cannot be simply transferred to brain activity in a (probably demanding) neurofeedback session. Finally, to date there is no knowledge available regarding change in amplitudes during the treatment and its relation to symptom change. Studies that have found a correlation of performance during so called transfer trials will be mentioned in the next section.

The argument brought forward against automatic threshold regulation partly holds for manual and/or individual regulation of thresholds, too. Whenever the participant “earns” too much or not enough reward, the threshold is adjusted, i.e., is set higher or lower. Again, the idea is to guarantee a certain amount of reward to keep the participant motivated. The motivation becomes more important than the quality of the performance. This is a questionable strategy which should be taken into consideration in future studies.

A few cognitive neuroscience studies with healthy subjects have shown a positive correlation with the amount of changes in amplitudes and cognitive performance (for a review see Gruzelier, 2014a). The open question then is the reference for determining “improvement”: pre-training baseline, first session, last session, pre-session baseline…? The nature of the brain signal that is feedback should make a difference. More stationary activity as in the frequency bands may not need a continuous update of the baseline whereas because of their phasic nature SCP should be continuously (i.e., after each trial) updated. Here it might be more adequate to reinforce any change compared to baseline (see Sherlin et al., 2011).

Again only a few studies have assessed the nature of learning in EEG-feedback (for a review see Gruzelier, 2014c). More knowledge as regards to this issue will help to deal with the question of shaping and threshold regulation.

Transfer

The transfer of a skill from the setting in which it was acquired to any situation in life where the skill is needed is an important issue. Delivering feedback after every trial compared to intermittent feedback leads to the fastest learning success in motor learning. In the long run however retaining feedback is more successful. Following this observation, Winstein and Schmidt (1990, cited after Mazur, 2002) developed the “guidance hypothesis”. From the very beginning of training, participants experience the same situation they will be confronted with after the training has ended. In addition, they assume that withholding feedback elicits more efforts in memorizing and supports intrinsic motivation.

In 1901, Thorndike and Woodworth put forward the theory of “context specifity” (Thorndike and Woodworth, 1901). They proposed that the degree to which skills transfer to novel situations depends on the number of elements that are identical between the learning context and the novel situation. From animal research, Cartoni et al. (2013) derived the “Pavlovian-Instrumental Transfer Hypothesis” (PIT). They conclude that a conditioned stimulus that is associated to a reward can affect the operant conditioned behavior in different ways. Firstly, an action directed to a goal needs the right context. This is given, if there are cues (in the novel situation) that indicate (from the old context) higher chances to get a reward. This can be realized if the cues from the lab or practitioner’s office are transferred to the everyday life environment (e.g., classroom) and vice versa if cues from everyday life are transferred to the environment where the training takes place. Secondly, an action may have more or less chances to achieve a goal. Successful actions outside the training environment should be rewarded. Finally, the utility of a behavior in a certain situation is evaluated. According to this, cues should help to discriminate situations in which a certain behavior would be useful or not. An increase of theta e.g., might be useful in order to fall asleep while a decrease might be useful to be concentrated and awake. Cue dependent learning constricts learning to the learning environment as long as the cues are not transferred to everyday life situations. The same holds not only for the newly acquired behavior but also for the old, dysfunctional behaviors. Unfavorable stimulus (classroom)—response (inattentive brain states)—reinforcement (punishment, bad marks) associations have to be changed to favorable ones (classroom-attentive brain states-praise, good marks) by associating cues from the classroom with the acquired behavior. This can be done e.g., by simulation class room situations during the training and by bringing cues from the lab to the classroom. Of course the best place for neurofeedback exercises is the classroom—therefore the development of neurofeedback equipment that can be reliably, validly and safely used in real life situations would help a lot!

If the skill is to be transferred with the help of cues these have to be known. A systematic and thorough behavior analysis will help the patient as well the therapist to become aware of eliciting antecedents, be they environmental, emotional, cognitive, behavioral or physiological variables.

Children with Attention Deficit-/Hyperactivity Disorder (ADHD) may have additional problems transferring newly acquired behavior to everyday life. According to Abikoff (2009) this may be caused by the shortened delay gradient and the inability to anticipate consequences, which in turn affect the perception of cues. Being less able to generalize and to discriminate may compromise the transfer. There are two ways out of this dilemma: if neurofeedback is offered in a cognitive behavior therapy context the therapist can take care of disease specific issues (see Disease), and if the self-regulation is automatized and elicited independently of voluntary action (see next section).

Automation: Practice Makes Perfect

If the self-regulation of brain activity is regarded as a skill automating should be expected as the final aim. The skill is stored in the implicit memory and can be unconsciously retrieved. According to Fitts (1964, cited after Fitts and Posner, 1967) motor learning takes place in three consecutive steps. The “cognitive phase” at the beginning of the process demands a high amount of attentiveness while basis sequences are being learned. The learner will identify by trial and error the correct behavior. During the subsequent “associative” phase the new behavior is practiced, wrong reactions are inhibited if possible. In the end the performance is executed reliably and less attentiveness is needed in this “autonomous, automatic phase”.

The “Two-Process-Theory” (see Table 1) of the acquisition of autonomic control substantiates Fitts’ model. During the cognitive phase the participant tries to identify strategies (see next section) that lead to successful behavior. Thereafter the repeated matching of a reaction and feedback that signals success interoceptive stimuli form an image of a correct reaction, just as shown in the above mentioned monkey meditating for marshmallows. According to Lacroix (1981) biofeedback training leads to autonomic control through a process primarily consisting of the identification of efferent behavioral programs already within the subjects’ repertoire.

In patients with epilepsy who took part in a neurofeedback training of SCP Kotchoubey et al. (2002) showed that self-perception of self-regulation performance developed after patients were successfully able to self-regulate SCPs. Patients who failed in developing self-regulation skills could not correctly estimate their performance. As already mentioned, unlike peripheral motor behavior, electrophysiological activity of the brain is not perceivable. This leads to the question what are the interoceptive stimuli that had been associated with the feedback? Kotchoubey et al. (2002) suggest that changes in the cerebral blood flow, i.e., the extension of receptors of the arterial walls during cortical activation and deactivation might be responsible. Results of a functional imaging study proved an increase of blood flow in different areas of the cortex, depending on the task which was either to produce electrically negative or positive slow potential shifts (Hinterberger et al., 2003). Kotchoubey et al. (2002) provide an alternative explanation by referring to the general control theory. According to this theory subjects perceive operations that are connected with successful control of the cursor (i.e., feedback object) and by this may develop percepts.

Results from long-term studies support the model of skill learning for neurofeedback treatments. After neurofeedback of slow cortical potential patients with ADHD are still able to self-regulate the brain activity 6 months (Leins et al., 2007) and 2 years (Gani et al., 2008) after the end of treatment. In patients with epilepsy successful self-regulation was observed after 1 year (Kotchoubey et al., 2001) and 9 years (Strehl et al., 2014) after the end of treatment. As the activity during activation is more and more concentrated in the area below the sensor this is seen as a further proof for the automation of the skill (Neumann, 2001).

Strategies and instructions

If the self-control is achieved through perception of operations as may be derived from the above mentioned control theory the use of a certain strategy seems to be a possible operation. These strategies are rather easy to choose in the case of feedback of spontaneous EEG activity. The correlation between activation and arousal seem to allow easy access to a certain strategy. Very often participants in a theta-/beta-feedback training are instructed to be relaxed and attentive but there is no systematic data available. The use of strategies for SCPs feedback was investigated by Roberts et al. (1989). It was concluded that there are no valid interindividual strategies known. In SCP feedback participants are asked to self-regulate thresholds of cortical excitation. The slow negative potential shift resembles the contingent negative variation (CNV) which can be observed e.g., in a Go/No go experiment. Here the negative shift is provoked by a warning stimulus in expectation of an imperative stimulus after which the subject has to execute a motor reaction as quickly as possible. Therefore Roberts et al. (1989) expected that the imagination of movement preparation would work as a strategy. This was not confirmed by their study; instead strategies differed from subject to subject and even within the subject in the course of the experiment. Today it is thought that the analogy to the CNV does not work because during the feedback trials no imperative stimulus is given. It was concluded that a strategy is the individually developed percept during the associative phase of successful SCP-regulation Neumann (2001). As a consequence it is recommended not to indicate strategies at all. In a study with healthy participants who had to self-regulate the SMR those subjects who reported to use no specific strategy improved best (Kober et al., 2013). Better within session learning of lateralized SCP regulation was observed in a group with healthy participants who did not receive guidance compared to the group who was told to use emotional strategies. A group by session by block by trial analysis showed no performance differences between the groups (Hardman et al., 1997). The authors assume that vivid strategies might overload cognitive resources and that not being able to name the strategy may indicate a more automatic regulation.

Practice schedules, how much practice and skill decay?

The seemingly simple question regarding the number of sessions comprises several aspects. How many sessions are necessary until the skill is acquired? How many sessions are needed until reduction of symptoms will be observed? How many sessions will be paid (if at all) by the health insurances? Closely connected is the question regarding the training schedule.

Following the theory of reactive inhibition of Hull (1943) spaced practice yields better retention than massed practice. Accordingly Wang et al. (2014) reported significant improvement after 20 sessions spaced working memory training in healthy children compared to massed training (20 sessions in 2, 5 or 10 days). In the absence of any systematic research on these issues for neurofeedback trainings the bridging from basic theory to encompass cognitive training research and neurofeedback protocols is not easy. Considering that neurofeedback sessions normally last 20 to 60 min more than one session per day does not seem to be possible simply for practical reasons. There are two more aspects to consider. Firstly, how big does the interval between 2 sessions has to be in order to declare a training to be spaced—e.g., 1 day or 1 week? Secondly, does it make a difference which system is being trained—cognition, contingencies between behavior and its reinforcement, or a physiological parameter? Arnold et al. (2013) observed no difference in outcome and parents’ satisfaction after two vs. three weekly sessions, although parents preferred the schedule with three sessions a week.

The question regarding the number of sessions refers to the prognosis of learning success. Basically a positive correlation between successful self-regulation and clinical outcome is subsumed. From clinical practice it is well-known that the picture is more complicated. One patient may have succeeded in self-regulation without improving clinically, the other may have improved clinically without being able to self-regulate in a reliable manner, or self-regulation and outcome may correlate. From research it is only known that in neurofeedback protocols including transfer trials where no feedback is given, the performance during transfer trial predicts the clinical outcome (Strehl et al., 2005 for epilepsy patients; Strehl et al., 2006; Drechsler et al., 2007 for children with ADHD). These studies used SCP-protocols. Drechsler et al. (2007) as well as Strehl et al. (2005) used a significant differentiation between tasks (cortical negativation and cortical positivation) as a marker for learning success, while Strehl et al. (2006) chose a significant negative shift from baseline as criterion. A significant correlation between the number of sessions and decrease of symptoms of inattention was reported as a result of a meta-analysis by Arns et al. (2009). The relation between number of sessions and schedule has not been investigated so far.

Blume (2012) showed in her thesis that different studies used diverse criteria such as significant shifts of potentials compared to baseline, a differentiation between parameters (if more than one was trained), number of correct shifts, and duration of the correct shifts as well as a ratio between certain criteria. If “correct” shifts are to be chosen again criteria are needed. Finally it has to be decided which time points should be included as the amount of data produced in any of N sessions is huge. In her analysis of SCP-FB sessions she decided to classify participants as a “learner” if an a- priori defined differentiation and a reliable negativation was shown in the last session. As a result at the follow-up session 6 months after the end of training some children could now be labeled as a “learner” who were previously classified as a “non-learner”. It was concluded that the learning is ongoing and learning success cannot be predicted from the performance during the sessions. If these results can be replicated and proven to be clinically valid other criteria have to be developed in order to allow an early prognosis. For a small sample of children with ADHD it was demonstrated that the reduction of symptoms of inattention correlated positively with the change of mean amplitudes of negative shifts during training session 5 and 9, but not in session 13, due to an increase in negativities in children with poor outcome (Gevensleben et al., 2014). The authors hypothesize that these children might have needed a prolonged training. Searching for predictors within the training performance would help to individually tailor the treatment.

According to Singer (1980) learning curves in motor learning show that the task, its difficulty, duration and number of repetitions as well as individual variables influence the learning progress. The impact of individual variables is demonstrated in the so-called “overtraining” (Kreider et al., 1998, cited after Blume, 2012). The extent to which practice can lead to further improvement decreases with the extent of practice. Too many sessions may be disadvantageous if a participant is a quick learner. Blume (2012) observed participants who fulfilled the criteria as “learner” rather early after 12 sessions and fell off in quality after the second training phase containing 13 more sessions. In the follow-up evaluation they showed a good performance again. It is concluded that speed of learning differs in individuals possibly according to age, maturation of brain, stress vulnerability and / or cortical functioning (see below—individual factors).

Although skills can last a lifetime they do deteriorate with non-use. As mentioned above according to follow-up studies after SCP-feedback in epilepsy and ADHD, patients not only continued to improve clinically after the end of treatment, self-regulation of brain activity was improved or sustained. It may be concluded that learning does not stop with the last session. By using the self-regulation skill in everyday life patients are being reinforced to be less hyperactive, impulsive and inattentive. This in turn consolidates the behavior while unfavorable brain activity is being extinguished. The skill is used automatically whenever it is needed—in the end it can be assumed that the functioning of the brain has changed.

Individual Variables

The acquisition of the skill to self-regulate brain activity is not only based on certain rules or laws of learning. As already mentioned in the last section, individual variables have to be taken into account, too.

Motivation

According to Hofmann et al. (2012) participants need sufficient motivation to invest effort to overcome the discrepancy between the gap between actual and potential performance and obstacles and temptations along the way. Achievement motivation as hope for success or fear of failure and attribution styles are individual variables that might influence the intrinsic as well as the extrinsic motivation. There is limited data on the impact of these variables from neurofeedback and BCI-research available. Witte et al. (2013) observed in healthy participants that control beliefs as regards to technology correlated negatively with the ability to self-regulate SMR. It is assumed that a locus of control might lead to emotional or cognitive overload, which negatively influences the performance.

Intrinsic motivation can be spoiled by inflated praise (Brummelman et al., 2014) and may be enhanced by feedback, which draws attention to a skill without making a judgment about the individual or reporting on feelings. As a general rule an inherently interesting or enjoyable task promotes intrinsic motivation. Therefore it is discussed how to offer feedback sessions to be as interesting as possible. The succession of repeated trials seems to be contraindicated. Trainer or therapists sometimes ask for protocols that use different levels of expertise, similar to computer games. This analogy does not work because self-regulation of brain activity does not improve in a linear manner. As in any motor learning it is not the animation that leads to an improved technique. Instead the execution of the correct behavior (guided by the trainer) is reinforcing in itself. For patients with ADHD it is known that they may perform very well if the task is entertaining, however when facing monotonous tasks the symptoms become obvious. As a consequence a boring training would simulate difficult situations in everyday life. On the other hand loss of motivation has to be avoided—a difficult tightrope walk. Again the therapist is responsible in guiding the treatment and helping the patient to overcome frustration and moments of boredom.

Cognition

Results on the impact of cognitive variables as memory or attention are not consistent (Daum et al., 1993; Holzapfel, 1998). Intelligence did not turn out to be a prerequisite of successful self-regulation in Holzapfel et al. (1998) who treated a patient with an IQ below 80.

With regards to brain resources, Wangler et al. (2011) showed that in children with ADHD a larger CNV before training predicted a bigger improvement after training.

Disease

Factors being correlated with a disease might influence the performance, too. In locked-in patients with Amyothrophic Lateral Sclerosis (ALS) e.g., moods, bodily complaints, and quality of care influence the performance (Neumann, 2001).

For many years it was assumed that patients with an impairment of executive functions would not be able to learn self-regulation. Maintenance and updating of relevant information, inhibition of irrelevant impulses and mental set shifting are features of the working memory which are necessary for self-regulation (Hofmann et al., 2012). Although they are impaired e.g., in patients with ADHD, results from neurofeedback treatments show, that these patients nevertheless successfully complete the training (e.g., Strehl et al., 2006; Mayer et al., 2012).

In some diseases the typical symptoms may prevent taking part in neurofeedback training. For example an autistic child will not allow being touched or to having electrodes fixed on head and face. In this case a well-trained therapist will implement a shaping program in order to establish trust and compliance.

Neuronal Basis of Neurofeedback Learning

Due to the use of intracranial electrodes, the latest animal studies deliver insight into the neuronal basis of neurofeedback learning. According to Koralek et al. (2012) striatal neurons change their firing rates and build strong connections with motor cortex neurons. If by experimental manipulations these connections cannot develop the animal is not able to learn the skill. The authors conclude that corticostriatal plasticity is the basis not only for abstract skill learning but also for learning intentional neuroprosthetic skills in the absence of movements.

The specificity of neurofeedback was proven by Schafer and Moore (2011). Rhesus monkeys learned to voluntary reduce or enhance the activity of neurons within the frontal eye field. The pitch of a tone was used as feedback and juice was given as reinforcement. This operant conditioned behavior was associated with improved selective visual attention. The authors suggest that the specific association of self-regulated neural activity with top-down attention may constitute a basis for the observed improvements in patients with ADHD after neurofeedback.

Conclusion: Neurofeedback and Psychotherapy

Neurofeedback is not a magic box easily delivered to the patient. Neurofeedback as well as biofeedback for patients will always take place within a patient—therapist interaction. “My experience with years of biofeedback training with various physiological modalities leaves me with the conviction that a very large portion of the total influences on learning is bio-social in nature, testifying to the evolution of the species as a social species. Though seldom discussed in the scientific literature, the nature of interpersonal relations between trainer and trainee are often decisive for learning progress.” (Kamiya, unpublished, retrieved in Neumann, 2001, p. 32).

The equipment is a tool within this interaction, neurofeedback is a method of behavior therapy. As in any other behavior therapy the therapist initiates and helps through a process during which the patient may learn a new behavior that helps to overcome his symptoms. Different from the usual bottom-up targets in behavior therapy, which are overt behavior, cognitions and emotions, neurofeedback tries to directly change cortical activity. But with the help of the equipment brain activity becomes overt, too. The therapist will need to know the laws of learning as well as how to applicate neurofeedback training in order to be a competent partner in this top-down behavior therapy approach.

Conflict of Interest Statement

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

This paper is a translated and revised version of: Strehl, U., Lerntheoretische Grundlagen und Überlegungen zum Neurofeedback (see References; Strehl, 2013)—with friendly permission by Kohlhammer Verlag, Stuttgart. I acknowledge support by Deutsche Forschungsgemeinschaft and Open Access Publishing Fund of Tuebingen University. The author’s research is funded by the Deutsche Forschungsgemeinschaft (Ho 2503/4-1, Ho 2503/4-2, STR 597/7-1). Thanks to Katrina Heine for her help in editing this manuscript in English.

Footnotes

1. ^ http://www.newscientist.com/article/dn20989-monkeys-meditate-for-marshmallows.html

References

Abikoff, H. (2009). ADHD psychosocial treatments: generalization reconsidered. J. Atten. Disord. 13, 207–210. doi: 10.1177/1087054709333385

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Arnold, L. E., Lofthouse, N., Hersch, S., Pan, X., Hurt, E., Bates, B., et al. (2013). EEG neurofeedback for ADHD: double-blind sham-controlled randomized pilot feasibility trial. J. Atten. Disord. 17, 410–419. doi: 10.1177/1087054712446173

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Arns, M., de Ridder, S., Strehl, U., Breteler, M., and Coenen, A. (2009). Efficacy of neurofeedback treatment in ADHD: the effects on inattention, impulsivity and hyperactivity: a meta-analysis. Clin. EEG Neurosci. 40, 180–189. doi: 10.1177/155005940904000311

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Blume, F. (2012). Neurofeedbacktraining bei Kindern mit einer Aufmerksamkeitsdefizit-/Hyperaktivitätsstörung (ADHS): Eine Untersuchung der Trainingsverläufe mit dem Versuch der Klassifikation von Lernern und Nicht-Lernern. Thesis published in Tübingen: Eberhard-Karls-Universität Tübingen.

Brummelman, E., Thomaes, S., Orobio de Castro, B., Overbeek, G., and Bushman, B. J. (2014). “That’s not just beautiful—that’s incredibly beautiful!”: the adverse impact of inflated praise on children with low self-esteem. Psychol. Sci. 25, 728–735. doi: 10.1177/0956797613514251

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Cartoni, E., Puglisi-Allegra, S., and Baldassarre, G. (2013). The three principles of action: a Pavlovian-instrumental transfer hypothesis. Front. Behav. Neurosci. 7:153. doi: 10.3389/fnbeh.2013.00153

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Daum, I., Rockstroh, B., Birbaumer, N., Elbert, T., Canavan, A., and Lutzenberger, W. (1993). Behavioral treatment of slow cortical potentials in intractable epilepsy: neuropsychological predictors of outcome. J. Neurol. Neurosurg. Psychiatry 56, 94–97. doi: 10.1136/jnnp.56.1.94

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Drechsler, R., Straub, M., Doehnert, M., Heinrich, H., Steinhausen, H. C., and Brandeis, D. (2007). Controlled evaluation of a neurofeedback training of slow cortical potentials in children with Attention Deficit/Hyperactivity Disorder (ADHD). Behav. Brain Funct. 3:35. doi: 10.1186/1744-9081-3-35

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Fitts, P. M. (1964). “Perceptual-motor skill learning,” in Categories of Human Learning, ed A. W. Melton (New York: Academic Press), 243–285.

Google Scholar

Fitts, P. M., and Posner, M. I. (1967). Human Performance. Belmont: Wadsworth Publishing Company.

Google Scholar

Gani, C., Birbaumer, N., and Strehl, U. (2008). Long term effects after feedback of slow cortical potentials and of theta-beta-amplitudes in children with attention-deficit/hyperactivity disorder (ADHD). Int. J. Bioelectromagn. 10, 209–232.

Gevensleben, H., Kleemayer, M., Rothenberger, L. G., Studer, P., Flaig-Röhr, A., Moll, G. H., et al. (2014). Neurofeedback in ADHD: further pieces of the puzzle. Brain Topogr. 27, 20–32. doi: 10.1007/s10548-013-0285-y

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Gruzelier, J. H. (2014a). EEG-neurofeedback for optimising performance. I: a review of cognitive and affective outcome in healthy participants. Neurosci. Biobehav. Rev. 44, 124–141. doi: 10.1016/j.neubiorev.2013.09.015

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Gruzelier, J. H. (2014b). EEG-neurofeedback for optimising performance. II: creativity, the performing arts and ecological validity. Neurosci. Biobehav. Rev. 44, 142–158. doi: 10.1016/j.neubiorev.2013.11.004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Gruzelier, J. H. (2014c). EEG-neurofeedback for optimising performance. III: a review of methodological and theoretical considerations. Neurosci. Biobehav. Rev. 44, 159–182. doi: 10.1016/j.neubiorev.2014.03.015

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hallschmid, M., Mölle, M., Fischer, S., and Born, J. (2002). EEG synchronization upon reward in man. Clin. Neurophysiol. 113, 1059–1065. doi: 10.1016/s1388-2457(02)00142-6

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hardman, E., Gruzelier, J., Cheesman, K., Jones, C., Liddiard, D., Schleichert, H., et al. (1997). Frontal interhemispheric asymmetry: self regulation and individual differences in humans. Neurosci. Lett. 221, 117–120. doi: 10.1016/s0304-3940(96)13303-6

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hinterberger, T., Neumann, N., Pham, M., Kübler, A., Grether, A., Hofmayer, N., et al. (2004). A multimodal brain-based feedback and communication system. Exp. Brain Res. 154, 521–526. doi: 10.1007/s00221-003-1690-3

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hinterberger, T., Veit, R., Strehl, U., Trevorrow, T., Erb, M., Kotchoubey, B., et al. (2003). Brain areas activated in fMRI during self-regulation of slow cortical potentials (SCPs). Exp. Brain Res. 152, 113–122. doi: 10.1007/s00221-003-1515-4

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hofmann, W., Schmeichel, B. J., and Baddeley, A. D. (2012). Executive functions and self-regulation. Trends Cogn. Sci. 16, 174–180. doi: 10.1016/j.tics.2012.01.006

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Holzapfel, S. (1998). PräDiktoren der Selbstregulation der Langsamen Hirnpotentiale bei Epilepsie. Tübingen: Eberhard-Karls-Universität Tübingen.

Holzapfel, S., Strehl, U., Kotchoubey, B., and Birbaumer, N. (1998). Behavioral psychophysiological intervention in a mentally retarded epileptic patient with brain lesion. Appl. Psychophysiol. Biofeedback 23, 189–202. doi: 10.1023/A:1022299422116

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Hull, C. L. (1943). Principles of Behavior. New York: Appleton-Century-Crofts.

Google Scholar

Kamiya, J. (1966). Trained Control of EEG Alpha Frequency in Humans. Invited presentation, California: Stanford University, Palo Alto.

Kamiya, J. (2011). The first communications about operant conditioning of the EEG. J. Neurother. 15, 65–73. doi: 10.1080/10874208.2011.545764

CrossRef Full Text | Google Scholar

Kisil, A. (1992). Rückmeldung und Modifikation Langsamer Hirnrindenpotentiale. Dissertation Tübingen: Eberhard-Karls-Universität Tübingen.

Kisil, A., and Birbaumer, N. (1992). Biofeedback langsamer Hirnpotentiale. Z. Exp. Angew. Psychol. 39, 216–228.

Google Scholar

Kober, S. E., Witte, M., Ninaus, M., Neuper, C., and Wood, G. (2013). Learning to modulate one’s own brain activity: the effect of spontaneous mental strategies. Front. Hum. Neurosci. 7:695. doi: 10.3389/fnhum.2013.00695

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Koralek, A. C., Jin, X., Long, J. D. 2nd, Costa, R. M., and Carmena, J. M. (2012). Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 483, 331–335. doi: 10.1038/nature10845

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Kotchoubey, B., Kübler, A., Strehl, U., Flor, H., and Birbaumer, N. (2002). Can humans perceive their brain states? Conscious. Cogn. 11, 98–113. doi: 10.1006/ccog.2001.0535

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Kotchoubey, B., Strehl, U., Uhlmann, C., Holzapfel, S., König, M., Fröscher, W., et al. (2001). Modification of slow cortical potentials in patients with refractory epilepsy: a controlled outcome study. Epilepsia 42, 406–416. doi: 10.1046/j.1528-1157.2001.22200.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Kreider, R., Fry, A., and O’Toole, M. (1998). Overtraining in Sport. Champaign, Illinois: Human Kinetics-Verlag.

Google Scholar

Lacroix, J. M. (1981). The acquisition of autonomic control through biofeedback: a case against an afferent process and a two-process alternative. Psychophysiology 18, 573–587. doi: 10.1111/j.1469-8986.1981.tb01828.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Lacroix, J. M. (1986). “Mechanisms of biofeedback control,” in Consciousness and Self-Regulation, eds D. Shapiro and G. E. Schwartz (New York: Plenum), S.137–S.162.

Google Scholar

Lacroix, J. M., and Gowen, A. H. (1981). The acquisition of autonomic control through biofeedback: some tests of discrimination theory. Psychophysiology 18, 559–572. doi: 10.1111/j.1469-8986.1981.tb01826.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Lansbergen, M. M., van Dongen-Boomsma, M., Buitelaar, J. K., and Slaats-Willemse, D. (2011). ADHD and EEG-neurofeedback: a double-blind randomized placebo-controlled feasibility study. J. Neural Transm. 118, 275–284. doi: 10.1007/s00702-010-0524-2

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Leins, U., Goth, G., Hinterberger, T., Klinger, C., Rumpf, N., and Strehl, U. (2007). Neurofeedback for children with ADHD: a comparison of SCP and Theta/Beta protocols. Appl. Psychophysiol. Biofeedback 32, 73–88. doi: 10.1007/s10484-007-9031-0

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Lotte, F., Larrue, F., and Mühl, C. (2013). Flaws in current human training protocols for spontaneous brain-computer-interfces: lessons learned from instructional design. Front. Hum. Neurosci. 7:568. doi: 10.3389/fnhum.2013.00568

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Mayer, K., Wyckoff, S. N., Schulz, U., and Strehl, U. (2012). Neurofeedback for Adult Attention-Deficit/Hyperactivity Disorder: Investigation of Slow Cortical Potential Neurofeedback—Preliminary Results. J. Neurother. 16, 37–45. doi: 10.1080/10874208.2012.650113

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Mazur, J. E. (2002). Learning and Behavior. United Kingdom: Pearson Education Limited.

Google Scholar

Montgomery, D. D., Robb, J., Dwyer, V., and Gontkovsky, S. T. (1998). Single channel EEG amplitudes in a bright, normal young adult sample. J. Neurotherapy 2, 1–7. doi: 10.1300/J184v02n04_01

CrossRef Full Text | Google Scholar

Neumann, N. (2001). Gehirn-Computer-Schnittstelle: Einflussfaktoren der Selbstregulation Langsamer Kortikaler Hirnpotentiale. Dissertation Tübingen: Schwäbische Verlagsgesellschaft.

Philippens, I. H., and Vanwersch, R. A. (2010). Neurofeedback training on sensorimotor rhythm in marmoset monkeys. Neuroreport 21, 328–332. doi: 10.1097/WNR.0b013e3283360ba8

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Roberts, L. E., Birbaumer, N., Rockstroh, B., Lutzenberger, W., and Elbert, T. (1989). Self-report during feedback regulation of slow cortical potentials. Psychophysiology 26, 392–403. doi: 10.1111/j.1469-8986.1989.tb01941.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Schafer, R. J., and Moore, T. (2011). Selective attention from voluntary control of neurons in prefrontal cortex. Science 332, 1568–1571. doi: 10.1126/science.1199892

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Sherlin, L. H., Arns, M., Lubar, J., Heinrich, H., Kerson, C., Strehl, U., et al. (2011). Neurofeedback and basic learning theory: implications for research and practice. J. Neurother. 15, 292–304. doi: 10.1080/10874208.2011.623089

CrossRef Full Text | Google Scholar

Singer, R. N. (1980). Motor Learning and Human Performance. USA: Macmillan.

Siniatchkin, M., Kropp, P., and Gerber, W. D. (2000). Neurofeedback—the significance of reinforcement and the search for an appropriate strategy for the success of self-regulation. Appl. Psychophysiol. Biofeedback 25, 167–175. doi: 10.1023/A:1009502808906

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Strehl, U. (ed) (2013). “Lerntheoretische grundlagen und überlegungen zum neurofeedback,” in Neurofeedback (Stuttgart: Kohlhammer), 13–30.

Strehl, U., Birkle, S. M., Wörz, S., and Kotchoubey, B. (2014). Sustained reduction of seizures in patients with intractable epilepsy after self-regulation training of slow cortical potentials—10 years after. Front. Hum. Neurosci. 8:604. doi: 10.3389/fnhum.2014.00604

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Strehl, U., Kotchoubey, B., Trevorrow, T., and Birbaumer, N. (2005). Predictors of seizure reduction after self-regulation of slow cortical potentials as a treatment of drug-resistant epilepsy. Epilepsy Behav. 6, 156–166. doi: 10.1016/j.yebeh.2004.11.004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Strehl, U., Leins, U., Goth, G., Klinger, C., Hinterberger, T., and Birbaumer, N. (2006). Self-regulation of slow cortical potentials—a new treatment for children with attention-deficit/hyperactivity disorder. Pediatrics 118, e1530–e1540. doi: 10.1542/peds.2005-2478

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Thorndike, E. L., and Woodworth, R. S. (1901). The influence of improvement in one mental function upon the efficiency of other functions (I). Psychol. Rev. 8, 247–261. doi: 10.1037/h0074898

CrossRef Full Text | Google Scholar

Travis, T. A., Kondo, C. Y., and Knott, J. R. (1974). Parameters of eyes-closed alpha enhancement. Psychophysiology 11, 674–681. doi: 10.1111/j.1469-8986.1974.tb01136.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Trowbridge, M. H., and Cason, H. (1932). An experimental study of Thorndike’s theory of learning. J. Gen. Psychol. 7, 245–260. doi: 10.1080/00221309.1932.9918465

CrossRef Full Text | Google Scholar

Wang, Z., Zhou, R., and Shah, P. (2014). Spaced cognitive training promotes transfer. Front. Hum. Neurosci. 8:217. doi: 10.3389/fnhum.2014.00217

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Wangler, S., Gevensleben, H., Albrecht, B., Studer, P., Rothenberger, A., Moll, G. H., et al. (2011). Neurofeedback in children with ADHD: specific event-related potential findings of a randomized controlled trial. Clin. Neurophysiol. 122, 942–950. doi: 10.1016/j.clinph.2010.06.036

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Winstein, C. J., and Schmidt, R. A. (1990). Reduced frequency of knowledge of results enhances motor skill learning. J. Exp. Psychol. Learn. Mem. Cogn. 16, 677–691. doi: 10.1037//0278-7393.16.4.677

CrossRef Full Text | Google Scholar

Witte, M., Kober, S. E., Ninaus, M., Neuper, C., and Wood, G. (2013). Control beliefs can predict the ability to up-regulate sensorimotor rhythm during neurofeedback training. Front. Hum. Neurosci. 7:478. doi: 10.3389/fnhum.2013.00478

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text | Google Scholar

Wyrwicka, W., and Sterman, M. B. (1968). Instrumental conditioning of sensorimotor cortex EEG spindles in the waking cat. Physiol. Behav. 3, 703–707. doi: 10.1016/0031-9384(68)90139-x

CrossRef Full Text | Google Scholar