Skip to main content

REVIEW article

Front. Aging Neurosci., 22 June 2016
Sec. Parkinson’s Disease and Aging-related Movement Disorders
Volume 8 - 2016 | https://doi.org/10.3389/fnagi.2016.00147

Prodromal Markers in Parkinson’s Disease: Limitations in Longitudinal Studies and Lessons Learned

Sebastian Heinzel1,2*† Benjamin Roeben1,2† Yoav Ben-Shlomo3 Stefanie Lerche1,2 Guido Alves4 Paolo Barone5 Stefanie Behnke6 Henk W. Berendse7 Bastiaan R. Bloem8 David Burn9 Richard Dodel10 Donald G. Grosset11 Michele Hu12 Meike Kasten13 Rejko Krüger14 Marcello Moccia5 Brit Mollenhauer15,16 Wolfgang Oertel10 Ulrike Suenkel1,2 Uwe Walter17 Karin Wirdefeldt18 Inga Liepelt-Scarfone1,2 Walter Maetzler1,2 Daniela Berg1,2,19
  • 1Department of Neurodegeneration, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
  • 2German Center for Neurodegenerative Diseases, University of Tübingen, Tübingen, Germany
  • 3School of Social and Community Medicine, University of Bristol, Bristol, UK
  • 4Norwegian Centre for Movement Disorders and Department of Neurology, Stavanger University Hospital, Stavanger, Norway
  • 5Center for Neurodegenerative Diseases (CEMAND), Neuroscience Section, Department of Medicine, University of Salerno, Salerno, Italy
  • 6Department of Neurology, University of Homburg, Homburg, Germany
  • 7Department of Neurology and Neuroscience Campus Amsterdam, VU University Medical Centre, Amsterdam, Netherlands
  • 8Radboud University Medical Center, Donders Institute for Brain, Cognition and Behavior, Department of Neurology, Nijmegen, Netherlands
  • 9Institute of Neuroscience, Newcastle University, Newcastle Upon Tyne, UK
  • 10Department of Neurology, Philipps-University Marburg, Marburg, Germany
  • 11Institute of Neurological Sciences, Queen Elizabeth University Hospital, Glasgow, UK
  • 12Oxford Parkinson’s Disease Centre and Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
  • 13Institute of Neurogenetics, University of Lübeck, Lübeck, Germany
  • 14Clinical and Experimental Neuroscience, Luxembourg Center for Systems Biomedicine, Belva, Luxembourg
  • 15Paracelsus-Elena-Klinik, Kassel, Germany
  • 16Department of Neuropathology, University Medical Center, Göttingen, Germany
  • 17Department of Neurology, University of Rostock, Rostock, Germany
  • 18Department of Medical Epidemiology and Biostatistics and Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
  • 19Department of Neurology, Christian-Albrechts-University, Kiel, Germany

A growing body of evidence supports a prodromal neurodegenerative process preceding the clinical onset of Parkinson’s disease (PD). Studies have identified several different prodromal markers that may have the potential to predict the conversion from healthy to clinical PD but use considerably different approaches. We systematically reviewed 35 longitudinal studies reporting prodromal PD features and evaluated the methodological quality across 10 different predefined domains. We found limitations in the following domains: PD diagnosis (57% of studies), prodromal marker assessments (51%), temporal information on prodromal markers or PD diagnosis (34%), generalizability of results (17%), statistical methods (accounting for at least age as confounder; 17%), study design (14%), and sample size (9%). However, no limitations regarding drop-out (or bias investigation), or report of inclusion/exclusion criteria or prodromal marker associations were revealed. Lessons learned from these limitations and additional aspects of current prodromal marker studies in PD are discussed to provide a basis for the evaluation of findings and the improvement of future research in prodromal PD. The observed heterogeneity of studies, limitations and analyses might be addressed in future longitudinal studies using a, yet to be established, modular minimal set of assessments improving comparability of findings and enabling data sharing and combined analyses across studies.

Introduction

Parkinson’s disease (PD) is the second most prevalent neurodegenerative disorder. PD is characterized by motor features of resting tremor, bradykinesia, rigidity, and postural instability, but also non-motor symptoms (e.g., hyposmia, depression, autonomic dysfunction) are common in PD patients (Chaudhuri et al., 2006; Jankovic, 2008). However, by the time motor symptoms allow a clinical diagnosis of PD an extensive loss of dopaminergic nigrostriatal neurons will already have taken place due to an ongoing neurodegenerative process spanning years or even decades (Bernheimer et al., 1973; Marek et al., 2001). Several clinical markers have been suggested to indicate this early “prodromal” progressive degenerative process preceding the clinical diagnosis of PD (Gonera et al., 1997; Lang, 2011; Stern et al., 2012). Such prodromal markers include motor as well as non-motor symptoms. For instance, subtle motor signs of the cardinal motor symptoms of PD have been shown to be more frequent in incident PD patients than in controls (Berg et al., 2013b). In addition, a number of non-motor symptoms such as constipation, urinary dysfunction (Schrag et al., 2015), olfactory dysfunction (Ross et al., 2008), depression, anxiety (Schrag et al., 2015), and sleep disorders (Gao et al., 2011b; Postuma et al., 2015), have been shown to occur before the diagnosis of PD (see Figure 1 for a graphical illustration of the concept of prodromal PD). Importantly, prodromal markers of PD could enable an early detection of PD and possibly more effective or even preventive early treatments of the disease.

FIGURE 1
www.frontiersin.org

Figure 1. Graphical illustration of the prodromal phase with early neurodegenerative changes occurring years or even decades before the clinical diagnosis of Parkinson’s disease (PD) can be made. Risk markers may increase the PD risk without directly being associated with neurodegenerative changes. Only slight loss of neurons due to the normal aging process can be detected in this phase. Prodromal markers represent indicators of the early neurodegenerative process in which neuronal loss is accelerated. This phase may ultimately lead to PD. Risk markers increase the likelihood that an individual may enter the prodromal phase and may finally develop motor PD. Prodromal markers may indicate the ongoing neurodegenerative process and may help to identify those individuals who will likely develop PD in the future.

While numerous longitudinal cohort studies support the concept of prodromal PD and prodromal markers (e.g., Abbott et al., 2001; Postuma et al., 2015; Schrag et al., 2015), the comparability of study results is hampered by methodological differences (Lerche et al., 2015), such as design, type of assessments and analytical methods. Furthermore, limitations of individual studies might additionally affect comparability and interpretation of findings. However, limitations in these prodromal marker studies have not yet been systematically reviewed. Therefore, we performed a systematic review of published longitudinal studies investigating prodromal markers in PD to examine the methodological quality of these studies and to identify key areas that could be improved in future research.

Materials and Methods

Search Criteria

This systematic review focuses on longitudinal studies in the prodromal phase of PD. We defined prodromal markers as indicators of an ongoing neurodegenerative process in the central or peripheral nervous system prior to the typical symptoms allowing a clinical diagnosis, in our case PD. In contrast, risk factors are associated with an increased risk of developing PD, which themselves are not a sign of an ongoing neurodegenerative process and may never lead to it (e.g., pesticide exposure).

We acknowledge that the attribution of a factor to risk and/or prodromal marker categories is sometimes difficult and disputed (e.g., smoking habit). We therefore decided to use a pragmatic approach based on the definitions used by the study authors themselves, rather than impose our own definition.

We searched the literature following a two step-approach in order to identify studies reporting prodromal marker associations preceding the diagnosis of PD. First, we employed a PubMed database search (November 2014) for articles in English using the search term: “prodromal” and “PD” and “longitudinal”. Second, we performed a MEDLINE search (October 2015) for publications missed so far, which identified studies using the terms “prediagnostic”, “preclinical”, “premotor” or “prodromal”, and “Parkinson” (for query details see the “Supplementary Material”).

We disregarded markers of the “nascent sciences” (e.g., protein levels), neuro-imaging except transcranial sonography (TCS), which can be very easily applied in neurodegenerative disorders, or behavioral habits that could be due to personality traits (e.g., smoking). Inclusion criteria comprised: (1) studies providing data with the endpoint of new onset PD, i.e., the conversion from healthy to PD, were considered; (2) assessment of at least one prodromal symptom at the baseline investigation; and (3) for multiple publications of the same prodromal marker in the same cohort, the study with the largest sample size or, if equal, the longest follow-up was selected. We excluded: (a) study designs other than longitudinal (e.g., cross-sectional); (b) studies focusing on risk factors; (c) studies in which the majority of converters developed parkinsonism other than idiopathic PD; (d) PD treatment/intervention studies; (e) non-human studies; and (f) review articles, book chapters, editorials, commentaries, hypothesis articles, meta-analyses, and abstracts.

The initial PubMed search listed 292 publications. Of these, 251 were excluded after screening of abstracts for the exclusion criteria above. Here, often multiple reasons for exclusion applied (e.g., molecular marker, cross-sectional, non-human) and we therefore resigned from describing the individual reasons for exclusion of the respective studies in detail. After full text screening of 41 articles, 14 additional publications were excluded while 28 articles were found to be eligible for inclusion in the review. The MEDLINE search listed 1144 publications and after abstract screening seven additional articles were identified that had been missed in the initial PubMed search. Full text screening of these seven articles did not lead to further exclusions. In total, 35 eligible publications of longitudinal studies investigating prodromal markers in PD were included and systematically reviewed for limitations. However, the evaluation of specific prodromal marker associations or their comparison between studies was not in the scope of this systematic review.

Limitations of Studies

A specific set of criteria or limitations to be considered for the evaluation of longitudinal studies in prodromal PD has not been established. Yet, for the interpretation of reported prodromal marker associations, numerous and partly marker specific aspects may have to be considered. As a starting point, we used evidence-level criteria (Edlund et al., 2004; Maetzler et al., 2009; originally designed by the American Academy of Neurology (AAN) for intervention study evaluation) comprising five more generic aspects. We complemented this list of limitation categories by methodological and informative aspects more specific to longitudinal studies in prodromal PD. In total, 10 different limitation categories were defined:

(1) Study design: we regarded prospective cohort studies, historical cohort and “nested” case-control studies as the most valid study designs, where participants belonged to an explicit cohort and prodromal marker data had been already collected prior to disease onset. Conventional case-control studies or other designs were regarded as methodologically weaker and therefore fulfilled the criterion for this limitation. We also indicated whether studies were population-based or clinical cohorts, but we did not include this aspect in the evaluation of limitations.

(2) No clearly stated inclusion or exclusion criteria; (3) no adequate accounting for drop-outs (or investigation of potential drop-out bias) in studies with less than 80% of enrolled subjects at follow-up; (4) insufficient number of participants (for prospective cohort studies, historical cohort and “nested” case-control studies: n < 50 at baseline, for retrospective and conventional case-control studies: n < 100); (5) no presentation of effects indicated by odds ratio (OR), relative risk (RR), hazard ratio (HR), likelihood ratio (LR), sensitivity/specificity, or lack of clear descriptive results from which such effects could be calculated. Mere t-test results or reported P-values were considered insufficient.

We considered five additional limitation criteria, which are specifically relevant for the evaluation of reported prodromal marker associations; (6) diagnosis of idiopathic PD by non-specialists in movement disorders, only probable PD diagnosis or uncertainties regarding the parkinsonian disease status in “healthy” individuals at baseline; (7) limitations in prodromal marker assessments (e.g., self-reports, marker diagnosis by non-specialists); (8) reduced generalizability of findings (e.g., only males); (9) limitations of statistical analyses, e.g., no appropriate accounting for confounders (at least: age) in the design or analysis; and (10) absent or limited data on the temporal sequence, e.g., duration of marker presence at baseline, or latency period between exposure measurement and onset of PD.

Results

Descriptive Results

The 35 reviewed studies assessed the following prodromal markers: five studies investigated sleep disturbances (three Rapid eye movement sleep Behavior Disorder (RBD) (Schenck et al., 1996; Iranzo et al., 2014; Postuma et al., 2015), two daytime sleep (Abbott et al., 2005; Gao et al., 2011b)), three hyposmia (Haehner et al., 2007; Ross et al., 2008; Ponsen et al., 2010), three constipation (Abbott et al., 2001; Savica et al., 2009; Gao et al., 2011a), three cardiac function (i.e., cardiac stress test performance (Palma et al., 2013; Yahalom et al., 2014)), cardiac disease (Jain et al., 2012), one cognitive deficits (Sánchez-Ferro et al., 2013), one pain (Lin et al., 2013), one vital exhaustion (Clark et al., 2013), 10 anxiety/depression (three anxiety (Weisskopf et al., 2003; Bower et al., 2010; Lin et al., 2015), five depression (Leentjens et al., 2003; Fang et al., 2010; Shen et al., 2013; Gustafsson et al., 2015; Walter et al., 2015), two anxiety/depression (Ishihara-Paul et al., 2008; Jacob et al., 2010)), one erectile dysfunction (Gao et al., 2007), one transcranial sonography substantia nigra hyperechogenicity (TCS SN+; Berg et al., 2013a), and six studies (Gonera et al., 1997; Gaenslen et al., 2011; Berg et al., 2013b; Lerche et al., 2014; Plouvier et al., 2014; Schrag et al., 2015) assessed several prodromal markers or marker combinations without a primary focus on a particular prodromal marker.

Of the 35 studies, 28 (80%) comprised population-based samples or medical register data and 7 (20%) clinical cohorts. Study details including study design, markers, sample size, temporal information, prodromal marker effects, and limitations are given in the Supplementary material.

Limitations in Studies on Prodromal Markers in PD

Study Design

Five (14%) studies showed limitations in study design (two retrospective studies (Shen et al., 2013; Lin et al., 2015) and three conventional case-control studies (Gonera et al., 1997; Jacob et al., 2010; Gaenslen et al., 2011)). The other studies were prospective cohort studies (n = 22; 63%; Schenck et al., 1996; Abbott et al., 2001, 2005; Weisskopf et al., 2003; Gao et al., 2007, 2011a,b; Haehner et al., 2007; Ishihara-Paul et al., 2008; Ross et al., 2008; Bower et al., 2010; Ponsen et al., 2010; Jain et al., 2012; Berg et al., 2013a,b; Clark et al., 2013; Lin et al., 2013; Sánchez-Ferro et al., 2013; Iranzo et al., 2014; Lerche et al., 2014; Postuma et al., 2015; Walter et al., 2015), or nested case-control studies (n = 8; 23%; Leentjens et al., 2003; Savica et al., 2009; Fang et al., 2010; Palma et al., 2013; Plouvier et al., 2014; Yahalom et al., 2014; Gustafsson et al., 2015; Schrag et al., 2015).

No Inclusion/Exclusion Criteria

No study showed a total lack of inclusion or exclusion criteria. However, criteria differed between studies dependent on the data source (e.g., insurance/medical registers, hospital records, clinical study) and on study-specific inclusion/exclusion criteria as relevant for marker assessments and PD diagnosis.

Drop-Outs

No study reported a drop-out rate of over 20% between baseline and last follow-up without investigating factors associated with the drop-out to exclude a potential drop-out bias.

Insufficient Sample Size

Three studies (9%) did not fulfill the criterion of sufficient sample size. Two prospective cohorts (Schenck et al., 1996; Haehner et al., 2007) with <50, and one case-control study (Gonera et al., 1997) with <100 participants at baseline.

No Report of Marker Associations

No study failed to report statistical effects or detailed descriptive statistics.

Reduced Validity of PD Diagnosis

Eighteen studies (51%; Gonera et al., 1997; Leentjens et al., 2003; Weisskopf et al., 2003; Gao et al., 2007, 2011a; Ishihara-Paul et al., 2008; Ross et al., 2008; Savica et al., 2009; Bower et al., 2010; Fang et al., 2010; Jacob et al., 2010; Jain et al., 2012; Clark et al., 2013; Lin et al., 2013, 2015; Sánchez-Ferro et al., 2013; Gustafsson et al., 2015; Schrag et al., 2015) showed diagnostic limitations, as the diagnosis was not explicitly made by a movement disorder specialist. Alternatively, PD diagnosis was based on disease classification codes, self-reports, use of PD medication (e.g., levodopa) and/or insurance/medical registers, or death certificate documentation. Two additional studies (6%; Haehner et al., 2007; Walter et al., 2015) included “healthy” individuals with borderline PD motor symptoms as indicated by Unified PD Rating Scale part III (UPDRS-III) scores. Here, a UPDRS-III borderline score was defined as 5 or more (Haehner et al., 2007), or individuals with UPDRS-III > 9 (but without definite PD diagnosis) were also considered “healthy” (Walter et al., 2015).

Limitations in Prodromal Marker Assessments

Eighteen studies (51%; Gonera et al., 1997; Abbott et al., 2001, 2005; Leentjens et al., 2003; Weisskopf et al., 2003; Gao et al., 2007, 2011a,b; Ishihara-Paul et al., 2008; Bower et al., 2010; Fang et al., 2010; Jacob et al., 2010; Gaenslen et al., 2011; Lin et al., 2013, 2015; Lerche et al., 2014; Gustafsson et al., 2015; Schrag et al., 2015) showed limitations in prodromal marker assessments. Marker information was based on questionnaires/self-reports in 13 studies with 2 studies (Gao et al., 2007; Gaenslen et al., 2011) using longer term retrospective self-reports with possible recall bias, and was based on medical records (e.g., diagnosis of depression in primary care) in five studies (Gonera et al., 1997; Leentjens et al., 2003; Fang et al., 2010; Gustafsson et al., 2015; Schrag et al., 2015).

Reduced Generalizability of Findings

Findings of six studies (17%; Schenck et al., 1996; Abbott et al., 2001, 2005; Weisskopf et al., 2003; Gao et al., 2007; Ross et al., 2008) might not be generalizable to females as only males were investigated.

Limitations of Statistical Analyses

Six studies (17%; Schenck et al., 1996; Haehner et al., 2007; Berg et al., 2013a,b; Lerche et al., 2014; Walter et al., 2015) did not account for potentially confounding age effects in their statistical analysis or design. Many studies additionally accounted for a number of other confounders as relevant for PD, elderly individuals and/or prodromal marker interpretation in the statistical analysis or via appropriate exclusion criteria.

Temporal Uncertainties

Twelve studies (34%; Gao et al., 2007, 2011a,b; Haehner et al., 2007; Ishihara-Paul et al., 2008; Jain et al., 2012; Berg et al., 2013a,b; Sánchez-Ferro et al., 2013; Shen et al., 2013; Lerche et al., 2014; Plouvier et al., 2014) did not report any temporal information on the duration of marker presence at baseline, PD conversion (relative to baseline), or PD incidence (in person-years) in presence/absence of prodromal markers, in addition to the mere time-span between baseline and last follow-up.

Overall, five studies (14%; Ponsen et al., 2010; Palma et al., 2013; Iranzo et al., 2014; Yahalom et al., 2014; Postuma et al., 2015) showed no limitation according to our criteria. However, most studies (n = 30, 86%) showed one or more limitations out of the 10 proposed categories. Limitations in two categories per study [median; mean (SD): 1.7 (1.1) limitations] were most frequently found. Figure 2 shows how many of the reviewed studies had 0, 1, 2, 3 or 4 limitations in the 10 proposed limitation categories.

FIGURE 2
www.frontiersin.org

Figure 2. Frequency of limitations in prodromal PD studies.

For studies with 1, 2 and those with 3 or more limitations, the frequency [%] of studies with limitations is shown for each of the predefined limitation categories (Figure 3). Only studies with ≥3 limitations showed limitations in sample size and, compared to studies with fewer limitations, more frequently showed limitations in all other categories (if at all observed for that category). However, marked differences were only observed for limitations in study design, which were more than twice as frequent in studies with ≥3 limitations (30%) compared to studies with 2 limitations (12%). Studies with 1 limitation only showed limitations in PD diagnosis or temporal information.

FIGURE 3
www.frontiersin.org

Figure 3. Frequencies (in %) of studies with a limitation in the 10 predefined limitation categories. Frequencies are shown for studies with, in total, 1 limitation, 2 limitations and studies with 3 or more limitations.

Discussion—Lessons Learned

In this systematic review we set out to identify and categorize limitations of longitudinal studies that were designed to examine potential prodromal features of PD. We aimed to set the frame for a critical evaluation of prodromal markers in PD considering limitations as well as individual strengths of studies and to provide recommendations for the improvement of ongoing and future longitudinal studies. We acknowledge the great efforts in each of the reviewed longitudinal studies, which were designed when little was known about prodromal PD.

We defined 10 limitation categories for prodromal longitudinal studies based on evidence-level-criteria (Edlund et al., 2004; Maetzler et al., 2009) as well as additional aspects important for the evaluation of prodromal marker associations. While five studies (14%) showed no limitation in the proposed categories, 30 studies (86%) showed 1 or more limitations suggesting that future studies and reporting of findings can be improved.

Importantly, limitations can introduce different types of bias (e.g., non-differential or differential) which can either attenuate or enhance associations so that the observed associations may be either an under- or over-estimate of the “true” effects. The different limitation categories are discussed below.

Study Design (14% of Studies)

Two retrospective cohort and three conventional case-control studies were considered methodologically weaker compared to prospective or nested case-control studies. These designs may be more susceptible to bias in data selection/analysis, and confounders may be more likely to go unrecognized. Thereby, associations rather than true causal relationships between prodromal markers and the development of PD might be established.

No Inclusion/Exclusion Criteria (0%)

Specifications of inclusion/exclusion criteria varied between studies. While their appropriateness was not assessed, studies should carefully select specific and appropriate criteria to increase the specificity of prodromal marker effects (without introducing a selection bias).

Drop-Outs (0%)

Apart from the reduction of sample size, drop-out of participants over time might not be random but associated with other characteristics, e.g., age, sex, or health-related aspects, such as depression or physical mobility. Thus, demographics and factors related to markers or PD diagnosis should be investigated, especially when the drop-out rate is high, e.g., >20%. However, also a small number of (highly biased) drop-outs may alter findings, and potential biases in drop-outs should therefore always be explored. However, drop-out rates cannot always be inferred from the data and factors linked to drop-out (or motivational aspects of study participation over years) with potential impact on prodromal marker associations remain elusive and should be further investigated.

Insufficient Sample Size (9%)

The criterion of required sample size was relatively liberal and was based on intervention study criteria (Edlund et al., 2004). The lack of specificity of some prodromal markers and/or potential confounders may necessitate a larger sample size to obtain valid and reliable evidence of specific prodromal marker effects. For rare markers (e.g., RBD) with putatively strong associations, smaller sample sizes might suffice than for rather common/unspecific markers with smaller associations. The lack of statistical power due to a small sample size might result in false-negative prodromal marker findings (type II error). However, medical register studies in particular by far exceeded the required sample size.

No Report of Marker Associations (0%)

Results should provide statistical effects as ORs, RRs, HRs, LRs or sensitivity/specificity, or at least provide detailed descriptive statistics (of prodromal markers both in PD converters and non-converters). In addition to considering limitations, detailed report of associations is important for comparability of findings and for meta-analyses, which should be maintained as none of the reviewed studies showed limitations in this aspect.

Reduced Validity of PD Diagnosis (57%)

PD diagnosis by professionals other than movement disorder specialists or surrogate measures for clinical PD diagnosis (e.g., antiparkinsonian medication) is prone to misdiagnosis (Tolosa et al., 2006). Thereby, the specificity of PD prodromal marker findings might have been reduced due to uncertainties in PD diagnosis in 18 of the reviewed studies (51%). However, many studies of these studies put effort into cross-validation of diagnoses in a sub-sample and/or applied multiple criteria (e.g., repeated PD diagnosis in medical records and PD medication intake) to reduce false-positive PD diagnoses. In two studies (6%) individuals with borderline UPDRS-III scores at baseline were included as healthy subjects, thus, a rather late prodromal phase might have been investigated. Most studies did not report baseline UPDRS-III scores (see below: “Temporal Uncertainties” Section), which should be considered in future publications.

Limitations in Prodromal Marker Assessments (51%)

Prodromal markers were frequently assessed using self-reports, interviews, questionnaires or medical record data (with unknown validity of entry or diagnosis, i.e., general practice instead of specialist marker diagnosis). Due to practical aspects quantitative/objective assessments can be difficult to realize for some prodromal markers, in particular, in studies with a large sample size. The degree to which reliability of prodromal markers and evidence of findings is limited may differ between studies and assessment methods. Self-report questionnaires and interviews are prone to retrospective recall bias, deliberate false statements (e.g., erectile dysfunction, depression), or unawareness of marker presence (e.g., hyposmia). Also, subjective marker information may be erroneous due to stress, memory deficits, depression or investigator effects. However, also quantitative/objective information may be erroneous (e.g., diagnosis of depression by general practitioner, olfactory testing when having a cold). Potentially, register data carry the risk of over-diagnosis or less reliable assessment of markers/diseases due to non-specialist diagnosis or insurance/financial reasons affecting data entries. For some markers objective marker information is rarely available (e.g., diagnosis of constipation by gastroenterologist instead of self-reports), and the degree of agreement between quantitative/objective and subjective assessments may vary. For each study and prodromal marker these issues need to be considered. Importantly, in prospective studies a possible bias or marker assessment error likely does not differ between PD converters and non-converters rendering these errors less critical for prodromal marker associations.

Reduced Generalizability of Findings (17%)

Studies with reduced generalizability investigated only male cohorts. Some markers are for obvious reasons restricted to a subgroup of individuals (e.g., erectile dysfunction in males). However, other prodromal markers studied in males only would require confirmation in samples containing females.

While not considered for this limitation criterion, for some clinical cohorts and cohorts selectively enriched through recruitment of individuals with prodromal markers, or in at-risk groups (e.g., RBD or genetic risk groups), the relevance and generalizability of findings may need further validation in population-based cohorts. However, even some of the population-based samples are not fully random and specific interactions or biases may need to be considered for these samples.

Limitations of Statistical Analyses (17%)

Prodromal marker associations might be modulated by confounders, and for each prodromal marker a different set of confounders might play a role. Advanced age is the most important risk factor for PD and many prodromal markers are more frequent with increasing age. Therefore, statistical analyses or study design should at least account for age as a confounder to increase the specificity of prodromal marker associations. Some studies additionally accounted for a number of other relevant confounders in the statistical analysis (or via appropriate exclusion criteria or matching) that might have increased the specificity of reported prodromal marker associations.

Temporal Uncertainties (34%)

For the characterization and evaluation of prodromal marker associations with the conversion from healthy to PD, temporal information is crucial to understand the temporal sequence of progressive neurodegeneration preceding PD diagnosis. This neurodegenerative process and the corresponding association with a prodromal marker may span a (much) longer time than the time span from baseline to PD diagnosis. However, marker duration at baseline is rarely reported and thus it remains elusive to what extent marker duration rather than marker presence influences conversion to PD. All available (temporal) information of prodromal markers and PD diagnosis, as well as motor symptom severity (at each visit) should be reported to advance the understanding of temporal aspects of prodromal motor symptom progression and prodromal markers in PD.

Some limitations are unavoidable, and yet studies with limitations have yielded important information, which might otherwise have been missed. For instance, longitudinal studies with extensive assessment batteries as well as large sample sizes need to use easy-to-apply and quick-to-perform assessments such as questionnaires. Nevertheless, findings from these studies contributed with valuable findings despite the lack of quantitative/objective assessments.

Still, for a correct interpretation of prodromal marker findings and the reported effect sizes, potential limitations should be considered to improve comparability of findings and designs, assessments and analyses of ongoing and future studies in prodromal PD. In this systematic review, the three most frequent limitations were in marker assessments, report/availability of temporal information, and PD diagnosis. These limitations are important to address and in this way may improve future studies of prodromal PD.

In addition to the limitation categories investigated, the review of longitudinal studies in prodromal PD revealed other important aspects to be considered in future research.

Table 1 lists important issues to be addressed in future studies on prodromal markers in PD.

TABLE 1
www.frontiersin.org

Table 1. Open research questions in prodromal Parkinson’s disease (PD).

Further Suggestions and Lessons Learned

1. In PD and/or its prodromal phase, markers may not always be present or deteriorate linearly. The key advantage of longitudinal studies is the ability to show the trends in a marker over time, but reversion or fluctuation of marker status over time and its relevance for conversion to clinical PD has not been reported in any of the studies. For continuous markers (e.g., marker severity) and dichotomous markers (present/absent), the longitudinal (possibly non-linear) changes or reversion rate until PD diagnosis may, however, be highly valuable for PD prediction models and future therapeutic strategies in the prodromal phase. From this perspective, it will be of relevance to distinguish between dynamically changing state markers, and stable trait markers (possibly RBD, TCS SN+).

2. Some patients with an initial diagnosis of PD will show additional and/or atypical symptoms that require a re-evaluation of the initial diagnosis. Thus, individuals converting to PD should be clinically investigated over an extended period of time to substantiate the PD diagnosis and to gain further information on subgroups of PD patients and their optimal treatment.

3. Non-significant findings of prodromal markers, sub-group analyses or findings of interactions (with other prodromal markers) have not always been reported, although this information would be valuable especially in a future meta-analysis.

4. Enriched cohorts, i.e., individuals with a relatively increased risk of developing PD due to stratification by prodromal/risk factors (male gender, TCS SN+, positive dopamine transporter scintigraphy, PD relatives), may have a higher PD conversion rate, thus providing greater statistical power for a given sample size or shorter study duration. However, it needs to be considered that for single prodromal marker associations other confounders, e.g., additional risk or prodromal markers, might play a role.

5. It is widely acknowledged that PD is a heterogeneous disease (Foltynie et al., 2002; Erro et al., 2013) and symptom (or sub-symptom) severity, progression rate, as well as many other factors may vary among individual PD patients. This complexity has so far not been addressed by prodromal PD marker studies with a single endpoint of (idiopathic) PD.

Recommendations for Future Prodromal PD Marker Research

In addition to the present findings and lessons learned from longitudinal studies in the prodromal phase of PD, a large degree of heterogeneity in studies both in the prodromal and clinical phase of PD has been reported (Lerche et al., 2015). This heterogeneity concerns the markers assessed (or not assessed), the assessment tools used, and study design (e.g., age at inclusion, frequency of follow-up), thereby reducing comparability of study findings. Based on this experience, we propose a practical approach to advance prodromal PD marker research.

Modular Minimal Set of Assessments for Longitudinal Studies in (Prodromal) PD

Ongoing as well as new longitudinal studies may benefit from using a common dataset that is shared with other studies. This formal core dataset should be included in all studies (e.g., demographic data) and can be extended by specific additional modules meeting study resources and needs to answer specific scientific hypotheses. While such a modular minimal set of assessments has not yet been established, two major advantages support this concept. First, when studies are comparable in data quality, replication studies as well as testing of new hypotheses using existing data of published studies promise to be more successful. As each study would still have additional and unique characteristics and sample composition a modular minimal set of assessments would advance our understanding of prodromal PD by improving quality of studies and publications. Second, data sharing for joint analysis would be greatly facilitated by a common data approach. In the future, the proposed cooperative endeavor may provide more valid and reliable prodromal markers (or marker profiles) than single and largely unique studies, and may thereby allow to more accurately investigate the multi-factorial prodromal neurodegenerative process ultimately leading to PD.

Author Contributions

The authors comprise the members of the BioLoC-PD working group on “Harmonization of biomarker assessment in longitudinal cohort studies in Parkinson’s Disease” of the EU Joint Programme Neurodegenerative Disease Research (JPND). The submitted work has been conceptualized and discussed by all members of this working group. Individual contributions of the authors are as follows: Conception/Discussion of study: SH, BR, YB-S, SL, GA, PB, SB, HWB, BRB, DGG, MH, MK, RK, MM, BM, WO, US, UW, KW, IL-S, WM, DB (JPND BioLoC-PD working group). Search and systematic review methods: SH, YB-S, BR, SL, DB. Literature search: SH, BR, SL, US. Analyses: SH, YB-S, BR, SL. Figures: SH, BR. Drafting of manuscript: SH, BR, YB-S, DB. Revision of manuscript: SH, BR, YB-S, SL, GA, PB, SB, HWB, BRB, DGG, MH, MK, RK, MM, BM, WO, US, UW, KW, IL-S, WM, DB. Supervision: DB.

Funding

This work of the BioLoC-PD working group was supported by the Federal Ministry of Education and Research (BMBF; funding number: 01ED1410), Germany, under the aegis of the EU Joint Programme—Neurodegenerative Disease Research (JPND). The authors also acknowledge the support by the Deutsche Forschungsgemeinschaft (DFG) and the open access fund of the University of Tübingen.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The handling Editor declared a shared affiliation, though no other collaboration, with one of the authors [UW] and states that the process nevertheless met the standards of a fair and objective review.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/article/10.3389/fnagi.2016.00147/abstract

References

Abbott, R. D., Petrovitch, H., White, L. R., Masaki, K. H., Tanner, C. M., Curb, J. D., et al. (2001). Frequency of bowel movements and the future risk of Parkinson’s disease. Neurology 57, 456–462. doi: 10.1212/wnl.57.3.456

PubMed Abstract | CrossRef Full Text | Google Scholar

Abbott, R. D., Ross, G. W., White, L. R., Tanner, C. M., Masaki, K. H., Nelson, J. S., et al. (2005). Excessive daytime sleepiness and subsequent development of Parkinson disease. Neurology 65, 1442–1446. doi: 10.1212/01.wnl.0000183056.89590.0d

PubMed Abstract | CrossRef Full Text | Google Scholar

Berg, D., Behnke, S., Seppi, K., Godau, J., Lerche, S., Mahlknecht, P., et al. (2013a). Enlarged hyperechogenic substantia nigra as a risk marker for Parkinson’s disease. Mov. Disord. 28, 216–219. doi: 10.1002/mds.25192

PubMed Abstract | CrossRef Full Text | Google Scholar

Berg, D., Godau, J., Seppi, K., Behnke, S., Liepelt-Scarfone, I., Lerche, S., et al. (2013b). The PRIPS study: screening battery for subjects at risk for Parkinson’s disease. Eur. J. Neurol. 20, 102–108. doi: 10.1111/j.1468-1331.2012.03798.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bernheimer, H., Birkmayer, W., Hornykiewicz, O., Jellinger, K., and Seitelberger, F. (1973). Brain dopamine and the syndromes of Parkinson and Huntington. Clinical, morphological and neurochemical correlations. J. Neurol. Sci. 20, 415–455. doi: 10.1016/0022-510x(73)90175-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Bower, J. H., Grossardt, B. R., Maraganore, D. M., Ahlskog, J. E., Colligan, R. C., Geda, Y. E., et al. (2010). Anxious personality predicts an increased risk of Parkinson’s disease. Mov. Disord. 25, 2105–2113. doi: 10.1002/mds.23230

PubMed Abstract | CrossRef Full Text | Google Scholar

Chaudhuri, K. R., Healy, D. G., Schapira, A. H., and National Institute for Clinical Excellence. (2006). Non-motor symptoms of Parkinson’s disease: diagnosis and management. Lancet Neurol. 5, 235–245. doi: 10.1016/S1474-4422(06)70373-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, A. J., Ritz, B., Prescott, E., and Rod, N. H. (2013). Psychosocial risk factors, pre-motor symptoms and first-time hospitalization with Parkinson’s disease: a prospective cohort study. Eur. J. Neurol. 20, 1113–1120. doi: 10.1111/ene.12117

PubMed Abstract | CrossRef Full Text | Google Scholar

Edlund, W., Gronseth, G., So, Y., and Franklin, G. (2004). American Academy of Neurology Clinical Practice Guidelines Process Manual. Minneapolis: American Academy of Neurology.

Erro, R., Vitale, C., Amboni, M., Picillo, M., Moccia, M., Longo, K., et al. (2013). The heterogeneity of early Parkinson’s disease: a cluster analysis on newly diagnosed untreated patients. PLoS One 8:e70244. doi: 10.1371/journal.pone.0070244

PubMed Abstract | CrossRef Full Text | Google Scholar

Fang, F., Xu, Q., Park, Y., Huang, X. M., Hollenbeck, A., Blair, A., et al. (2010). Depression and the subsequent risk of Parkinson’s disease in the NIH-AARP diet and health study. Mov. Disord. 25, 1157–1162. doi: 10.1002/mds.23092

PubMed Abstract | CrossRef Full Text | Google Scholar

Foltynie, T., Brayne, C., and Barker, R. A. (2002). The heterogeneity of idiopathic Parkinson’s disease. J. Neurol. 249, 138–145. doi: 10.1007/PL00007856

PubMed Abstract | CrossRef Full Text | Google Scholar

Gaenslen, A., Swid, I., Liepelt-Scarfone, I., Godau, J., and Berg, D. (2011). The patients’ perception of prodromal symptoms before the initial diagnosis of Parkinson’s disease. Mov. Disord. 26, 653–658. doi: 10.1002/mds.23499

PubMed Abstract | CrossRef Full Text | Google Scholar

Gao, X., Chen, H. L., Schwarzschild, M. A., and Ascherio, A. (2011a). A prospective study of bowel movement frequency and risk of Parkinson’s disease. Am. J. Epidemiol. 174, 546–551. doi: 10.1093/aje/kwr119

PubMed Abstract | CrossRef Full Text | Google Scholar

Gao, J., Huang, X., Park, Y., Hollenbeck, A., Blair, A., Schatzkin, A., et al. (2011b). Daytime napping, nighttime sleeping and Parkinson disease. Am. J. Epidemiol. 173, 1032–1038. doi: 10.1093/aje/kwq478

PubMed Abstract | CrossRef Full Text | Google Scholar

Gao, X., Chen, H., Schwarzschild, M. A., Glasser, D. B., Logroscino, G., Rimm, E. B., et al. (2007). Erectile function and risk of Parkinson’s disease. Am. J. Epidemiol. 166, 1446–1450. doi: 10.1093/aje/kwm246

PubMed Abstract | CrossRef Full Text | Google Scholar

Gonera, E. G., van’t Hof, M., Berger, H. J., van Weel, C., and Horstink, M. W. (1997). Symptoms and duration of the prodromal phase in Parkinson’s disease. Mov. Disord. 12, 871–876. doi: 10.1002/mds.870120607

PubMed Abstract | CrossRef Full Text | Google Scholar

Gustafsson, H., Nordstrom, A., and Nordstrom, P. (2015). Depression and subsequent risk of Parkinson disease: a nationwide cohort study. Neurology 84, 2422–2429. doi: 10.1212/WNL.0000000000001684

PubMed Abstract | CrossRef Full Text | Google Scholar

Haehner, A., Hummel, T., Hummel, C., Sommer, U., Junghanns, S., and Reichmann, H. (2007). Olfactory loss may be a first sign of idiopathic Parkinson’s disease. Mov. Disord. 22, 839–842. doi: 10.1002/mds.21413

PubMed Abstract | CrossRef Full Text | Google Scholar

Iranzo, A., Fernández-Arcos, A., Tolosa, E., Serradell, M., Molinuevo, J. L., Valldeoriola, F., et al. (2014). Neurodegenerative disorder risk in idiopathic REM sleep behavior disorder: study in 174 patients. PLoS One 9:e89741. doi: 10.1371/journal.pone.0089741

PubMed Abstract | CrossRef Full Text | Google Scholar

Ishihara-Paul, L., Wainwright, N. W. J., Khaw, K. T., Luben, R. N., Welch, A. A., Day, N. E., et al. (2008). Prospective association between emotional health and clinical evidence of Parkinson’s disease. Eur. J. Neurol. 15, 1148–1154. doi: 10.1111/j.1468-1331.2008.02299.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Jacob, E. L., Gatto, N. M., Thompson, A., Bordelon, Y., and Ritz, B. (2010). Occurrence of depression and anxiety prior to Parkinson’s disease. Parkinsonism Relat. Disord. 16, 576–581. doi: 10.1016/j.parkreldis.2010.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Jain, S., Ton, T. G., Perera, S., Zheng, Y., Stein, P. K., Thacker, E., et al. (2012). Cardiovascular physiology in premotor Parkinson’s disease: a neuroepidemiologic study. Mov. Disord. 27, 988–995. doi: 10.1002/mds.24979

PubMed Abstract | CrossRef Full Text | Google Scholar

Jankovic, J. (2008). Parkinson’s disease: clinical features and diagnosis. J. Neurol. Neurosurg. Psychiatry 79, 368–376. doi: 10.1136/jnnp.2007.131045

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, A. E. (2011). A critical appraisal of the premotor symptoms of Parkinson’s disease: potential usefulness in early diagnosis and design of neuroprotective trials. Mov. Disord. 26, 775–783. doi: 10.1002/mds.23609

PubMed Abstract | CrossRef Full Text | Google Scholar

Leentjens, A. F. G., Van den Akker, M., Metsemakers, J. F. M., Lousberg, R., and Verhey, F. R. J. (2003). Higher incidence of depression preceding the onset of Parkinson’s disease: a register study. Mov. Disord. 18, 414–418. doi: 10.1002/mds.10387

PubMed Abstract | CrossRef Full Text | Google Scholar

Lerche, S., Liepelt-Scarfone, I., Alves, G., Barone, P., Behnke, S., Ben-Shlomo, Y., et al. (2015). Methods in neuroepidemiology characterization of European longitudinal cohort studies in Parkinson’s disease–report of the JPND working group BioLoC-PD. Neuroepidemiology 45, 282–297. doi: 10.1159/000439221

PubMed Abstract | CrossRef Full Text | Google Scholar

Lerche, S., Seppi, K., Behnke, S., Liepelt-Scarfone, I., Godau, J., Mahlknecht, P., et al. (2014). Risk factors and prodromal markers and the development of Parkinson’s disease. J. Neurol. 261, 180–187. doi: 10.1007/s00415-013-7171-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, C. H., Lin, J. W., Liu, Y. C., Chang, C. H., and Wu, R. M. (2015). Risk of Parkinson’s disease following anxiety disorders: a nationwide population-based cohort study. Eur. J. Neurol. 22, 1280–1287. doi: 10.1111/ene.12740

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, C. H., Wu, R. M., Chang, H. Y., Chiang, Y. T., and Lin, H. H. (2013). Preceding pain symptoms and Parkinson’s disease: a nationwide population-based cohort study. Eur. J. Neurol. 20, 1398–1404. doi: 10.1111/ene.12197

PubMed Abstract | CrossRef Full Text | Google Scholar

Maetzler, W., Liepelt, I., and Berg, D. (2009). Progression of Parkinson’s disease in the clinical phase: potential markers. Lancet Neurol. 8, 1158–1171. doi: 10.1016/s1474-4422(09)70291-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Marek, K., Innis, R., van Dyck, C., Fussell, B., Early, M., Eberly, S., et al. (2001). [123I]β-CIT SPECT imaging assessment of the rate of Parkinson’s disease progression. Neurology 57, 2089–2094. doi: 10.1212/wnl.57.11.2089

PubMed Abstract | CrossRef Full Text | Google Scholar

Palma, J. A., Carmona-Abellan, M. M., Barriobero, N., Trevino-Peinado, C., Garcia-Lopez, M., Fernandez-Jarne, E., et al. (2013). Is cardiac function impaired in premotor Parkinson’s disease? A retrospective cohort study. Mov. Disord. 28, 591–596. doi: 10.1002/mds.25431

PubMed Abstract | CrossRef Full Text | Google Scholar

Plouvier, A. O. A., Hameleers, R. J. M. G., van den Heuvel, E. A. J., Bor, H. H., Hartman, T. C. O., Bloem, B. R., et al. (2014). Prodromal symptoms and early detection of Parkinson’s disease in general practice: a nested case-control study. Fam. Pract. 31, 373–378. doi: 10.1093/fampra/cmu025

PubMed Abstract | CrossRef Full Text | Google Scholar

Ponsen, M. M., Stoffers, D., Wolters, E. C., Booij, J., and Berendse, H. W. (2010). Olfactory testing combined with dopamine transporter imaging as a method to detect prodromal Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry 81, 396–399. doi: 10.1136/jnnp.2009.183715

PubMed Abstract | CrossRef Full Text | Google Scholar

Postuma, R. B., Gagnon, J. F., Bertrand, J. A., Genier Marchand, D., and Montplaisir, J. Y. (2015). Parkinson risk in idiopathic REM sleep behavior disorder: preparing for neuroprotective trials. Neurology 84, 1104–1113. doi: 10.1212/WNL.0000000000001364

PubMed Abstract | CrossRef Full Text | Google Scholar

Ross, G. W., Petrovitch, H., Abbott, R. D., Tanner, C. M., Popper, J., Masaki, K., et al. (2008). Association of olfactory dysfunction with risk for future Parkinson’s disease. Ann. Neurol. 63, 167–173. doi: 10.1002/ana.21291

PubMed Abstract | CrossRef Full Text | Google Scholar

Sánchez-Ferro, A., Benito-León, J., Louis, E. D., Mitchell, A. J., Molina-Arjona, J. A., Trincado, R., et al. (2013). Rate of cognitive decline in premotor Parkinson’s disease: a prospective study (NEDICES). Mov. Disord. 28, 161–168. doi: 10.1002/mds.25148

PubMed Abstract | CrossRef Full Text | Google Scholar

Savica, R., Carlin, J. M., Grossardt, B. R., Bower, J. H., Ahlskog, J. E., Maraganore, D. M., et al. (2009). Medical records documentation of constipation preceding Parkinson disease a case-control study. Neurology 73, 1752–1758. doi: 10.1212/WNL.0b013e3181c34af5

PubMed Abstract | CrossRef Full Text | Google Scholar

Schenck, C. H., Bundlie, S. R., and Mahowald, M. W. (1996). Delayed emergence of a parkinsonian disorder in 38% of 29 older men initially diagnosed with idiopathic rapid eye movement sleep behavior disorder. Neurology 46, 388–393. doi: 10.1212/wnl.46.2.388

PubMed Abstract | CrossRef Full Text | Google Scholar

Schrag, A., Horsfall, L., Walters, K., Noyce, A., and Petersen, I. (2015). Prediagnostic presentations of Parkinson’s disease in primary care: a case-control study. Lancet Neurol. 14, 57–64. doi: 10.1016/s1474-4422(14)70287-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Shen, C. C., Tsai, S. J., Perng, C. L., Kuo, B. I. T., and Yang, A. C. (2013). Risk of Parkinson disease after depression a nationwide population-based study. Neurology 81, 1538–1544. doi: 10.1212/WNL.0b013e3182a956ad

PubMed Abstract | CrossRef Full Text | Google Scholar

Stern, M. B., Lang, A., and Poewe, W. (2012). Toward a redefinition of Parkinson’s disease. Mov. Disord. 27, 54–60. doi: 10.1002/mds.24051

PubMed Abstract | CrossRef Full Text | Google Scholar

Tolosa, E., Wenning, G., and Poewe, W. (2006). The diagnosis of Parkinson’s disease. Lancet Neurol. 5, 75–86. doi: 10.1016/S1474-4422(05)70285-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Walter, U., Heilmann, R., Kaulitz, L., Just, T., Krause, B. J., Benecke, R., et al. (2015). Prediction of Parkinson’s disease subsequent to severe depression: a ten-year follow-up study. J. Neural Transm. (Vienna) 122, 789–797. doi: 10.1007/s00702-014-1313-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Weisskopf, M. G., Chen, H. L., Schwarzschild, M. A., Kawachi, I., and Ascherio, A. (2003). Prospective study of phobic anxiety and risk of Parkinson’s disease. Mov. Disord. 18, 646–651. doi: 10.1002/mds.10425

PubMed Abstract | CrossRef Full Text | Google Scholar

Yahalom, G., Maor, E., Hassin-Baer, S., Segev, S., Sidi, Y., and Kivity, S. (2014). Cardiac stress test is normal in pre-motor Parkinson’s disease. Mov. Disord. 29, 1158–1162. doi: 10.1002/mds.25943

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Parkinson’s disease, prodromal, cohort, prospective, case-control, clinical, longitudinal, marker

Citation: Heinzel S, Roeben B, Ben-Shlomo Y, Lerche S, Alves G, Barone P, Behnke S, Berendse HW, Bloem BR, Burn D, Dodel R, Grosset DG, Hu M, Kasten M, Krüger R, Moccia M, Mollenhauer B, Oertel W, Suenkel U, Walter U, Wirdefeldt K, Liepelt-Scarfone I, Maetzler W and Berg D (2016) Prodromal Markers in Parkinson’s Disease: Limitations in Longitudinal Studies and Lessons Learned. Front. Aging Neurosci. 8:147. doi: 10.3389/fnagi.2016.00147

Received: 20 April 2016; Accepted: 07 June 2016;
Published: 22 June 2016.

Edited by:

Aurel Popa-Wagner, University of Medicine Rostock, Germany

Reviewed by:

Maria Markaki, Foundation for Research and Technology (FORTH)-Hellas, Greece
Ramesh Kandimalla, Emory University, USA

Copyright © 2016 Heinzel, Roeben, Ben-Shlomo, Lerche, Alves, Barone, Behnke, Berendse, Bloem, Burn, Dodel, Grosset, Hu, Kasten, Krüger, Moccia, Mollenhauer, Oertel, Suenkel, Walter, Wirdefeldt, Liepelt-Scarfone, Maetzler and Berg. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sebastian Heinzel, sebastian.heinzel@med.uni-tuebingen.de

These authors have contributed equally to this work.

Download