Silas E. Burris
Danielle D. Brown- Department of Psychology, Howard University, Washington, DC, USA
Narratives, also called stories, can be found in conversations, children's play interactions, reading material, and television programs. From infancy to adulthood, narrative comprehension processes interpret events and inform our understanding of physical and social environments. These processes have been extensively studied to ascertain the multifaceted nature of narrative comprehension. From this research we know that three overlapping processes (i.e., knowledge integration, goal structure understanding, and causal inference generation) proposed by the constructionist paradigm are necessary for narrative comprehension, narrative comprehension has a predictive relationship with children's later reading performance, and comprehension processes are generalizable to other contexts. Much of the previous research has emphasized internal and predictive validity; thus, limiting the generalizability of previous findings. We are concerned these limitations may be excluding underrepresented populations from benefits and implications identified by early comprehension processes research. This review identifies gaps in extant literature regarding external validity and argues for increased emphasis on externally valid research. We highlight limited research on narrative comprehension processes in children from low-income and minority populations, and argue for changes in comprehension assessments. Specifically, we argue both on- and off-line assessments should be used across various narrative types (e.g., picture books, televised narratives) with traditionally underserved and underrepresented populations. We propose increasing the generalizability of narrative comprehension processes research can inform persistent reading achievement gaps, and have practical implications for how children learn from narratives.
The human mind constantly interprets and learns new information from narratives, commonly referred to as stories. The majority of our conversations, media, and early educational resources occur as narrative discourse (Graesser et al., 1991, 1997, 2002b; Tannock et al., 1993; Trabasso, 1994; Berger, 1997; Trabasso and Stein, 1997; Pearce, 2003; Cevasco and van den Broek, 2008). Narratives are typically stories that contain characters, their goals, and successive events leading to accomplishment of goals (Trabasso, 1994; Eaton et al., 1999; Magliano and Radvansky, 2001). Narratives are often experienced as aural presentations (e.g., verbal stories), wordless picture sequences (e.g., young children's picture books), audio-visual films (e.g., movies), and written text (Trabasso et al., 1992; Berman and Slobin, 1994; Graesser et al., 2003; Paris and Paris, 2003; Berman, 2004; Kendeou et al., 2005, 2008; Verhallen et al., 2006). Research suggests that all narrative forms require similar underlying processes for comprehension (Trabasso and Nickels, 1992; Eaton et al., 1999; Graesser et al., 2002a; Paris and Paris, 2003; Kendeou et al., 2005, 2008; Florit et al., 2011).
Precursors to narrative comprehension processes emerge during infancy (Bauer and Shore, 1987; Bauer, 1992; Wenner and Bauer, 1999; Henderson and Woodward, 2011; Gerson and Woodward, 2012) and improve with narrative exposure, familiarity, and adult support (Morrow, 1985; Bauer and Shore, 1987; Berman, 1995; Whitehurst and Lonigan, 1998). These processes help children interpret external information to understand physical and social environments (Bauer, 1992; Berger, 1997) and encourage later school-related skills (Brown et al., 1986, 2011; Bauer et al., 1999; Paris and Paris, 2003; Pelletier and Astington, 2004; Kendeou et al., 2005, 2008; van den Broek et al., 2005; Zucker et al., 2010). Studies have even suggested a connection between narrative exposure and vocabulary development (Trostle and Hicks, 1998; Whitehurst and Lonigan, 1998; Brown et al., 2011; see Lynch et al., 2008 for a different perspective). Potential benefits of narrative exposure have inspired many researchers to explore the multifaceted nature of narrative comprehension. These explorations, however, have been limited by their emphasis on internal and predictive validity rather than external validity and generalizability.
This review addresses the external validity of research on narrative comprehension development as described by the constructionist paradigm (Graesser et al., 1994). First, we describe the constructionist paradigm's perspective on narrative comprehension, which argues that comprehension processes are employed to construct meaningful mental representations of narratives. Second, we review literature on the development of narrative comprehension processes from infancy into adulthood. We identify gaps in this research for specific populations and ages. Third, we compare and discuss on-line and off-line assessments of narrative comprehension processes and propose a multi-method approach for developmental studies. Last, we argue that future research must incorporate methodology and scope that intentionally assesses narrative comprehension across diverse populations, knowledgebases, and media. Empirically informing our understanding of the generalizability of comprehension processes development will guide researchers to more accurately assess children and narrative media in the future.
Narrative Comprehension: The Constructionist Paradigm
The constructionist paradigm defines narrative comprehension as a coherent understanding resulting from overlapping processes to form a comprehender's mental representation (Graesser et al., 1994, 1997, 2002a; van den Broek et al., 1996, 2005; Graesser and Wiemer-Hastings, 1999). Asserting that comprehenders “search after meaning” within narratives, Graesser and colleagues identified integration of prior knowledge (Graesser et al., 1997, 2003; Best et al., 2008), goal structure understanding (Graesser et al., 1994), and generation of causal inferences (Trabasso and Nickels, 1992) as overlapping processes that assist the maintenance of relevant story details in memory (Trabasso et al., 1989; Bower and Morrow, 1990; Zwaan et al., 1995a; Zwaan and Radvansky, 1998; Kurby and Zacks, 2012). Comprehension successfully occurs when these processes converge as a meaningful and coherent mental representation (Kintsch, 1988; van den Broek et al., 2005).
Other theories include processes described by the constructionist paradigm (e.g., inference generation, the integration of prior knowledge); however, they typically emphasize a more narrowed approach and would benefit from an increased focus on external validity and generalizability (e.g., Kintsch, 1988; McKoon and Ratcliff, 1992). The holistic view proposed by the constructionist paradigm emphasizes relations between processes and can be developmentally examined. Although developmental research on narrative comprehension and narrative production are clearly different, these differences are not always made explicit in the literature. For example, storytelling procedures can assess both comprehension and production abilities. It is the method of analyzing these storytelling procedures which clarifies the distinction. Studies of production are often interested in children's or adults' narrative quality, length, details, and cohesion (Berman, 1988, 2004; Shapiro and Hudson, 1991; Berman and Slobin, 1994; Peterson and McCabe, 1994; Wigglesworth, 1997; Peterson et al., 1999; Kulkofsky et al., 2008; McCabe et al., 2008; Curenton, 2010), whereas studies of comprehension examine mechanisms underlying the construction of narrative mental representations (Paris and Paris, 2003). This review identifies trends in the comprehension research field and describes them in Table 1 (i.e., processes investigated according to population demographics). These trends reveal external validity concerns of population exclusion in comprehension development research. We discuss each process's role in comprehension, beginning with the integration of prior knowledge.
Table 1. Numbers of sources describing narrative comprehension processes across populations from low- and middle- to high-income households.
Knowledgebase Integration
The process of knowledge integration requires access to stores of generic world knowledge and personal experiences in order to build narrative mental representations (Gowie, 1973; Kintsch, 1988; Graesser et al., 1994, 1997, 2001, 2002a,b; Graesser and Wiemer-Hastings, 1999; Brandão and Oakhill, 2005; Gerrig, 2011). Prior knowledge compensates for gaps in narrative coherence or when information is ambiguous (McNamara and Kintsch, 1996; Graesser et al., 2001, 2002b) and allows for generation of inferences connecting prior knowledge to narrative information (Hannon and Daneman, 2001; McNamara and Kendeou, 2011). Knowledge integration also allows comprehenders to update mental representations based on personal encounters and understandings (Long et al., 1989; Hamm and Hasher, 1992; Zwaan et al., 1995a; Prentice et al., 1997; Marmolejo-Ramos et al., 2009; Florit et al., 2011).
Narrative comprehension is vulnerable to deficits in prior knowledge (Graesser et al., 2003), particularly for children who have fewer world experiences (Graesser et al., 2002b). For example, consider the knowledgebase required to interpret a popular wordless picture book used to assess narrative comprehension processes in young children, Frog, Where are You? (Mayer, 1969). This 25-page picture book begins with an illustration of a boy and a dog in a bedroom. Also in the bedroom, a frog is in a jar. The child comprehender must first have some prior knowledge of, or experience with, animals kept in jars as pets. This knowledge must then be incorporated with the illustration to inform that the frog is the boy's pet. If this specific narrative event is new to the child, it will be more cognitively demanding to generalize and integrate prior knowledge (Graesser and Wiemer-Hastings, 1999) and potentially lead to difficulties in establishing a coherent understanding (Graesser et al., 2002b; Best et al., 2008). When successful, child comprehenders relate their own experiences to narrative content and appropriately infer meaning (Cain et al., 2001). For example, the child may know people hug animals that are pets and, therefore, infer from a picture of the boy hugging a frog that the frog is a pet. A child's knowledge-based inference for this event can potentially deepen comprehension, if successful, or limit them to a surface understanding if inference-making abilities are limited (Graesser and Kreuz, 1993; Graesser et al., 1997, 2002b; Graesser and Wiemer-Hastings, 1999; McNamara and Kendeou, 2011).
Despite the significance of knowledge integration for comprehension (Graesser et al., 1994, 1997, 2002b), this process has been investigated the least, particularly in children from low-income households (see Table 1). Our review of the literature found no studies intentionally assessing knowledge integration in children from low-income households, regardless of age. As such, there is little evidence to suggest these children integrate knowledge differently than children from middle- and high-income families; however, there may be qualitative differences due to varying background knowledge (McLoyd, 2013). For example, children from low-income households may be less familiar with concepts in a story about a preparatory school and exhibit less understanding of the character's goals than children from middle- or high-income families. On the other hand, they may have greater knowledge related to stories where characters independently overcome obstacles using their problem solving skills. Domain-specific knowledge studies (see Alexander et al., 1994 for a review), however, should not to be confused with investigating how generalized prior learning and experiences lead to inferences (Hannon and Daneman, 2001). The dearth of experimental manipulations of knowledge integration presents a significant gap in our knowledge of narrative comprehension. If converging research aims to provide a holistic view of children's comprehension, gaps surrounding this and other processes must be investigated across all populations.
Goal Structure Understanding
Since narratives and everyday experiences follow goal directed patterns of actions and events (Trabasso, 1994; Berger, 1997), understanding links between characters' motives and narrative events is essential for forming coherent mental representations of narratives (Trabasso et al., 1989; Graesser et al., 1994, 1997; Wenner, 2004; Trabasso and Wiley, 2005; Lynch and van den Broek, 2007). Fundamental elements of narrative goal structure are goals, attempts, and outcomes (Trabasso and Nickels, 1992; Trabasso et al., 1992; Suh and Trabasso, 1993; Trabasso and Rodkin, 1994; Trabasso and Wiley, 2005; Lynch and van den Broek, 2007). Goals are defined as a character's desires that motivate subsequent actions (e.g., the boy wanted to eat). Attempts are actions taken to achieve the character's goal (e.g., the boy made a sandwich). Results of attempts are labeled outcomes, which can be successful, unsuccessful, reinstated, or abandoned. The degree that goal structure elements are logically matched facilitates comprehension in both adults and children (Albrecht and Myers, 1995; Low and Durrkin, 1998; Milch-Reich et al., 1999; Poynor and Morris, 2003; Egidi and Gerrig, 2006; Pyykkönen and Järvikivi, 2012; Orrantia et al., 2014).
Goal structure understanding also typically requires comprehenders to hierarchically relate goal structure elements (Trabasso and Nickels, 1992; Graesser et al., 1994; Trabasso and Wiley, 2005; Lynch and van den Broek, 2007). An initiating event causes an unwanted change in state for the protagonist (Trabasso et al., 1989) and a superordinate or primary goal forms to drive the remainder of the narrative (Trabasso and Nickels, 1992). Other goals supporting superordinate goal attainment are labeled “subordinate” and represented at lower levels of the hierarchy (Suh and Trabasso, 1993; Singer et al., 1994; Trabasso and Wiley, 2005). Subordinate goals are established when preliminary steps are required before an attempt can be made at the superordinate goal or when an attempt at a superordinate goal fails (Suh and Trabasso, 1993; Trabasso and Wiley, 2005; van den Broek et al., 2005). In the wordless picture book Frog, Where are You? (Mayer, 1969), children must understand that the boy's main, or superordinate goal, is to find the frog. In order to do so, the boy must form a subordinate goal of looking in specific locations (e.g., his boot, outside, in the woods; Trabasso and Rodkin, 1994). When an attempt successfully accomplishes a subordinate goal, another attempt can be made at the superordinate goal.
There is considerable agreement that understanding goal structures is important for comprehending narratives (Poynor and Morris, 2003; Lynch and van den Broek, 2007) through the generation of more inferences (Omanson et al., 1978; Lutz and Radvansky, 1997), aiding in retention when narratives are relatively long (Wenner, 2004), and allowing comprehenders to detect problems, anticipate solutions, and predict outcomes (Trabasso and Nickels, 1992). Goal structure understanding also increases understanding of main ideas (van den Broek et al., 2003). Few studies have investigated the impact of variations in goal structures. Research regarding the role of characters' competing goals, abandoned goals (Lutz and Radvansky, 1997; Magliano and Radvansky, 2001; McFarlan and Brown, unpublished manuscript), subordinate goals of secondary characters (Magliano et al., 2005), and multiple superordinate goals (Magliano and Radvansky, 2001; Linderholm et al., 2004) on comprehension is limited. Trabasso et al.'s (1992) work suggests that variations in objects that are targets of characters' motivations are important. Specifically, the frequent presence of a character's goal object in narrative scenes facilitates comprehension and may remind the comprehender of connections between character goals, goal objects, and attempts. Investigating goal structure variations will improve our current understanding of comprehension development and how goal structure understanding relates to causal inference generation.
Causal Inference Generation
Causal inferences support knowledge integration and goal structure understanding by connecting time and place of actions, characters, character goals and motivations, internal states, and other narrative events (Trabasso et al., 1989; Suh and Trabasso, 1993; Trabasso and Suh, 1993; Graesser et al., 1994, 2001; Singer et al., 1994; Tompkins et al., 2013). Causal inferences fill narrative information gaps allowing comprehenders to integrate real-world knowledge with goal structure information (Trabasso et al., 1989; Graesser et al., 1994, 2001, 2002a; Tapiero et al., 2002), connect events across the goal structure (Trabasso et al., 1989; van den Broek, 1989; Trabasso and Nickels, 1992; Graesser et al., 1994; Zwaan and Radvansky, 1998; Tapiero et al., 2002; van den Broek et al., 2003; Brandão and Oakhill, 2005; Kendeou et al., 2008), and identify inconsistencies between narrative and mental representation (Long and Chong, 2001). In general, causal inferences promote recall (Trabasso et al., 1989; Bloom et al., 1990; McKoon and Ratcliff, 1992; Myers et al., 1994; Singer et al., 1994; Rizzella and O'Brien, 1996; van den Broek et al., 1996; Trabasso and Stein, 1997; Brownstein and Read, 2007) by organizing narrative events into causally related chains (Trabasso and van den Broek, 1985; Trabasso et al., 1989; Trabasso and Nickels, 1992; Myers et al., 1994; Singer et al., 1994; Wolman et al., 1997; Long and Chong, 2001; Tapiero et al., 2002).
Categorized by the logic and type of information connected, several taxonomies exist for describing causal inferences that assist the formation of coherent mental representations. One classification distinguishes local causal inferences that link proximal narrative content active in working memory (McKoon and Ratcliff, 1992; Graesser et al., 1994; Myers et al., 1994; Singer et al., 1994; Long and Chong, 2001; van den Broek et al., 2003) from global causal inferences that organize local narrative events into an established higher order (Myers et al., 1994; Singer et al., 1994; Long and Chong, 2001; Mason and Just, 2004; Brown et al., 2011). Another classification differentiates enabling, physical, motivational, and psychological inferences. Enabling inferences weakly relate narrative events by adding details and are considered least complex (Trabasso et al., 1989; Trabasso and Nickels, 1992). For example, “Max went up the stairs (antecedent). He heard a creaking noise (consequent).” Physical inferences establish physical causality between events and provide the strongest relations (Trabasso et al., 1989; Tapiero et al., 2002). For example, “The jar fell off the windowsill (antecedent). The jar shattered (consequent).” Motivational and psychological inferences are considered most complex (Trabasso et al., 1989). Motivational inferences connect characters' goals to narrative events (Trabasso and Nickels, 1992; Graesser et al., 1994). For example, “The boy wanted to catch the frog (antecedent). He chased after him (consequent).” Psychological inferences connect narrative events to characters' resulting internal states (i.e., emotions). For example, “The frog had gotten away (antecedent). The boy became very angry (consequent).” Although some inference types are more cognitively demanding than others, all ensure coherently organized mental representations form (Trabasso and Stein, 1997; Long and Chong, 2001; van den Broek et al., 2003).
While research has examined how inference generation relates to knowledge integration in the form of knowledge-based inferences (Nicholson and Imlach, 1981; Frank et al., 2003; Cain et al., 2004; Bowyer-Crane and Snowling, 2005; Shears et al., 2007), few studies examine this interaction in children (see Table 1). Some studies suggest knowledge of story structure, and from the narrative itself, inform knowledge-based inferences (Cain et al., 2001, 2004). Future research should intentionally examine knowledge that allows generation of these inferences in populations of young children (i.e., 1- to 4-year-olds). This would improve our estimation of children's understanding by distinguishing how cultural and developmental knowledge impacts inferences and comprehension.
Summary
The constructionist approach to narrative comprehension has offered important information about processes underlying comprehension (Graesser et al., 1994, 1997; Kendeou et al., 2005, 2009) and has lead researchers to examine its application to describing development of narrative comprehension processes (e.g., Trabasso and Nickels, 1992; van den Broek et al., 2005; Lynch et al., 2008). In the next section, we review research on narrative comprehension development in young children and identify gaps in the extant literature.
Narrative Comprehension Development
The last two decades have focused on applying the constructionist paradigm (Graesser et al., 1994) to children, non-readers, and reading achievement during school. Based on research with children from middle- and high-income households, we know that precursors to basic narrative comprehension processes emerge during infancy and reach mature levels around 9 years of age (Omanson et al., 1978; Bauer, 1992; Trabasso et al., 1992). As early as 8 months old, infants begin exhibiting immature causal inferences and goal structure understanding, such as sensitivity to causal structure and means-end (i.e., goal-attainment) problems in the real world (Sommerville and Woodward, 2005; Gerson and Woodward, 2012). By 20 months of age, children can generate enabling inferences and have limited recall of ordered events (Cohen et al., 1999; Wenner and Bauer, 1999). These studies of precursor processes support the constructionist paradigm's notion that, even in infancy, humans make sense of their world by searching for meaning (Franco, 1997).
Development of comprehension processes reaches a critical period between 3 and 5 years of age (Brown et al., 1986, 2011; Benson, 1997; Kendeou et al., 2005, 2008; van den Broek et al., 2005; Lynch et al., 2008; Tompkins et al., 2013). By the age of 3, children can occasionally generate inferences about causal relationships between isolated, physical objects when they encounter them in wordless picture narratives (Berman, 1988; Trabasso and Nickels, 1992; Trabasso et al., 1992; Brown et al., 2011). Children at this age rarely form coherent narrative representations (Berman, 1988) because they struggle to identify key goal structure elements (Trabasso and Nickels, 1992; Trabasso et al., 1992) and possess limited knowledge of the world (Kendeou et al., 2005). At 4 years old, children appear to be in developmental transition (Trabasso et al., 1992; Wenner, 2004). They become more sensitive to hierarchical goal structures and relations between events (Morrow, 1985; Trabasso and Nickels, 1992; Trabasso et al., 1992; van den Broek et al., 1996; Kendeou et al., 2005; Lynch and van den Broek, 2007; Brown et al., 2011). On the other hand, 4-year-olds rely more on enabling and physical inferences and less on complex inferences (van den Broek et al., 2005). Around age 5, children begin to use more mature processes (Trabasso and Nickels, 1992; Trabasso et al., 1992; Brown et al., 2011) and produce more goal-directed mental representations (Trabasso et al., 1992; Berman and Slobin, 1994; Kendeou et al., 2008; Brown et al., unpublished manuscript). These children have memorable experiences to integrate with narrative content, which increases the number and complexity of generated inferences (Trabasso and Nickels, 1992; Eaton et al., 1999; van den Broek et al., 2005; Brown et al., 2011).
From age 6 onward, comprehension processes continue to refine until maturity. Six-year-olds show increased sensitivity to causal relations (Lynch et al., 2008) and make more on-line inferences referring to superordinate and subordinate goals (Lynch and van den Broek, 2007). By age 7, children integrate world-knowledge and potentially over-rely on it for inference-making while ignoring narrative details (Cain et al., 2001; Brandão and Oakhill, 2005). Eight-year-olds appear to be more sensitive to subordinate goals and outcomes, but struggle with superordinate goals (van den Broek et al., 2003). Sensitivities to goal structures and inferences occurring at age 9 result in comprehension processing patterns similar to adult comprehenders (Trabasso et al., 1992; Orrantia et al., 2014).
Future Research Directions
Our review of the literature has identified several important gaps in developmental research regarding narrative comprehension processes (see Table 1). One gap is research that intentionally assesses the process of knowledge integration in children. We assume children rely on this process as a component comprehension process (Pearson et al., 1979; Nicholson and Imlach, 1981; Fincher-Kiefer et al., 1988; Prentice et al., 1997; Cain et al., 2001), but there has been little effort devoted to describing its development. Additionally, few studies have examined goal structure understanding development in children younger than 4 years old (see Table 1). This gap is noteworthy given that children's narrative comprehension heavily depends on goal structure understanding (Low and Durrkin, 1998; Milch-Reich et al., 1999; Lynch and van den Broek, 2007; Pyykkönen and Järvikivi, 2012). Lastly, even less is known about early causal inference generation and goal structure understanding in children from low-income and minority populations. Curenton (2010) and Benson (1997) provide only limited information about causal inference generation and goal structure understanding in these populations of children. Research in this area has excluded populations struggling most in reading achievement outcomes (Federal Interagency Forum on Child and Family Statistics, 2013), and represents 74% of the lowest quartile on national reading assessments (NCES, 2011). Addressing these gaps will identify whether differences between populations exist and the responsible risk factors (e.g., socioeconomic status; McLoyd, 2013).
Underserved and underrepresented populations must be included in future examinations of how narrative variations inhibit or aid comprehension (e.g., Trabasso et al., 1992). van den Broek (1989) argued young children first make inferences between concrete events and are increasingly able to make inferences about abstract events as they age; however, no study has directly examined this or how children comprehend competing or abandoned goals in narratives. Investigating these variations, especially in children from low-income and minority households would extend our knowledge of comprehension, provide developmental standards for children's narratives, and set a more externally valid precedent for future research (Sue, 1999). The future and complexity of narrative research will also require a multi-method approach to assessing narrative comprehension processes.
Narrative Comprehension Assessments
Narrative comprehension assessments typically belong to one of two categories: on-line and off-line (Berman, 1988; Trabasso and Nickels, 1992; Trabasso et al., 1992; Paris and Paris, 2003; Lynch and van den Broek, 2007). On-line assessments require responses be actively generated during narrative presentation whereas off-line assessments require reflective responses be generated after narrative presentation (Milch-Reich et al., 1999; Lynch and van den Broek, 2007). These categories of assessments provide different information about the multifaceted nature of comprehension.
On-Line Assessments
On-line assessments measure what information is integrated into narrative mental representations in “real time” (Milch-Reich et al., 1999). As such, on-line assessments measure ongoing construction and maintenance of narrative mental representations (Renz et al., 2003). This type of assessment is often used with children because it requires less from their limited attentional resources (Milch-Reich et al., 1999; Lorch et al., 2010). Typical on-line assessments include think-aloud protocols, probe questions, and narrations (or storytelling).
Think-aloud protocols assess comprehension during narrative exposure by requiring on-going commentary indicating narrative understanding (Suh and Trabasso, 1993). Typically used for written text comprehension assessment in adults (Trabasso and Suh, 1993; Magliano et al., 1999; Kendeou et al., 2011), think-aloud protocols have informed how and when mental representations form and update (Graesser et al., 1997; Kurby and Zacks, 2012). When used with children as young as 6 years old, narrative events are presented as picture books and children describe the main character's thoughts (Lynch and van den Broek, 2007) or what is happening in the scene (Milch-Reich et al., 1999). Think-aloud protocols have the potential to assess how comprehension processes are developing online at different ages (Suh and Trabasso, 1993; Milch-Reich et al., 1999; Lynch and van den Broek, 2007). Nevertheless, this method must be adjusted to assess young children who have limited or developing expressive vocabularies (Lynch and van den Broek, 2007).
Probe questions are open-ended questions assessing comprehenders' current mental representation at a given point during narrative exposure (Lutz and Radvansky, 1997; Lorch et al., 2006). A probe question might ask a child, “Why is the boy mad at his parents?” Answering requires recalling narrative events and generating inferences. Responses are analyzed for accuracy and are indicators of comprehension processes (e.g., goal-related inferences; Lynch and van den Broek, 2007). Probe questions are challenging for younger comprehenders as they interrupt and divert children's already limited attentional resources and may actually disrupt comprehension (van den Broek et al., 2001).
Story narration methods typically require comprehenders create an oral story based on picture sequences (Berman and Slobin, 1994; Berman, 1995, 2004). Story narrations are perhaps most often employed using wordless picture books when assessing comprehension processing in preschool children (Shapiro and Hudson, 1991; Trabasso and Nickels, 1992; Paris and Paris, 2003; Brown et al., 2011). Picture books are often used because the stationary images offer fewer distractions for child comprehenders (Pike et al., 2010). Arfé and Boscolo (2006) asked a sample of hearing and non-hearing children to write, rather than orally produce, a story based on the children's picture book Frog, Where are You? (Mayer, 1969). Resulting narrations are analyzed for words used (Berman, 1988; Pelletier and Astington, 2004), number of goal related inferences generated (Lynch and van den Broek, 2007), accuracy of identified goal structure elements (Pemberton and Watkins, 1987; Brown et al., unpublished manuscript), and frequency and complexity of causal inferences generated (Arfé and Boscolo, 2006; Brown et al., 2011). Narrations allow individual processes to be assessed in terms of maturation. Ideal narrations include purposeful organization of narrative events (i.e., goal structure understanding), causal inferences of varying complexity, and integration of world and narrative knowledge (Trabasso and Nickels, 1992; Trabasso et al., 1992).
Other measures such as brain imaging, eye tracking, and reading times have also been used to assess on-line processes. Event related potentials (ERPs) and eye tracking have been employed in examinations of knowledge integration (Cook and Myers, 2004; Ferretti et al., 2013; Filik and Leuthold, 2013). Specific brain areas have been identified as important for causal inference generation (Mason and Just, 2004). Orrantia et al. (2014) showed 11-year-olds were more efficient than 9-year-olds at connecting character goals with actions based on faster reading times (see also Albrecht and Myers, 1995). Other studies use reading times to compare the availability of neutral, completed or achieved, and failed goal information in memory (Lutz and Radvansky, 1997; Richards and Singer, 2001). Obviously, reading times are inappropriate for young non-readers; however, eye-tracking methods measuring looking times during picture book narrations may provide insight into processing that emerges prior to formal reading (Evans and Saint-Aubin, 2005). Although ERPs have assessed language development in young children (e.g., Friederici, 2005; see Kuhl, 2010), brain imaging has not been extended to investigations of on-line narrative comprehension processing in preschool-age children.
Off-Line Assessments
Off-line assessments measure the outcome of processing and what information has been included in comprehenders' final mental representations (Milch-Reich et al., 1999; Lynch and van den Broek, 2007). Although these assessments may not be the most appropriate for young children (Gibbons et al., 1986; Tompkins et al., 2013), they identify specific narrative content that has been comprehended. Commonly used off-line assessments include free recall, narrative retellings, and cued recall.
Free recall tasks assess what content is encoded as most important and accessible in a narrative (Kendeou et al., 2005). Open-ended recall prompts often ask comprehenders to “tell what you can remember from the story.” This method allows for large variations in responses and has been instrumental in identifying individual and developmental differences in recalled content (van den Broek et al., 1996; Lorch et al., 2010). Free recall has examined comprehension across different narratives media types (e.g., videos, written text, and aural stories; Kendeou et al., 2005, 2008), how much narrative information was remembered (Kendeou et al., 2008, 2009; Kim et al., 2008) and comprehenders' causal sensitivity (Tompkins et al., 2013). Because of demands placed on attention, memory and interest, simple free recall tasks are not as sensitive to young children's comprehension (Gibbons et al., 1986).
Narrative retellings, a form of free recall, are considered the most ideal off-line assessment for child populations, as they allow them to revisit their narrative experience (Morrow, 1985; Wenner, 2004). Retellings may take the form of a verbal story (Trabasso et al., 1992; Lorch et al., 2010) or physical enactment with or without props (Morrow, 1985; Wenner, 2004). Accuracy of children's retellings indicates their sensitivity to narrative goal structure and inferred event relations (Morrow, 1985). Murachver et al. (1996) found the use of props and characters while enacting the narrative increased children's comprehension of narrative events. They suggest actively involving children in the narrative may assist comprehension by highlighting goal and attempt relations (Murachver et al., 1996).
Compared to free recall, cued recall is useful for determining the most effective cues for retrieving information from mental representations (Paris et al., 1977). Lorch et al. (2006) used cued recall questions to assess children's comprehension of narrative events. They found children's accuracy was greatest for narrative events in causal chains. Unlike on-line probe questions, cued recall questions typically yield very literal, content-based answers when used with children (Lynch and van den Broek, 2007). However, Omanson et al. (1978) found increased inferential comprehension for 5- and 8-year-olds during cued recall when compared to free recall. Cued recall may encourage inferences through vague questions such as, “What made the boy leave his house?” or assess specific narrative understanding through more literal questioning, such as “Who was in the tree?” (Lorch et al., 1999a). These questions draw attention to central narrative details, encourage inference generation, and assist in young comprehenders' maintenance of information (Lorch et al., 1999a,b, 2000, 2004, 2006, 2010; Curenton, 2010). As considerable dialog between early childhood educators and their students already involves inferential questioning (Zucker et al., 2010), researchers have increasingly employed cued recall to assess narrative comprehension in school-age children.
Comparing and Combining Assessments
Accurately assessing comprehension demands a multi-method approach be taken, particularly when assessing narrative comprehension processes in young children. Our previous descriptions of on- and off-line assessments highlight knowledge added from each assessment and its developmental appropriateness. However, both on- and off-line assessments contain methodological aspects that limit their use in isolation.
Investigating young children's comprehension processes typically employs on-line comprehension measures (e.g., picture book narrations; Berman, 1988; Trabasso and Nickels, 1992; Trabasso et al., 1992; Paris and Paris, 2003; Lynch and van den Broek, 2007; Brown et al., 2011). Although efficient and frequently used, narrating picture books may underestimate children's competencies if used in isolation (Trabasso et al., 1992). Three- to 5-year-olds, for example, may not fully articulate their understanding due to immature expressive language (Berman, 1988, 2004; Shapiro and Hudson, 1991; Berman and Slobin, 1994; Wigglesworth, 1997; Pearce, 2003; Kulkofsky et al., 2008; Curenton, 2010) and would benefit from additional comprehension tasks. Similarly, young children require additional training procedures to complete think-aloud protocols (Lynch and van den Broek, 2007). Isolated assessments may be unable to differentiate between cognitive resources used for completing the task (e.g., vocabulary) and specific comprehension processes (e.g., causal inference generation). Graesser et al. (1997) further argue that some on-line assessments, such as reading times, may provide ambiguous evidence about processes involved.
Similarly, off-line measures should not be used in isolation with children who may not possess the cognitive maturity required to construct a complete representation. Specifically, young children's limited attentional and memory resources may negatively impact performance on off-line assessments (Lorch et al., 1999a,b, 2000, 2004, 2006, 2010; Milch-Reich et al., 1999). While some off-line assessments use support props or illustrations (Morrow, 1985; Murachver et al., 1996; Wenner, 2004), narratives unable to provide such accommodations risk children misunderstanding story content. Children's comprehension errors made during narrative exposure are not easily corrected after their mental representation is constructed (van den Broek et al., 2001). As comprehension processing development is central to children's reading outcomes (Benson, 1997; van den Broek et al., 2005; Lynch and van den Broek, 2007; Kendeou et al., 2008; Brown et al., 2011), measures with developmental limitations cannot be used in isolation. We propose on- and off-line measures used in conjunction may provide insight as to how children engage specific processes when forming coherent mental representations.
A limited set of studies underscores the significance of a multi-method approach to understanding narrative comprehension development. van den Broek et al. (2005) suggested cued recall, in addition to story narrations, may provide information regarding young children's narrative mental representations. An early study employing this multi-method approach measured comprehension using cued and free recall but did not find parallel comprehension increases for 5- and 8-year-olds (Omanson et al., 1978). However, more recent studies found 4- to 8-year-olds' inferences generated on-line during think-aloud protocols and story narration positively related to the amount of narrative information included in both free and cued recall (Lynch and van den Broek, 2007; Tompkins et al., 2013). This suggests specific method combinations may provide accurate depictions of children's mental representations. For example, Trabasso et al. (1992) used both story narrations and cued recall questions to assess children and found, when prompted by cued recall, increases in story comprehension.
A multi-method approach to narrative comprehension processes research also has the potential to address many of the gaps in the extant literature. One gap is the examination of comprehension processes across narrative media presentations (Kendeou et al., 2005, 2008). The constructionist paradigm (Graesser et al., 1994) asserts processing should be similar regardless of presentation, which limited research has confirmed. Another gap encompasses the development of knowledge integration. Research suggests combining on- and off-line measures is most informative for investigating knowledge integration with adults. Narvaez et al. (1999) found changes in comprehenders' purpose (i.e., entertainment vs. studying) led to differences in on-line processing measured by think-aloud protocols, but not in off-line processing measured by free recall. Specifically, comprehenders' were more likely to engage in knowledge integration when reading to study. Thus, comprehenders' intentions may impact knowledge integration during on-line comprehension, but not the final mental representation. This finding has implications for reading instruction. Through intentional selection of multi-method assessments that can address variations in individual knowledge, population-based differences, and narratives across media, the body of comprehension research will more accurately describe how processes develop in all children.
External Validity and Narrative Comprehension Development Research
Review of the current literature suggests an emphasis on internal validity when assessing narrative comprehension development that has resulted in a de-emphasis on external validity (Anderson et al., 1999; Sue, 1999). Internal validity addresses whether the construct being measured (e.g., tiredness) causes a specific effect (e.g., crankiness); whereas external validity addresses whether a causal relationship can be generalized across other measures, populations, time, and settings (e.g., Does tiredness make all children cranky? Bracht and Glass, 1968; Calder et al., 1982). These validities have an inverse relationship, such that increasing experimental control (internal validity) decreases generalizability (external validity). Arguments against externally valid studies include the suggestion that such studies are nearly impossible to conduct (Calder et al., 1982; Mook, 1983) and that they decrease internal validity, which hinders progress of scientific research (Calder et al., 1982). Alternatively, it has been suggested that subtle, systemic biases have crafted contemporary psychology to value empiricism and internal validity, resulting in a lack of high quality ethnic minority research (Sue, 1999). Despite resistance to, and perceived difficulty of, conducting experiments that account for background factors affecting generalizability (Calder et al., 1982), externally valid research has been influential in identifying significant truths about how humans operate (Anderson et al., 1999; Quintana et al., 2006). For example, Paris and Paris (2003) assessed on- and off-line narrative comprehension in 158 racially and socioeconomically diverse 5- to 8-year-olds from the same city. Despite having a representative sample, they reported finding only developmental and ability-related differences in children's comprehension rather than differences related to racial and socioeconomic factors. These results raise the empirical question of whether demographics systematically relate to narrative comprehension abilities (Sue, 1999; McLoyd, 2013). Addressing this requires first identifying if significant differences stem from race or socioeconomic status, and then under what circumstances those differences manifest. However, until greater research intentionally assesses diverse populations, we can only speculate differences in background knowledge may exist. Hence, we have highlighted external validity concerns in the extant literature and identified what may be gained by addressing these concerns. Specifically, we argue for more studies that account for individual knowledgebases, differences in populations, and narrative media types employed when assessing young children.
Individual Knowledgebase
In order to broaden the scope of narrative comprehension research to include all children, researchers must proactively consider the impact of individual differences in knowledgebase on comprehension. It is understood that knowledge impacts mental representation formation (Myers et al., 1994; Singer et al., 1994; Zwaan et al., 1995a,b; Long and Chong, 2001; Brandão and Oakhill, 2005; Gerrig, 2011; Kurby and Zacks, 2012) and comprehension (Gowie, 1973; Graesser et al., 1994, 1997; Best et al., 2008); however, knowledgebase content is constrained by many external factors including age, gender, environment, geography, culture, race and ethnicity, and socioeconomic status. The problem arises when highly controlled experiments find deficits in children's comprehension processes that can be attributed to individual variations in knowledge. For example, a child from a metropolitan area may not have the necessary knowledge to integrate and comprehend why the boy would want to capture and bring home a frog in the picture book Frog, Where are You? (Mayer, 1969). Labeling such variations as merely individual differences (Hannon and Daneman, 2001) is problematic because it implies that a standard body of knowledge transcends all ages, cultures, and differences; and that any knowledge deviations are indications of cognitive deficits.
We must consider more directly then the impact of knowledgebase differences on narrative comprehension processes and their assessment (Graesser et al., 1997). When assessing different cohorts of children, Berman (2004) noted that the concept of a “birthday party” differed for American and Israeli preschoolers. For American children, a birthday party was typically an open-ended script. For Israeli preschoolers, however, it was associated with a highly conventionalized and stereotyped concept. This difference in knowledge may impact goal structure understanding, causal inference generation, and overall comprehension for narratives that include birthday party information.
Differences in experiences may affect what knowledge comprehenders integrate during comprehension (Berman and Slobin, 1994; Gorman et al., 2011). A robust literature describes the importance and frequency of storytelling interactions in African American and low-income families (Gardner-Neblett et al., 2012). There is some suggestion that African American children from low-income households may actually have unique strengths in narrative processing (Gardner-Neblett et al., 2012) because storytelling practices provide children with early exposure to narrative structure and rules (Sperry and Sperry, 1996). Indeed, Curenton (2010) found that, among samples from low-income families, African American children understood characters' goals more often than European American children.
Future comprehension research must select narrative stimuli, assessments, and study designs that account for knowledgebase. For example, Hannon and Daneman (2001) provided nonsense concepts that related to real-world images (e.g., a MIRT resembles an ostrich, but with a larger and longer neck), which measured whether participants had access to specific prior knowledge that impacted their inference making. Performance on this task accounted for much of the variance in reading comprehension, suggesting prior knowledge had a significant impact on comprehension. Assessing knowledge used during specific comprehension tasks can reduce biases in future research that may be due to environmental, economic, or cultural variations (see Sue, 1999; McLoyd, 2013). If researchers intend to close existing gaps in the literature, changes in experimental procedures must be made to account for variations in knowledgebase across diverse populations (Gorman et al., 2011).
Diverse Populations
By examining narrative comprehension development in diverse populations, researchers will better understand the development of fundamental comprehension processes. Much of the reviewed literature has indicated a trend for assessing convenient and relatively homogenous samples (Sue, 1999). In reality, many studies fail to specify the sample and population (e.g., Cain et al., 2004; Kendeou et al., 2008, 2009). This is detrimental in that much can be gained from examining how ordinary human variations impact comprehension processing. We have identified how diverse samples informed previous narrative comprehension research through differences in ability, culture, and environment; yet, a dearth of research directly tests the role of these factors.
Examining comprehension processes in populations with diverse cognitive abilities has enhanced our general understanding of resources necessary for comprehension. For example, numerous examinations of children with attention deficit hyperactivity disorder (ADHD) have advanced our appreciation for attentional resources needed for narrative comprehension and young comprehenders' limits (Tannock et al., 1993; Lorch et al., 1999a,b, 2000, 2004, 2006, 2010; Renz et al., 2003). One study examining children with mild mental retardation and learning disabilities found narrative recall was related to information on causal chains (Wolman et al., 1997). This confirmed that children's and adults' cognitive load is reduced when comprehending narratives that are highly causally-related (Trabasso and Sperry, 1985; Trabasso and van den Broek, 1985; van den Broek et al., 1996; Lorch et al., 2006). Similar to typically developing children (Kendeou et al., 2008), this sensitivity to causal structure has been found to develop relatively independently of basic language skills in young children with Down syndrome (Kim et al., 2008). Investigations of non-hearing (Arfé and Boscolo, 2006; Chamberlain and Mayberry, 2008) and non-seeing (Carreiras and Alvarez, 1999) populations have demonstrated both similarities and differences in narrative comprehension processing. These studies speak to factors supporting the development of comprehension processes and highlight the necessity of examining populations typically underrepresented in research.
A greater concern regarding the current body of literature is the underrepresentation of racial and ethnic minority samples. Findings from predominately European American, middle-class populations may yield results with minimal variability and limited generalizability to other populations (Sue, 1999; Frierson et al., 2008). It is suggested that there are numerous concerns to be addressed when recruiting racial and ethnic minorities in research (Frierson et al., 2008). A limited number of studies have focused on traditionally underrepresented and underserved populations when examining narrative comprehension processes. (Melzi, 2000; Fiorentino and Howe, 2004; Curenton, 2010; Gorman et al., 2011; Brown et al., unpublished manuscript). Results from Gorman et al., (2011) identified cultural differences in storytelling style and how these differences impact comprehension. Latino children emphasized character names during storytelling, African American children included story embellishments, and European American children emphasized character relationships. While this procedure provided a culturally non-biased context for analyzing story production, a less culturally sensitive researcher might have concluded that some children struggled to identify and emphasize key story elements based on stylistic differences. It is imperative then that future studies consider the role of cultural values for future and past narrative research (Quintana et al., 2006).
Some research intentionally increases external validity by purposefully including children from low-income and racial and ethnic minority populations in samples (e.g., Curenton, 2010; Brown et al., unpublished manuscript). As a result of their focus, these researchers are regularly challenged and criticized about the validity and necessity of their work (Sue, 1999). Common criticisms highlight that these studies may lack control groups of children from majority or middle-income populations. Further, there is reluctance to include such studies as part of converging evidence about typical developmental trends. Although these arguments suggest a desire to maintain basic experimental control and internal validity, they have made research of underrepresented groups difficult to conduct and fund (Sue, 1999). This suggests the desire to conduct externally valid research exists, but is met with resistance by the scientific community.
Since early comprehension processes are strong predictors of later comprehension and reading skills (van den Broek et al., 2001, 2003, 2005; Brown et al., 2011), it is essential to include children placed at-risk using externally valid assessments (Benson, 1997; Brown et al., unpublished manuscript). Despite this, the current review identified the dearth of such research (see Table 1). As at-risk communities typically experience threats to development during critical learning periods, less access to health-care and resources, and diverse values (Morrow, 1985; Bradley and Corwyn, 2002; Evans, 2004; Curenton, 2010), there may be differences in knowledgebases used to form coherent narrative mental representations (Sharp et al., 1995). It has also been suggested that children from low-income communities have difficulty generating narratives and require additional attention in schools (Fiorentino and Howe, 2004). As a considerable portion of comprehension research has examined children's narrative comprehension through story narration, these findings suggest a new approach may be necessary. For example, future comprehension assessments using familiar or dynamic narrative stimuli (e.g., televised narratives, multimedia books) may provide support to children who struggle with narrative production (Sharp et al., 1995; Wright et al., 2001; Verhallen et al., 2006). We assert then that future research must accommodate and include people from underrepresented groups, particularly children. Using a multi-method approach to assess comprehension will ensure these populations are accurately evaluated. More importantly, though, they will receive the same attention that has identified comprehension difficulties in typically measured populations.
Media Type
While knowledge, experiential, and cultural differences may impact children's narrative comprehension processing, the constructionist paradigm argues that these underlying processes are generalizable across narrative media type (Graesser et al., 1994; Kendeou et al., 2005, 2008, 2009). This idea is supported by fMRI investigations by Anderson et al. (2006) that found that comprehending silent filmic montages activated brain regions similar to those activated by comprehending language and narratives. This suggests that comprehension of narrative-structured events recruit similar cortical networks regardless of presentation. These results were confirmed by Kendeou et al. (2008) who found 4- and 6-year-olds' inference generation were interrelated across aural, written, and televised stories. This interdependency continued over time as children turned 6 and 8 years old. Thus, as society becomes increasingly technological, it is necessary that research continue to examine this generalizability of comprehension processing across narrative media during children's development (Anderson and Hanson, 2009; Christakis and Zimmerman, 2009). The Kaiser Family Foundation (Rideout and Hamel, 2006) reported that 81–87% of 2- to 6-year-olds read or are read to everyday, but more than 70% also watch television daily. Further, more than 40% of young children spend 2 hours or more watching television in a typical day and 29–43% have television in their bedroom. Parallel changes in narrative stimuli formats must be considered for the future of comprehension research in order to ensure its external validity.
Still, narrative research often selects wordless picture books as stimuli for young children because they limit distractors and require basic comprehension processes (Pike et al., 2010). This may also be partially due to public resistance toward television and the argument that it negatively impacts cognitive and social development (Vandewater et al., 2007; Schmidt et al., 2008; Kirkorian et al., 2009). A growing body of research, however, refutes this assertion and suggests that regulating the amount of media exposure and content may actually benefit and educate children (Schmidt and Vandewater, 2008; Kirkorian and Anderson, 2009; Anderson and Hanson, 2009; Kirkorian et al., 2009). For example, educational programs such as Sesame Street and Blues Clues use goal-oriented narratives to discuss topics later covered in schools and to teach problem solving (Kirkorian et al., 2008). The promise of such programming suggests that narrative media may be beneficial in assessing and improving children's comprehension processing.
It seems apparent then that both developmental appropriateness and potential benefits of media narratives must be considered for the future of comprehension research. For example, dynamic conventions associated with televised narratives for children (e.g., scene changes, transitions, off-screen audio) may be too complex for children younger than 24 months (Anderson and Hanson, 2009, 2010; Kirkorian et al., 2009, 2012; Pempek et al., 2010). Alternatively, it has been suggested that elaborate visual information enhances comprehension processing in young children (Shapiro and Hudson, 1991; Pearce, 2003; Orrantia et al., 2014). By 3 years old, it appears that children can discriminate between symbolic representations of the world and the real world efficiently enough to engage in instructional problem solving (e.g., 3-year-olds can watch a video of a toy hidden in a room, and later locate the hidden toy when brought into a room identical to the depiction; Schmitt and Anderson, 2002). As an extension, it is possible that dynamic visual information accompanied by auditory information available in television has greater benefits to comprehension processes as children mature. Indeed, storybooks presented in a multimedia format were found to improve causal inference generation, narrative retellings, and overall coherence in 5-year-olds placed at-risk compared to storybooks with static pictures (Verhallen et al., 2006). These studies suggest that, while comprehension processes generalize across media formats, certain populations may benefit from different or enhanced narrative presentations.
When contemplating the future of comprehension research, it is important to change opinions regarding narrative media in order to identify and maximize benefits for children (Anderson and Hanson, 2009; Christakis and Zimmerman, 2009). Using non-traditional narrative media presentations, such as television or interactive “e-books,” may reduce cognitive load, improve recall of narrative events, and enhance story comprehension for children (Gibbons et al., 1986; Sharp et al., 1995; Linebarger and Piotrowski, 2009; Korat, 2010). As an increasingly technological society, researchers must consider the ecological validity of laboratory stimuli (Pearce, 2003). This is particularly important for children from underrepresented communities who often have more access to televisions than print media (Sharp et al., 1995; Neuman and Celano, 2001; Evans, 2004; Rideout and Hamel, 2006). It is imperative that narrative stimuli be developmentally and ecologically appropriate for all children's comprehension processes.
Conclusion
This review argued for intentional changes to increase the external validity of narrative comprehension development research. Pervasive internal validity emphasis within the scientific community has deemphasized external validity and led to unbalanced research practices (Sue, 1999). This endeavor requires future studies employ externally valid rationales in order to fill important gaps in the current literature. An intentional shift toward balancing converging evidence with internally and externally valid studies will ensure accurate assessment of future children's comprehension. As a research area with significant academic implications, future work must include traditionally understudied and underserved populations (Sharp et al., 1995; Sue, 1999; Neuman and Celano, 2001; Evans, 2004; Rideout and Hamel, 2006) who continue to struggle in reading achievement (NCES, 2011; Federal Interagency Forum on Child and Family Statistics, 2013). This will require the intentional inclusion of diverse populations and increase in cultural validity of laboratory studies (Sue, 1999; Quintana et al., 2006; McLoyd, 2013).
The theoretical framework of this review, the constructionist paradigm (Graesser et al., 1994), lends itself to applied future studies that would improve the generalizability of converging comprehension research. Therefore, intentional inclusion of underserved and underrepresented children in future studies will provide a more accurate, holistic view of and how environmental factors contribute to comprehension development. Accompanying this inclusion, researchers must be mindful of differences in knowledgebases when creating age and culturally appropriate narratives for assessment. This, in turn, will offer clearer insight into improving assessments for underserved populations (e.g., using narrative stimuli that are sample-appropriate and ecologically valid). Through the purposeful investigation of these populations, improved comprehension measures will be developed to benefit all children.
We would be misguided to ignore societal changes that impact child development, and must, therefore, adapt methodology to assess narrative comprehension in the current era (Anderson and Hanson, 2009; Christakis and Zimmerman, 2009). Indeed, policies and practices within research laboratories must also reflect this (McLoyd, 2013). The constructionist paradigm of narrative comprehension has the potential to explain comprehension through previously excluded narrative stimuli (Graesser et al., 1994; Kendeou et al., 2005, 2008, 2009). The outcomes of such changes remain an empirical question similar to ideas concerning generalizability across populations (Sue, 1999; Brown et al., unpublished manuscript). Broadening the scope of narrative comprehension research will only have positive implications for academic and societal outcomes. When research balances internal and external validity we will be able to truly assess when, and how, all children comprehend.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Albrecht, J. E., and Myers, J. L. (1995). Role of context in accessing distant information during reading. J. Exp. Psychol. Learn. Mem. Cogn. 21, 1459–1468. doi: 10.1037/0278-7393.21.6.1459
Aldrich, N. J., Tenenbaum, H. R., Brooks, P. J., Harrison, K., and Sines, J. (2011). Perspective taking in children's narratives about jealousy. Br. J. Dev. Psychol. 29, 86–109. doi: 10.1348/026151010X533238
Alexander, P. A., Kulikowich, J. M., and Jetton, T. L. (1994). The role of subject-matter knowledge and interest in the processing of linear and nonlinear texts. Rev. Educ. Res. 64, 201–252. doi: 10.3102/00346543064002201
Anderson, C. A., Lindsay, J. J., and Bushman, B. J. (1999). Research in the psychological laboratory truth or triviality? Curr. Dir. Psychol. Sci. 8, 3–9. doi: 10.1111/1467-8721.00002
Anderson, D. R., Fite, K. V., Petrovich, N., and Hirsch, J. (2006). Cortical activation while watching video montage: an fMRI study. Media Psychol. 8, 7–24. doi: 10.1207/S1532785XMEP0801_2
Anderson, D. R., and Hanson, K. G. (2009). Children, media, and methodology. Am. Behav. Sci. 52, 1204–1219. doi: 10.1177/0002764209331542
Anderson, D. R., and Hanson, K. G. (2010). From blooming, buzzing confusion to media literacy: The early development of television viewing. Dev. Rev. 30, 239–255. doi: 10.1016/j.dr.2010.03.004
Arfé, B., and Boscolo, P. (2006). Causal coherence in deaf and hearing students' written narratives. Discourse Process. 42, 271–300. doi: 10.1207/s15326950dp4203_2
Bauer, P. J. (1992). Holding it all together: how enabling relations facilitate young children's event recall. Cogn. Dev. 7, 1–28. doi: 10.1016/0885-2014(92)90002-9
Bauer, P. J., Dow, G. A., Bittinger, K. A., and Wenner, J. A. (1998). Accepting and exempting the unexpected: 30-month-olds' generalization of event knowledge. Cogn. Dev. 13, 421–452. doi: 10.1016/S0885-2014(98)90002-8
Bauer, P. J., Schwade, J. A., Wewerka, S. S., and Delaney, K. (1999). Planning ahead: goal-directed problem solving by 2-year-olds. Dev. Psychol. 35, 1321–1337. doi: 10.1037/0012-1649.35.5.1321
Bauer, P. J., and Shore, C. M. (1987). Making a memorable event: effects of familiarity and organization on young children's recall of action sequences. Cogn. Dev. 2, 327–338. doi: 10.1016/S0885-2014(87)80011-4
Benson, M. S. (1997). Psychological causation and goal-based episodes: low-income children's emerging narrative skills. Early Child. Res. Q. 12, 439–457. doi: 10.1016/S0885-2006(97)90021-1
Berger, A. A. (1997). Narratives in Popular Culture, Media, and Everyday Life. Thousand Oaks, CA: SAGE Publications, Inc.
Berman, R. A. (1988). On the ability to relate events in narrative. Discourse Process. 11, 469–497. doi: 10.1080/01638538809544714
Berman, R. A. (1995). Narrative competence and storytelling performance: how children tell stories in different contexts. J. Narrat. Life Hist. 5, 285–313.
Berman, R. A. (2004). “The role of context in developing narrative abilities,” in Relating Events in Narrative: Typological and Contextual Perspectives, eds S. Strömqvist and L. Verhoeven (Mahwah, NJ: Erlbaum), 261–280.
Berman, R. A., and Slobin, D. I. (eds.). (1994). Relating Events in Narrative: a Crosslinguistic Developmental Study. Hillsdale, NJ: Erlbaum.
Best, R. M., Floyd, R. G., and McNamara, D. S. (2008). Differential competencies contributing to children's comprehension of narrative and expository texts. Read. Psychol. 29, 137–164. doi: 10.1080/02702710801963951
Bloom, C., Fletcher, C., van den Broek, P., Reitz, L., and Shapiro, B. (1990). An on-line assessment of causal reasoning during comprehension. Mem. Cogn. 18, 65–71. doi: 10.3758/BF03202647
Bower, G. H., and Morrow, D. G. (1990). Mental models in narrative comprehension. Science 247, 44–48. doi: 10.1126/science.2403694
Bowyer-Crane, C., and Snowling, M. J. (2005). Assessing children's inference generation: what do tests of reading comprehension measure? Br. J. Educ. Psychol. 75, 189–201. doi: 10.1348/000709904X22674
Bracht, G. H., and Glass, G. V. (1968). The external validity of experiments. Am. Educ. Res. J. 5, 437–474. doi: 10.3102/00028312005004437
Bradley, R. H., and Corwyn, R. F. (2002). Socioeconomic status and child development. Annu. Rev. Psychol. 53, 371–399. doi: 10.1146/annurev.psych.53.100901.135233
Brandão, A., and Oakhill, J. (2005). “How do you know this answer?” Children's use of text data and general knowledge in story comprehension. Read. Writ. 18, 687–713. doi: 10.1007/s11145-005-5600-x
Brown, A. L., Kane, M. J., and Echols, C. H. (1986). Young children's mental models determine analogical transfer across problems with a common goal structure. Cogn. Dev. 1, 103–121. doi: 10.1016/S0885-2014(86)80014-4
Brown, D. D., Lile, J., and Burns, B. M. (2011). Basic language skills and young children's understanding of causal connections during storytelling. Read. Psychol. 32, 372–394. doi: 10.1080/02702711.2010.495573
Brownstein, A. L., and Read, S. J. (2007). Situation models and memory: the effects of temporal and causal information on recall sequence. Memory 15, 730–745. doi: 10.1080/09658210701539596
Cain, K., Oakhill, J. V., Barnes, M. A., and Bryant, P. E. (2001). Comprehension skill, inference-making ability, and their relation to knowledge. Mem. Cogn. 29, 850–859. doi: 10.3758/BF03196414
Cain, K., Oakhill, J., and Bryant, P. (2004). Children's reading comprehension ability: concurrent prediction by working memory, verbal ability, and component skills. J. Educ. Psychol. 96, 31–42. doi: 10.1037/0022-0663.96.1.31
Calder, B. J., Phillips, L. W., and Tybout, A. M. (1982). The concept of external validity. J. Consum. Res. 9, 240–244. doi: 10.1086/208920
Carreiras, M., and Alvarez, C. J. (1999). Comprehension processes in braille reading. J. Vis. Impair. Blind. 93, 589–595.
Cevasco, J., and van den Broek, P. (2008). The importance of causal connections in the comprehension of spontaneous spoken discourse. Psicothema 20, 801–806.
Chamberlain, C., and Mayberry, R. I. (2008). American sign language syntactic and narrative comprehension in skilled and less skilled readers: bilingual and bimodal evidence for the linguistic basis of reading. Appl. Psycholing. 29, 367–388. doi: 10.1017/S014271640808017X
Christakis, D. A., and Zimmerman, F. J. (2009). Young children and media limitations of current knowledge and future directions for research. Am. Behav. Sci. 52, 1177–1185. doi: 10.1177/0002764209331540
Cohen, L. B., Rundell, L. J., Spellman, B. A., and Cashon, C. H. (1999). Infants' perception of causal chains. Psychol. Sci. 10, 412–418. doi: 10.1111/1467-9280.00178
Cook, A. E., and Myers, J. L. (2004). Processing discourse roles in scripted narratives: the in?uences of context and world knowledge. J. Mem. Lang. 50, 268–288. doi: 10.1016/j.jml.2003.11.003
Curenton, S. M. (2010). Understanding the landscapes of stories: the association between preschooler's narrative comprehension and production skills and cognitive abilities. Early Child Dev. Care 175, 1–18. doi: 10.1080/03004430.2010.490946
Eaton, J. H., Collis, G. M., and Lewis, V. A. (1999). Evaluative explanations in children's narratives of a video sequence without dialogue. J. Child Lang. 26, 699–720. doi: 10.1017/S0305000999003967
Egidi, G., and Gerrig, R. J. (2006). Readers' experiences of characters' goals and actions. J. Exp. Psychol. Learn. Mem. Cogn. 32, 1322–1329. doi: 10.1037/0278-7393.32.6.1322
Evans, G. W. (2004). The environment of childhood poverty. Am. Psychol. 59, 77–92. doi: 10.1037/0003-066X.59.2.77
Evans, M. A., and Saint-Aubin, J. (2005). What children are looking at during shared storybook reading evidence from eye movement monitoring. Psychol. Sci. 16, 913–920. doi: 10.1111/j.1467-9280.2005.01636.x
Federal Interagency Forum on Child and Family Statistics. (2013). America's Children: Key National Indicators of Well-Being 2013. Washington, DC: U.S. Government Printing Office. Available online at: http://childstats.gov/pdf/ac2013/ac_13.pdf
Ferretti, T. R., Singer, M., and Harwod, J. (2013). Processes of discourse integration: evidence from event-related brain potentials. Discourse Process. 50 165–186. doi: 10.1080/0163853X.2013.766123
Filik, R., and Leuthold, H. (2013). The role of character-based knowledge in online narrative comprehension: evidence from eye movements and ERPs. Brain Res. 1506, 94–104. doi: 10.1016/j.brainres.2013.02.017
Fincher-Kiefer, R., Post, T. A., Greene, T. R., and Voss, J. F. (1988). On the role of prior knowledge and task demands in the processing of text. J. Mem. Lang. 27, 416–428. doi: 10.1016/0749-596X(88)90065-4
Fiorentino, L., and Howe, N. (2004). Language competence, narrative ability, and school readiness in low-income preschool children. Can. J. Behav. Sci. 36, 280–294. doi: 10.1037/h0087237
Florit, E., Roch, M., and Levorato, M. C. (2011). Listening text comprehension of explicit and implicit information in preschoolers: the role of verbal and inferential skills. Discourse Process. 48, 119–138. doi: 10.1080/0163853X.2010.494244
Franco, F. (1997). “The development of meaning in infancy: early communication and social understanding,” in The Development of Social Cognition, ed S. Hala (Hove: Psychology Press), 95–160.
Frank, S. L., Koppen, M., Noordman, L. G., and Vonk, W. (2003). Modeling knowledge-based inferences in story comprehension. Cogn. Sci. 27, 875–910. doi: 10.1207/s15516709cog2706_3
Friederici, A. D. (2005). Neurophysiological markers of early language acquisition: from syllables to sentences. Trends Cogn. Sci. 9, 481–488. doi: 10.1016/j.tics.2005.08.008
Frierson, G. M., Williams, D. M., Dunsiger, S., Lewis, B. A., Whiteley, J. A., Albrecht, A. E., et al. (2008). Recruitment of a racially and ethnically diverse sample into a physical activity efficacy trial. Clin. Trials 5, 504–516. doi: 10.1177/1740774508096314
Gardner-Neblett, N., Pungello, E. P., and Iruka, I. U. (2012). Oral narrative skills: implications for the reading development of African American children. Child Dev. Perspect. 6, 218–224. doi: 10.1111/j.1750-8606.2011.00225.x
Gerrig, R. J. (2011). Individual differences in readers' narrative experiences. Sci. Study Lit. 1, 88–94. doi: 10.1075/ssol.1.1.09ger
Gerson, S. A., and Woodward, A. L. (2012). The goal trumps the means: highlighting goals is more beneficial than highlighting means in means-end training. Infancy 17, 455–590. doi: 10.1111/j.1532-7078.2012.00112.x
Gibbons, J., Anderson, D. R., Smith, R., Field, D. E., and Fischer, C. (1986). Young children's recall and reconstruction of audio and audiovisual narratives. Child Dev. 57, 1014–1023. doi: 10.2307/1130375
Gorman, B. K., Fiestas, C. E., Peña, E. D., and Clark, M. (2011). Creative and stylistic devices employed by children during a storybook narrative task: a cross-cultural study. Lang. Speech Hear. Serv. Sch. 42, 167–181. doi: 10.1044/0161-1461(2010/10-0052)
Gowie, C. J. (1973). Psycholinguistic strategies for improving reading comprehension. Elem. Sch. J. 79, 67–73. doi: 10.1086/461133
Graesser, A. C., Golding, J. M., and Long, D. L. (1991). “Narrative representation and comprehension,” in Handbook of Reading Research: Vol. II, eds R. Barr, M. L. Kamil, P. B. Mosenthal, and P. D. Pearson (White Plains, NY: Longman), 171–205.
Graesser, A. C., and Kreuz, R. J. (1993). A theory of inference generation during text comprehension. Discourse Process. 16, 145–160. doi: 10.1080/01638539309544833
Graesser, A. C., McNamara, D. S., and Louwerse, M. M. (2003). “What do readers need to learn in order to process coherence relations in narrative and expository text?” in Rethinking Reading Comprehension, eds A. P. Sweet and C. E. Snow (New York, NY: Guilford), 82–98.
Graesser, A. C., Millis, K. K., and Zwaan, R. A. (1997). Discourse comprehension. Annu. Rev. Psychol. 48, 163–189. doi: 10.1146/annurev.psych.48.1.163
Graesser, A. C., Olde, B., and Klettke, B. (2002a). “How does the mind construct and represent stories?” in Narrative Impact: Social and Cognitive Foundations, eds M. C. Green, J. J. Strange, and T. C. Brock (Mahwah, NJ: Lawrence Erlbaum), 231–263.
Graesser, A. C., Person, N. K., and Hu, X. (2002b). Improving comprehension through discourse processing. New Dir. Teach. Learn. 89, 33–44. doi: 10.1002/tl.45
Graesser, A. C., Singer, M., and Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychol. Rev. 101, 371–395. doi: 10.1037/0033-295X.101.3.371
Graesser, A. C., and Wiemer-Hastings, K. (1999). “Situational models and concepts in story comprehension,” in Narrative Comprehension, Causality, and Coherence: Essays in Honor of Tom Trabasso, eds S. R. Goldman, A. C. Graesser, and P. van den Broek (Mahwah, NJ: Erlbaum), 77–92.
Graesser, A. C., Wiemer-Hastings, P., and Wiemer-Hastings, K. (2001). “Constructing inferences and relations during text comprehension,” in Text Representation: Linguistic and Psycholinguistic Aspects, eds T. Sanders, J. Schilperoord, and W. Spooren (Amsterdam: John Benjamins Publishing Company), 249–271.
Hamm, V. P., and Hasher, L. (1992). Age and the availability of inferences. Psychol. Aging 7, 56–64. doi: 10.1037/0882-7974.7.1.56
Hannon, B., and Daneman, M. (2001). A new tool for measuring and understanding individual differences in the component processes of reading comprehension. J. Educ. Psychol. 93, 103–128. doi: 10.1037/0022-0663.93.1.103
Henderson, A. M., and Woodward, A. L. (2011). “Let's work together”: what do infants understand about collaborative goals? Cognition 121, 12–21. doi: 10.1016/j.cognition.2011.05.008
Kendeou, P., Bohn-Gettler, C., White, M., and van den Broek, P. (2008). Children's inference generation across different media. J. Res. Read. 31, 259–272. doi: 10.1111/j.1467-9817.2008.00370.x
Kendeou, P., Lynch, J. S., van den Broek, P., Espin, C. A., White, M., and Kremer, K. E. (2005). Developing successful readers: building early comprehension skills through television viewing and listening. Early Child. Educ. J. 33, 91–98. doi: 10.1007/s10643-005-0030-6
Kendeou, P., Muis, K. R., and Fulton, S. (2011). Reader and text factors in reading comprehension processes. J. Res. Read. 34, 365–383. doi: 10.1111/j.1467-9817.2010.01436.x
Kendeou, P., Savage, R., and van den Broek, P. (2009). Revisiting the simple view of reading. Br. J. Educ. Psychol. 79, 353–370. doi: 10.1348/978185408X369020
Kim, O. Kendeou, P., van den Broek, P., White, M. J., and Kremer, K. (2008). Cat, rat, and Rugrats: narrative comprehension in young children with Down Syndrome. J. Dev. Phys. Disabil. 20, 337–351. doi: 10.1007/s10882-008-9101-0
Kintsch, W. (1988). The role of knowledge in discourse comprehension: a construction-integration model. Psychol. Rev. 95, 163–182. doi: 10.1037/0033-295X.95.2.163
Kirkorian, H. L., and Anderson, D. R. (2009). “Learning from educational media,” in The Handbook of Children, Media, and Development, eds S. L. Calvert and B. J. Wilson (Oxford: Blackwell Publishing Ltd.), 188–213. doi: 10.1002/9781444302752.ch9
Kirkorian, H. L., Anderson, D. R., and Keen, R. (2012). Age differences in online processing of video: an eye movement study. Child Dev. 83, 497–507. doi: 10.1111/j.1467-8624.2011.01719.x
Kirkorian, H. L., Pempek, T. A., Murphy, L. A., Schmidt, M. E., and Anderson, D. R. (2009). The impact of background television on parent–child interaction. Child Dev. 80, 1350–1359. doi: 10.1111/j.1467-8624.2009.01337.x
Kirkorian, H. L., Wartella, E. A., and Anderson, D. R. (2008). Media and young children's learning. Future Child. 18, 39–61. doi: 10.1353/foc.0.0002
Korat, O. (2010). Reading electronic books as a support for vocabulary, story comprehension and word reading in kindergarten and first grade. Comput. Educ. 55, 24–31. doi: 10.1016/j.compedu.2009.11.014
Kuhl, P. K. (2010). Brain mechanisms in early language acquisition. Neuron 67, 713–727. doi: 10.1016/j.neuron.2010.08.038
Kulkofsky, S., Wang, Q., and Ceci, S. J. (2008). Do better stories make better memories? Narrative quality and memory accuracy in preschool children. Appl. Cogn. Psychol. 22, 21–38. doi: 10.1002/acp.1326
Kurby, C. A., and Zacks, J. M. (2012). Starting from scratch and building brick by brick in comprehension. Mem. Cogn. 40, 1–15. doi: 10.3758/s13421-011-0179-8
Linderholm, T., Gernsbacher, M. A., van den Broek, P., Neninde, L., Robertson, R. R., and Sundermier, B. (2004). Suppression of story character goals during reading. Discourse Process. 37, 67–78. doi: 10.1207/s15326950dp3701_4
Linebarger, D. L., and Piotrowski, J. T. (2009). TV as storyteller: how exposure to television narratives impacts at−risk preschoolers' story knowledge and narrative skills. Br. J. Dev. Psychol. 27, 47–69. doi: 10.1348/026151008X400445
Long, D. L., and Chong, J. L. (2001). Comprehension skill and global coherence: a paradoxical picture of poor comprehenders' abilities. J. Exp. Psychol. Learn. Mem. Cogn. 27, 1424–1429. doi: 10.1037/0278-7393.27.6.1424
Long, S. A., Winograd, P. N., and Bridge, C. A. (1989). The effects of reader and text characteristics on imagery reported during and after reading. Read. Res. Q. 24, 353–372. doi: 10.2307/747774
Lorch, E. P., Diener, M. B., Sanchez, R. P., Milich, R., Welsh, R., and van den Broek, P. (1999a). The effects of story structure on the recall of stories in children with attention deficit hyperactivity disorder. J. Educ. Psychol. 91, 273–283. doi: 10.1037/0022-0663.91.2.273
Lorch, E. P., Eastham, D., Milich, R., Lemberger, C. C., Polley-Sanchez, R., Welsh, R. et al. (2004). Difficulties in comprehending causal relations among children with ADHD: the role of cognitive engagement. J. Abnorm. Psychol. 113, 56–63. doi: 10.1037/0021-843X.113.1.56
Lorch, E. P., Milich, R., Astrin, C. C., and Berthiaume, K. S. (2006). Cognitive engagement and story comprehension in typically developing children and children with ADHD from preschool through elementary school. Dev. Psychol. 42, 1206–1219. doi: 10.1037/0012-1649.42.6.1206
Lorch, E. P., Milich, R., Flake, R. A., Ohlendorf, J., and Little, S. (2010). A developmental examination of story recall and coherence among children with ADHD. J. Abnorm. Child Psychol. 38, 291–301. doi: 10.1007/s10802-009-9377-2
Lorch, E. P., Milich, R., Sanchez, R. P., van den Broek, P., Baer, S., Hooks, K., et al. (2000). Comprehension of televised stories in boys with attention deficit/hyperactivity disorder and nonreferred boys. J. Abnorm. Psychol. 109, 321–330. doi: 10.1037//0021-843X.109.2.321
Lorch, E. P., Sanchez, R. P., van den Broek, P., Milich, R., Murphy, E. L., Lorch, R. F., et al. (1999b). The relation of story structure properties to recall of television stories in young children with attention-deficit hyperactivity disorder and nonreferred peers. J. Abnorm. Child Psychol. 27, 293–309. doi: 10.1023/A:1022658625678
Low, J., and Durrkin, K. (1998). Structure and causal connections in children's on-line television narratives: what develops? Cogn. Dev. 13, 201–225. doi: 10.1016/S0885-2014(98)90039-9
Lutz, M. F., and Radvansky, G. A. (1997). The fate of completed goal information in narrative comprehension. J. Mem. Lang. 36, 293–310. doi: 10.1006/jmla.1996.2491
Lynch, J. S., and van den Broek, P. (2007). Understanding the glue of narrative structure: children's on- and off-line inferences about characters' goals. Cogn. Dev. 22, 323–340. doi: 10.1016/j.cogdev.2007.02.002
Lynch, J. S., van den Broek, P., Kremer, K. E., Kendeou, P., White, M., and Lorch, E. P. (2008). The development of narrative comprehension and its relation to other early reading skills. Read. Psychol. 29, 327–365. doi: 10.1080/02702710802165416
Magliano, J. P., and Radvansky, G. A. (2001). Goal coordination in narrative comprehension. Psychon. Bull. Rev. 8, 372–376. doi: 10.3758/BF03196175
Magliano, J. P., Taylor, H. A., and Kim, H. J. J. (2005). When goals collide: monitoring the goals of multiple characters. Mem. Cogn. 33, 1357–1367. doi: 10.3758/BF03193368
Magliano, J. P., Trabasso, T., and Graesser, A. C. (1999). Strategic processing during comprehension. J. Educ. Psychol. 91, 615–629. doi: 10.1037/0022-0663.91.4.615
Marmolejo-Ramos, F., de Juan, M., Gygax, P., Madden, C. J., and Roa, S. (2009). Reading between the lines: the activation of background knowledge during text comprehension. Pragmatics Cogn. 17, 77–107. doi: 10.1075/pc.17.1.03mar
Mason, R. A., and Just, M. A. (2004). How the brain processes causal inferences in text: a theoretical account of generation and integration component processes utilizing both cerebral hemispheres. Psychol. Sci. 15, 1–7. doi: 10.1111/j.0963-7214.2004.01501001.x
McCabe, A., Bliss, L., Barra, G., and Bennett, M. (2008). Comparison of personal versus fictional narratives of children with language impairment. Am. J. Speech Lang. Pathol. 17, 194–206. doi: 10.1044/1058-0360(2008/019)
McLoyd, V. (2013). What are we studying when we study children of color? Asking new questions, advancing new perspectives. Soc. Policy Rep. 27, 26–28.
McNamara, D. S., and Kendeou, P. (2011). Translating advances in reading comprehension research to educational practice. Int. Electron. J. Elem. Educ. 4, 33–46.
McNamara, D. S., and Kintsch, W. (1996). Learning from texts: effects of prior knowledge and text coherence. Discourse Process. 22, 247–288. doi: 10.1080/01638539609544975
McNamara, D. S., Kintsch, E., Songer, N. B., and Kintsch, W. (1996). Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cogn. Instr. 14, 1–43. doi: 10.1207/s1532690xci1401_1
Melzi, G. (2000). Cultural variations in the construction of personal narratives: Central American and European American mothers' elicitation styles. Discourse Process. 30, 153–177. doi: 10.1207/S15326950DP3002_04
Milch-Reich, S., Campbell, S. B., Pelham, W. E. Jr., Connelly, L. M., and Geva, D. (1999). Developmental and individual differences in children's on-line representations of dynamic social events. Child Dev. 70, 413–431. doi: 10.1111/1467-8624.00030
Mook, D. G. (1983). In defense of external invalidity. Am. Psychol. 38, 379–387. doi: 10.1037/0003-066X.38.4.379
Morrow, L. M. (1985). Retelling stories: a strategy for improving young children's comprehension, concept of story structure, and oral language complexity. Elem. Sch. J. 85, 647–661. doi: 10.1086/461427
Murachver, T., Pipe, M. E., Gordon, R., Owens, J. L., and Fivush, R. (1996). Do, show, and tell: children's event memories acquired through direct experience, observation, and stories. Child Dev. 67, 3029–3044. doi: 10.1111/j.1467-8624.1996.tb01901.x
Myers, J. L., O'Brien, E. J., Albrecht, J. E., and Mason, R. A. (1994). Maintaining global coherence during reading. J. Exp. Psychol. Learn. Mem. Cogn. 20, 876–886. doi: 10.1037/0278-7393.20.4.876
Narvaez, D., van den Broek, P., and Ruiz, A. B. (1999). The influence of reading purpose on inference generation and comprehension in reading. J. Educ. Psychol. 91, 488–496. doi: 10.1037/0022-0663.91.3.488
National Center for Education Statistics, Institute of Education Statistics, US Department of Education. (2011). The Nation's Report Card: Reading 2011. National Assessment of Educational Progress at Grades 4 and 8. (NCES 2012–457). Available online at: http://nces.ed.gov/nationsreportcard/pubs/main2011/2012457.asp
Neuman, S. B., and Celano, D. (2001). Access to print in low−income and middle−income communities: an ecological study of four neighborhoods. Read. Res. Q. 36, 8–26. doi: 10.1598/RRQ.36.1.1
Nicholson, T., and Imlach, R. (1981). Where do their answers come from? A study of the inferences which children make when answering questions about narrative stories. J. Lit. Res. 13, 111–129. doi: 10.1080/10862968109547400
Omanson, R. C., Warren, W. H., and Trabasso, T. (1978). Goals, inferential comprehension, and recall of stories by children. Discourse Process. 1, 337–354. doi: 10.1080/01638537809544444
Orrantia, J., Múñez, D., and Tarín, J. (2014). Connecting goals and actions during reading: the role of illustrations. Read. Writ. 27, 153–170. doi: 10.1007/s11145-013-9437-4
Paris, A. H., and Paris, S. G. (2003). Assessing narrative comprehension in young children. Read. Res. Q. 38, 36–76. doi: 10.1598/RRQ.38.1.3
Paris, S. G., Lindauer, B. K., and Cox, G. L. (1977). The development of inferential comprehension. Child Dev. 48, 1728–1733.
Pearce, W. M. (2003). Does the choice of stimulus affect the complexity of children's oral narratives? Int. J. Speech Lang. Pathol. 5, 95–103. doi: 10.1080/14417040510001669121
Pearson, P. D., Hansen, J., and Gordon, C. (1979). The effect of background knowledge on young children's comprehension of explicit and implicit information. J. Lit. Res. 11, 201–209. doi: 10.1080/10862967909547324
Pelletier, J., and Astington, J. W. (2004). Action, consciousness and theory of mind: children's ability to coordinate story characters' actions and thoughts. Early Educ. Dev. 15, 5–22. doi: 10.1207/s15566935eed1501_1
Pemberton, E. F., and Watkins, R. V. (1987). Language facilitation through stories: recasting and modelling. First Lang. 7, 79–89. doi: 10.1177/014272378700701905
Pempek, T. A., Kirkorian, H. L., Richards, J. E., Anderson, D. R., Lund, A. F., and Stevens, M. (2010). Video comprehensibility and attention in very young children. Dev. Psychol. 46, 1283–1293. doi: 10.1037/a0020614
Peterson, C., Jesso, B., and McCabe, A. (1999). Encouraging narratives in preschoolers: an intervention study. J. Child Lang. 26, 49–67. doi: 10.1017/S0305000998003651
Peterson, C., and McCabe, A. (1994). A social interactionist account of developing decontextualized narrative skill. Dev. Psychol. 30, 937–948. doi: 10.1037/0012-1649.30.6.937
Pike, M. M., Barnes, M. A., and Barron, R. W. (2010). The role of illustrations in children's inferential comprehension. J. Exp. Child Psychol. 105, 243–255. doi: 10.1016/j.jecp.2009.10.006
Poynor, D. V., and Morris, R. K. (2003). Inferred goals in narratives: evidence from self-paced reading, recall, and eye movements. J. Exp. Psychol. Learn. Mem. Cogn. 29, 3–9. doi: 10.1037//0278-7393.29.1.3
Prentice, D. A., Gerrig, R. J., and Bailis, D. S. (1997). What readers bring to the processing of fictional texts. Psychon. Bull. Rev. 4, 416–420. doi: 10.3758/BF03210803
Pyykkönen, P., and Järvikivi, J. (2012). Children and situation models of multiple events. Dev. Psychol. 48, 521–529. doi: 10.1037/a0025526
Quintana, S. M., Aboud, F. E., Chao, R. K., Contreras−Grau, J., Cross, W. E., Hudley, C. et al. (2006). Race, ethnicity, and culture in child development: contemporary research and future directions. Child Dev. 77, 1129–1141. doi: 10.1111/j.1467-8624.2006.00951.x
Renz, K., Lorch, E. P., Milich, R., Lemberger, C., Bodner, A., and Welsh, R. (2003). On-line story representation in boys with attention deficit hyperactivity disorder. J. Abnorm. Child Psychol. 31, 93–104. doi: 10.1023/A:1021777417160
Richards, E., and Singer, M. (2001). Representation of complex goal structures in narrative comprehension. Discourse Process. 31, 111–135. doi: 10.1207/S15326950DP3102_01
Rideout, V., and Hamel, E. (2006). The Media Family: Electronic Media in the Lives of Infants, Toddlers, Preschoolers and Their Parents. Menlo Park, CA: Henry J. Kaiser Family Foundation.
Rizzella, M. L., and O'Brien, E. J. (1996). Accessing global causes during reading. J. Exp. Psychol. Learn. Mem. Cogn. 22, 1208–1218. doi: 10.1037/0278-7393.22.5.1208
Schmidt, M. E., Pempek, T. A., Kirkorian, H. L., Lund, A. F., and Anderson, D. R. (2008). The effects of background television on the toy play behavior of very young children. Child Dev. 79, 1137–1151. doi: 10.1111/j.1467-8624.2008.01180.x
Schmidt, M. E., and Vandewater, E. A. (2008). Media and attention, cognition, and school achievement. Future Child. 18, 63–85. doi: 10.1353/foc.0.0004
Schmitt, K. L., and Anderson, D. R. (2002). Television and reality: toddlers' use of visual information from video to guide behavior. Media Psychol. 4, 51–76. doi: 10.1207/S1532785XMEP0401_03
Schulz, L. E., and Gopnik, A. (2004). Causal learning across domains. Dev. Psychol. 40, 162–176. doi: 10.1037/0012-1649.40.2.162
Shapiro, L. R., and Hudson, J. A. (1991). Tell me a make-believe story: coherence and cohesion in young children's picture-elicited narratives. Dev. Psychol. 27, 960–974. doi: 10.1037/0012-1649.27.6.960
Sharp, D. L., Bransford, J. D., Goldman, S. R., Risko, V. J., Kinzer, C. K., and Vye, N. J. (1995). Dynamic visual support for story comprehension and mental model building by young, at-risk children. Educ. Technol. Res. Dev. 43, 25–42. doi: 10.1007/BF02300489
Shears, C., Miller, V., Ball, M., Hawkins, A., Griggs, J., and Varner, A. (2007). Cognitive demand differences in causal inferences: characters' plans are more difficult to comprehend than physical causation. Discourse Process. 43, 255–278. doi: 10.1080/01638530701226238
Singer, M., Graesser, A. C., and Trabasso, T. (1994). Minimal or global inference during reading. J. Mem. Lang. 33, 421–441. doi: 10.1006/jmla.1994.1020
Sommerville, J. A., and Woodward, A. L. (2005). Infants' sensitivity to the causal features of means–end support sequences in action and perception. Infancy 8, 119–145. doi: 10.1207/s15327078in0802_2
Sperry, L. L., and Sperry, D. E. (1996). Early development of narrative skills. Cogn. Dev. 11, 443–465. doi: 10.1016/S0885-2014(96)90013-1
Sue, S. (1999). Science, ethnicity, and bias: where have we gone wrong? Am. Psychol. 54, 1070–1077. doi: 10.1037/0003-066X.54.12.1070
Suh, S., and Trabasso, T. (1993). Inferences during reading: converging evidence from discourse analysis, talk-aloud protocols, and recognition priming. J. Mem. Lang. 32, 279–300. doi: 10.1006/jmla.1993.1015
Tannock, R., Purvis, K. L., and Schachar, R. J. (1993). Narrative abilities in children with attention deficit hyperactivity disorder and normal peers. J. Abnorm. Child Psychol. 21, 103–117. doi: 10.1007/BF00910492
Tapiero, I., van den Broek, P., and Quintana, M. (2002). The mental representation of narrative texts as networks: the role of necessity and sufficiency in the detection of different types of causal relations. Discourse Process. 34, 237–258. doi: 10.1207/S15326950DP3403_1
Tompkins, V., Guo, Y., and Justice, L. M. (2013). Inference generation, story comprehension, and language skills in the preschool years. Read. Writ. 26, 403–429. doi: 10.1007/s11145-012-9374-7
Trabasso, T. (1994). “The power of the narrative,” in Reading, Language, and Literacy: Instruction for the Twenty-First Century, eds F. Lehr and J. Osborn (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.), 187–200.
Trabasso, T., and Nickels, M. (1992). The development of goal plans of action in the narration of a picture story. Discourse Process. 15, 249–275. doi: 10.1080/01638539209544812
Trabasso, T., and Rodkin, P. (1994). “Knowledge of goal/plans: a conceptual basis for narrating frog, where are you,” in Relating Events in Narrative: A Crosslinguistic Developmental Study, eds R. A. Berman and D. I. Slobin (Mahwah, NJ: Lawrence Erlbaum Associates, Inc.), 85–106.
Trabasso, T., and Sperry, L. L. (1985). Causal relatedness and importance of story events. J. Mem. Lang. 24, 595–611. doi: 10.1016/0749-596X(85)90048-8
Trabasso, T., and Stein, N. (1997). “Narrating, representing, and remembering event sequences,” in Developmental Spans in Event Comprehension and Representation: Bridging Fictional and Actual Events, eds P. W. van den Broek, P. J. Bauer, and T. Bourg (Mahwah, NJ: Lawrence Erlbaum Associates), 237–270.
Trabasso, T., Stein, N. L., Rodkin, P. C., and Munger, M. P. (1992). Knowledge of goals and plans in the on-line narration of events. Cogn. Dev. 7, 133–170. doi: 10.1016/0885-2014(92)90009-G
Trabasso, T., and Suh, S. (1993). Understanding text: achieving explanatory coherence through on-line inferences and mental operations in working memory. Discourse Process. 16, 3–34. doi: 10.1080/01638539309544827
Trabasso, T., and van den Broek, P. (1985). Causal thinking and the representation of narrative events. J. Mem. Lang. 24, 612–630. doi: 10.1016/0749-596X(85)90049-X
Trabasso, T., van den Broek, P., and Suh, S. (1989). Logical necessity and transitivity of causal relations in stories. Discourse Process. 12, 1–25. doi: 10.1080/01638538909544717
Trabasso, T., and Wiley, J. (2005). Goal plans of action and inferences during comprehension of narratives. Discourse Process. 39, 129–164. doi: 10.1080/0163853X.2005.9651677
Trostle, S., and Hicks, S. J. (1998). The effects of storytelling versus story reading on comprehension and vocabulary knowledge of British primary school children. Read. Improv. 38, 127–136.
van den Broek, P. (1989). Causal reasoning and inference making judging the importance of story statements. Child Dev. 60, 286–297. doi: 10.2307/1130976
van den Broek, P., Kendeou, P., Kremer, K., Lynch, J., Butler, J., White, M. et al. (2005). “Assessment of comprehension abilities in young children,” in Children's Reading Comprehension and Assessment, eds S. G. Paris and S. A. Stahl (Mahwah, NJ: Lawrence Erlbaum Associates Publishers), 107–130.
van den Broek, P., Lorch, E. P., and Thurlow, R. (1996). Children's and adult's memory for television stories: the role of causal factors, story-grammar categories, and hierarchical level. Child Dev. 67, 3010–3028. doi: 10.2307/1131764
van den Broek, P., Lynch, J. S., Naslund, J., Ievers-Landis, C. E., and Verduin, K. (2003). The development of comprehension of main ideas in narratives: evidence from the selection of titles. J. Educ. Psychol. 95, 707–718. doi: 10.1037/0022-0663.95.4.707
van den Broek, P., Tzeng, Y., Risden, K., Trabasso, T., and Basche, P. (2001). Inferential questioning: effects on comprehension of narrative texts as a function of grade and timing. J. Educ. Psychol. 93, 521–529. doi: 10.1037/0022-0663.93.3.521
Vandewater, E. A., Rideout, V. J., Wartella, E. A., Huang, X., Lee, J. H., and Shim, M. S. (2007). Digital childhood: electronic media and technology use among infants, toddlers, and preschoolers. Pediatrics 119, e1006–e1015. doi: 10.1542/peds.2006-1804
Verhallen, M. J., Bus, A. G., and de Jong, M. T. (2006). The promise of multimedia stories for kindergarten children at risk. J. Educ. Psychol. 98, 410–419. doi: 10.1037/0022-0663.98.2.410
Wenner, J. (2004). Preschoolers' comprehension of goal structure in narratives. Memory 12, 193–202. doi: 10.1080/09658210244000478
Wenner, J. A., and Bauer, P. J. (1999). Bringing order to the arbitrary: one- to two-year olds' recall of event sequences. Infant Behav. Dev. 22, 585–590. doi: 10.1016/S0163-6383(00)00013-8
Whitehurst, G. J., and Lonigan, C. J. (1998). Child development and emergent literacy. Child Dev. 69, 848–872. doi: 10.1111/j.1467-8624.1998.tb06247.x
Wigglesworth, G. (1997). Children's individual approaches to the organization of narrative. J. Child Lang. 24, 279–309. doi: 10.1017/S0305000997003048
Wolman, C., van den Broek, P., and Lorch, R. F. (1997). Effects of causal structure on immediate and delayed story recall by children with mild mental retardation, children with learning disabilities, and children without disabilities. J. Spec. Educ. 30, 439–455. doi: 10.1177/002246699703000405
Wright, J. C., Huston, A. C., Murphy, K. C., St. Peters, M., Piñon, M., Scantlin, R., et al. (2001). The relations of early television viewing to school readiness and vocabulary of children from low−income families: the early window project. Child Dev. 72, 1347–1366. doi: 10.1111/1467-8624.t01-1-00352
Zucker, T. A., Justice, L. M., Piasta, S. B., and Kaderavek, J. N. (2010). Preschool teachers' literal and inferential questions and children's responses during whole-class shared reading. Early Child. Res. Q. 25, 65–83. doi: 10.1016/j.ecresq.2009.07.001
Zwaan, R. A., Langston, M. C., and Graesser, A. C. (1995a). The construction of situation models in narrative comprehension: an event-indexing model. Psychol. Sci. 6, 292–297 doi: 10.1111/j.1467-9280.1995.tb00513.x
Zwaan, R. A., Magliano, J. P., and Graesser, A. C. (1995b). Dimensions of situation model construction in narrative comprehension. J. Exp. Psychol. Learn. Mem. Cogn. 21, 386–397. doi: 10.1037/0278-7393.21.2.386
Zwaan, R. A., and Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychol. Bull. 123, 162–185. doi: 10.1037/0033-2909.123.2.162
Appendix A
Description of Table 1
Table 1 describes 71 sources observing comprehension processes in children. Some studies did not explicitly identify the comprehension processes as described in this paper. In such cases, studies assessing constructs such as “causal relatedness,” “inference-making,” and “relations between events” were understood to be measuring causal inference generation. Constructs such as “event relatedness,” “goal actions,” and “intentionality” were understood to be measuring goal structure understanding. “World knowledge,” “general knowledge,” and “generalization of knowledge” were understood to be measuring knowledge integration. Table 1 also distinguishes these processes according to sample-income. When not made explicit, maternal and paternal education means at, or above, 16 years were considered proxies for middle-income status. Studies without indicators of socioeconomic status were assumed to have examined middle- to high-income samples and are noted in Appendix B by an asterisk (*).
Appendix B
Sources Describing Narrative Comprehension Processes Across Low- and Middle- to High-Income Households.
Studies of Child Samples Representing Lower-Income Households:
Assessing Goal Structure Understanding
1. Benson, 1997
2. Brown et al., unpublished manuscript
5. Linebarger and Piotrowski, 2009
6. Morrow, 1985
9. Pelletier and Astington, 2004
Assessing Causal Inference Generation
1. Benson, 1997
4. Pelletier and Astington, 2004
Studies of Child Samples Representing Middle-Income to High-Income Households*:
Assessing Knowledge Integration
2. Bowyer-Crane and Snowling, 2005*
8. Nicholson and Imlach, 1981*
Assessing Goal Structure Understanding
4. Berman, 1988*
5. Berman, 1995*
6. Berman, 2004*
11. Henderson and Woodward, 2011*
13. Lorch et al., 2006*
14. Lorch et al., 2010*
15. Lorch et al., 1999b*
17. Lynch and van den Broek, 2007
21. Morrow, 1985
23. Omanson et al., 1978*
24. Pearce, 2003*
25. Pelletier and Astington, 2004
26. Pyykkönen and Järvikivi, 2012*
27. Renz et al., 2003*
28. Sommerville and Woodward, 2005*
29. Tannock et al., 1993*
31. Trabasso and Nickels, 1992
33. van den Broek et al., 2003*
34. van den Broek et al., 1996*
35. Wenner, 2004
Assessing Causal Inference Generation
1. Bauer, 1992*
11. Gibbons et al., 1986*
12. Henderson and Woodward, 2011*
13. Kendeou et al., 2008*
14. Kendeou et al., 2009*
15. Kim et al., 2008*
17. Lorch et al., 1999a*
18. Lorch et al., 2004*
19. Lorch et al., 2010*
20. Lorch et al., 2000*
21. Lorch et al., 1999b*
25. Omanson et al., 1978*
26. Pelletier and Astington, 2004
27. Pike et al., 2010*
30. van den Broek et al., 2003*
31. van den Broek et al., 1996*
32. Wenner, 2004
Studies without indicators of socioeconomic status were assumed to have examined middle- to high-income samples and are noted here by an asterisk (*).
Keywords: narrative comprehension, development, knowledge integration, goal structure understanding, causal inferences, external validity, review
Citation: Burris SE and Brown DD (2014) When all children comprehend: increasing the external validity of narrative comprehension development research. Front. Psychol. 5:168. doi: 10.3389/fpsyg.2014.00168
Received: 02 October 2013; Accepted: 11 February 2014;
Published online: 13 March 2014.
Edited by:
Jessica S. Horst, University of Sussex, UKReviewed by:
Angela Nyhout, University of Waterloo, CanadaYvette Rence Harris, Miami University, USA
Copyright © 2014 Burris and Brown. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Danielle D. Brown, Department of Psychology, Howard University, 525 Bryant St. NW, N-179, CB Powell Building, Washington, DC 20059, USA e-mail: danielled.brown@howard.edu