Beware of the Small-World Neuroscientist!
David Papo
Massimiliano Zanin
Johann H. Martínez
Javier M. Buldú- 1Laboratory of Biological Networks, Center for Biomedical Technology and GISC, Universidad Politécnica de Madrid, Madrid, Spain
- 2Departamento de Engenharia Electrotecnica, Faculdade de Ciencias e Tecnologia, Universidade Nova de Lisboa, Lisboa, Portugal
- 3Innaxis Foundation and Research Institute, Madrid, Spain
- 4Universidad del Rosario, Bogotá, Colombia
- 5GISC, Madrid, Spain
- 6Complex Systems Group and GISC, Universidad Rey Juan Carlos, Móstoles, Spain
Characterizing the brain's anatomical and dynamical organization and how this enables it to carry out complex tasks is highly non trivial. While there has long been strong evidence that brain anatomy can be thought of as a complex network at micro as well as macro scales, the use of functional imaging techniques has recently shown that brain dynamics also has a network-like structure.
Network Science (Newman, 2010) allows neuroscientists to quantify the general organizing principles of brain structure and dynamics at all scales in terms of highly reproducible, often universal properties shared by prima facie very different systems (Bullmore and Sporns, 2009). A network representation also helps addressing classical but complex issues such as structure-function relationships in a straightforward and elegant fashion, and determining how efficiently a system transfers information or how vulnerable it is to damage (Bullmore and Sporns, 2012; Papo et al., 2014).
One of the most studied global network properties is the small-world (SW) structure (Watts and Strogatz, 1998). In a SW network, nodes tend to form triangles, making the network locally robust. At the same time, the distance between any pair of nodes is much smaller than the network size and increases slowly (logarithmically) with the number of nodes in the network. This combination of properties has been suggested to represent a solution to the trade-off between module independence and specialization, and has been associated with optimal communication efficiency, high-speed and reliability of information transmission (Bullmore and Sporns, 2009, 2012).
In neuroscience, the SW structure has been reported for healthy brain anatomical and functional networks, and deviations from this global organization in various pathologies (Bassett et al., 2006; Stam, 2014). While there has been some heterogeneity in the adopted definition of SW network, these findings gave the neuroscience community hope that the SW could constitute a functionally meaningful universal feature of global brain organization.
In spite of this preliminary evidence, whether or not the brain is indeed a SW network is still very much an open question (Hilgetag and Goulas, 2015). The question that we address here is of a pragmatical rather than an ontological nature: independently of whether the brain is a SW network or not, to what extent can neuroscientists using standard system-level neuroimaging techniques interpret the SW construct in the context of functional brain networks?
In a typical experimental setting, neuroscientists record brain images, define nodes and links, construct a network, extract its topological properties, to finally assess their statistical significance and their possible functional meaning. We discuss evidence (some of which is already familiar to the neuroscience community) showing that behind each of these stages lurk fundamental technical, methodological or theoretical stumbling blocks that render the experimental quantification of the SW structure and its interpretation in terms of information processing problematic, questioning its usefulness as a descriptor of global brain organization. The emphasis is on functional brain activity reconstructed using standard system-level brain recording techniques, where the SW construct appears to be the most problematic.
Small-World Property, Small-Word Networks, and Small-Worldness
While the SW construct has enjoyed vast popularity in the neuroscience community, a careful look at the literature shows that the various studies resorted to three different though related definitions of SW, which turn out to be nested into each other.
The SW property designates networks in which the shortest path L (i.e., the average number of steps needed to go from a node to any other node in the network) is much smaller than the network size N (L ≪ N) (Milgram, 1967). In a SW network, few connecting links drastically shorten the distance between closely knit groups of nodes, so that L is low and grows very slowly with N (L ~ ln(N)), while the clustering coefficient C (i.e., the percentage of node's neighbors that are, in turn, linked between them) remains high (Watts and Strogatz, 1998). Finally, the SW-ness parameter σ is a continuous, quantitative, measure defined as:
i.e., the ratio between C and L normalized by the Lrand and Crand of a set of equivalent random networks (Humphries and Gurney, 2008). In the remainder, attention is mostly focused on σ, which encompasses the two preceding constructs.
Pitfalls Along the Way: from Brain Recording to Data Interpretation
1. Brain recording devices and standard analyses used to construct networks from neural data can distort the extent to which a network may appear SW.
The basic ingredients of a SW network are its clustering coefficient C and the average shortest-path L. Estimates of these properties crucially depend on the way nodes and links are defined. Different definitions modify C and L, ultimately affecting the estimated SW character of the network.
Various sources of possible distortion arising at the first step, that of brain recording, have been illustrated in a number of studies (Bialonski et al., 2010; Zalesky et al., 2010a, 2012; van Wijk et al., 2010; Fornito et al., 2013), including problems due to parcellation and edge definition, spatial embedding, and edge density. For example, in classical electrophysiological methods, nodes are identified with sensors. The lattice-like sensor organization can lead to overestimating the extent to which a network is SW, as different sensors may measure the activity of the same region, ultimately increasing C (Bialonski et al., 2010).
Even supposing that brain activity is recorded with an error-free device, projecting brain data onto a network structure comes with its own problems. When dealing with magnetic resonance imaging data, defining nodes is highly non-trivial and may be carried out in different ways, each introducing its own bias, e.g., network reconstruction based on voxel-voxel correlations over-represents connectivity between neighboring voxels, increasing C, whereas parcellations based on different atlases lead to differences in the SW-ness parameter (Yao et al., 2015).
Estimate distortions also arise from the possible ways of defining links. While there is no well-established criterion to choose a connectivity metric out of the many existing ones, different metrics lead to different connectivity patterns, which may be associated with different basic topological properties, affecting SW evaluation. Moreover, limitations in the reliability of link estimation (e.g., due to noise or common sources) may decrease L and increase C, by simply adding a few false positive connections, leading to the observation of SW even in regular or random networks (Bialonski et al., 2010). Furthermore, in its standard formulation, the SW requires networks to be connected, as d diverges in the presence of disconnected nodes. This issue can be dealt with either by adding links (but, this may introduce spurious ones); by taking into account the connected giant component, (but this alters the network size, complicating network comparisons, van Wijk et al., 2010); or by resorting to an equivalent efficiency measure avoiding divergence for disconnected nodes (Latora and Marchiori, 2001).
Furthermore, SW estimates are sensitive to thresholds adopted to prune non-significant links: for high threshold values, brain activity appears hierarchically organized into modules with large-world self-similar properties, while adding just a few weak links can make the network non-fractal and small-world (Gallos et al., 2012).
2. Evaluating SW-ness is non-trivial
Due to the diversity of brain imaging techniques and methodological tools, functional networks may vary in size and link distribution and, as a consequence, in their topological parameters. For this reason, quantifying SW-ness and comparing it across networks requires normalizing L and C.
The metric most commonly used to quantify SW-ness, the SW parameter σ, mainly relies on a normalization using random versions of the original networks (Zanin, 2015). However, how to define an adequate ensemble of random networks is not a straightforward task, as it is unclear what properties of the original network should be conserved. Current methodologies use random rewirings of observed connections, typically conserving the number of nodes and links and the degree distribution, but disregarding the effects of network size on the normalized C and L and the statistical properties of the random ensemble.
The reasons for this standard normalization procedure are to do with the generative model proposed by Watts and Strogatz (WS), which explains the formation of SW as a transition region in a rewiring process from regular to completely random structures (Papo et al., 2014), making the latter a reasonable reference point. However, the WS mechanism does not reflect the formation of neural connections, suggesting that alternative references, possibly incorporating anatomical or functional constraints, may be more appropriate for normalizing brain networks, and other properties, e.g., link distribution, number of modules in the network, correlations in the number of links, may be conserved in the random versions of observed network structures.
A normalization against random networks may also fail to provide information about the statistical relevance or abnormality of results, an issue that may be dealt with by means of a Z-Score (Latora and Marchiori, 2001). For instance, two networks with the same normalized clustering coefficient
2.0 may respectively result from a C = 1.0 and expected Crand = 0.5, and C = 0.02 and Crand = 0.01. While the former network has a clearly abnormal clustering (the highest possible clustering is not to be expected in a random network), the latter may be the result of random fluctuations. Both situations can occur in the same network, as the threshold value above which existing couplings are converted or not into links is varied. Increasing the threshold value induces a shift from a highly clustered network with overabundant links, to one where networks are highly sparse. Notice in addition that, when the overall network size is small, L cannot vary much, so that σ values are bound to be strongly correlated with C ones (Zanin, 2015). For functional networks obtained from electro- or magneto-encephalography, L is constrained by the low number of nodes, so that σ is mainly controlled by C.
3. The true Aquilles heel of the SW measure lies in interpreting its significance.
Suppose that the results of unbiased network analyses of brain activity obtained with an ideal recording device point to a SW network. Can this result be taken at face value?
The results of Barthélemy and Amaral (1999) suggest that, for any given degree of disorder p, if the system is larger than a crossover size, the network will fall in the SW regime. The percentage p of long-range connections making the network SW scales with the number of nodes N as N~p−2∕3 (Kleinberg, 2000), indicating that only a very small fraction of long-range connections can dramatically decrease L. Functional brain imaging studies, which can in principle consider up to 105 nodes, would then typically lead to observing SW-ness.
More importantly, what functional implications should we attribute to a SW brain network? While the SW represents a topological universality class, its functional significance greatly differs in networks of different nature. In communication systems SW networks optimize information processing or transmission efficiency (Kleinberg, 2000), but this is likely not the case for brain networks. The shortest path is usually optimal in a router communication system, whereas in a system such as the brain, other topological (e.g., path redundancy, communicability, branching, loops) and dynamical variables, e.g., burstiness, may better capture information transfer than SW-ness (Karsai et al., 2011; DeDeo and Krakauer, 2012; Estrada et al., 2012; Estrada and Hatano, 2015).
Finally, functional SW networks may result from a diversity of underlying anatomical networks, including randomly connected ones (Hlinka et al., 2015). Thus, the interplay between functional and anatomical networks further enhances the complexity of the SW construct interpretation.
Concluding Remarks: Can the SW be Salvaged?
The SW has undeniably been one of the most popular network descriptors in the neuroscience literature. Two main reasons for its lasting popularity are its apparent ease of computation and the intuitions it is thought to provide on how networked systems operate. Over the last few years, some pitfalls of the SW construct and, more generally, of network summary measures, have widely been acknowledged. For instance, analyses using less derivative network measures, such as contrasts of basic edge density have been proposed (Zalesky et al., 2010b). However, stress was put far more on technical than on conceptual limitations. The practical advantages of the SW construct often seem to weigh more than fundamental shortcomings. Given the multiple stumbling blocks the SW measure faces, we conclude with two suggestions. First, network normalization should go beyond comparison with “equivalent random networks” and include other properties that account for fundamental properties of brain networks such as modularity, hierarchical structure or spatial embedding. Second, efforts to quantify functional networks' information transfer efficiency or reliability should strive to capture physiologically plausible mechanisms of information transfer and processing. This may involve acknowledging that the universality of network metrics, originally introduced to describe systems profoundly different from the brain, has its limits, and creating a new neuroscience-inspired network science.
Author Contributions
All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was supported by the Spanish Ministry of Economy and Competitiveness (project No: FIS2013-41057-P).
References
Barthélemy, M., and Amaral, L. A. N. (1999). Small-world networks: evidence for a crossover picture. Phys. Rev. Lett. 82, 3180–3183. doi: 10.1103/PhysRevLett.82.3180
Bassett, D. S., Meyer-Lindenberg, A., Achard, S., Duke, T., and Bullmore, E. (2006). Adaptive reconfiguration of fractal small-world human brain functional networks. Proc. Natl. Acad. Sci. U.S.A. 103, 19518–19523. doi: 10.1073/pnas.0606005103
Bialonski, S., Horstmann, M. T., and Lehnertz, K. (2010). From brain to earth and climate systems: small-world interaction networks or not? Chaos 20:013134. doi: 10.1063/1.3360561
Bullmore, E., and Sporns, O. (2009). Complex brain networks: graph theoretical analysis of structural functional systems. Nat. Rev. Neurosci. 10, 186. doi: 10.1038/nrn2575
Bullmore, E., and Sporns, O. (2012). The economy of brain network organization. Nat. Rev. Neurosci. 13, 336–348. doi: 10.1038/nrn3214
DeDeo, S., and Krakauer, D. C. (2012). Dynamics and processing in finite self-similar networks. J. R. Soc. Interface 9, 2131–2144. doi: 10.1098/rsif.2011.0840
Estrada, E., and Hatano, N. (2015). Communicability angle and the spatial efficiency of networks. ArXiv:1412.7388.
Estrada, E., Hatano, N., and Benzi, M. (2012). The physics of communicability in complex networks. Phys. Rep. 514, 89–119. doi: 10.1016/j.physrep.2012.01.006
Fornito, A., Zalesky, A., and Breakspear, M. (2013). Graph analysis of the human connectome: promise, progress, and pitfalls. Neuroimage 80, 426–444. doi: 10.1016/j.neuroimage.2013.04.087
Gallos, L. K., Makse, H. A., and Sigman, M. (2012). A small world of weak ties provides optimal global integration of self-similar modules in functional brain networks. Proc. Natl. Acad. Sci. U.S.A. 109, 2825–2830. doi: 10.1073/pnas.1106612109
Hilgetag, C. C., and Goulas, A. (2015). Is the brain really as small-world network? Brain Struct. Funct. doi: 10.1007/s00429-015-1035-6. [Epub ahead of print].
Hlinka, J., Hartman, D., and Paluš, M. (2015). Small-world topology of functional connectivity in randomly connected dynamical systems. Chaos 22:033107. doi: 10.1063/1.4732541
Humphries, M. D., and Gurney, K. (2008). Network ‘small-world-ness’: a quantitative method for determining canonical network equivalence. PLoS ONE 3:e0002051. doi: 10.1371/journal.pone.0002051
Karsai, M., Kivelä, M., Pan, R. K., Kaski, K., Kertész, J., Barabási, A.-L., et al. (2011). Small but slow world: how network topology and burstiness slow down spreading. Phys. Rev. E 83:025102. doi: 10.1103/physreve.83.025102
Latora, V., and Marchiori, M. (2001). Efficient behavior of small-world networks. Phys. Rev. Lett. 87:19870. doi: 10.1103/PhysRevLett.87.198701
Papo, D., Buldú, J. M., Boccaletti, S., and Bullmore, E. T. (2014). Complex networks theory and the brain. Philos. Trans. R. Soc. B 369:20130520. doi: 10.1098/rstb.2013.0520
Stam, C. J. (2014). Modern network science of neurological disorders. Nat. Rev. Neurosci. 15, 683–695. doi: 10.1038/nrn3801
van Wijk, B.C., Stam, C. J., and Daffertshofer, A. (2010). Comparing brain networks of different size and connectivity density using graph theory. PLoS ONE 5:e13701. doi: 10.1371/journal.pone.0013701
Watts, D. J., and Strogatz, S. H. (1998). Collective dynamics of small-world networks. Nature 393, 440–442. doi: 10.1038/30918
Yao, Z., Hu, B., Xi, Y., Moore, P., and Zheng, J. (2015). A review of structural and functional brain networks: small world and atlas. Brain Inf. 2, 45–52. doi: 10.1007/s40708-015-0009-z
Zalesky, A., Fornito, A., and Bullmore, E. (2012). On the use of correlation as a measure of network connectivity. Neuroimage 60, 2096–2106. doi: 10.1016/j.neuroimage.2012.02.001
Zalesky, A., Fornito, A., and Bullmore, E. T. (2010b). Network-based statistic: identifying differences in brain networks. Neuroimage 53, 1197–1207. doi: 10.1016/j.neuroimage.2010.06.041
Zalesky, A., Fornito, A., Harding, I. H., Cocchi, L., Yücel, M., Pantelis, C., et al. (2010a). Whole-brain anatomical networks: does the choice of nodes matter? Neuroimage 50, 970–983. doi: 10.1016/j.neuroimage.2009.12.027
Keywords: small-world, functional networks, complex network theory, clustering coefficient, efficiency, communicability
Citation: Papo D, Zanin M, Martínez JH and Buldú JM (2016) Beware of the Small-World Neuroscientist! Front. Hum. Neurosci. 10:96. doi: 10.3389/fnhum.2016.00096
Received: 07 January 2016; Accepted: 22 February 2016;
Published: 08 March 2016.
Edited by:
Mikhail Lebedev, Duke University, USAReviewed by:
Stefano Panzeri, Italian Institute of Technology, ItalyQingbao Yu, The Mind Research Network, USA
Copyright © 2016 Papo, Zanin, Martínez and Buldú. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: David Papo, papodav@gmail.com