Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 18 April 2018
Sec. Quantitative Psychology and Measurement
This article is part of the Research Topic Clinical Psychometrics: Old Issues and New Perspectives View all 20 articles

Psychometric Properties and Measurement Invariance of the Brief Symptom Inventory-18 Among Chinese Insurance Employees

  • 1Department of Psychology, Guangzhou University, Guangzhou, China
  • 2The Center for Psychometrics and Latent Variable Modeling, Guangzhou University, Guangzhou, China
  • 3The Key Laboratory for Juveniles Mental Health and Educational Neuroscience in Guangdong Province, Guangzhou University, Guangzhou, China
  • 4Research School of Psychology, The Australian National University, Canberra, ACT, Australia
  • 5School of Education and Psychology, University of Jinan, Jinan, China

This study aimed to examine the psychometric properties and factorial invariance of the Brief Symptom Inventory-18 (BSI-18). Confirmatory factor analyses (CFAs) were performed to verify the BSI-18’s factor structure in a large sample of Chinese insurance professionals (N = 2363, 62.7% women; age range = 19–70). Multigroup CFA were performed to test the measurement invariance of the model with the best fit across genders. In addition, structural equation modeling was conducted to test the correlations between the BSI-18 and two covariates – social support perception and grit trait. Results indicated that the bi-factor model best fit the data and was also equivalent across genders. The BSI-18’s general factor, and somatization and depression dimensions were significantly related to social support perception and grit trait, whereas the anxiety dimension was not. Overall, our findings suggested that the BSI-18’s can be a promising tool in assessing general psychological distress in Chinese employees.

Introduction

The Brief Symptom Inventory-18 (BSI-18; Derogatis, 2001) is an 18-item self-report checklist, a common screening tool for psychological symptoms adapted from the Symptom Checklist-90-Revised (SCL-90-R; Derogatis, 1977) and BSI-53 (Zabora et al., 2001). Previous studies have found that the BSI-18 was highly correlated with its parent instruments—the SCL-90-R and BSI-53. Although the SCL-90-R and BSI-53 have been used extensively in clinical and community samples, both have complicated structural dimensions and large numbers of items. The BSI-18 with 18 items only was developed to more effectively obtain the most critical information about psychiatric symptoms.

The BSI-18’s brief items improved test efficiency to some extent; however, the previous findings regarding the factor structure of the BSI-18 were inconsistent. Using a Latina-speaking sample, Prelow et al. (2005) found that a single-factor model resulted from the exploratory factor analysis (EFA) was the best and most concise model. However, the authors also found that a hypothetical three-factor model fit the data reasonably well when performing confirmatory factor analyses (CFAs) using cross-validation subsamples (Prelow et al., 2005). In the three-factor model, the BSI-18 items were equally distributed to represent the three-factors of depression, anxiety, and somatization (Wiesner et al., 2010). On the other hand, Andreu et al. (2008) found a four-factor structure in a non-clinical sample of 1134 subjects (Andreu et al., 2008). Two of these four-factors (I and II) contained the same items of somatization and depression dimensions. The other two-factors had items of from the initial anxiety factor. One included a group of items assessing distress and widespread nervousness, and another included three items assessing panic symptoms.

In recent years, the bi-factor model has been increasingly popular in mapping the constructs of psychopathological scales, for instance, the Psychopathy Checklist-Revised (Flores-Mendoza et al., 2008) and the Beck Depression Inventory (Al-Turkait and Ohaeri, 2010). The bi-factor measurement structure can be an effective method for modeling multidimensional measurement tools (Reise, 2012). In the process of measuring psychological symptoms, the bi-factor model not only measures the overall situation but also places a secondary load on special symptoms represented by specific dimensions. It has been an increasingly popular view that a bi-factor structure exists between psychiatric symptoms and disorders, where both common and specific components play an important role (Watson, 2005; Thomas, 2012). It has been found that SCL-90-R and BSI-53 had bi-factor model structures (Vassend and Skrondal, 1999; Urbán et al., 2014). The bi-factor model, however, has not been tested for the BSI-18.

Another question surrounding the BSI-18 is whether the instrument has universal applicability among various non-clinical samples, ethnicities, and genders. Preceding studies demonstrated that the BSI-18 is a widely adopted measure with high internal consistency and test–retest reliability in clinical research areas (Wang et al., 2013). However, only one study tested and supported a three-factor model (somatization, depression, and anxiety) of the BSI-18 in Chinese-speaking population using a clinical sample of substance users (Wang et al., 2013). It is unclear whether the BSI-18 self-report version is similarly applicable to non-clinical samples in China.

Previous cross-cultural studies have focused on samples between different ethnicities. To determine the factorial structure and measurement invariance across races/ethnicities, Prelow et al. (2005) emphasized the need for strict invariance testing of the BSI-18 through multigroup CFA. Wiesner et al. (2010) applied a multigroup CFA to evaluate factorial invariance of the BSI-18 in women across multiple ethnicities and the three-factor model only achieved partial metric invariance. From a cross-cultural standpoint, psychological symptoms are sometimes manifested and expressed differently across populations (Wiesner et al., 2010). Each cultural group manifests its specific expression under influences of a typical language format, traditional culture, and educational background. Evaluating the measurement invariance of the BSI-18’s self-report version in a Chinese non-clinical sample can be helpful for cross-cultural research.

Many epidemiological investigations have demonstrated that women’s incidence of emotional disorders, anxiety disorders, and affective psychosis is higher than men’s (Urbán et al., 2014). In a study of insurance employee samples, Dai (2003) found that male insurers were more serious than women in terms of obsessive-compulsive and psychoticism mental health problems. Differences between men and women make it particularly important to verify the measurement model’s gender invariance. To date, the BSI-18’s measurement invariance across gender is scarcely known, especially among non-Western people.

Mental Health in Chinese Insurance Employees

Insurance industry in mainland China faced with the pressure of external competition and self-development due to the disadvantages of being late starters (Yang, 2013). Huge organization, numerous labor, complex personnel, and high performance requirement along with high working pressure lead to high employee turnover rate and various psychological problems (Yang, 2013). Existing evidence has showed that these psychological problems correlated with social factors and personal traits, especially in insurance staff samples (Dai, 2003). It has been found that psychological distress was influenced by both perceived social support and personality traits among various professional groups (Williams et al., 2002). A lack of social support and sense of belonging have been associated with a person’s vulnerability to depression (Williams et al., 2002).

For example, grit is one important trait that may be associated with the success in insurance employees (Ling et al., 2001). Grit trait refers to firm and persistent for a long time with unswerving determination (Duckworth et al., 2007). Whether an insurance employee can tolerate high frustration and work efficiently under pressure all the time will determine his or her success as well as psychological conditions (Ling et al., 2001).

With regards to social factors, previous study shows that the level of social support of insurance employee significantly influenced their psychological well-being (Dai, 2003). For instance, severity of depressive symptoms and frequency of suicidal ideation showed negative significant correlations with low levels of social support (Zhang et al., 2010). These studies predicted, to a certain extent, correlation between specific dimensions (depression and suicide) of psychiatric symptoms and external criteria.

Objective of the Study

This study aimed to examine the BSI-18’s psychometric properties in a large sample of Chinese insurance employees. The first goal was to examine the BSI-18’s factor structure. CFA were used to examine five hypothetical models: the original single-factor model, three-factor model, four-factor model, and bi-factor model (i.e., the three and four-factor model with one general factor). The second goal was to test measurement invariance of the BSI-18’s best-fitting model across genders using the multigroup CFA. Finally, we want to explore the manner in which the general factor (can be considered as an overall mental health status) and dimensions (specific psychiatric symptoms) were related to the social and personality covariates. Specifically, criterion validity of the BSI-18 bi-factor model was examined using structural equation modeling (SEM).

Materials and Methods

Participants

Participants were 2,363 insurance employees from 39 insurance companies in Guangdong Province, China. Their mean age was 35.14 (SD = 8.985; age range = 19–70), and 62.7% of the participants were women. Approximately 60.3% of the participants were married, and 65.4% of the participants had attained higher education (see Table 1 for more information).

TABLE 1
www.frontiersin.org

TABLE 1. Sample demographic statistics.

Measures

Brief Symptom Inventory-18

The BSI-18 (Derogatis, 2001), a brief self-report version of the 53-item BSI (Derogatis, 1993), was developed to assess general psychological distress in clinical and community populations. The BSI-18 requires participants to evaluate the extent of distress or annoyance they had experienced. Responses were rated on a five-point Likert-type scale, ranging from 1 (not at all) to 5 (very much). The questionnaire’s global score summed up all the 18 items. Internal consistency reliability for the present sample was good (Cronbach’s alpha = 0.947, 0.867, 0.859, and 0.907 for BSI total, Somatization, Depression, and Anxiety respectively).

Grit-8

The Grit-8 (Duckworth and Quinn, 2009), was an eight-item self-report measure that comprises eight items over two-factors, i.e., consistency of interests and perseverance of effort. These eight items were rated on a five-point Likert scale, ranging from 1 (not at all like me) to 5 (very much like me). Items 1, 3, 5, and 6 scored negatively; items 2, 4, 7, and 8 scored positively. In the current sample, the Cronbach’s alpha was 0.738 for the total scores, indicating good reliability.

Perceived Social Support Scale

The Perceived Social Support Scale (PSSS; Zimet et al., 1990) was a self-report instrument that measures how an individual comprehends various sources of social support, such as family and friends; the total score reflected the total degree of social support that individuals received. The PSSS comprises eight items rated on a seven-point Likert scale, ranging from 1 (not at all true) to 7 (definitely true). For this study, we selected eight items from the family and friend support dimensions. In this study, internal consistency was good for the PSSS total (α = 0.900) and two subscales (α = 0.875 for family support and α = 0.870 for friend support).

Procedures

Participants completed aforementioned self-report questionnaires during their company’s morning meeting (administration time was approximately 30 min). The survey was administered by a trained research assistant (RA). The RA provided a general instruction of the survey before the participants started the survey. Participants could ask the RA for clarification if they did not understand any parts of the questionnaire. This study was carried out in accordance with the recommendations of Human Subjects Review Committee at Guangzhou University. All subjects gave written informed consent in accordance with the Declaration of Helsinki.

Data Analysis Strategy

The CFA was performed separately to test five-factor structures, including the single-factor model, three-factor model, four-factor model, and two bi-factor models. Items were treated as categorical variables; thus, robust weighted least squares with mean and variance adjustment (WLSMV) was used in model estimation (Flora and Curran, 2004). Additionally, robust maximum likelihood estimator was employed to obtain the Bayesian information criterion (BIC) value for comparing the non-nested models. Model fits were evaluated using chi-squares, root-mean-square error of approximation (RMSEA), the Tucker-Lewis Index (TLI), the comparative fit index (CFI), and the BIC. Conventional guidelines indicate that an RMSEA value ≤ 0.08 indicates acceptable model fit and a value ≤ 0.05 indicates good model fit. Moreover, CFI and TLI ≥ 0.90 indicate adequate model fit (Kline, 2010). In addition, the ΔBIC value of the two models was greater than 10, indicating that the model with a smaller BIC showed a better model fit (Kuha, 2004).

To further evaluate the bi-factor models, coefficient omega hierarchical (ωH), the hierarchical omega subscales (ωHS) and the explained common variances (ECVs) were calculated to examine whether the specific factors provide utility beyond the general factor (based on the factor loadings) using the “psych” package (version 1.7.8; Revelle, 2017) in R statistical software (R Core Team, 2017). The proportion of variance in total scores estimated by ωH can be attributed to a single general factor (e.g., Zinbarg et al., 2006), while the reliability of a subscale (or factor) score was reflected by ωHS after controlling for the variance due to the general factor (Reise et al., 2013). When the coefficient ωH is higher than 0.80, total scores can be regarded as unidimensional because of the most reliable is due to a single common factor (Rodriguez et al., 2016). Meanwhile, the large coefficient ωH (>0.80) indicates that the vast majority of reliable variance imputing to a specific factor rather than a general factor (Reise et al., 2013).

To test the measurement invariance, the best-fit model resulted from the CFA was initially assessed in both male and female groups separately. Configural invariance can be indicated by that the model fits both genders equally well. Next, metric invariance and scalar invariance were tested by constraining factor loadings and thresholds of the factor models. A DIFFTEST was used to compare improvement in fit between nested models. Notably, the chi-square test was easily affected by sample size so that with increased sample size, even small differences resulted in significant differences. Thus, this research adopted the CFI (ΔCFI) difference numerical model fit indexed to evaluate measurement invariance (Cheung and Rensvold, 2002). According to Cheung and Rensvold (2002), the equivalent model is considered to be acceptable when ΔCFI ≤ 0.010 and ΔTLI ≤ 0.010.

Finally, the correlations among the factors of the BIS-18 and external criteria variables were examined using a SEM. This study used latent variables to compare observed variables and examined relations among constructs without measurement error (Oh et al., 2004). All models were performed by Mplus 7.4 (Muthén and Muthén, 1998–2010).

Results

Descriptive Statistics

Descriptive statistics and skewness and kurtosis for all key variables were included in Table 2. Due to the large values of the skewness and kurtosis, it was necessary to treat the BSI-18 variables as categorical instead on interval. Thus, we used the WLSMV to estimate models.

TABLE 2
www.frontiersin.org

TABLE 2. Descriptive statistics and skewness and kurtosis for all scales included.

Factor Structure

Table 3 exhibits fit indices of five competing models for the polychromic correlation matrix of the BSI-18 in the whole sample. As depicted in Table 3, all five hypothetical models exhibited good fit to the data (CFIs > 0.90, TLIs > 0.90). Overall, the bi-factor model provided the best fit to this data among these five alternative models (WLSMVχ2 = 957.934, df = 117, CFI = 0.985, TLI = 0.980, RMSEA = 0.055, BIC = 55923.251). In the model, the general factor and three dimensions containing somatization, depression, and anxiety factors were all considered. Because the fit statistics such as CFI were similarly good for the five models (CFI values all greater than or equal to 0.950), the BIC value was used for further verification. The ΔBIC value between the three-factor bi-factor model and four-factor model was189.733, indicating that the smaller value, i.e., the three-factor bi-factor model, shows better fit (see Table 3). Due to the items 3 and 6 were not fully representative of anxiety dimension and item 2 of the depression dimension, we tried to re-specify a new model in which items 2, 3, and 6 don’t loading on specific factor. Difference testing result indicated a worse model fit [Δχ2 = 47.255, Δdf = 3 (p < 0.001)]. Thus, we still used the original three-factor bi-factor model as the best model.

TABLE 3
www.frontiersin.org

TABLE 3. Goodness-of-fit indices for the five tested models of the BSI-18.

The ωH for the general factor was 0.87, and the ωHS for somatization factor was 0.28, for anxiety factor was 0.17, and for depression factor was 0.04. In addition, the ECV was 80%. The bi-factor model’s standardized factor loadings were presented in Table 4.

TABLE 4
www.frontiersin.org

TABLE 4. The standardized factor loadings for the BSI-18 bi-factor model.

Measurement Invariance

To ensure that the three-factor bi-factor model provided adequate fit in each group, we first examined it separately for males and females. Results indicated that the bi-factor model fit the two groups well (see Table 5). Then the metric invariance model, in which item factor loadings were constrained to be equal, was tested. Results indicated negligible gender differences in model fits (ΔCFI ≤ 0.01). Finally, the scalar invariance was tested by further constraining the thresholds to be equal across the two gender groups. The scalar invariance was achieved with a ΔCFI = +0.003.

TABLE 5
www.frontiersin.org

TABLE 5. Fit indices for measurement invariance.

Criterion Validity

The SEM exhibited mediocre fit to the data (CFI = 0.847, TLI = 0.807). The general BSI factor negatively correlated with all factors of the Grit, the correlation coefficients ranged from -0.239 to -0.374 (p < 0.001; see Table 6 for details). On the other hand, the somatization factor was positively and significantly related to all factors of GRIT. The depression subscale had negative correlations with Grit total and Grit Effort factor (see Table 6). No significant correlations were found between the anxiety factor and the Grit.

TABLE 6
www.frontiersin.org

TABLE 6. Correlations between Grit, PSSS, and the BSI-18 general and dimension factors.

For PSSS, both the general BSI factor and the depression factor showed the strongest negative relation with all PSSS factors, the correlations coefficients ranged from -0.293 to -0.331 (p < 0.001). On the other hand, somatization was positively related to all PSSS factors (see Table 6). Anxiety factor was not significantly related to PSSS.

Discussion

This study aimed to test the BSI-18’s factor structure and measurement invariance in a large sample of Chinese employees. The BSI-18’s bi-factor model best fit the present data. The MI tests indicated that the BSI-18 was equivalent for males and females. The results also reveal significant correlations between BSI-18 scores and grit trait and social support.

Although the one-, three-, and four-factor models achieved satisfactory fit, the bi-factor models outperformed the other three models. Moreover, the three-factor bi-factor model better fit the data than four-factor bi-factor model considering the model conciseness, and three-factor bi-factor model was chosen in the follow research. The bi-factor model consists of a general factor (General BSI) that accounted for covariation among all indicators of the comprehensive mental health level and three specific factors (somatizaton, depression, and anxiety) accounting for variance beyond the general factor in covariation among specific factor indicators (Ward et al., 2015). The current results for the bi-factor model supported the bi-factor structure of psychiatric symptoms, providing general and specific areas of composition. The bi-factor model considers the general mental health status (General BSI) while accounting for the three specific symptoms. Future studies may consider cross-cultural MI tests to clarify the cultural differences in the factor models. From another point of view, the three domain-specific components of the bi-factor model and discriminant validity demonstrated the panic factor was a product of over extraction (Recklitis et al., 2006); this is in accordance with the result of Derogatis (2001) and concludes that panic may be associated with broader anxiety symptoms.

The current finding also provided evidence for the measurement invariance of the BIS-18 across the male and female samples. The three levels of measurement invariance – configural, metric, and scalar invariance were all achieved in the present study, indicating that the BIS-18 may measure the constructs equally across the two genders.

Finally, we tested the potential covariates that may contribute to the mental conditions measured by the BSI-18. Moderate but significantly negative relations of the general BSI with grit and perceived social support were observed. This finding is consistent with the literature that the grit trait and social support were important for individuals’ mental health conditions (Williams et al., 2002; Dai, 2003). For the three dimensions beyond the general factor, the depression dimension showed modest negative correlation with grit trait and perceived social support. This is in line with the previous finding that suggested low levels of social support may result in higher level of depressive symptoms (Williams et al., 2002) and frequency of suicidal ideation (Zhang et al., 2010).

In contrast, the somatization dimension had positive correlations with the two covariates. The positive correlations of somatization with grit trait and social support may be explained by the cultural influences. Traditional Chinese culture seems to discourage people from expressing their feelings directly; thus, somatization is an alternative way to express emotional disorders (Kleinman, 1982; Cheung, 1995). When there is sufficient social support and grit characteristics, people may fear expressing their psychological distress overtly. This leads to the positive correlations of somatization with social support and grit trait. Another likely reason is that the use of the bi-factor model requires the consideration of the common differences between dimensions (Reise, 2012), and these differences can lead to cross suppression effect (Patrick et al., 2007). The correlations between anxiety dimension and grit trait and social support in this sample were not significant. In other words, all factors are included in the structural equation model, and the direction of the relationship can be reversed when these factors are tested separately.

Clinical Significance

Cultural factors, including ethnic identity and cultural values, influence an individual’s idiomatic expression of psychological distress, conceptualization of psychological problems’ etiology, and subsequent help-seeking behavior (Torres et al., 2013). The findings in the present study have suggested that Chinese may express psychological problems via somatic symptoms. This is important in for clinical research that aims to measure mental health conditions, and for clinical practice in which how clinicians better assess patients’ problems. Clinicians may encourage Chinese patients to isolate the influence of cultural beliefs to be aware of and identify emotional problems, which may also facilitate the patients’ help-seeking behaviors. Second, as we observed, both social support and grit are associated with general mental health among the insurance employees. This implied that specific treatment options may be developed and used for the insurance practitioners. For instance, group career guidance will be affected during the morning session to alleviate employees’ occupational stress. Finally, focusing on various special symptoms, the concurrency of various adverse symptoms and the individual’s overall psychological state should be simultaneously considered during clinical research and intervention.

Limitations

Some limitations need to be acknowledged. Because expression of psychopathology may be restricted by specific cultural backgrounds, the research’s lack of foreign samples as reference groups may be problematic. From this perspective, assessing psychological symptoms of a specific cultural norm to strengthen cross-cultural research is essential. In terms of relationships with external criteria, more other social and behavioral manifestations can be investigated, such as family-to-work conflicts, sources of social pressure, social desirability, days out of work, and so forth. Moreover, the general factor of bi-factor model maybe represent a statistical artifact factor, only in theory, but the factor loadings on general factor were large enough in our data, so it is couldn’t be caused by artifact effect or method effects.

In sum, this study suggested that the BSI-18 is a reliable and valid general psychological distress measurement instrument that can be extended to Chinese insurance employees. The bi-factor model better represented the BSI-18’s underlying structure. Meanwhile, Chinese men and women shared a common understanding of psychological distress as measured by the BSI-18. Furthermore, this study highlighted the importance of assessing the general factor and viewed the mental health of insurance practitioners as a holistic approach rather than focusing on individual dimensions while excluding the artifact effect or method effects.

Author Contributions

ML and CZ made substantial contribution to the analysis and to the interpretation of the data, drafted the manuscript, provided final approval for the version to be published, and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. M-CW made substantial contributions to the conception and the design of the study, drafted the manuscript, provided final approval for the version to be published, and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. FR, XZ, YS, and WY helped out in the interpretation of data for the work, revised the manuscript critically for important intellectual content, provided final approval for the version to be published, and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding

This study was funded by the National Natural Science Foundation of China (Grant No. 31400904), Xinmiao Project of Guangzhou University (2014-27), Foundation of Guangzhou Shishu Gaoxiao Project (Grant No. 1201431330), and Guangzhou University’s 2017 training program for young top-notch personnels (BJ201715).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We would like to thank Guangdong Insurance Intermediary Association for their assistance in collecting data.

References

Al-Turkait, F. A., and Ohaeri, J. U. (2010). Dimensional and hierarchical models of depression using the beck depression inventory-ii in an Arab college student sample. BMC Psychiatry 10:60. doi: 10.1186/1471-244X-10-60

PubMed Abstract | CrossRef Full Text | Google Scholar

Andreu, Y., Galdón, M. J., Dura, E., Ferrando, M., Murgui, S., and García, A. (2008). Psychometric properties of the Brief Symptoms Inventory-18 (BSI-18) in a Spanish sample of outpatients with psychiatric disorders. Psicothema 20, 844–850.

PubMed Abstract | Google Scholar

Cheung, F. M. (1995). “Facts and myths about somatization among the Chinese,” in Chinese Societies and Mental Health, eds T.-Y. Lin, W. S. Tseng, and E. K. Yeh (New York, NY: Oxford University Press), 156–180.

Google Scholar

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 9, 233–255. doi: 10.1097/NNR.0b013e3182544750

PubMed Abstract | CrossRef Full Text | Google Scholar

R Core Team (2017). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna: R Core Team.

Google Scholar

Dai, F. (2003). Research on the Mental Health Status and Related Factors of Insurance Salesmen. M.A. thesis, Jiangxi Normal University, Jiangxi.

Derogatis, L. (1993). Brief Symptom Inventory (BSI): Administration, Scoring, and Procedures Manual, 3rd Edn. Minneapolis, MN: NCS Pearson.

Google Scholar

Derogatis, L. (2001). Brief Symptoms Inventory 18: Administration, Scoring, and Procedures Manual. Minneapolis, MN: NCS Pearson.

Google Scholar

Derogatis, L. R. (1977). The SCL–90 Manual: Scoring, Administration and Procedures for the SCL-90. Baltimore, MD: John Hopkins University School of Medicine.

Google Scholar

Duckworth, A. L., Peterson, C., Matthews, M. D., and Kelly, D. R. (2007). Grit: perseverance and passion for long-term goals. J. Pers. Soc. Psychol. 92, 1087–1101. doi: 10.1037/0022-3514.92.6.1087

PubMed Abstract | CrossRef Full Text | Google Scholar

Duckworth, A. L., and Quinn, P. D. (2009). Development and validation of the short grit scale (grit-s). J. Pers. Assess. 91, 166–174. doi: 10.1080/00223890802634290

PubMed Abstract | CrossRef Full Text | Google Scholar

Flora, D. B., and Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 9, 466–491. doi: 10.1037/1082-989X.9.4.466

PubMed Abstract | CrossRef Full Text | Google Scholar

Flores-Mendoza, C. E., Herrero, O., and Abad, F. J. (2008). Factor structure and behavioural correlates of the psychopathy checklist-revised [PCL-R] in a Brazilian prisoner sample. Pers. Individ. Dif. 45, 584–590. doi: 10.1016/j.paid.2008.06.016

CrossRef Full Text | Google Scholar

Kleinman, A. (1982). Neurasthenia and depression: a study of somatization and culture in china. Cult. Med. Psychiatry 6, 117–190. doi: 10.1007/BF00051427

CrossRef Full Text | Google Scholar

Kline, R. B. (2010). Principles and Practice of Structural Equation Modeling, 3rd Edn. New York, NY: Guilford Press.

Google Scholar

Kuha, J. (2004). AIC and BIC: comparisons of Assumptions and Performance. Sociol. Methods Res. 33, 188–229. doi: 10.1177/0049124103262065

CrossRef Full Text | Google Scholar

Ling, W. Q., Zhang, D. K., and Fang, L. L. (2001). The analysis of the structure for self-efficacy of insurance salesmen. Acta Psychol. Sin. 33, 63–67.

Google Scholar

Muthén, L. K., and Muthén, B. O. (1998–2010). Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén.

Oh, H.-J., Glutting, J. J., Watkins, M. W., Youngstrom, E. A., and McDermott, P. A. (2004). Correct interpretation of latent versus observed abilities: implications from structural equation modeling applied to the WISC-III and WIAT linking sample. J. Spec. Educ. 38, 159–173. doi: 10.1177/00224669040380030301

CrossRef Full Text | Google Scholar

Patrick, C. J., Hicks, B. M., Nichol, P. E., and Krueger, R. F. (2007). A bifactor approach to modeling the structure of the psychopathy check-list-revised. J. Pers. Disord. 21, 118–141. doi: 10.1521/pedi.2007.21.2.118

PubMed Abstract | CrossRef Full Text | Google Scholar

Prelow, H. M., Weaver, S. R., Swenson, R. R., and Bowman, M. A. (2005). A preliminary investigation of the validity and reliability of the brief-symptom inventory-18 in economically disadvantaged Latina American mothers. J. Commun. Psychol. 33, 139–155. doi: 10.1002/jcop.20041

CrossRef Full Text | Google Scholar

Recklitis, C. J., Parsons, S. K., Shih, M. C., Mertens, A., Robison, L. L., and Zeltzer, L. (2006). Factor structure of the brief symptom inventory–18 in adult survivors of childhood cancer: results from the childhood cancer survivor study. Psychol. Assess. 18, 22–32. doi: 10.1037/1040-3590.18.1.22

PubMed Abstract | CrossRef Full Text | Google Scholar

Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behav. Res. 47, 667–696. doi: 10.1080/00273171.2012.715555

PubMed Abstract | CrossRef Full Text | Google Scholar

Reise, S. P., Bonifay, W. E., and Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. J. Pers. Assess. 95, 129–140. doi: 10.1080/00223891.2012.725437

PubMed Abstract | CrossRef Full Text | Google Scholar

Revelle, W. (2017). Psych: Procedures for Personality and Psychological Research. Evanston, IL: Northwestern University.

Google Scholar

Rodriguez, A., Reise, S. P., and Haviland, M. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. J. Pers. Assess. 98, 223–237. doi: 10.1080/00223891.2015.1089249

PubMed Abstract | CrossRef Full Text | Google Scholar

Thomas, M. L. (2012). Rewards of bridging the divide between measurement and clinical theory: demonstration of a bifactor model for the brief symptom inventory. Psychol. Assess. 24, 101–113. doi: 10.1037/a0024712

PubMed Abstract | CrossRef Full Text | Google Scholar

Torres, L., Miller, M. J., and Moore, K. M. (2013). Factorial invariance of the brief symptom inventory-18 (bsi-18) for adults of Mexican descent across nativity status, language format, and gender. Psychol. Assess. 25, 300–305. doi: 10.1037/a0030436

PubMed Abstract | CrossRef Full Text | Google Scholar

Urbán, R., Kun, B., Farkas, J., Paksi, B., Kökönyei, G., and Unoka, Z. (2014). Bifactor structural model of symptom checklists: scl-90-r and brief symptom inventory (BSI) in a non-clinical community sample. Psychiatry Res. 216, 146–154. doi: 10.1016/j.psychres.2014.01.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Vassend, O., and Skrondal, A. (1999). The problem of structural indeterminacy in multidimensional symptom report instruments the case of SCL-90-R. Behav. Res. Ther. 37, 685–701. doi: 10.1016/S0005-7967(98)00182-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, J., Kelly, B. C., Liu, T., Zhang, G., and Hao, W. (2013). Factorial structure of the brief symptom inventory (BSI)-18 among Chinese drug users. Drug Alcohol Depend. 133, 368–375. doi: 10.1016/j.drugalcdep.2013.06.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Ward, J. T., Nobles, M. R., and Fox, K. A. (2015). Disentangling self-control from its elements: a bifactor analysis. J. Quant. Criminol. 31, 595–627. doi: 10.1007/s10940-014-9241-6

CrossRef Full Text | Google Scholar

Watson, D. (2005). Rethinking the mood and anxiety disorders: a quantitative hierarchical model for DSM-V. J. Abnorm. Psychol. 114, 522–536. doi: 10.1037/0021-843X.114.4.522

PubMed Abstract | CrossRef Full Text | Google Scholar

Wiesner, M., Chen, V., Windle, M., Elliott, M. N., Grunbaum, J. A., and Kanouse, D. E. (2010). Factor structure and psychometric properties of the brief symptom inventory–18 in women: a macs approach to testing for invariance across racial/ethnic groups. Psychol. Assess. 22, 912–922. doi: 10.1037/a0020704

PubMed Abstract | CrossRef Full Text | Google Scholar

Williams, R. A., Hagerty, B. M., Yousha, S. M., Hoyle, K. S., and Oe, H. (2002). Factors associated with depression in navy recruits. J. Clin. Psychol. 58, 323–337. doi: 10.1002/jclp.1146

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, X. Y. (2013). Research on Mental Health to Staff for Insurance Marketing in T Branch of HX Life-Insurance Company. M.A. thesis, University Of International Business and Economics, Beijing.

Zabora, J., Brintzenhofeszoc, K., Jacobsen, P., Curbow, B., Piantadosi, S., and Hooker, C. (2001). A new psychosocial screening instrument for use with cancer patients. Psychosomatics 42, 241–246. doi: 10.1176/appi.psy.42.3.241

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, J., Grabiner, V. E., Zhou, Y., and Li, N. (2010). Suicidal ideation and its correlates in prisoners: a comparative study in china. Crisis 31, 335–342. doi: 10.1027/0227-5910/a000055

PubMed Abstract | CrossRef Full Text | Google Scholar

Zimet, G. D., Powell, S. S., Farley, G. K., Werkman, S., and Berkoff, K. A. (1990). Psychometric characteristics of the multidimensional scale of perceived social support. J. Pers. Assess. 55, 610–617. doi: 10.1080/00223891.1990.9674095

PubMed Abstract | CrossRef Full Text | Google Scholar

Zinbarg, R., Yovel, I., Revelle, W., and McDonald, R. P. (2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: a comparison of estimators for h. Appl. Psychol. Meas. 30, 121–144. doi: 10.1177/0146621605278814

CrossRef Full Text | Google Scholar

Keywords: psychometric properties, Brief Symptom Inventory-18, bi-factor model, measurement invariance, Chinese insurance professionals

Citation: Li M, Wang M-C, Shou Y, Zhong C, Ren F, Zhang X and Yang W (2018) Psychometric Properties and Measurement Invariance of the Brief Symptom Inventory-18 Among Chinese Insurance Employees. Front. Psychol. 9:519. doi: 10.3389/fpsyg.2018.00519

Received: 25 January 2018; Accepted: 27 March 2018;
Published: 18 April 2018.

Edited by:

Marco Innamorati, Università Europea di Roma, Italy

Reviewed by:

Leonardo Carlucci, Università degli Studi “G. d’Annunzio” Chieti-Pescara, Italy
Marco Lauriola, Sapienza Università di Roma, Italy

Copyright © 2018 Li, Wang, Shou, Zhong, Ren, Zhang and Yang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Meng-Cheng Wang, wmcheng2006@126.com Wendeng Yang, yangwendeng@163.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.