AUTHOR=Svetina Dubravka , Feng Yanan , Paulsen Justin , Valdivia Montserrat , Valdivia Arturo , Dai Shenghai TITLE=Examining DIF in the Context of CDMs When the Q-Matrix Is Misspecified JOURNAL=Frontiers in Psychology VOLUME=9 YEAR=2018 URL=https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2018.00696 DOI=10.3389/fpsyg.2018.00696 ISSN=1664-1078 ABSTRACT=

The rise in popularity and use of cognitive diagnostic models (CDMs) in educational research are partly motivated by the models’ ability to provide diagnostic information regarding students’ strengths and weaknesses in a variety of content areas. An important step to ensure appropriate interpretations from CDMs is to investigate differential item functioning (DIF). To this end, the current simulation study examined the performance of three methods to detect DIF in CDMs, with particular emphasis on the impact of Q-matrix misspecification on methods’ performance. Results illustrated that logistic regression and Mantel–Haenszel had better control of Type I error than the Wald test; however, high power rates were found using logistic regression and Wald methods, only. In addition to the tradeoff between Type I error control and acceptable power, our results suggested that Q-matrix complexity and item structures yield different results for different methods, presenting a more complex picture of the methods’ performance. Finally, implications and future directions are discussed.