ES EN
Vol. 20. Núm. 2. - 2014. Páginas 89-97

Cognitively Diagnostic Assessments and the Cognitive Diagnosis Model Framework

[El marco de la evaluación y los modelos de diagnostico cognitivo]

Jimmy de la Torre1 , Nathan Minchen1


1The State Univ. New Jersey, Dep. Educational Psychology Rutgers, USA


https://doi.org/10.1016/j.pse.2014.11.001

Abstract

This paper aims to identify the utility of and the need for cognitively diagnostic assessments (CDAs) in conjunction with cognitive diagnosis models (CDMs), and to outline various considerations involved in their development and use. We begin by contrasting the CDA/CDM framework against existing assessment frameworks, which are typically based on item response theory or classical test theory, and show that CDAs used in the CDM context can provide valuable diagnostic information that could enhance classroom instruction and learning. We then detail how the components of a CDA fit into the assessment triangle framework, as well as the evidence-centered design framework. Attribute identification and item development in the context of CDA are discussed, and examples from relevant research are provided. Details of CDMs, which are the statistical models that underpin the practical implementations of CDAs, are also discussed. 

 

Resumen

El presente artículo trata de identificar la utilidad y la necesidad de las Evaluaciones para el Diagnóstico Cognitivo (EDC) junto a los Modelos de Diagnóstico Cognitivo (MDC) y plantea algunas de las consideraciones implicadas en su desarrollo y uso. Se comienza comparando el marco EDC/MDC con otros marcos existentes basados típicamente en la teoría de respuesta al ítem o en la teoría clásica de los tests, mostrando que las EDC utilizadas en el contexto MDC pueden proporcionar información diagnóstica muy valiosa para mejorar el proceso de enseñanza-aprendizaje en el aula. Seguidamente se utiliza el marco del triángulo de la evaluación y del diseño centrado en la evidencia para presentar los componentes de una evaluación de este tipo. Se analiza la identificación de atributos y el desarrollo de ítems en el contexto de una EDC y se proporcionan ejemplos tomados de una investigación relevante. También se analizan cuestiones relativas a los MDC, que son los modelos estadísticos que vertebran la implementación práctica de las EDC. 

 

References
 
Bachman and Palmer, 2010
 
L. Bachman
A. Palmer
Language assessment in practice: Developing language assessments and justifying their use in the real world
2010
Chudowsky and Pellegrino, 2003
 
N. Chudowsky
J.W. Pellegrino
Large-scale assessments that support learning: What will it take?
Theory into Practice
42
2003
75-83
de la Torre, 2009
 
J. de la Torre
A cognitive diagnosis model for cognitively based multiple-choice options
Applied Psychological Measurement
33
2009
163-83
de la Torre, 2012
 
J. de la Torre
Application of the DINA Model Framework to Enhance Assessment and Learning
Self-directed learning oriented assessments in the Asia-Pacific
Springer
New York
2012
92-110
de La Torre, 2011
 
J. de La Torre
The generalized DINA model framework
Psychometrika
76
2011
179-99
de la Torre and Karelitz, 2009
 
J. de la Torre
T.M. Karelitz
Impact of diagnosticity on the adequacy of models for cognitive diagnosis under a linear attribute structure: A simulation study
Journal of Educational Measurement
46
2009
450-69
de la Torre and Lee, 2010
 
de la Torre, J., & Lee, Y.S. (2010, April). Item-level comparison of saturated and reduced cognitive diagnosis models. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Denver, CO.
DiBello et al., 2007
 
L.V. DiBello
L.A. Roussos
W. Stout
Review of cognitively diagnostic assessment and a summary of psychometric models
Handbook of statistics
26
2007
979-1030
Haertel, 1989
 
E.H. Haertel
Using restricted latent class models to map the skill structure of achievement items
Journal of Educational Measurement
26
1989
301-21
Hartz, 2002
 
Hartz, S.M. (2002). A Bayesian framework for the Unified Model for assessing cognitive abilities: blending theory with practicality.(Unpublished doctoral dissertation).
Henson and Douglas, 2005
 
R. Henson
J. Douglas
Test construction for cognitive diagnosis
Applied Psychological Measurement
29
2005
262-77
Junker and Sijtsma, 2001
 
B.W. Junker
K. Sijtsma
Cognitive assessment models with few assumptions, and connections with nonparametric item response theory
Applied Psychological Measurement
25
2001
258-72
Kane, 2013
 
M. Kane
Validating the interpretations and uses of test scores
Journal of Educational Measurement
50
2013
1-73
Leighton et al., 2004
 
J.P. Leighton
M.J. Gierl
S. Hunka
The attribute hierarchy method for cognitive assessment: A variation on Tatsuoka's rule-space approach
Journal of Educational Measurement
41
2004
205-37
Maris, 1999
 
E. Maris
Estimating multiple classification latent class models
Psychometrika
64
1999
187-212
Mislevy, 2011
 
Mislevy, R.J. (2011). Evidence-centered design for simulation-based assessment (CRESST Report 800). Los Angeles, CA: The National Center for Research on Evaluation, Standards, and Student Testing, UCLA.
Mislevy and Haertel, 2006
 
R.J. Mislevy
G.D. Haertel
Implications of evidence-centered design for educational testing
Educational Measurement: Issues and Practice
25
2006
6-20
Mislevy et al., 2003
 
R.J. Mislevy
L.S. Steinberg
R.G. Almond
On the structure of educational assessments
Measurement: Interdisciplinary research and perspectives
1
2003
3-62
Pellegrino, 2014
 
J.W. Pellegrino
Assessment as a positive influence on 21st century teaching and learning: A systems approach to progress
Psicología Educativa
20
2014
65-77
Pellegrino et al., 2001
 
Knowing what students know: The science and design of educational assessment (National Research Council's Committee on the Foundations of Assessment)
National Academies Press
Washington, DC
2001
Shepard, 2000
 
L.A. Shepard
The role of assessment in a learning culture
Educational Researcher
29
2000
4-14
Tatsuoka, 1995
 
K.K. Tatsuoka
Architecture of knowledge structures and cognitive diagnosis: A statistical pattern recognition and classification approach
Cognitively diagnostic assessment
Erlbaum
Hillsdale, NJ
1995
327-59
Tatsuoka, 1983
 
K.K. Tatsuoka
Rule-space: An approach for dealing with misconceptions based on item response theory
Journal of Educational Measurement
20
1983
345-54
Tatsuoka et al., 2014
 
Tatsuoka et al., Tatsuoka, C., Clements, D.H., Sarama, J., Izsak, A., Orril, C.H., de la Torre, J., & Khasanova, E. (in press). Developing workable attributes for psychometric models based on the Q-matrix. Journal of Research on Mathematics Education .
Templin and Henson, 2006
 
J.L. Templin
R.A. Henson
Measurement of psychological disorders using cognitive diagnosis models
Psychological methods
11
2006
287-305
Tjoe and de la Torre, 2012
 
H. Tjoe
J. de la Torre
Proportional reasoning problems: Current state and a possible future direction
Proceedings of the 12th International Congress on Mathematics Education
2012
6741-50
Tjoe and de la Torre, 2013a
 
H. Tjoe
J. de la Torre
Designing cognitively-based proportional reasoning problems as an application of modern psychological measurement models
Journal of Mathematics Education
6
2013
17-22
Tjoe and de la Torre, 2013b
 
H. Tjoe
J. de la Torre
The identification and validation process of proportional reasoning attributes: An application of a cognitive diagnosis modeling framework
Mathematics Education Research Journal
26
2013
237-55
Tjoe and de la Torre, 2014
 
H. Tjoe
J. de la Torre
On recognizing proportionality: Does the ability to solve missing value proportional problems presuppose the conception of proportional reasoning?
The Journal of Mathematical Behavior
33
2014
1-7
Department of Education, 2013
 
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics (2013). National Assessment of Educational Progress (NAEP), 2013 Mathematics Assessment . Retrieved from h t t p & # 5 8 ; & # 4 7 ; & # 4 7;nces.ed.gov/nationsreportcard/itemmaps/index.asp.
Zieky, 2014
 
M.J. Zieky
An introduction to the use of evidence-centered design in test development
Psicología Educativa
20
2014
79-87

Copyright © 2024. Colegio Oficial de la Psicología de Madrid

© Copyright 2024. Colegio Oficial de la Psicología de Madrid ContactoPolítica de privacidadPolítica de cookies

Utilizamos cookies propias y de terceros para mejorar nuestros servicios y conocer sus preferencias mediante el análisis de sus hábitos de navegación. Si continua navegando, consideramos que acepta su uso. Puede acceder a política de cookies para obtener más información.

Aceptar