Person-fit statistics : a useful tool for formative assessment
Fuentes Agustí, Marta (Universitat Autònoma de Barcelona. Departament de Psicologia Bàsica, Evolutiva i de l'Educació)
Doval Diéguez, Eduardo (Universitat Autònoma de Barcelona. Departament de Psicobiologia i de Metodologia de les Ciències de la Salut)
Riba i Lloret, M. Dolors (Universitat Autònoma de Barcelona. Departament de Psicobiologia i de Metodologia de les Ciències de la Salut)
Renom Pinsach, Jordi (Universitat de Barcelona. Departament de Psicologia Social i Psicologia Quantitativa)

Date: 2015
Abstract: The total test scores are interpreted as indicators of the level of proficiency. Even if the test is built with guarantees of content validity, the validity of these interpretations is not guaranteed for all people tested. The process that has followed each assessed person to give their answers to the test questions is crucial to ensure the validity of individual interpretations. The guidelines for the reporting of test score, published in 2012 by the International Test Commission, recommend use statistical techniques to identify invalid scores. In tests with multiple-choice questions, the person-fit statistics are suitable for identifying atypical patterns of response that invalidate the interpretation of the total score. The main aim is to quantify the atypical response patterns present at an English language proficiency test. Our interest is to provide a useful tool for formative assessment. The data are from an institutional assessment conducted by the Department of Education of the Catalan Government. The test was completed by 56. 428 students of fourth course of Secondary Education throughout all schools in Catalonia. Analyses were carried out with PerFit R package. Modified Caution Index was calculated to quantify the presence of atypical response patterns. The results show a high number of atypical response patterns. Our attention is addressed to students with central scores, because this target group has a higher potential improvement. We present different identified atypical patterns and discuss its relevance in evaluative assessments.
Note: Número d'acord de subvenció MINECO/EDU2013-41399-P
Note: Lligar amb la ponència del mateix títol
Note: Amb el suport del Consell Superior d'Avaluació de Catalunya
Rights: Aquest document està subjecte a una llicència d'ús Creative Commons. Es permet la reproducció total o parcial i la comunicació pública de l'obra, sempre que no sigui amb finalitats comercials, i sempre que es reconegui l'autoria de l'obra original. No es permet la creació d'obres derivades. Creative Commons
Language: Anglès.
Document: conferenceObject
Subject: Pedagogical innovations ; Evaluation of Student Learning ; Educational Assessment ; Aberrant Response Patterns ; Learning Styles ; Compulsory Education
Published in: EDULEARN. Barcelona, : 2015

16 p, 500.9 KB

The record appears in these collections:
Contributions to meetings and congresses > Presentations

 Record created 2018-03-20, last modified 2018-10-20

   Favorit i Compartir