Computer-assisted assessment in open-ended activities through the analysis of traces: A proof of concept in statistics with R commander

Miquel Calvo, Artur Carnicer, Jordi Cuadros, Francesc Martori, Antonio Miñarro, Vanessa Serrano

Research output: Indexed journal article Articlepeer-review

1 Citation (Scopus)

Abstract

Open-ended tasks are common in Science, Technology, Engineering and Mathematics (STEM) education. However, as far as we know, no tools have been developed to assist in the assessment of the solution process of open-ended questions. In this paper, we propose the use of analysis of traces as a tool to address this need. To illustrate this approach, we developed a modified version of R Commander that collects traces of students' actions and described a way to analyze them by using regular expressions. We used this tool in an undergraduate introductory statistics course. The traces were analyzed by comparing them to predefined problem-solving steps, arranged by the instructor. The analyses provide information about the time students spent on the activity, their work intensity and the choices they made when solving open-ended questions. This automated assessment tool provides grades highly correlated to those obtained by a traditional test and traditional grading scheme.

Original languageEnglish
Article numberem1743
JournalEurasia Journal of Mathematics, Science and Technology Education
Volume15
Issue number9
DOIs
Publication statusPublished - 2019

Keywords

  • Computer-assisted assessment
  • Learning analytics
  • Open-ended activity
  • R commander
  • Statistics education

Fingerprint

Dive into the research topics of 'Computer-assisted assessment in open-ended activities through the analysis of traces: A proof of concept in statistics with R commander'. Together they form a unique fingerprint.

Cite this