doiSerbia

Evaluation of a learning analytics application for open edX platform

Ruipérez-Valiente José A. (Universidad Carlos III de Madrid, Leganés, Madrid, Spain + IMDEA Networks Institute, Leganés, Madrid, Spain)
Muñoz-Merino Pedro J. (Universidad Carlos III de Madrid, Leganés, Madrid, Spain)
Pijeira Díaz Héctor J. (Universidad Carlos III de Madrid, Leganés, Madrid, Spain)
Santofimia Ruiz Javier (Universidad Carlos III de Madrid, Leganés, Madrid, Spain)
Kloos Carlos Delgado (Universidad Carlos III de Madrid, Leganés, Madrid, Spain)

Massive open online courses (MOOCs) have recently emerged as a revolution in education. Due to the huge amount of users, it is difficult for teachers to provide personalized instruction. Learning analytics computer applications have emerged as a solution. At present, MOOC platforms provide low support for learning analytics visualizations, and a challenge is to provide useful and effective visualization applications about the learning process. At this paper we review the learning analytics functionality of Open edX and make an overview of our learning analytics application ANALYSE. We present a usability and effectiveness evaluation of ANALYSE tool with 40 students taking a Design of Telematics Applications course. The survey obtained very positive results in a system usability scale (SUS) questionnaire (78.44/100) in terms of the usefulness of visualizations (3.68/5) and the effectiveness ratio (92/100) of the actions required for the respondents. Therefore, we can conclude that the implemented learning analytics application is usable and effective.

Keywords: learning analytics, human machine system, open edx, MOOCs, information visualization