Open Universiteit

Please use this identifier to cite or link to this item: http://hdl.handle.net/1820/8390
Title: The Proof of the Pudding: Examining Validity and Reliability of the Evaluation Framework for Learning Analytics
Authors: Scheffel, Maren
Drachsler, Hendrik
Toisoul, Christian
Ternier, Stefaan
Specht, Marcus
Keywords: learning analytics
evaluation
validity
reliability
Issue Date: Sep-2017
Publisher: Springer
Citation: Scheffel, M., Drachsler, H., Toisoul, C., Ternier, S., & Specht, M. (2017). The Proof of the Pudding: Examining Validity and Reliability of the Evaluation Framework for Learning Analytics. In E. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Data Driven Approaches in Digital Education: Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), LNCS: Vol. 10474 (pp. 194–208). Berlin, Heidelberg: Springer.
Series/Report no.: LNCS;10474
Abstract: While learning analytics (LA) is maturing from being a trend to being part of the institutional toolbox, the need for more empirical evidences about the effects for LA on the actual stakeholders, i.e. learners and teachers, is increasing. Within this paper we report about a further evaluation iteration of the Evaluation Framework for Learning Analytics (EFLA) that provides an efficient and effective measure to get insights into the application of LA in educational institutes. For this empirical study we have thus developed and implemented several LA widgets into a MOOC platform’s dashboard and evaluated these widgets using the EFLA as well as the framework itself using principal component and reliability analysis. The results show that the EFLA is able to measure differences between widget versions. Furthermore, they indicate that the framework is highly reliable after slightly adapting its dimensions.
URI: http://hdl.handle.net/1820/8390
Appears in Collections:1. TELI Publications, books and conference papers

Files in This Item:
File Description SizeFormat 
scheffelectel2017preprint.pdf979.39 kBAdobe PDFView/Open


This item is licensed under a Creative Commons License Creative Commons