Open Universiteit

Please use this identifier to cite or link to this item:
Title: An Evaluation Framework for Data Competitions in TEL
Authors: Drachsler, Hendrik
Stoyanov, Slavi
d'Aquin, Mathieu
Herder, Eelco
Guy, Marieke
Dietze, Stefan
Keywords: data competition
Linked Data
evaluation framework
Issue Date: 8-Jan-2015
Citation: Drachsler, H., Stoyanov, S., d’Aquin, M., Herder, E., Guy, M., & Dietze, S. (2014, 16-19 September). An Evaluation Framework for Data Competitions in TEL. In C. Rensing, S. de Freitas, T. Ley, & P. J. Munoz-Merino (Eds.), Proceedings of the 8th European Conference on Technology Enhanced Learning, LNCS: Vol. 8719 (pp. 70-83). Graz, Austria. [Please see also:]
Abstract: This paper presents a study describing the development of an Evaluation Framework (EF) for data competitions in TEL. The study applies the Group Concept Method (GCM) to empirically depict criteria and their indicators for evaluating software applications in TEL. A statistical analysis of multidimensional scaling and hierarchical clustering on the GCM data identified the following six evaluation criteria: 1.Educational Innovation, 2.Usability, 3.Data, 4.Performance, 5.Privacy, and 6.Audience. Each of them was operationalized through a set of indicators. The resulting Evaluation Framework (EF) including these criteria was applied to the first data competition of the LinkedUp project. The EF was consequently improved using the results from reviewers’ interviews, which were analysed qualitatively and quantitatively. The outcome of these efforts is a comprehensive EF that can be used for TEL data competitions and for the evaluation of TEL tools in general.
Appears in Collections:1. TELI Publications, books and conference papers

Files in This Item:
File Description SizeFormat 
ECTEL2014_LinkedUp.pdf1.04 MBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons