Open Universiteit

Please use this identifier to cite or link to this item:
Title: A methodology to assess the effectiveness of serious games and infer player learning outcomes
Other Titles: Final draft
Authors: Serrano-Laguna, Angel
Manero, Borja
Freire, Manuel
Fernandez-Manjon, Baltasar
Keywords: serious games
learning analytics
game design
learning outcomes analysis
educational games
Issue Date: Feb-2017
Publisher: Springer
Citation: Ángel Serrano-Laguna, Borja Manero, Manuel Freire, Baltasar Fernández-Manjón (2017): A methodology for assessing the effectiveness of serious games and for inferring player learning outcomes. Multimedia Tools and Applications (in press), pp 1-23
Abstract: Although serious games are proven educational tools in many educational domains, they lack reliable, automated and repeatable methodologies to measure their effectiveness: what do players know after playing a serious game? Did they learn with it? Literature research shows that the vast majority of serious games are assessed through questionnaires, which strikes a stark contrast with current trends in the video game industry. Commercial videogames have been learning from their players through Game Analytics for years, using non-disruptive game tracking. In this paper, we propose a methodology to assess serious games effectiveness using non-disruptive in-game tracking. The methodology proposes a design pattern that structures the delivery of educational goals within the game. This structure also allows inferring learning outcomes for each individual player, which, when aggregated, would determine the effectiveness of the serious game. We have tested this methodology with a serious game that was played by 320 students. The proposed methodology allowed us to infer players’ learning outcomes and assess game effectiveness and to spot issues in the game design.
Appears in Collections:1. RAGE Publications

Files in This Item:
File Description SizeFormat 
final manuscript MTA Serrano.pdf787.81 kBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons