Open Universiteit

Please use this identifier to cite or link to this item:
Title: Performance assessment in serious games: Compensating for the effects of randomness
Authors: Westera, Wim
Keywords: serious
cut score
computer-assisted lelarning
monte carlo
Issue Date: 6-Nov-2014
Citation: Westera, W. (2016). Performance assessment in serious games: Compensating for the effects of randomness. Education and Information Technologies, 21(3), 681-697. DOI 10.1007/s10639-014-9347-3
Abstract: This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41% of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players´ achievements.
Appears in Collections:1. FEEEL Publications, books and conference papers

Files in This Item:
File Description SizeFormat 
Performance assessment in serious games.pdf610.35 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.