Open Universiteit

Please use this identifier to cite or link to this item:
Title: Communication skills training exploiting multimodal emotion recognition
Authors: Bahreini, Kiavash
Nadolski, Rob
Westera, Wim
Keywords: Assessment of learners
communication skills
emotion recognition
serious gaming
Issue Date: 27-Oct-2016
Publisher: Taylor & Francis Online
Citation: Bahreini, K., Nadolski, R., & Westera, W. (2016). Communication skills training exploiting multimodal emotion recognition. Interactive Learning Environments, 1-18. Taylor & Francis Group. DOI: 10.1080/10494820.2016.1247286.
Abstract: The teaching of communication skills is a labour-intensive task because of the detailed feedback that should be given to learners during their prolonged practice. This study investigates to what extent our FILTWAM facial and vocal emotion recognition software can be used for improving a serious game (the Communication Advisor) that delivers a web-based training of communication skills. A test group of 25 participants played the game wherein they were requested to mimic specific facial and vocal emotions. Half of the assignments included direct feedback and the other half included no feedback. It was investigated whether feedback on the mimicked emotions would lead to better learning. The results suggest the facial performance growth was found to be positive, particularly significant in the feedback condition. The vocal performance growth was significant in both conditions. The results are a significant indication that the automated feedback from the software improves learners’ communication performances.
Appears in Collections:1. FEEEL Publications, books and conference papers

Files in This Item:
File Description SizeFormat 
Bahreini, Nadolski, Westera, 2016b.pdf2.04 MBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons