This paper introduces the integration of the face emotion recognition part and the voice
emotion recognition part of our FILTWAM framework that uses webcams and microphones.
This framework enables real-time multimodal emotion recognition of learners during game-
based learning for triggering feedback towards improved learning. The main goal of this
study is to validate the integration of webcam and microphone data for a real-time and
adequate interpretation of facial and vocal expressions into emotional states where the …

… The Kappa value for the validation results of the face emotion recognition module for all the
seven emotion for task 1, task 2, task3, and task 4. … The Kappa value for the validation results
of the voice emotion recognition module for all the seven emotion for task 1, task 2, task3, and
task 4. … The overall Kappa value for the validation results of the face and the voice emotion
recognition software modules for all the seven emotion for task 1, task 2, task3, and task 4. …