COVID-19 has driven most schools to remote learning through online meeting software such as Zoom and Google Meet. Although this trend helps students continue learning without in-person classes, it removes a vital tool that teachers use to teach effectively: visual cues. By not being able to see a student's face clearly, the teacher may not notice when the student needs assistance, or when the student is not paying attention. In order to help remedy the teachers of this challenge, this project proposes a machine learning based approach that provides real-time student mental state monitoring and classifications for the teachers to better conduct remote teaching. Using publicly available electroencephalogram (EEG) data collections, this research explored four different classification techniques: the classic deep neural network, the traditionally popular support vector machine, the latest convolutional neural network, and the XGBoost model, which has gained popularity recently. This study defined three mental classes: an engaged learning mode, a confused learning mode, and a relaxed mode. The experimental results from this project showed that these selected classifiers have varying potentials in classifying EEG signals for mental states. While some of the selected classifiers only yield around 50% accuracy with some delay, the best ones can achieve 80% accurate classification in real-time. This could be very beneficial for teachers in need of help making remote teaching adjustments, and for many other potential applications where in-person interactions are not possible.
翻译:COVID-19促使大多数学校通过Zoom 和 Google Meet 等在线会议软件进行远程学习。 虽然这一趋势有助于学生继续不上人间课程的学习,但它消除了教师有效教学使用的一个重要工具:视觉提示。由于无法清楚地看到学生的脸,教师可能没有注意到学生需要援助,或者学生没有注意这一点。为了帮助纠正教师的这一挑战,该项目提议了一种基于机器的学习方法,为教师提供实时学生精神状态监测和分类,以更好地进行远程教学。虽然这一趋势有助于学生在公开提供的电子脑图(EEEG)数据收集中继续学习,但这一研究探索了四种不同的分类技术:典型的深神经网络、传统的大众支持矢量机、最新的革命性神经网络和XGBoost模型,这些模型最近越来越受欢迎。这项研究确定了三个心理班:一种参与学习模式、一种混淆的学习模式和一种宽松模式。 这个项目的实验结果表明,这些选定的分类师在为心理状态分类对EEEG信号进行分类方面有着不同的潜力。 某些选定的分类师在进行精确的排序中,只有大约80 % 的精确度的精确度, 才能在远程排序中取得某些可能的精确性调整。