We present an overview of the EmotionX 2019 Challenge, held at the 7th International Workshop on Natural Language Processing for Social Media (SocialNLP), in conjunction with IJCAI 2019. The challenge entailed predicting emotions in spoken and chat-based dialogues using augmented EmotionLines datasets. EmotionLines contains two distinct datasets: the first includes excerpts from a US-based TV sitcom episode scripts (Friends) and the second contains online chats (EmotionPush). A total of thirty-six teams registered to participate in the challenge. Eleven of the teams successfully submitted their predictions performance evaluation. The top-scoring team achieved a micro-F1 score of 81.5% for the spoken-based dialogues (Friends) and 79.5% for the chat-based dialogues (EmotionPush).
翻译:我们结合2019年国际犹太人咨询理事会(JCAI)在第七届社会媒体自然语言处理国际讲习班(ScienceNLP)上概述了情感X 2019挑战,这一挑战包括利用增强的情感线数据集预测口头和聊天对话中的情绪。情感线包含两个不同的数据集:第一个数据集包括美国电视演唱剧片段(之友)的节录,第二个数据集包括已登记参与这项挑战的在线聊天(EmovePush),共有36个团队登记参加这项挑战。 11个团队成功提交了预测业绩评估。 顶级团队在口头对话(朋友)和聊天对话(EmovePush)中取得了81.5%的微分F1分和79.5%的小额对话(情感普什)成绩。