Sound and movement are closely coupled, particularly in dance. Certain audio features have been found to affect the way we move to music. Is this relationship between sound and movement something which can be modelled using machine learning? This work presents initial experiments wherein high-level audio features calculated from a set of music pieces are included in a movement generation model trained on motion capture recordings of improvised dance. Our results indicate that the model learns to generate realistic dance movements which vary depending on the audio features.
翻译:声音和运动是紧密结合的, 特别是在舞蹈中。 某些音频特征已经发现会影响我们向音乐移动的方式。 声音和运动之间的关系是可以通过机器学习来模拟的吗? 这项工作是初步实验, 从一组音乐作品中计算出来的高级音频特征包含在运动生成模型中, 通过运动捕捉即兴舞蹈的录音。 我们的结果表明, 模型学会产生现实的舞蹈运动, 视音频特征的不同而有所不同 。