Data-driven Communicative Behaviour Generation: A Survey


Oralbayeva N. Aly A. Sandygulova A. Belpaeme T.
30 January 2024Association for Computing Machinery

ACM Transactions on Human-Robot Interaction
2024#13Issue 1

The development of data-driven behaviour generating systems has recently become the focus of considerable attention in the fields of human-Agent interaction and human-robot interaction. Although rule-based approaches were dominant for years, these proved inflexible and expensive to develop. The difficulty of developing production rules, as well as the need for manual configuration to generate artificial behaviours, places a limit on how complex and diverse rule-based behaviours can be. In contrast, actual human-human interaction data collected using tracking and recording devices makes humanlike multimodal co-speech behaviour generation possible using machine learning and specifically, in recent years, deep learning. This survey provides an overview of the state of the art of deep learning-based co-speech behaviour generation models and offers an outlook for future research in this area.

Additional Key Words and PhrasesDatasets , data-driven behaviour generation , neural networks

Text of the article Перейти на текст статьи

Department of Robotics and Mechatronics, School of Engineering and Digital Sciences, Nazarbayev University, Nur-Sultan, 010000, Kazakhstan
School of Engineering, Computing and Mathematics, University of Plymouth, United Kingdom
Ghent University, IDLab-imec, Belgium

Department of Robotics and Mechatronics
School of Engineering
Ghent University

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026