A review of evaluation practices of gesture generation in embodied conversational agents

P Wolfert, N Robinson… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Embodied conversational agents (ECAs) are often designed to produce nonverbal behavior
to complement or enhance their verbal communication. One such form of the nonverbal …

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

T Kucherenko, P Jonell, Y Yoon, P Wolfert… - Proceedings of the 26th …, 2021 - dl.acm.org
Co-speech gestures, gestures that accompany speech, play an important role in human
communication. Automatic co-speech gesture generation is thus a key enabling technology …

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

T Kucherenko*, P Wolfert*, Y Yoon*, C Viegas… - ACM Transactions on …, 2024 - dl.acm.org
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

To rate or not to rate: Investigating evaluation methods for generated co-speech gestures

P Wolfert, JM Girard, T Kucherenko… - Proceedings of the 2021 …, 2021 - dl.acm.org
While automatic performance metrics are crucial for machine learning of artificial human-like
behaviour, the gold standard for evaluation remains human judgement. The subjective …

Data-Driven Communicative Behaviour Generation: A Survey

N Oralbayeva, A Aly, A Sandygulova… - ACM Transactions on …, 2024 - dl.acm.org
The development of data-driven behaviour generating systems has recently become the
focus of considerable attention in the fields of human–agent interaction and human–robot …

Modeling and evaluating beat gestures for social robots

U Zabala, I Rodriguez, JM Martínez-Otzeta… - Multimedia Tools and …, 2022 - Springer
Natural gestures are a desirable feature for a humanoid robot, as they are presumed to elicit
a more comfortable interaction in people. With this aim in mind, we present in this paper a …

Quantitative analysis of robot gesticulation behavior

U Zabala, I Rodriguez, JM Martínez-Otzeta, I Irigoien… - Autonomous …, 2021 - Springer
Social robot capabilities, such as talking gestures, are best produced using data driven
approaches to avoid being repetitive and to show trustworthiness. However, there is a lack …

The GENEA Challenge 2020: Benchmarking gesture-generation systems on common data

T Kucherenko, P Jonell, Y Yoon, P Wolfert, GE Henter - 2020 - diva-portal.org
Automatic gesture generation is a field of growing interest, and a key technology for
enabling embodied conversational agents. Research into gesture generation is rapidly …

Motion and meaning: data-driven analyses of the relationship between gesture and communicative semantics

C Saund, H Matuszak, A Weinstein… - Proceedings of the 10th …, 2022 - dl.acm.org
Gestures convey critical information within social interactions. As such, the success of virtual
agents (VA) in both building social relationships and achieving their goals is heavily …

Generating robotic emotional body language of targeted valence and arousal with conditional variational autoencoders

M Marmpena, F Garcia, A Lim - Companion of the 2020 ACM/IEEE …, 2020 - dl.acm.org
Non-verbal communication that encompasses emotional body language is a crucial aspect
of social robotics applications. Deep learning models for the generation of robotic …