Familiar words but strange voices: Modelling the influence of speech variability on word recognition

Alexandra Mayn, Badr M. Abdullah, Dietrich Klakow


Abstract
We present a deep neural model of spoken word recognition which is trained to retrieve the meaning of a word (in the form of a word embedding) given its spoken form, a task which resembles that faced by a human listener. Furthermore, we investigate the influence of variability in speech signals on the model’s performance. To this end, we conduct of set of controlled experiments using word-aligned read speech data in German. Our experiments show that (1) the model is more sensitive to dialectical variation than gender variation, and (2) recognition performance of word cognates from related languages reflect the degree of relatedness between languages in our study. Our work highlights the feasibility of modeling human speech perception using deep neural networks.
Anthology ID:
2021.eacl-srw.14
Volume:
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
April
Year:
2021
Address:
Online
Editors:
Ionut-Teodor Sorodoc, Madhumita Sushil, Ece Takmaz, Eneko Agirre
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
96–102
Language:
URL:
https://aclanthology.org/2021.eacl-srw.14
DOI:
10.18653/v1/2021.eacl-srw.14
Bibkey:
Cite (ACL):
Alexandra Mayn, Badr M. Abdullah, and Dietrich Klakow. 2021. Familiar words but strange voices: Modelling the influence of speech variability on word recognition. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 96–102, Online. Association for Computational Linguistics.
Cite (Informal):
Familiar words but strange voices: Modelling the influence of speech variability on word recognition (Mayn et al., EACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.eacl-srw.14.pdf