Audio and Speech Processing

Authors and titles for recent submissions

• Mon, 11 Nov 2024
• Fri, 8 Nov 2024
• Thu, 7 Nov 2024
• Wed, 6 Nov 2024
• Tue, 5 Nov 2024

See today's new changes

Mon, 11 Nov 2024 (showing 6 of 6 entries )

[1] arXiv:2411.05774 [pdf, other]

Title: An ambient denoising method based on multi-channel non-negative matrix factorization for wheezing detection

Antonio J. Muñoz-Montoro, Pablo Revuelta-Sanz, Damian Martínez-Muñoz, Juan Torre-Cruz, José Ranilla

Journal-ref: The Journal of Supercomputing, Volume 79, pages 1571-1591, 2023

Subjects: Audio and Speech Processing (eess.AS); Emerging Technologies (cs.ET); Signal Processing (eess.SP)

[2] arXiv:2411.05141 [pdf, html, other]

Title: Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation

Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu, Andros Tjandra

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[3] arXiv:2411.05715 (cross-list from cs.SD) [pdf, html, other]

Title: On the Role of Noise in AudioVisual Integration: Evidence from Artificial Neural Networks that Exhibit the McGurk Effect

Lukas Grasse, Matthew S. Tata

Subjects: Sound (cs.SD); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[4] arXiv:2411.05679 (cross-list from cs.CV) [pdf, html, other]

Title: Tell What You Hear From What You See -- Video to Audio Generation Through Text

Xiulong Liu, Kun Su, Eli Shlizerman

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[5] arXiv:2411.05361 (cross-list from cs.CL) [pdf, html, other]

Title: Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks

Chien-yu Huang, Wei-Chih Chen, Shu-wen Yang, Andy T. Liu, Chen-An Li, Yu-Xiang Lin, Wei-Cheng Tseng, Anuj Diwan, Yi-Jen Shih, Jiatong Shi, William Chen, Xuanjun Chen, Chi-Yuan Hsiao, Puyuan Peng, Shih-Heng Wang, Chun-Yi Kuan, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Fabian Ritter-Gutierrez, Ming To Chuang, Kuan-Po Huang, Siddhant Arora, You-Kuan Lin, Eunjung Yeo, Kalvin Chang, Chung-Ming Chien, Kwanghee Choi, Cheng-Hsiu Hsieh, Yi-Cheng Lin, Chee-En Yu, I-Hsiang Chiu, Heitor R. Guimarães, Jionghao Han, Tzu-Quan Lin, Tzu-Yuan Lin, Homu Chang, Ting-Wu Chang, Chun Wei Chen, Shou-Jen Chen, Yu-Hua Chen, Hsi-Chun Cheng, Kunal Dhawan, Jia-Lin Fang, Shi-Xin Fang, Kuan-Yu Fang Chiang, Chi An Fu, Hsien-Fu Hsiao, Ching Yu Hsu, Shao-Syuan Huang, Lee Chen Wei, Hsi-Che Lin, Hsuan-Hao Lin, Hsuan-Ting Lin, Jian-Ren Lin, Ting-Chun Liu, Li-Chun Lu, Tsung-Min Pai, Ankita Pasad, Shih-Yun Shan Kuan, Suwon Shon, Yuxun Tang, Yun-Shao Tsai, Jui-Chiang Wei, Tzu-Chieh Wei, Chengxi Wu, Dien-Ruei Wu, Chao-Han Huck Yang, Chieh-Chi Yang, Jia Qi Yip, Shao-Xiang Yuan, Vahid Noroozi, Zhehuai Chen, Haibin Wu, Karen Livescu, David Harwath, Shinji Watanabe, Hung-yi Lee

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[6] arXiv:2410.20334 (cross-list from cs.CL) [pdf, html, other]

Title: Improving Speech-based Emotion Recognition with Contextual Utterance Analysis and LLMs

Enshi Zhang, Christian Poellabauer

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Fri, 8 Nov 2024 (showing 7 of 7 entries )

[7] arXiv:2411.04379 [pdf, html, other]

Title: A Pre-training Framework that Encodes Noise Information for Speech Quality Assessment

Subrina Sultana, Donald S. Williamson

Subjects: Audio and Speech Processing (eess.AS)

[8] arXiv:2411.04158 [pdf, html, other]

Title: Analyzing Multimodal Features of Spontaneous Voice Assistant Commands for Mild Cognitive Impairment Detection

Nana Lin, Youxiang Zhu, Xiaohui Liang, John A. Batsis, Caroline Summerour

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[9] arXiv:2411.04152 [pdf, other]

Title: A Contrastive Self-Supervised Learning scheme for beat tracking amenable to few-shot learning

Antonin Gagnere (LTCI, IDS, S2A), Geoffroy Peeters (LTCI, S2A, IDS), Slim Essid (IDS, S2A, LTCI)

Journal-ref: ISMIR 2024, Nov 2024, San Francisco, Californ, United States

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[10] arXiv:2411.04142 [pdf, html, other]

Title: Unified Pathological Speech Analysis with Prompt Tuning

Fei Yang, Xuenan Xu, Mengyue Wu, Kai Yu

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[11] arXiv:2411.04573 (cross-list from cs.CL) [pdf, html, other]

Title: Multistage Fine-tuning Strategies for Automatic Speech Recognition in Low-resource Languages

Leena G Pillai, Kavya Manohar, Basil K Raju, Elizabeth Sherly

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[12] arXiv:2411.04366 (cross-list from cs.SD) [pdf, html, other]

Title: The Concatenator: A Bayesian Approach To Real Time Concatenative Musaicing

Christopher Tralie, Ben Cantil

Comments: 12 pages, 6 figures, Accepted for Publication in The International Society for Music Information Retrieval Proceedings, 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[13] arXiv:2411.04337 (cross-list from cs.SD) [pdf, html, other]

Title: Model and Deep learning based Dynamic Range Compression Inversion

Haoran Sun, Dominique Fourer, Hichem Maaref

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

Thu, 7 Nov 2024 (showing 4 of 4 entries )

[14] arXiv:2411.03948 (cross-list from cs.SD) [pdf, html, other]

Title: Long-Form Text-to-Music Generation with Adaptive Prompts: A Case of Study in Tabletop Role-Playing Games Soundtracks

Felipe Marra, Lucas N. Ferreira

Comments: Paper accepted at the LAMIR 2024 workshop

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[15] arXiv:2411.03866 (cross-list from cs.CL) [pdf, html, other]

Title: Performance evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forward

Shashi Kumar, Iuliia Thorbecke, Sergio Burdisso, Esaú Villatoro-Tello, Manjunath K E, Kadri Hacioğlu, Pradeep Rangappa, Petr Motlicek, Aravind Ganapathiraju, Andreas Stolcke

Comments: Submitted to ICASSP 2025 SALMA Workshop

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[16] arXiv:2411.03715 (cross-list from cs.SD) [pdf, html, other]

Title: MOS-Bench: Benchmarking Generalization Abilities of Subjective Speech Quality Assessment Models

Wen-Chin Huang, Erica Cooper, Tomoki Toda

Comments: Submitted to Transactions on Audio, Speech and Language Processing. This work has been submitted to the IEEE for possible publication

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[17] arXiv:2411.03668 (cross-list from cs.SD) [pdf, html, other]

Title: Mobile Recording Device Recognition Based Cross-Scale and Multi-Level Representation Learning

Chunyan Zeng, Yuhao Zhao, Zhifeng Wang

Comments: 16 pages

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

Wed, 6 Nov 2024 (showing 7 of 7 entries )

[18] arXiv:2411.03172 [pdf, html, other]

Title: Blind Estimation of Sub-band Acoustic Parameters from Ambisonics Recordings using Spectro-Spatial Covariance Features

Hanyu Meng, Jeroen Breebaart, Jeremy Stoddard, Vidhyasaharan Sethu, Eliathamby Ambikairajah

Comments: Submitted to ICASSP2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[19] arXiv:2411.03168 [pdf, html, other]

Title: Reference Microphone Selection for the Weighted Prediction Error Algorithm using the Normalized L-p Norm

Anselm Lohmann, Toon van Waterschoot, Joerg Bitzer, Simon Doclo

Subjects: Audio and Speech Processing (eess.AS)

[20] arXiv:2411.03150 [pdf, html, other]

Title: Noise-Robust Hearing Aid Voice Control

Iván López-Espejo, Eros Roselló, Amin Edraki, Naomi Harte, Jesper Jensen

Comments: Submitted to IEEE Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS)

[21] arXiv:2411.03061 [pdf, other]

Title: Unsupervised detection and classification of heartbeats using the dissimilarity matrix in PCG signals

J. Torre-Cruz, D. Martinez-Munoz, N. Ruiz-Reyes, A.J. Munoz-Montoro, M. Puentes-Chiachio, F.J. Canadas-Quesada

Journal-ref: Computer Methods and Programs in Biomedicine, vol 221 (2022) 106909

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[22] arXiv:2411.03016 (cross-list from cs.SD) [pdf, other]

Title: Real-Time Scream Detection and Position Estimation for Worker Safety in Construction Sites

Bikalpa Gautam, Anmol Guragain, Sarthak Giri

Comments: 12 pages, 14 figures, 1 table, submitted to AIRISE conference

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[23] arXiv:2411.02625 (cross-list from cs.SD) [pdf, html, other]

Title: EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vector

Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim, Seong-Whan Lee

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[24] arXiv:2411.02402 (cross-list from cs.SD) [pdf, html, other]

Title: Optimal Transport Maps are Good Voice Converters

Arip Asadulaev, Rostislav Korst, Vitalii Shutov, Alexander Korotin, Yaroslav Grebnyak, Vahe Egiazarian, Evgeny Burnaev

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

Tue, 5 Nov 2024 (showing 16 of 16 entries )

[25] arXiv:2411.02165 [pdf, html, other]

Title: Joint Training of Speaker Embedding Extractor, Speech and Overlap Detection for Diarization

Petr Pálka, Federico Landini, Dominik Klement, Mireia Diez, Anna Silnova, Marc Delcroix, Lukáš Burget

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[26] arXiv:2411.02037 [pdf, html, other]

Title: Complete reconstruction of the tongue contour through acoustic to articulatory inversion using real-time MRI data

Sofiane Azzouz, Pierre-André Vuissoz, Yves Laprie

Subjects: Audio and Speech Processing (eess.AS)

[27] arXiv:2411.02019 [pdf, html, other]

Title: Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement

Longbiao Cheng, Ashutosh Pandey, Buye Xu, Tobi Delbruck, Vamsi Krishna Ithapu, Shih-Chii Liu

Comments: Submitted to ICASSP 2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[28] arXiv:2411.01174 [pdf, html, other]

Title: Leveraging LLM and Text-Queried Separation for Noise-Robust Sound Event Detection

Han Yin, Yang Xiao, Jisheng Bai, Rohan Kumar Das

Comments: Submitted to ICASSP 2025 Workshop

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[29] arXiv:2411.01018 [pdf, other]

Title: An incremental algorithm based on multichannel non-negative matrix partial co-factorization for ambient denoising in auscultation

Juan De La Torre Cruz, Francisco Jesus Canadas Quesada, Damian Martinez-Munoz, Nicolas Ruiz Reyes, Sebastian Garcia Galan, Julio Jose Carabias Orti

Journal-ref: Applied Acoustics, volume 182, November 2021, 108229

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[30] arXiv:2411.02236 (cross-list from cs.CV) [pdf, html, other]

Title: 3D Audio-Visual Segmentation

Artem Sokolov, Swapnil Bhosale, Xiatian Zhu

Comments: Accepted at the NeurIPS 2024 Workshop on Audio Imagination

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[31] arXiv:2411.02038 (cross-list from cs.LG) [pdf, html, other]

Title: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer

Yongxin Zhu, Bocheng Li, Yifei Xin, Linli Xu

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[32] arXiv:2411.02026 (cross-list from cs.SD) [pdf, html, other]

Title: CTEFM-VC: Zero-Shot Voice Conversion Based on Content-Aware Timbre Ensemble Modeling and Flow Matching

Yu Pan, Yuguang Yang, Jixun Yao, Jianhao Ye, Hongbin Zhou, Lei Ma, Jianjun Zhao

Comments: Work in progress; 5 pages;

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[33] arXiv:2411.01834 (cross-list from cs.CL) [pdf, html, other]

Title: Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback

Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[34] arXiv:2411.01805 (cross-list from cs.SD) [pdf, html, other]

Title: MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence

Fuming You, Minghui Fang, Li Tang, Rongjie Huang, Yongqi Wang, Zhou Zhao

Comments: NeurIPS 2024

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[35] arXiv:2411.01710 (cross-list from cs.CL) [pdf, html, other]

Title: SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation

Dennis Fucci, Marco Gaido, Beatrice Savoldi, Matteo Negri, Mauro Cettolo, Luisa Bentivogli

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[36] arXiv:2411.01661 (cross-list from cs.SD) [pdf, html, other]

Title: Sing-On-Your-Beat: Simple Text-Controllable Accompaniment Generations

Quoc-Huy Trinh, Minh-Van Nguyen, Trong-Hieu Nguyen Mau, Khoa Tran, Thanh Do

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[37] arXiv:2411.01156 (cross-list from cs.SD) [pdf, html, other]

Title: Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesis

Shijia Liao, Yuxuan Wang, Tianyu Li, Yifan Cheng, Ruoyi Zhang, Rongzhi Zhou, Yijin Xing

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[38] arXiv:2411.01135 (cross-list from cs.SD) [pdf, html, other]

Title: Music Foundation Model as Generic Booster for Music Downstream Tasks

WeiHsiang Liao, Yuhta Takida, Yukara Ikemiya, Zhi Zhong, Chieh-Hsin Lai, Giorgio Fabbro, Kazuki Shimada, Keisuke Toyama, Kinwai Cheuk, Marco A. Martínez-Ramírez, Shusuke Takahashi, Stefan Uhlich, Taketo Akama, Woosung Choi, Yuichiro Koyama, Yuki Mitsufuji

Comments: 41 pages with 14 figures

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[39] arXiv:2411.00980 (cross-list from cs.CL) [pdf, html, other]

Title: Enhancing AAC Software for Dysarthric Speakers in e-Health Settings: An Evaluation Using TORGO

Macarious Hui, Jinda Zhang, Aanchan Mohan

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[40] arXiv:2411.00813 (cross-list from cs.MM) [pdf, html, other]

Title: Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

Sixu An, Xiangguo Sun, Yicong Li, Yu Yang, Guandong Xu

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Audio and Speech Processing (eess.AS)