Audio and Speech Processing

Authors and titles for July 2023

[1] arXiv:2307.00024 [pdf, other]

Title: EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speech

Daria Diatlova, Vitaly Shutov

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[2] arXiv:2307.00169 [pdf, other]

Title: VoxWatch: An open-set speaker recognition benchmark on VoxCeleb

Raghuveer Peri, Seyed Omid Sadjadi, Daniel Garcia-Romero

Comments: 8 pages

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[3] arXiv:2307.00366 [pdf, other]

Title: Enhancing the EEG Speech Match Mismatch Tasks With Word Boundaries

Akshara Soman, Vidhi Sinha, Sriram Ganapathy

Comments: 5 pages, 4 figures, 4 tables, accepted to Interspeech2023 conference

Subjects: Audio and Speech Processing (eess.AS)

[4] arXiv:2307.00393 [pdf, other]

Title: Using joint training speaker encoder with consistency loss to achieve cross-lingual voice conversion and expressive voice conversion

Houjian Guo, Chaoran Liu, Carlos Toshinori Ishi, Hiroshi Ishiguro

Subjects: Audio and Speech Processing (eess.AS)

[5] arXiv:2307.01673 [pdf, html, other]

Title: Disentanglement in a GAN for Unconditional Speech Synthesis

Matthew Baas, Herman Kamper

Comments: 12 pages, 5 tables, 4 figures. Accepted to IEEE TASLP. arXiv admin note: substantial text overlap with arXiv:2210.05271

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[6] arXiv:2307.02051 [pdf, other]

Title: Flowchase: a Mobile Application for Pronunciation Training

Noé Tits, Zoé Broisson

Comments: Interspeech 2023 - SLaTE workshop 2023 (Speech and Language Technology in Education)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD)

[7] arXiv:2307.02083 [pdf, other]

Title: Leveraging multilingual transfer for unsupervised semantic acoustic word embeddings

Christiaan Jacobs, Herman Kamper

Comments: Submitted to IEEE SPL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[8] arXiv:2307.02110 [pdf, other]

Title: A Database with Directivities of Musical Instruments

David Ackermann, Fabian Brinkmann, Stefan Weinzierl

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[9] arXiv:2307.02135 [pdf, other]

Title: Differentially Private Adversarial Auto-Encoder to Protect Gender in Voice Biometrics

Oubaïda Chouchane, Michele Panariello, Oualid Zari, Ismet Kerenciler, Imen Chihaoui, Massimiliano Todisco, Melek Önen

Comments: 6 Pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS)

[10] arXiv:2307.02299 [pdf, other]

Title: Why can big.bi be changed to bi.gbi? A mathematical model of syllabification and articulatory synthesis

Frédéric Berthommier

Comments: 5 pages, 4 figures, submitted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[11] arXiv:2307.02351 [pdf, other]

Title: Online Hybrid CTC/Attention End-to-End Automatic Speech Recognition Architecture

Haoran Miao, Gaofeng Cheng, Pengyuan Zhang, Yonghong Yan

Journal-ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing, Volume 28, 2020, Pages 1452 - 1465

Subjects: Audio and Speech Processing (eess.AS)

[12] arXiv:2307.02471 [pdf, other]

Title: Deep Speech Synthesis from MRI-Based Articulatory Representations

Peter Wu, Tingle Li, Yijing Lu, Yubin Zhang, Jiachen Lian, Alan W Black, Louis Goldstein, Shinji Watanabe, Gopala K. Anumanchipalli

Subjects: Audio and Speech Processing (eess.AS)

[13] arXiv:2307.02514 [pdf, other]

Title: Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Data

Hongmin Cai, Xiaoke Huang, Zhengliang Liu, Wenxiong Liao, Haixing Dai, Zihao Wu, Dajiang Zhu, Hui Ren, Quanzheng Li, Tianming Liu, Xiang Li

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[14] arXiv:2307.02909 [pdf, other]

Title: Audio-visual End-to-end Multi-channel Speech Separation, Dereverberation and Recognition

Guinan Li, Jiajun Deng, Mengzhe Geng, Zengrui Jin, Tianzi Wang, Shujie Hu, Mingyu Cui, Helen Meng, Xunying Liu

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[15] arXiv:2307.03088 [pdf, other]

Title: Label-Synchronous Neural Transducer for End-to-End ASR

Keqi Deng, Philip C. Woodland

Subjects: Audio and Speech Processing (eess.AS)

[16] arXiv:2307.03168 [pdf, other]

Title: Recovering implicit pitch contours from formants in whispered speech

Pablo Pérez Zarazaga, Zofia Malisz

Comments: 5 pages, 3 figures, 2 tables, Accepted at ICPhS 2023

Subjects: Audio and Speech Processing (eess.AS)

[17] arXiv:2307.03296 [pdf, html, other]

Title: Gammatonegram Representation for End-to-End Dysarthric Speech Processing Tasks: Speech Recognition, Speaker Identification, and Intelligibility Assessment

Aref Farhadipour, Hadi Veisi

Comments: 12 pages, 8 figures. Iran J Comput Sci (2024)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[18] arXiv:2307.03917 [pdf, other]

Title: On decoder-only architecture for speech-to-text and large language model integration

Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[19] arXiv:2307.04179 [pdf, other]

Title: IANS: Intelligibility-aware Null-steering Beamforming for Dual-Microphone Arrays

Wen-Yuan Ting, Syu-Siang Wang, Yu Tsao, Borching Su

Comments: Preprint submitted to IEEE MLSP 2023

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[20] arXiv:2307.04292 [pdf, other]

Title: A Demand-Driven Perspective on Generative Audio AI

Sangshin Oh, Minsung Kang, Hyeongi Moon, Keunwoo Choi, Ben Sangbae Chon

Comments: 10 pages, 7 figures

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[21] arXiv:2307.04460 [pdf, other]

Title: Exploiting an External Microphone for Binaural RTF-Vector-Based Direction of Arrival Estimation for Multiple Speakers

Daniel Fejgin, Simon Doclo

Comments: Paper accepted for Forum Acusticum 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[22] arXiv:2307.04517 [pdf, other]

Title: Study on the Correlation between Objective Evaluations and Subjective Speech Quality and Intelligibility

Hsin-Tien Chiang, Kuo-Hsuan Hung, Szu-Wei Fu, Heng-Cheng Kuo, Ming-Hsueh Tsai, Yu Tsao

Subjects: Audio and Speech Processing (eess.AS)

[23] arXiv:2307.04586 [pdf, other]

Title: Timbre transfer using image-to-image denoising diffusion implicit models

Luca Comanducci, Fabio Antonacci, Augusto Sarti

Subjects: Audio and Speech Processing (eess.AS)

[24] arXiv:2307.04744 [pdf, other]

Title: Behavioral Analysis of Pathological Speaker Embeddings of Patients During Oncological Treatment of Oral Cancer

Jenthe Thienpondt, Caroline M. Speksnijder, Kris Demuynck

Comments: proceedings of INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS)

[25] arXiv:2307.04842 [pdf, other]

Title: Predicting Tuberculosis from Real-World Cough Audio Recordings and Metadata

George P. Kafentzis, Stephane Tetsing, Joe Brew, Lola Jover, Mindaugas Galvosas, Carlos Chaccour, Peter M. Small

Subjects: Audio and Speech Processing (eess.AS)

[26] arXiv:2307.05132 [pdf, other]

Title: On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesis

Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely

Comments: 7 pages, 2 figures. 12th ISCA Speech Synthesis Workshop (SSW) 2023

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)

[27] arXiv:2307.05533 [pdf, other]

Title: Anti-noise window: Subjective perception of active noise reduction and effect of informational masking

Bhan Lam, Kelvin Chee Quan Lim, Kenneth Ooi, Zhen-Ting Ong, Dongyuan Shi, Woon-Seng Gan

Comments: Accepted manuscript submitted to Sustainable Cities and Society

Journal-ref: Sustain. Cities Soc., 104763, 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[28] arXiv:2307.05637 [pdf, other]

Title: Speech Diarization and ASR with GMM

Aayush Kumar Sharma, Vineet Bhavikatti, Amogh Nidawani, Siddappaji, Sanath P, Dr Geetishree Mishra

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[29] arXiv:2307.05641 [pdf, html, other]

Title: Point to the Hidden: Exposing Speech Audio Splicing via Signal Pointer Nets

Denise Moussa, Germans Hirsch, Sebastian Wankerl, Christian Riess

Comments: published at Interspeech 2023 - Code: this https URL

Journal-ref: Proc. INTERSPEECH 2023, 5057-5061 (2023)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[30] arXiv:2307.06040 [pdf, other]

Title: Rhythm Modeling for Voice Conversion

Benjamin van Niekerk, Marc-André Carbonneau, Herman Kamper

Comments: 5 pages, 4 figures, 4 tables, submitted to IEEE Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[31] arXiv:2307.06292 [pdf, other]

Title: Global birdsong embeddings enable superior transfer learning for bioacoustic classification

Burooj Ghani, Tom Denton, Stefan Kahl, Holger Klinck

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[32] arXiv:2307.06610 [pdf, other]

Title: LACE: A light-weight, causal model for enhancing coded speech through adaptive convolutions

Jan Büthe, Jean-Marc Valin, Ahmed Mustafa

Comments: 5 pages, accepted at WASPAA 2023

Subjects: Audio and Speech Processing (eess.AS)

[33] arXiv:2307.06656 [pdf, other]

Title: An Improved Metric of Informational Masking for Perceptual Audio Quality Measurement

Pablo M. Delgado, Jürgen Herre

Comments: Accepted Publication for WASPAA 2023 - IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Mohonk Mountain House, New Paltz, NY, USA, Oct 22-25, 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[34] arXiv:2307.06832 [pdf, other]

Title: Personalization for BERT-based Discriminative Speech Recognition Rescoring

Jari Kolehmainen, Yile Gu, Aditya Gourav, Prashanth Gurunath Shivakumar, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[35] arXiv:2307.07062 [pdf, other]

Title: Controllable Emphasis with zero data for text-to-speech

Arnaud Joly, Marco Nicolis, Ekaterina Peterova, Alessandro Lombardi, Ammar Abbas, Arent van Korlaar, Aman Hussain, Parul Sharma, Alexis Moinet, Mateusz Lajszczak, Penny Karanasou, Antonio Bonafonte, Thomas Drugman, Elena Sokolova

Comments: In proceeding of 12th Speech Synthesis Workshop (SSW) 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[36] arXiv:2307.07096 [pdf, other]

Title: Low Rank Properties for Estimating Microphones Start Time and Sources Emission Time

Faxian Cao, Yongqiang Cheng, Adil Mehmood Khan, Zhijing Yang, S. M. Ahsan Kazmiand Yingxiu Chang

Comments: 13 pages for main content; 9 pages for proof of proposed low rank properties; 13 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[37] arXiv:2307.07200 [pdf, html, other]

Title: Reproducing the Acoustic Velocity Vectors in a Spherical Listening Region

Jiarui Wang, Thushara Abhayapala, Jihui Aimee Zhang, Prasanga Samarasinghe

Comments: Accepted for publication in IEEE Signal Processing Letters

Journal-ref: IEEE Signal Processing Letters, vol. 31, pp. 2220-2224, 2024.

Subjects: Audio and Speech Processing (eess.AS)

[38] arXiv:2307.07218 [pdf, html, other]

Title: Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis

Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Zhenhui Ye, Shengpeng Ji, Qian Yang, Chen Zhang, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao

Comments: Accepted by ICLR 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[39] arXiv:2307.07325 [pdf, other]

Title: Representation Learning With Hidden Unit Clustering For Low Resource Speech Applications

Varun Krishna, Tarun Sai, Sriram Ganapathy

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[40] arXiv:2307.07748 [pdf, other]

Title: Audio-Visual Speech Enhancement Using Self-supervised Learning to Improve Speech Intelligibility in Cochlear Implant Simulations

Richard Lee Lai, Jen-Cheng Hou, Mandar Gogate, Kia Dashtipour, Amir Hussain, Yu Tsao

Subjects: Audio and Speech Processing (eess.AS)

[41] arXiv:2307.07948 [pdf, other]

Title: Model Adaptation for ASR in low-resource Indian Languages

Abhayjeet Singh, Arjun Singh Mehta, Ashish Khuraishi K S, Deekshitha G, Gauri Date, Jai Nanavati, Jesuraja Bandekar, Karnalius Basumatary, Karthika P, Sandhya Badiger, Sathvik Udupa, Saurabh Kumar, Savitha, Prasanta Kumar Ghosh, Prashanthi V, Priyanka Pai, Raoul Nanavati, Rohan Saxena, Sai Praneeth Reddy Mora, Srinivasa Raghavan

Comments: ASRU Special session overview paper

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[42] arXiv:2307.08029 [pdf, html, other]

Title: Noise-aware Speech Enhancement using Diffusion Probabilistic Model

Yuchen Hu, Chen Chen, Ruizhe Li, Qiushi Zhu, Eng Siong Chng

Comments: 5 pages, 2 figures, Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[43] arXiv:2307.08205 [pdf, other]

Title: Exploring Binary Classification Loss For Speaker Verification

Bing Han, Zhengyang Chen, Yanmin Qian

Comments: Accepted by ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[44] arXiv:2307.08234 [pdf, other]

Title: Adapting Large Language Model with Speech for Fully Formatted End-to-End Speech Recognition

Shaoshi Ling, Yuxuan Hu, Shuangbei Qian, Guoli Ye, Yao Qian, Yifan Gong, Ed Lin, Michael Zeng

Subjects: Audio and Speech Processing (eess.AS)

[45] arXiv:2307.08239 [pdf, other]

Title: Dynamic Kernel Convolution Network with Scene-dedicate Training for Sound Event Localization and Detection

Siwei Huang, Jianfeng Chen, Jisheng Bai, Yafei Jia, Dongzhe Zhang

Comments: 11 pages, 6 figures

Subjects: Audio and Speech Processing (eess.AS)

[46] arXiv:2307.08403 [pdf, other]

Title: Vocoder drift compensation by x-vector alignment in speaker anonymisation

Michele Panariello, Massimiliano Todisco, Nicholas Evans

Comments: Accepted at the ISCA SPSC Symposium 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[47] arXiv:2307.08688 [pdf, other]

Title: Semi-supervised multi-channel speaker diarization with cross-channel attention

Shilong Wu, Jun Du, Maokui He, Shutong Niu, Hang Chen, Haitao Tang, Chin-Hui Lee

Comments: 8 pages,3 figures

Subjects: Audio and Speech Processing (eess.AS)

[48] arXiv:2307.08720 [pdf, other]

Title: ivrit.ai: A Comprehensive Dataset of Hebrew Speech for AI Research and Development

Yanir Marmor, Kinneret Misgav, Yair Lifshitz

Comments: 9 pages, 1 table and 3 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[49] arXiv:2307.08858 [pdf, other]

Title: Low bit rate binaural link for improved ultra low-latency low-complexity multichannel speech enhancement in Hearing Aids

Nils L. Westhausen, Bernd T. Meyer

Comments: Accepted at WASPAA 2023

Subjects: Audio and Speech Processing (eess.AS)

[50] arXiv:2307.09352 [pdf, other]

Title: Efficient representation of head-related transfer functions in continuous space-frequency domains

Adam Szwajcowski

Comments: 33 pages, 9 figures, preprint of published paper submitted for green open access to fulfill funding institution mandate

Journal-ref: Journal of Sound and Vibration, vol. 563, paper no. 117850, 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)