Version 1
: Received: 30 September 2024 / Approved: 2 October 2024 / Online: 3 October 2024 (03:51:59 CEST)
How to cite:
Hu, H.-T.; Lee, T.-T. Options for Performing DNN-Based Causal Speech Denoising Using the U-Net Architecture. Preprints2024, 2024100143. https://doi.org/10.20944/preprints202410.0143.v1
Hu, H.-T.; Lee, T.-T. Options for Performing DNN-Based Causal Speech Denoising Using the U-Net Architecture. Preprints 2024, 2024100143. https://doi.org/10.20944/preprints202410.0143.v1
Hu, H.-T.; Lee, T.-T. Options for Performing DNN-Based Causal Speech Denoising Using the U-Net Architecture. Preprints2024, 2024100143. https://doi.org/10.20944/preprints202410.0143.v1
APA Style
Hu, H. T., & Lee, T. T. (2024). Options for Performing DNN-Based Causal Speech Denoising Using the U-Net Architecture. Preprints. https://doi.org/10.20944/preprints202410.0143.v1
Chicago/Turabian Style
Hu, H. and Tung-Tsun Lee. 2024 "Options for Performing DNN-Based Causal Speech Denoising Using the U-Net Architecture" Preprints. https://doi.org/10.20944/preprints202410.0143.v1
Abstract
Speech enhancement technology seeks to improve the quality and intelligibility of speech signals degraded by noise, particularly in telephone communications. Recent advancements have focused on leveraging deep neural networks (DNN), especially U-Net architectures, for effective denoising. In this study, we evaluate the performance of a 6-level skip-connected U-Net constructed using either conventional convolution activation blocks (CCAB) or innovative global local former blocks (GLFB) across different processing domains: temporal waveform, short-time Fourier transform (STFT), and short-time discrete cosine transform (STDCT). Our results indicate that the U-Nets can receive better signal-to-noise ratio (SNR) and perceptual evaluation of speech quality (PESQ) when applied in the STFT and STDCT domains, with comparable short-time objective intelligibility (STOI) scores across all domains. Notably, the GLFB-based U-Net outperforms its CCAB counterpart in metrics such as CSIG, CBAK, COVL, and PESQ, while maintaining fewer learnable parameters. Furthermore, we propose domain-specific composite loss functions, considering the acoustic and perceptual characteristics of the spectral domain, to enhance the perceptual quality of denoised speech. Our findings provide valuable insights that can guide the optimization of DNN designs for causal speech denoising.
Computer Science and Mathematics, Signal Processing
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
