Skip to main navigation Skip to search Skip to main content

Electrolaryngeal speech enhancement based on a two stage framework with bottleneck feature refinement and voice conversion

  • Yaogen Yang
  • , Haozhe Zhang
  • , Zexin Cai
  • , Yao Shi
  • , Ming Li*
  • , Dong Zhang
  • , Xiaojun Ding*
  • , Jianhua Deng
  • , Jie Wang
  • *Corresponding author for this work
  • Duke Kunshan Univ
  • Sun Yat Sen Univ
  • First Peoples Hosp Kunshan

Research output: Contribution to journal › Article › peer-review

16 Scopus citations

Abstract

An electrolarynx (EL) is a medical device that generates speech for people who lost their biological larynx. However, EL speech signals are unnatural and unintelligible due to the monotonous pitch and the mechanical excitation of the EL device. This paper proposes an end-to-end voice conversion method to enhance EL speech. We adopt a speaker-independent automatic speech recognition model to extract bottleneck features as the intermediate phonetic features for enhancement. Our system includes two stages: the bottleneck feature vectors of the EL speech are mapped by a parallel non-autoregressive model to the corresponding feature vectors of the normal speech in stage one. Then another voice conversion model maps normal speech's bottleneck feature vectors directly to normal speech's Mel-spectrogram in stage two, followed by a MelGAN-based vocoder to convert the Mel-spectrogram into waveform. In addition, we incorporate data augmentation and transfer learning to improve conversion performance. Experimental results show that the proposed method outperforms our baseline methods and performs well in terms of naturalness and intelligibility. The audio samples are available online.(2)
Original languageEnglish
Article number104279
Number of pages9
JournalBiomedical Signal Processing and Control
Volume80
Early online dateOct 2022
DOIs
StatePublished - Feb 2023

Funding

This research is funded by the Kunshan Municipal Government Research Funding. Many thanks for the computational resource provided by the Advanced Computing East China Sub-Center.

Keywords

  • Electrolarynx speech
  • Voice conversion
  • Bottleneck features
  • Speech enhancement

Indexed by

  • Scopus
  • EI
  • SCIE

Fingerprint

Dive into the research topics of 'Electrolaryngeal speech enhancement based on a two stage framework with bottleneck feature refinement and voice conversion'. Together they form a unique fingerprint.

Cite this