In this work, an end‐to‐end framework is proposed to achieve multilingual automatic speech recognition (ASR) in air traffic control (ATC) systems. Considering the standard ATC procedure, a recurrent neural network (RNN) based framework is selected to mine the temporal dependencies among speech frames. Facing the distributed feature space caused by the radio transmission, a hybrid feature embedding block is designed to extract high‐level representations, in which multiple convolutional neural networks are designed to accommodate different frequency and temporal resolutions. The residual mechanism is performed on the RNN layers to improve the trainability and the convergence. To integrate the multilingual ASR into a single model and relieve the class imbalance, a special vocabulary is designed to unify the pronunciation of the vocabulary in Chinese and English, i.e., pronunciation‐oriented vocabulary. The proposed model is optimized by the connectionist temporal classification loss and is validated on a real‐world speech corpus (ATCSpeech). A character error rate of 4.4% and 5.9% is achieved for Chinese and English speech, respectively, which outperforms other popular approaches. Most importantly, the proposed approach achieves the multilingual ASR task in an end‐to‐end manner with considerable high performance.
Towards multilingual end‐to‐end speech recognition for air traffic control
IET Intelligent Transport Systems ; 15 , 9 ; 1203-1214
2021-09-01
12 pages
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Towards multilingual end‐to‐end speech recognition for air traffic control
DOAJ | 2021
|DSpace@MIT | 1987
|Automatic Speech Recognition in Air Traffic Control
NTIS | 1990
|Automatic speech recognition in air traffic control
NTRS | 1990
|Multilingual Speech Synthesis for Car Applications
British Library Conference Proceedings | 1999
|