In this work, an end‐to‐end framework is proposed to achieve multilingual automatic speech recognition (ASR) in air traffic control (ATC) systems. Considering the standard ATC procedure, a recurrent neural network (RNN) based framework is selected to mine the temporal dependencies among speech frames. Facing the distributed feature space caused by the radio transmission, a hybrid feature embedding block is designed to extract high‐level representations, in which multiple convolutional neural networks are designed to accommodate different frequency and temporal resolutions. The residual mechanism is performed on the RNN layers to improve the trainability and the convergence. To integrate the multilingual ASR into a single model and relieve the class imbalance, a special vocabulary is designed to unify the pronunciation of the vocabulary in Chinese and English, i.e., pronunciation‐oriented vocabulary. The proposed model is optimized by the connectionist temporal classification loss and is validated on a real‐world speech corpus (ATCSpeech). A character error rate of 4.4% and 5.9% is achieved for Chinese and English speech, respectively, which outperforms other popular approaches. Most importantly, the proposed approach achieves the multilingual ASR task in an end‐to‐end manner with considerable high performance.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Towards multilingual end‐to‐end speech recognition for air traffic control


    Beteiligte:
    Lin, Yi (Autor:in) / Yang, Bo (Autor:in) / Guo, Dongyue (Autor:in) / Fan, Peng (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2021-09-01


    Format / Umfang :

    12 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Towards multilingual end‐to‐end speech recognition for air traffic control

    Yi Lin / Bo Yang / Dongyue Guo et al. | DOAJ | 2021

    Freier Zugriff




    Multilingual speech synthesis for car applications

    Hoffmann, R. / Kordon, U. / Holland, H.J. et al. | Tema Archiv | 1999