Skip to main content

Adaptation of Assistant Based Speech Recognition to New Domains and Its Acceptance by Air Traffic Controllers

  • Conference paper
  • First Online:
Intelligent Human Systems Integration 2019 (IHSI 2019)

Abstract

In air traffic control rooms, paper flight strips are more and more replaced by digital solutions. The digital systems, however, increase the workload for air traffic controllers: For instance, each voice-command must be manually inserted into the system by the controller. Recently the AcListant® project has validated that Assistant Based Speech Recognition (ABSR) can replace the manual inputs by automatically recognized voice commands. Adaptation of ABSR to different environments, however, has shown to be expensive. The Horizon 2020 funded project MALORCA (MAchine Learning Of Speech Recognition Models for Controller Assistance), proposed a more effective adaptation solution integrating a machine learning framework. As a first showcase, ABSR was automatically adapted with radar data and voice recordings for Prague and Vienna. The system reaches command recognition error rates of 0.6% (Prague) resp. 3.2% (Vienna). This paper describes the feedback trials with controllers from Vienna and Prague.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. The project AcListant® (Active Listening Assistant) http://www.aclistant.de

  2. Helmke, H., Ohneiser, O., Mühlhausen, T., Wies, M.: Reducing controller workload with automatic speech recognition. In: IEEE/AIAA 35th Digital Avionics Systems Conference (DASC). Sacramento, California (2016)

    Google Scholar 

  3. Helmke, H., Ohneiser, O., Buxbaum, J., Kern, C.: Increasing ATM efficiency with assistant-based speech recognition. In: 12th USA/Europe Air Traffic Management Research and Development Seminar (ATM2017). Seattle, Washington (2017)

    Google Scholar 

  4. Kleinert, M., Helmke, H., Siol, G., Ehr, H., Cerna, A., Kern, C., Klakow, D., Motlicek, P. et al.: Semi-supervised Adaptation of Assistant Based Speech Recognition Models for different Approach Areas. In: IEEE/AIAA 37th Digital Avionics Systems Conference (DASC). London, England (2018)

    Google Scholar 

  5. Kleinert, M., Helmke, H., Ehr. H., Kern, C., Klakow, D., Motlicek, P., Singh, M., Siol, G.: Building Blocks of Assistant Based Speech Recognition for Air Traffic Management Applications. In: 8th SESAR Innovation Days, Salzburg, 2018, to be published

    Google Scholar 

  6. Nguyen, V.N., Holone, H.: Possibilities, challenges and the state of the art of automatic speech recognition in Air Traffic Control. Int. J. Comput. Inf. Eng. 9(8), 1940–1949 (2015)

    Google Scholar 

  7. Chen, S., Kopald, H.D., Chong, R., Wei, Y., Levonian, Z: Read back error detection using automatic speech recognition. In: 12th USA/ Europe Air Traffic Management Research and Development Seminar (ATM2017), Seattle, WA, USA (2017)

    Google Scholar 

  8. AIRBUS Air Traffic Control Challenge Workshop: https://www.irit.fr/recherches/SAMOVA/pagechallenge-airbus-atc-workshop.html (2018)

  9. Shore, T., Faubel, F., Helmke, H., Klakow, D.: Knowledge-based word lattice rescoring in a dynamic context. In: Interspeech 2012, Sep. 2012, Portland, Oregon (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthias Kleinert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kleinert, M. et al. (2019). Adaptation of Assistant Based Speech Recognition to New Domains and Its Acceptance by Air Traffic Controllers. In: Karwowski, W., Ahram, T. (eds) Intelligent Human Systems Integration 2019. IHSI 2019. Advances in Intelligent Systems and Computing, vol 903. Springer, Cham. https://doi.org/10.1007/978-3-030-11051-2_125

Download citation

Publish with us

Policies and ethics