Highly Automated Air Traffic Controller Workstations with Artificial Intelligence Integration

Deliverables

This report is the updated version of D12 which is already created during the first three months of the project

The task Tool supporting transcription of pilot and controller utterances includes i an update of the manual transcriptionannotation tool named CoCoLoToCoCo ii integration of an automatic transcription Idiap and iii command extraction BUT into CoCoLoToCoCo and iv execution of CoCoLoToCoCo to semiautomatically transcribe NATS Isavia and annotate DLR an initial set of controller and pilot utterances for UK and Iceland airspace The usage of CoCoLoToCoCo by other partners requires an update of handbook

Updated Operational Concept Document

This document is the updated version of D11 which is already created in first two months of the project

Final Project Results Report

The objective of the project reviewand closeout meeting is to assess the readiness of the project results for the next stage of the RI lifecycle ie if the project claims having achieved the maturity TRL 2 for moving to the next RI phase an Applied Oriented Research Review will be organized by the SJU for assessing the readiness of the project results for the Industrial Research HAAWAII will deliver an RI proposal as part of the Final Project Results Report as an input to the Review details can be found in the ER Project management Guidance document and will be provided by SJU during kickoff meetingTo conclude This report is the input for project review and closeout meeting

Results of Dissemination, Communication and Exploitation

One of the first tasks of WP6 is to release the first version of D64 the Communication Dissemination and Exploitation Plan This plan is maintained during the lifetime of HAAWAII project This report however contains the final version of D64 ie it contains the results of the Dissemination Communication and Exploitation tasks with special emphasis on the results of the demo days and the stakeholder workshops

Four hours of silence reduced annotated controller and pilot utterance for Iceland

The deliverable consists of four hours of annotated and transcribed data of the Iceland airspace which is needed for model training and for evaluation of the building blocks the softwareThe data of the deliverable are of course confidential due to data privacy issuesThe deliverable consists also of a short report approx 5 pages which just contains a description of the data in table form Therefore the type is set to R and we set the deliverable to public

Dissemination, Communication and Exploitation Plan

One of the first tasks of WP6 is to release the first version of D64 the Communication Dissemination and Exploitation Plan This plan is maintained during the lifetime of HAAWAII project The task includes the identification of targeted stakeholders competing Solutions and the HAAWAII advantage customer segments etc

Report on Stakeholder Workshop Results

Two Stakeholder Workshops are planned The first one after T012 in Vienna and the second one in London The report describes the results An intermediate version of the report is created already one months after the first workshop

Four hours of silence reduced annotated controller and pilot utterance for UK

The deliverable consists of four hours of annotated and transcribed data of the London airspace which is needed for model training and for evaluation of the building blocks the softwareThe data of the deliverable are of course confidential due to data privacy issuesThe deliverable consists also of a short report approx 5 pages which just contains a description of the data in table form Therefore the type is set to R and we set the deliverable to public

Operational Concept Document

The document describes the operation concept for the different applications of ABSR including the use cases

Publications

How to Measure Speech Recognition Performance in the Air Traffic Control Domain? The Word Error Rate is only half of the truth

Author(s): Helmke, Hartmut; Shetty, Shruthi; Kleinert, Matthias; Ohneiser, Oliver; Prasad, Amrutha; Motlice, Petr; Cerna, Aneta; Windisch, Christian
Published in: Issue 2, 2021
Publisher: SESAR Innovation Days

Machine Learning of Air Traffic Controller Command Extraction Models for Speech Recognition Applications

Author(s): Hartmut Helmke, Matthias Kleinert, Oliver Ohneiser, Heiko Ehr, Shruthi Shetty
Published in: 2020 AIAA/IEEE 39th Digital Avionics Systems Conference (DASC), 2020, Page(s) 1-9, ISBN 978-1-7281-9825-5
Publisher: IEEE
DOI: 10.1109/dasc50938.2020.9256484

Readback Error Detection by Automatic Speech Recognition to Increase ATM Safety

Author(s): Helmke, Hartmut; Kleinert, Matthias; Shetty, Shruthi; Ohneiser, Oliver; Ehr, Heiko; Arilíusson, Hörður; Simiganoschi, Teodor S.; Prasad, Amrutha; Motlicek, Petr; Veselý, Karel; Ondřej, Karel; Smrz, Pavel; Harfmann, Julia; Windisch, Christian
Published in: Issue 1, 2021, Page(s) 10
Publisher: FAA Eurocontrol ATM Seminar

Measuring Speech Recognition And Understanding Performance in Air Traffic Control Domain Beyond Word Error Rates

Author(s): Helmke, Hartmut; Shetty, Shruthi; Kleinert, Matthias; Ohneiser, Oliver; Prasad, Amrutha; Motlicek, Petr; Cerna, Aneta; Windisch, Christian
Published in: Issue 2, 2021
Publisher: SESAR Innovation Days

Early Callsign Highlighting using Automatic Speech Recognition to Reduce Air Traffic Controller Workload

Author(s): Shetty, Shruthi; Helmke, Hartmut; Kleinert, Matthias; Ohneiser, Oliver
Published in: Crossref, Issue 2, 2022
Publisher: AHFE conference
DOI: 10.54941/ahfe1002493

Automated Interpretation of Air Traffic Control Communication: The Journey from Spoken Words to a Deeper Understanding of the Meaning

Author(s): Matthias Kleinert; Hartmut Helmke; Shruthi Shetty; Oliver Ohneiser; Heiko Ehr; Amrutha Prasad; Petr Motlicek; Julia Harfmann
Published in: Issue 2, 2021
Publisher: DASC
DOI: 10.1109/dasc52595.2021.9594387

Deliverables

Publications

Share this page

Download