Periodic Reporting for period 2 - SAFEMODE (Strengthening synergies between Aviation and maritime in the area of human Factors towards achieving more Efficient and resilient MODE of transportation)
Periodo di rendicontazione: 2020-12-01 al 2022-11-30
The main aim of SAFEMODE project is to develop a novel Human Risk Informed Design (HURID) framework in order to identify, collect and assess Human Factors data. Such data will inform risk-based design of systems and operation related to the aviation and maritime sectors.
SAFEMODE is the largest EU cooperation initiative between aviation and maritime on the critical topic of Human Factors Risks.
SAFEMODE has a worldwide reach, by involving partners from Russia, China, Indonesia, Philippines. Dedicated dissemination and training events were organised in Manila and Jakarta.
The major gaps addressed by SAFEMODE are:
- Safety data analyses only scratch the surface of Human Factors - whose nature resembles the well-known iceberg analogy - due to a lack a systematic approach to collect Human Factors information from safety events and assess the design implications.
- Confusing Human Factors landscape for non experts and industrial partners, with a multitude of concepts, methods, techniques, taxonomies, and no clear distinction between academic research and ready-to-apply results.
- Weak adoption of Human Factors best practices in the industry. The discipline is stronger in the academia than in the industry.
- Lack of a strong Safety Culture - HF oriented - in some of the aviation and maritime segments.
To overcome these gaps, the SAFEMODE consortium brings together the most renowned EU experts on Safety and Human Factors, addressing the following key question “How to capture data on human elements, and on their interaction with the other system elements, to enhance safety in maritime and aviation operations?”
SAFEMODE is the largest EU cooperation initiative between aviation and maritime on the critical topic of Human Factors Risks.
SAFEMODE has a worldwide reach, by involving partners from Russia, China, Indonesia, Philippines. Dedicated dissemination and training events were organised in Manila and Jakarta.
The major gaps addressed by SAFEMODE are:
- Safety data analyses only scratch the surface of Human Factors - whose nature resembles the well-known iceberg analogy - due to a lack a systematic approach to collect Human Factors information from safety events and assess the design implications.
- Confusing Human Factors landscape for non experts and industrial partners, with a multitude of concepts, methods, techniques, taxonomies, and no clear distinction between academic research and ready-to-apply results.
- Weak adoption of Human Factors best practices in the industry. The discipline is stronger in the academia than in the industry.
- Lack of a strong Safety Culture - HF oriented - in some of the aviation and maritime segments.
To overcome these gaps, the SAFEMODE consortium brings together the most renowned EU experts on Safety and Human Factors, addressing the following key question “How to capture data on human elements, and on their interaction with the other system elements, to enhance safety in maritime and aviation operations?”
The main results delivered in the project can be categorised under two main impact areas. First, the project aimed to improve the safety data collection and analysis, for instance by harmonising taxonomies and methods, selecting best-in-class standards to improve the analysis by «digging deeper». Second, best practices need to be disseminated and adopted in the community by various stakeholders, ranging from ship-plane manufacturers, operators of various size, service providers, regulators and national agencies. SAFEMODE applied user-centred principles to all of its activities, with frequent interactions and feedback from stakeholders, to define sustainable methods, proportionate to the potential level of risk, coherent with the organisational safety and Human Factors culture.
"Improving safety data collection and analysis" area
The main results are the following:
- A unified Taxonomy between aviation and maritime to analyse safety occurrences, as a means to improve Safety Learning. The SHIELD taxonomy has been tried and tested on hundreds of aviation and maritime incidents and accident reports, to ensure it is usable and helpful in understanding the event and all its contributory factors. Following this application, the initial version of SHIELD was simplified to strike the right balance: "as simple as possible, but not too simple".
- Design and development of the SHIELD Database to collect data and identify top risks. SHIELD is both a taxonomy and a database. The SHIELD database gives more power to the analysis, because it can go beyond single events, or even a company’s own fleet experience, to consider a broader range of safety events from which learning can be extracted. The SHIELD database allows designers to see what went right and what went wrong with similar or related designs.
- Test of advanced analytics to mine safety data and extract insights. SAFEMODE tested and compared the performance of various Natural Language Processing algorithms on SHIELD and on other freely available safety datasets, e.g. NASA ASRS. For each algorithm, we assessed its performance and limits of applicability, for instance the minimum number of occurrences needed for the algorithm to perform adequately.
- Development of the HF COMPASS tool, to guide users into picking the best HF method & technique. The Human Factors COMPASS addresses one of main challenges reported by stakeholders, i.e. being unsure about which Human Factors methods they should apply for their projects and in which order.
- Guidance for applying, building and quantifying Risk Models for aviation and maritime. Risk models determine which barriers and elements are vulnerable, primarily human actions with influences. This risk model is applicable to a wide range of situations and typically supports: i) Identifying high-risk areas, ii) identifying and assessing the impact of new design solutions, iii) supporting incident investigations.
"Spreading best practices" area
The main results are:
- Application of the HURID framework to 7 different Case Studies, involving different partner organisations, with different levels of HF expertise and experience. In particular, the Wake Vortex Alert Case Study was performed to provide a state-of-the-art example of how HF methods can steer and inform design decisions, from initial co-design workshop to human-in-the-loop simulations on the cockpit and ground side. An innovative Low Fidelity Simulation approach was tested for innovative concepts development. On the maritime side, Case Studies addressed research on Human Response to Emergencies with human-in-the-loop simulation of bridge operations, forward looking scenarios of remotely piloted unmanned ships, better integration of Human Factors into a shipping company Safety Management System.
- Two output papers were presented to the International Maritime Organisation, on the SHIELD-HF taxonomy and Safety Learning Culture. The first submission is entitled “Proposal for a new output to amend the Casualty Investigation Code to mandate a root cause investigation” and was rejected by Flag states. The second submission is entitled "Report on safety learning culture". The proposal was accepted and the main Safety Committee invited the Member states to submit papers based on the SAFEMODE outcome presented. This includes even new output proposals to start a new agenda item to take further action relating to the concept of a safety learning culture. Finally, the IMO Maritime Safety Division scheduled a SAFEMODE presentation at the IMO (5 June 2023, 12:45) on Safety Learning Culture during the next MSC 107.
- Authoritative online resources like SEAbrary - an electronic repository of maritime safety knowledge related to maritime operations, management, and design with a focus on Human Factors (HF) - and SafeFlix - video introductions and/or tutorials about selected Human Factors methods.
- Training and workshops were delivered in EU and international (Philippines, Indonesia) countries, reaching approx. 500 participants.
"Improving safety data collection and analysis" area
The main results are the following:
- A unified Taxonomy between aviation and maritime to analyse safety occurrences, as a means to improve Safety Learning. The SHIELD taxonomy has been tried and tested on hundreds of aviation and maritime incidents and accident reports, to ensure it is usable and helpful in understanding the event and all its contributory factors. Following this application, the initial version of SHIELD was simplified to strike the right balance: "as simple as possible, but not too simple".
- Design and development of the SHIELD Database to collect data and identify top risks. SHIELD is both a taxonomy and a database. The SHIELD database gives more power to the analysis, because it can go beyond single events, or even a company’s own fleet experience, to consider a broader range of safety events from which learning can be extracted. The SHIELD database allows designers to see what went right and what went wrong with similar or related designs.
- Test of advanced analytics to mine safety data and extract insights. SAFEMODE tested and compared the performance of various Natural Language Processing algorithms on SHIELD and on other freely available safety datasets, e.g. NASA ASRS. For each algorithm, we assessed its performance and limits of applicability, for instance the minimum number of occurrences needed for the algorithm to perform adequately.
- Development of the HF COMPASS tool, to guide users into picking the best HF method & technique. The Human Factors COMPASS addresses one of main challenges reported by stakeholders, i.e. being unsure about which Human Factors methods they should apply for their projects and in which order.
- Guidance for applying, building and quantifying Risk Models for aviation and maritime. Risk models determine which barriers and elements are vulnerable, primarily human actions with influences. This risk model is applicable to a wide range of situations and typically supports: i) Identifying high-risk areas, ii) identifying and assessing the impact of new design solutions, iii) supporting incident investigations.
"Spreading best practices" area
The main results are:
- Application of the HURID framework to 7 different Case Studies, involving different partner organisations, with different levels of HF expertise and experience. In particular, the Wake Vortex Alert Case Study was performed to provide a state-of-the-art example of how HF methods can steer and inform design decisions, from initial co-design workshop to human-in-the-loop simulations on the cockpit and ground side. An innovative Low Fidelity Simulation approach was tested for innovative concepts development. On the maritime side, Case Studies addressed research on Human Response to Emergencies with human-in-the-loop simulation of bridge operations, forward looking scenarios of remotely piloted unmanned ships, better integration of Human Factors into a shipping company Safety Management System.
- Two output papers were presented to the International Maritime Organisation, on the SHIELD-HF taxonomy and Safety Learning Culture. The first submission is entitled “Proposal for a new output to amend the Casualty Investigation Code to mandate a root cause investigation” and was rejected by Flag states. The second submission is entitled "Report on safety learning culture". The proposal was accepted and the main Safety Committee invited the Member states to submit papers based on the SAFEMODE outcome presented. This includes even new output proposals to start a new agenda item to take further action relating to the concept of a safety learning culture. Finally, the IMO Maritime Safety Division scheduled a SAFEMODE presentation at the IMO (5 June 2023, 12:45) on Safety Learning Culture during the next MSC 107.
- Authoritative online resources like SEAbrary - an electronic repository of maritime safety knowledge related to maritime operations, management, and design with a focus on Human Factors (HF) - and SafeFlix - video introductions and/or tutorials about selected Human Factors methods.
- Training and workshops were delivered in EU and international (Philippines, Indonesia) countries, reaching approx. 500 participants.
SAFEMODE advancement beyond the state of the art can be summarised as below:
- User-driven definition and validation of the HURID framework, including the following building blocks: SHIELD Open Repository, Human Factors Compass, Human Factors Assurance Toolkit, Risk Models.
- Test of Advanced Analytics.
- Quantification of Human Contribution to Risk Models.
In particular, the SAFEMODE legacy is "embodied" into HURID web-based platform, containing:
- Human Factors Compass
- Human Factors Assurance Toolkit
- SHIELD
- SafetyEye
- Human Performance Capability Profiles
- SafeFlix
- Training on Human Factors Fundamentals
- Seabrary
- Risk Models
The HURID platform will be maintained for at least 3 years after the end of the project.
- User-driven definition and validation of the HURID framework, including the following building blocks: SHIELD Open Repository, Human Factors Compass, Human Factors Assurance Toolkit, Risk Models.
- Test of Advanced Analytics.
- Quantification of Human Contribution to Risk Models.
In particular, the SAFEMODE legacy is "embodied" into HURID web-based platform, containing:
- Human Factors Compass
- Human Factors Assurance Toolkit
- SHIELD
- SafetyEye
- Human Performance Capability Profiles
- SafeFlix
- Training on Human Factors Fundamentals
- Seabrary
- Risk Models
The HURID platform will be maintained for at least 3 years after the end of the project.