Periodic Reporting for period 2 - MED1stMR (Medical First Responder Training using a Mixed Reality Approach featuring haptic feedback for enhanced realism)
Periodo di rendicontazione: 2022-12-01 al 2024-05-31
The MED1stMR project brought together a consortium of science, technology and end-user partners to transform current training methods for medical first responders (MFRs) to better prepare them for the increasing number of highly complex and unpredictable crisis situations, such as Mass Casualty Incidents (MCI). In such situations, MFRs need to perform triage, basic life support and other first aid procedures rapidly and under high stress. In the MED1stMR project, virtual reality (VR) was extended to so-called mixed reality (MR) since in medical training haptical input is crucial, people need to be examined, biosignals need to be measured and analysed.
Currently, training for MCIs is rare and very cost intensive. The implementation of MR in the training of MCI scenarios overcomes the limitations of traditional training methods and represents a suitable supplement to cost-intensive real-life training. By providing a more realistic and personalised training experience, MR-based training can prepare MFRs better for real-life incidents, potentially leading to more efficient and effective response actions and ultimately improving the success of operations.
The main technological objectives of the project were to develop a MR system that enables innovative training with haptic enhancements for MFRs (objective 1) and innovative wearable technology to support MFRs in their training assessment and to establish a biosignals feedback loop for intelligent scenario control to enhance the effectiveness of MR training (objective 3). This was complemented by the development of effective training scenarios and curricula through agile and user-centred design with intensive collaboration with medical first responders (objective 2). Finally, dissemination and communication of project results, training concepts and showcases of MED1stMR training as a pioneering approach has contributed to positioning the pioneering MR training approach across Europe (objective 4).
Currently, training for MCIs is rare and very cost intensive. The implementation of MR in the training of MCI scenarios overcomes the limitations of traditional training methods and represents a suitable supplement to cost-intensive real-life training. By providing a more realistic and personalised training experience, MR-based training can prepare MFRs better for real-life incidents, potentially leading to more efficient and effective response actions and ultimately improving the success of operations.
The main technological objectives of the project were to develop a MR system that enables innovative training with haptic enhancements for MFRs (objective 1) and innovative wearable technology to support MFRs in their training assessment and to establish a biosignals feedback loop for intelligent scenario control to enhance the effectiveness of MR training (objective 3). This was complemented by the development of effective training scenarios and curricula through agile and user-centred design with intensive collaboration with medical first responders (objective 2). Finally, dissemination and communication of project results, training concepts and showcases of MED1stMR training as a pioneering approach has contributed to positioning the pioneering MR training approach across Europe (objective 4).
The focus was on developing innovative training approaches by integrating MR technology and creating a conceptual framework for effective performance in medical emergencies (EPME). The EPME model, validated through several studies, formed the basis for including psychological, physiological, and behavioural measures in the MED1stMR training solution developed.
In intensive cooperation with the end users, current forms of training were investigated, requirements for VR training were collected and concepts were developed with practitioners. From these requirements, the technical requirements emerging from the overarching wants and needs of the end users were derived and prioritized for development. A technology framework was developed to incorporate the manikin in the MR training system.
PLUX developed easy-to-use wearables, integrating miniaturized sensors to collect MFRs' biosignals data which allowed for real-time monitoring of MFRs' stress levels during training scenarios. The resulting physiological data was processed by the MED1stMR biosignals software client, enabling stress score calculation and live feedback for trainers, as well as debriefing insights.
Based on the requirements collected from the workshops with end users and real training observations, consequences for the scenario guidelines were drawn. To operationalise these scenario guidelines, a MR training template was developed. It contains considerations on learning objectives, scenario environment, event type and considers the functionalities and possibilities of the MR system. The first MCI training scenario dealing with a bus accident. This scenario was extended with challenging environmental conditions, different medical and injury patterns and served as a baseline scenario for further developments and contained the essential elements for training.
Through six FTs in six different countries (Austria, Germany, Belgium, Spain, Greece and Sweden), the project tested and refined these scenarios, considering both technological and contextual factors. Insights from the trials informed recommendations for good practice, including adapting scenarios to trainee expertise levels and varying scenario contexts for each repetition.
The MED1stMR project has successfully developed a comprehensive suite of tools and guidelines that leverage mixed reality and wearable technologies to enhance first responder training. As main result an advanced MR training system for medical first responders, featuring a patient simulation manikin to enhance the realism of medical emergency scenarios. The inclusion of the patient manikin allows medical first responders to practice life-saving procedures on a realistic model, significantly improving their preparedness for real-world situations.
A key technological innovation within the MR system is AI-supported performance evaluation. The AI-driven insights help trainers assess performance more objectively, identifying areas for improvement.
The project also delivered a comprehensive training framework and guidelines to maximize the effectiveness of these tools. Additionally, policymakers are provided with strategies and toolkits to facilitate the integration of MR technology and smart wearables into national training programs.
A comprehensive exploitation plan was developed for the key exploitable results, ensuring that each innovation was aligned with potential market opportunities. This plan was continuously refined as the project progressed and new results emerged.
The dissemination activities covered events hosted by the consortium (webinars, field trails, real-life exercises, and final conference), the participation of consortium members at external events and meetings, contact with policy- and decision-makers, the exchange with other projects as well as scientific dissemination in the form of publications or presentations at conferences.
In intensive cooperation with the end users, current forms of training were investigated, requirements for VR training were collected and concepts were developed with practitioners. From these requirements, the technical requirements emerging from the overarching wants and needs of the end users were derived and prioritized for development. A technology framework was developed to incorporate the manikin in the MR training system.
PLUX developed easy-to-use wearables, integrating miniaturized sensors to collect MFRs' biosignals data which allowed for real-time monitoring of MFRs' stress levels during training scenarios. The resulting physiological data was processed by the MED1stMR biosignals software client, enabling stress score calculation and live feedback for trainers, as well as debriefing insights.
Based on the requirements collected from the workshops with end users and real training observations, consequences for the scenario guidelines were drawn. To operationalise these scenario guidelines, a MR training template was developed. It contains considerations on learning objectives, scenario environment, event type and considers the functionalities and possibilities of the MR system. The first MCI training scenario dealing with a bus accident. This scenario was extended with challenging environmental conditions, different medical and injury patterns and served as a baseline scenario for further developments and contained the essential elements for training.
Through six FTs in six different countries (Austria, Germany, Belgium, Spain, Greece and Sweden), the project tested and refined these scenarios, considering both technological and contextual factors. Insights from the trials informed recommendations for good practice, including adapting scenarios to trainee expertise levels and varying scenario contexts for each repetition.
The MED1stMR project has successfully developed a comprehensive suite of tools and guidelines that leverage mixed reality and wearable technologies to enhance first responder training. As main result an advanced MR training system for medical first responders, featuring a patient simulation manikin to enhance the realism of medical emergency scenarios. The inclusion of the patient manikin allows medical first responders to practice life-saving procedures on a realistic model, significantly improving their preparedness for real-world situations.
A key technological innovation within the MR system is AI-supported performance evaluation. The AI-driven insights help trainers assess performance more objectively, identifying areas for improvement.
The project also delivered a comprehensive training framework and guidelines to maximize the effectiveness of these tools. Additionally, policymakers are provided with strategies and toolkits to facilitate the integration of MR technology and smart wearables into national training programs.
A comprehensive exploitation plan was developed for the key exploitable results, ensuring that each innovation was aligned with potential market opportunities. This plan was continuously refined as the project progressed and new results emerged.
The dissemination activities covered events hosted by the consortium (webinars, field trails, real-life exercises, and final conference), the participation of consortium members at external events and meetings, contact with policy- and decision-makers, the exchange with other projects as well as scientific dissemination in the form of publications or presentations at conferences.
MED1stMR is revolutionizing medical first responder training through the use of MR technologies. By integrating high-fidelity patient simulation manikins, it offers a much richer sensory experience compared to other VR training and is setting new standards in medical training. The developed wearables allow the monitoring of the trainees’ stress level and behaviours in real-time and will provide an innovative approach to personalise and adapt training to their needs with the application of machine learning models improving MR training effectiveness.
The socio-economic impacts of MED1stMR are significant. The project lowers training costs, reduces the need for physical equipment, and creates new jobs in tech and healthcare. Better training for first responders is expected to improve patient outcomes and reduce healthcare costs, benefiting society overall.
Beyond immediate socio-economic benefits, MED1stMR has broader societal impacts. It enhances public safety, saves lives, and mitigates disaster impacts through better emergency response. The project also drives the adoption of advanced technologies in healthcare and sets a precedent for future innovations. Additionally, the educational benefits of MR training could extend to other fields, enriching learning experiences across disciplines.
The socio-economic impacts of MED1stMR are significant. The project lowers training costs, reduces the need for physical equipment, and creates new jobs in tech and healthcare. Better training for first responders is expected to improve patient outcomes and reduce healthcare costs, benefiting society overall.
Beyond immediate socio-economic benefits, MED1stMR has broader societal impacts. It enhances public safety, saves lives, and mitigates disaster impacts through better emergency response. The project also drives the adoption of advanced technologies in healthcare and sets a precedent for future innovations. Additionally, the educational benefits of MR training could extend to other fields, enriching learning experiences across disciplines.