Periodic Reporting for period 1 - BODYinTRANSIT (Sensory-driven Body Transformation Experiences On-the-move)
Reporting period: 2022-01-01 to 2023-06-30
Our physical body is the interface between ourselves and the world around us. The way we perceive our body, its appearance, configuration and motor abilities shapes our behaviour, emotion and social functioning. Recent advances in sensing technologies coupled with bodily sensory feedback devices are paving the way for body transformation experiences (BTE) or perceptual experiences of one’s body changing. Imagine a perceptual illusion like being in a child’s body. Beyond fun experiences, BTE technologies can bring significant advancements for wellbeing and health applications for different clinical conditions, as well as opening possibilities for applications for sports, virtual reality, robotics, fashion design and the Arts. The aim of this ERC-funded project BODYinTRANSIT is to establish a new fundamental knowledge base for individualised sensorial manipulation of body perceptions that will enable future BTE technologies and applications. To induce, preserve, measure, model, personalize and support Body Transformation Experiences the project relies on neuroscience of multisensory body perception, data modelling, wearable-based embodied multisensory interaction design and field studies in real life and on-the-move contexts with physically inactive users, somatic practitioners and users with body image concerns.
The work has been carried out as planned with significant progress made on the five research objectives (RO):
RO1: Development of a theoretical framework integrating multidisciplinary research on MBR (Mental Body Representations) and guiding the design of future BTE (Body Transformation Experiences) technologies: Currently, we are conducting studies investigating the effects of different sensory combinations and top-down influences on body perception, which will contribute to a theoretical framework encompassing brain functioning and bottom-up/top-down multisensory mechanisms of body perception. Furthermore, we are working on the design and optimization of measures of MBR, such as the use of body maps as a research tool, and strategies, methods, and prototypes for BTE interventions, including the utilization of material metaphors to transform body perceptions.
RO2: Identification, mapping, and validation of the most effective non-visual cue combinations and underlying top-down and bottom-up mechanisms for transforming MBR in terms of body appearance and capabilities: we collected data from a diverse group of participants (N>100) with various body complexions, concerns and body ideals, experiencing the sound-driven illusion of having a heavier or lighter body. This corpus will enable us to model behavior-MBR relationships (RO3) and investigate the interaction between individual factors and sound effects.
RO3: Understanding and quantifying the within- and between-subject interdependence of MBR with behavior, emotion, and self-identity variables: Leveraging the data corpus generated (RO2), we are conducting analyses to uncover the effects of sensory feedback on changes in emotion, behavior, self-identity, and the interdependencies between these variables and MBR. Additionally, using the data corpus, we are developing a model that relates body-tracking features to changes in MBR.
RO4: Investigation of the short- and long-term effects on MBR malleability and persistence in complex environments, including longitudinal and field studies with representative populations (body image concerns, physically inactive individuals, dancers): A subset of our studies has focused on examining the effects of body-related cues and non-body-related sound cues on individuals with symptomatology of eating disorders. Our results have provided evidence of disturbances in sensory integration mechanisms among this population, as evidenced by altered patterns in body perceptions resulting from sensory effects.
RO5: Laying the knowledge basis for new technologies supporting the “inner fashion” concept which uses smart clothing to shape body perception, as validated in real-life studies: We are employing a user-centered iterative approach to develop wearable interactive prototypes. Ten thematic workshops in the form of embodied design explorations were conducted, engaging different user cohorts, including physically inactive individuals, professional dancers with body concerns, and the general population. Additionally, we organized two thematic workshops and two demo sessions collocated with international conferences with field experts. Two transdisciplinary art-science residencies have also been conducted in our lab to gather creative design solutions from artists and makers.
The results of these activities have been disseminated through publications, conference presentations, seminars, demos, a dedicated website, social media, public events, and artistic performances. Notably, we organized an international conference on Body Representation.
These activities have been made possible through the establishment of a new laboratory known as i_mBODY Lab - Interactive Multisensory Body-centred Experiences at the Intersection of Neuroscience & Technology. This innovative lab integrates a maker space for prototyping, experimental testing capabilities and resources for sensory stimulation and body tracking.
RO1: Development of a theoretical framework integrating multidisciplinary research on MBR (Mental Body Representations) and guiding the design of future BTE (Body Transformation Experiences) technologies: Currently, we are conducting studies investigating the effects of different sensory combinations and top-down influences on body perception, which will contribute to a theoretical framework encompassing brain functioning and bottom-up/top-down multisensory mechanisms of body perception. Furthermore, we are working on the design and optimization of measures of MBR, such as the use of body maps as a research tool, and strategies, methods, and prototypes for BTE interventions, including the utilization of material metaphors to transform body perceptions.
RO2: Identification, mapping, and validation of the most effective non-visual cue combinations and underlying top-down and bottom-up mechanisms for transforming MBR in terms of body appearance and capabilities: we collected data from a diverse group of participants (N>100) with various body complexions, concerns and body ideals, experiencing the sound-driven illusion of having a heavier or lighter body. This corpus will enable us to model behavior-MBR relationships (RO3) and investigate the interaction between individual factors and sound effects.
RO3: Understanding and quantifying the within- and between-subject interdependence of MBR with behavior, emotion, and self-identity variables: Leveraging the data corpus generated (RO2), we are conducting analyses to uncover the effects of sensory feedback on changes in emotion, behavior, self-identity, and the interdependencies between these variables and MBR. Additionally, using the data corpus, we are developing a model that relates body-tracking features to changes in MBR.
RO4: Investigation of the short- and long-term effects on MBR malleability and persistence in complex environments, including longitudinal and field studies with representative populations (body image concerns, physically inactive individuals, dancers): A subset of our studies has focused on examining the effects of body-related cues and non-body-related sound cues on individuals with symptomatology of eating disorders. Our results have provided evidence of disturbances in sensory integration mechanisms among this population, as evidenced by altered patterns in body perceptions resulting from sensory effects.
RO5: Laying the knowledge basis for new technologies supporting the “inner fashion” concept which uses smart clothing to shape body perception, as validated in real-life studies: We are employing a user-centered iterative approach to develop wearable interactive prototypes. Ten thematic workshops in the form of embodied design explorations were conducted, engaging different user cohorts, including physically inactive individuals, professional dancers with body concerns, and the general population. Additionally, we organized two thematic workshops and two demo sessions collocated with international conferences with field experts. Two transdisciplinary art-science residencies have also been conducted in our lab to gather creative design solutions from artists and makers.
The results of these activities have been disseminated through publications, conference presentations, seminars, demos, a dedicated website, social media, public events, and artistic performances. Notably, we organized an international conference on Body Representation.
These activities have been made possible through the establishment of a new laboratory known as i_mBODY Lab - Interactive Multisensory Body-centred Experiences at the Intersection of Neuroscience & Technology. This innovative lab integrates a maker space for prototyping, experimental testing capabilities and resources for sensory stimulation and body tracking.
The project aims to generate fundamental knowledge for the emerging field of Body-Transformation Experiences (BTE) engineering, integrating research from various disciplines. This endeavor may revolutionize everyday body perceptions and enable the design of BTE technologies for real-life scenarios.
Scientifically, it is expected that the results by the end of the project will lead to significant breakthroughs, including:
- The identification of links between mental Body Representations (MBR) and behavioral, emotional, and self-identity variables.
- The reformulation of principles of multisensory body perception to incorporate novel sensory combinations, top-down influences, and MBR-behavior links
- The development of a real-time measure of MBR changes (rtMBR) based on modeling
- The exploration of new non-visual BTE paradigms arising from in-the-wild research.
Technologically, BODYinTRANSIT will lay the foundation for next-generation BTE technologies by establishing theoretical principles and an rtMBR measure that underlie the design of personalized BTE systems. Technological breakthroughs will include:
- Reduced-order modeling methods for optimizing body-tracking interfaces.
- Prototypes of BTE wearable technology developed within the project.
- Data-driven models that map links between MBR and behavior, emotion, and self-identity.
- Datasets with the experimental data corpus.
On a societal level, the in-the-wild studies involving various populations will uncover strategies for improving health and well-being, specifically targeting negative body perceptions. These applications have the potential to impact users' motor and social behavior, emotional state, self-identity, and body satisfaction. The translation of these principles into technological tools for fashion design and production opens up opportunities in sports, wearable technologies, and retail, among other fields. Dissemination and communication activities will engage stakeholders through art residencies, workshops, and real-life demonstrations.
Scientifically, it is expected that the results by the end of the project will lead to significant breakthroughs, including:
- The identification of links between mental Body Representations (MBR) and behavioral, emotional, and self-identity variables.
- The reformulation of principles of multisensory body perception to incorporate novel sensory combinations, top-down influences, and MBR-behavior links
- The development of a real-time measure of MBR changes (rtMBR) based on modeling
- The exploration of new non-visual BTE paradigms arising from in-the-wild research.
Technologically, BODYinTRANSIT will lay the foundation for next-generation BTE technologies by establishing theoretical principles and an rtMBR measure that underlie the design of personalized BTE systems. Technological breakthroughs will include:
- Reduced-order modeling methods for optimizing body-tracking interfaces.
- Prototypes of BTE wearable technology developed within the project.
- Data-driven models that map links between MBR and behavior, emotion, and self-identity.
- Datasets with the experimental data corpus.
On a societal level, the in-the-wild studies involving various populations will uncover strategies for improving health and well-being, specifically targeting negative body perceptions. These applications have the potential to impact users' motor and social behavior, emotional state, self-identity, and body satisfaction. The translation of these principles into technological tools for fashion design and production opens up opportunities in sports, wearable technologies, and retail, among other fields. Dissemination and communication activities will engage stakeholders through art residencies, workshops, and real-life demonstrations.