CONnected through roBOTS: physically coupling humans to boost handwriting and music learning

Project Information

CONBOTS

Grant agreement ID: 871803

DOI 10.3030/871803

Project closed

EC signature date 5 December 2019

Start date 1 January 2020

End date 31 December 2023

Funded under

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Total cost € 4 810 796,25

EU contribution € 4 810 796,25

Coordinated by

UNIVERSITY OF NEWCASTLE UPON TYNE
United Kingdom

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (6)

Report on model validity with CONBOTS use cases

Report on model validity with CONBOTS use cases.

Report on preliminary experiments on learning with/out physical communication

Report on preliminary experiments on learning without physical communication

Final report on music experiments

Final report on music experiments.

Final report on handwriting experiments

Final report on handwriting experiments.

Report on ethical, legal and socio-economic issues related to the use of CONBOTS platform

Report on ethical legal and socioeconomic issues related to the use of CONBOTS platform

Report on Privacy and Cybersecurity issues related to CONBOTS project

Open Research Data Pilot (1)

Data Management Plan (DMP)

"Definition of the Data Management Plan (DMP), as foreseen by the ""Pilot on Open Research Data"" of Horizon 2020"

Websites, patent fillings, videos etc. (1)

Public project website

Public project website.

Publications

Conference proceedings (17)

Foot gestures to control the grasping of a surgical robot

Author(s): Yijun Cheng; Yanpei Huang; Ziwei Wang; Etienne Burdet
Published in: IEEE International Conference on Robotics and Automation (ICRA), 2023, ISBN 979-8-3503-2365-8
Publisher: IEEE
DOI: 10.1109/icra48891.2023.10160368

Wearable Sensors to Monitor Psychophysiological Response Induced by Musical Consonance and Dissonance

Author(s): Daniela Lo Presti; Chiara Romano; Carlo Massaroni; Nicola Di Stefano; Domenico Formica; Emiliano Schena
Published in: International Workshop on Biomedical Applications, Technologies and Sensors (BATS), 2023, ISBN 979-8-3503-4347-2
Publisher: IEEE
DOI: 10.1109/bats59463.2023.10303095

A soft sensor based on FBG technology for heart rate monitoring in archery

Author(s): Daniela Lo Presti; Chiara Romano; Catia Leitao; Carlo Massaroni; Domenico Formica; Emiliano Schena
Published in: 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Issue 6, 2022, ISBN 978-1-6654-8299-8
Publisher: IEEE
DOI: 10.1109/memea54994.2022.9856545

Assessment of the visual noise influence on muscle activation during a tracking task

Author(s): Buscaglione, S., Noccaro, A., Di Pino, G., & Formica, D.
Published in: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2023, ISBN 978-1-6654-9384-0
Publisher: IEEE
DOI: 10.1109/memea57477.2023.10171927

Evaluating Handwriting Skills through Human-Machine Interaction: A New Digitalized System for Parameters Extraction

Author(s): Provenzale, C., Sparaci, L., Fantasia, V., Bonsignori, C., Formica, D., & Taffoni, F.
Published in: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022
Publisher: IEEE
DOI: 10.1109/embc48229.2022.9871538

Cardiorespiratory monitoring using a mechanical and an optical system

Author(s): Daniela Lo Presti; Carlo Massaroni; Michele Caponero; Domenico Formica; Emiliano Schena
Published in: IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2021, ISBN 978-1-6654-1914-7
Publisher: IEEE
DOI: 10.1109/memea52024.2021.9478750

Evaluation of a 7-DoFs Robotic Manipulator as haptic interface during planar reaching tasks

Author(s): Alessia Noccaro; Silvia Buscaglione; Mattia Pinardi; Giovanni Di Pino; Domenico Formica
Published in: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023, ISSN 2153-0866
Publisher: IEEE
DOI: 10.1109/iros55552.2023.10342470

Perception and Performance of Electrical Stimulation for Proprioception

Author(s): Camille M. Blondin, Ekaterina Ivanova, Jonathan Eden, Etienne Burdet
Published in: 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2021, ISSN 2694-0604
Publisher: IEEE
DOI: 10.1109/embc46164.2021.9630186

Tele-Impedance Control Approach Using Wearable Sensors

Author(s): S. Buscaglione; N. L. Tagliamonte; G. Ticchiarelli; G. Di Pino; D. Formica; A. Noccaro
Published in: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022, ISSN 2694-0604
Publisher: IEEE
DOI: 10.1109/embc48229.2022.9871736

A virtual reality platform to evaluate the effects of supernumerary limbs’ appearance

Author(s): Ziyi Jiang; Yanpei Huang; Jonathan Eden; Ekaterina Ivanova; Xiaoxiao Cheng; Etienne Burdet
Published in: 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2023, ISSN 2694-0604
Publisher: IEEE
DOI: 10.1109/embc40787.2023.10340197

Dissociating haptic feedback from physical assistance does not improve motor performance

Author(s): Ekaterina Ivanova; Nuria Peña-Perez; Jonathan Eden; Yammi Yip; Etienne Burdet
Published in: 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2023, ISSN 2694-0604
Publisher: IEEE
DOI: 10.1109/embc40787.2023.10340983

Design and validation of 3D printed hand interfaces for wrist stiffness assessment

Author(s): Giorgia Giovannetti; Silvia Buscaglione; Alessia Noccaro; Domenico Formica
Published in: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2023, ISBN 978-1-6654-9384-0
Publisher: IEEE
DOI: 10.1109/memea57477.2023.10171924

Validation of Vibrotactile Feedback to Improve Selective Motor Units Recruitment

Author(s): Davide Deiana; Mattia Pinardi; Alessia Noccaro; Michela Iandoli; Giovanni Di Pino; Domenico Formica
Published in: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2023, ISBN 978-1-6654-9384-0
Publisher: IEEE
DOI: 10.1109/memea57477.2023.10171925

Wearable systems for respiratory monitoring: solutions based on strain measurements

Author(s): Daniela Lo Presti, Carlo Massaroni, Domenico Formica, Emiliano Schena
Published in: IEEE International Conference on Sensors and Nanotechnology (SENNANO), 2021, ISBN 978-1-6654-0439-6
Publisher: IEEE
DOI: 10.1109/sennano51750.2021.9642522

Clean-Breathing: a Novel Sensor Fusion Algorithm Based on ICA to Remove Motion Artifacts from Breathing Signal

Author(s): Luigi Raiano, Joshua Di Tocco, Carlo Massaroni, Giovanni Di Pino, Emiliano Schena, Domenico Formica
Published in: 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT, 2020, Page(s) 734-739, ISBN 978-1-7281-4892-2
Publisher: IEEE
DOI: 10.1109/metroind4.0iot48571.2020.9138265

Biomechanics of Exoskeleton-Assisted Treadmill Walking

Author(s): F. Di Tommaso; F. Tamburella; M. Lorusso; L. Gastaldi; M. Molinari; N. L. Tagliamonte
Published in: 2023 International Conference on Rehabilitation Robotics (ICORR), 2023, ISSN 1945-7901
Publisher: IEEE
DOI: 10.1109/icorr58425.2023.10304685

Visual Noise Linearly Influences Tracking Performance

Author(s): A Noccaro, S Buscaglione, G Di Pino, D Formica
Published in: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022, ISBN 978-1-7281-2782-8
Publisher: IEEE
DOI: 10.1109/embc48229.2022.9871509

Peer reviewed articles (32)

A review on interaction control for contact robots through intent detection

Author(s): Yanan Li; Aran Sena; Ziwei Wang; Xueyan Xing; Jan Babic; Edwin H.F. van Asseldonk; Etienne Burdet
Published in: Progress in Biomedical Engineering, Issue 25161091, 2022, ISSN 2516-1091
Publisher: IOP publishing
DOI: 10.1088/2516-1091/ac8193

How virtual and mechanical coupling impact bimanual tracking

Author(s): Peña-Pérez, Nuria; Eden, Jonathan; Ivanova, Ekaterina; Farkhatdinov, Ildar; Burdet, Etienne
Published in: Journal of Neurophysiology, Issue 9, 2023, ISSN 1522-1598
Publisher: American physiological society
DOI: 10.1152/jn.00057.2022

Toward a meaningful technology for instrumental music education: Teachers’ voice

Author(s): Michałko A, Campo A, Nijs L, Leman M and Van Dyck E
Published in: Frontiers in Education, Issue 2504284X, 2022, ISSN 2504-284X
Publisher: Frontiers
DOI: 10.3389/feduc.2022.1027042

Dataset for the Assessment of Presence and Performance in an Augmented Reality Environment for Motor Imitation Learning: A Case-Study on Violinists

Author(s): Campo A., Michałko, A., Van Kerrebroeck, B., & Leman, M.
Published in: Data in Brief, 2023, ISSN 2352-3409
Publisher: Elsevier BV
DOI: 10.2139/ssrn.4530154

Improving Tracking through Human-Robot Sensory Augmentation

Author(s): Yanan Li, Jonathan Eden, Gerolamo Carboni, Etienne Burdet
Published in: IEEE Robotics and Automation Letters, Issue 5/3, 2020, Page(s) 4399-4406, ISSN 2377-3766
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lra.2020.2998715

Competition increases the effort put into a physical interaction task

Author(s): Takagi A., Bagnato C., Melendez-Calderon A., Jarrasse N., Ganesh G. & Burdet E.
Published in: IEEE Transactions on Haptics, 2023, ISSN 1939-1412
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/toh.2023.3306794

Wrist redundancy management during pointing tasks remains stable over time and in presence of a visuomotor perturbation

Author(s): Luigi Raiano, Alessia Noccaro, Giovanni Di Pino & Domenico Formica
Published in: Scientific Reports, 2023, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-023-33531-2

The assessment of presence and performance in an AR environment for motor imitation learning: A case-study on violinists

Author(s): Adriaan Campo; Aleksandra Michałko; Bavo Van Kerrebroeck; Boris Stajic; Maja Pokric; Marc Leman
Published in: Computers in Human Behavior, 2023, ISSN 0747-5632
Publisher: Pergamon Press Ltd.
DOI: 10.1016/j.chb.2023.107810

Comparison between Chest-Worn Accelerometer and Gyroscope Performance for Heart Rate and Respiratory Rate Monitoring

Author(s): Romano, C., Schena, E., Formica, D., & Massaroni, C.
Published in: Biosensors, Issue 20796374, 2022, ISSN 2079-6374
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/bios12100834

MC-AR-A software suite for comparative mocap analysis in an augmented reality environment

Author(s): Campo, A., Van Kerrebroeck, B., & Leman, M.
Published in: Software Impacts, 2023, ISSN 2665-9638
Publisher: Elsevier
DOI: 10.1016/j.simpa.2023.100605

Assessing the Bowing Technique in Violin Beginners Using MIMU and Optical Proximity Sensors: A Feasibility Study

Author(s): Cecilia Provenzale, Nicola Di Stefano, Alessia Noccaro, Fabrizio Taffoni
Published in: Sensors, Issue 21/17, 2021, Page(s) 5817, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21175817

Physically interacting humans regulate muscle coactivation to improve visuo-haptic perception

Author(s): Hendrik Börner; Gerolamo Carboni; Xiaoxiao Cheng; Atsushi Takagi; Sandra Hirche; Satoshi Endo; Etienne Burdet
Published in: Journal of Neurophysiology, 2023, ISSN 0022-3077
Publisher: American Physiological Society
DOI: 10.1152/jn.00420.2022

The effect of infill pattern and density on the response of 3-D-printed sensors based on FBG technology

Author(s): Presti, D. L., Leitao, C., Noccaro, A., Tavares, C., Massaroni, C., Caponero, M. A., Antunes, P., Formica, D. & Schena, E.
Published in: IEEE Sensors Journal, 2022, ISSN 1530-437X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jsen.2022.3202101

Short Time Delay Does Not Hinder Haptic Communication Benefits

Author(s): Ekaterina Ivanova, Jonathan Eden, Silei Zhu, Gerolamo Carboni, Aaron Yurkewich, Etienne Burdet
Published in: IEEE Transactions on Haptics, Issue 14/2, 2021, Page(s) 322-327, ISSN 1939-1412
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/toh.2021.3079227

A Novel Training and Collaboration Integrated Framework for Human–Agent Teleoperation

Author(s): Zebin Huang; Ziwei Wang; Weibang Bai; Yanpei Huang; Lichao Sun; Bo Xiao; Eric M. Yeatman
Published in: Sensors, 2021, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21248341

Adaptive Event-Triggered Control for Nonlinear Systems With Asymmetric State Constraints: A Prescribed-Time Approach

Author(s): Wang, Z., Lam, H.K, Guo, Y., Xiao, B., Li, Y., Su, X., Yeatman, E.M., Burdet, E.
Published in: IEEE Transactions on Automatic Control, Issue 00189286, 2022, ISSN 0018-9286
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tac.2022.3194880

Using screen-based technologies to assess handwriting in children: a preliminary study choosing human-machine interaction

Author(s): Provenzale, Cecilia; Bonsignori, Chiara; Sparaci, Laura; Formica, Domenico; Taffoni, Fabrizio
Published in: IEEE Access, 2023, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2023.3326357

Investigation of Body Locations for Cardiac and Respiratory Monitoring With Skin-Interfaced Inertial Measurement Unit Sensors

Author(s): Romano, C., Formica, D., Schena, E., & Massaroni, C
Published in: IEEE Sensors Journal, 2023, ISSN 1530-437X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jsen.2023.3245415

For motion assistance humans prefer to rely on a robot rather than on an unpredictable human

Author(s): Ivanova, E., Carboni, G., Eden, J, Krüger, J., Burdet, E.
Published in: IEEE Open Journal of Engineering in Medicine and Biology, Issue 26441276, 2020, ISSN 2644-1276
Publisher: IEEE
DOI: 10.1109/ojemb.2020.2987885

A PCA-Based Method to Select the Number and the Body Location of Piezoresistive Sensors in a Wearable System for Respiratory Monitoring

Author(s): Luigi Raiano, Joshua Di Tocco, Carlo Massaroni, Giovanni Di Pino, Emiliano Schena, Domenico Formica
Published in: IEEE Sensors Journal, Issue 21/5, 2021, Page(s) 6847-6855, ISSN 1530-437X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jsen.2020.3043140

Human performance in three-hands tasks

Author(s): A. Noccaro, J. Eden, G. Di Pino, D. Formica, E. Burdet
Published in: Scientific Reports, Issue 11/1, 2021, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-021-88862-9

Flexible Assimilation of Human's Target for Versatile Human-Robot Physical Interaction

Author(s): Atsushi Takagi, Yanan Li, Etienne Burdet
Published in: IEEE Transactions on Haptics, Issue 14/2, 2021, Page(s) 421-431, ISSN 1939-1412
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/toh.2020.3039725

A multi-point heart rate monitoring using a soft wearable system based on fiber optic technology

Author(s): Lo Presti, D., Santucci, F., Massaroni, C., Formica, D., Setola, R., & Schena, E.
Published in: Scientific reports, Issue 20452322, 2021, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-021-00574-2

Can Training Make Three Arms Better Than Two Heads for Trimanual Coordination?

Author(s): Huang Y., Eden J., Ivanova E. & Burdet E.
Published in: IEEE Open Journal of Engineering in Medicine and Biology, 2023, ISSN 2644-1276
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ojemb.2023.3305808

A Wearable System with Embedded Conductive Textiles and an IMU for Unobtrusive Cardio-Respiratory Monitoring

Author(s): Joshua Di Tocco, Luigi Raiano, Riccardo Sabbadini, Carlo Massaroni, Domenico Formica, Emiliano Schena
Published in: Sensors, Issue 21/9, 2021, Page(s) 3018, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21093018

An fMRI Compatible Smart Device for Measuring Palmar Grasping Actions in Newborns

Author(s): Daniela Lo Presti, Sofia Dall’Orso, Silvia Muceli, Tomoki Arichi, Sara Neumane, Anna Lukens, Riccardo Sabbadini, Carlo Massaroni, Michele Arturo Caponero, Domenico Formica, Etienne Burdet, Emiliano Schena
Published in: Sensors, Issue 20/21, 2020, Page(s) 6040, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s20216040

Interaction with a reactive partner improves learning in contrast to passive guidance

Author(s): Ivanova, E. , Eden, J., Carboni, G., Krüger, J., Burdet E.
Published in: Scientific Reports, Issue 20452322, 2022, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-022-18617-7

Embodying melody through a conducting baton: a pilot comparison between musicians and non-musicians

Author(s): Andrea Costantino, Nicola Di Stefano, Fabrizio Taffoni, Giovanni Di Pino, Manuele Casale, Flavio Keller
Published in: Experimental Brain Research, Issue 238/10, 2020, Page(s) 2279-2291, ISSN 0014-4819
Publisher: Springer Verlag
DOI: 10.1007/s00221-020-05890-z

Is a Robot Needed to Modify Human Effort in Bimanual Tracking?

Author(s): Pena Perez, N., Eden, J., Ivanova, E., Burdet, E., Farkhatdinov, I.
Published in: IEEE Robotics and Automation Letters, Issue 23773766, 2022, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/lra.2022.3183753

The dominant limb preferentially stabilizes posture in a bimanual task with physical coupling

Author(s): A. Takagi, S. Maxwell, A. Melendez-Calderon, E. Burdet
Published in: Journal of Neurophysiology, Issue 123/6, 2020, Page(s) 2154-2160, ISSN 0022-3077
Publisher: American Physiological Society
DOI: 10.1152/jn.00047.2020

Influence of musical context on sensorimotor synchronization in classical ballet solo dance

Author(s): Mohammad Talebi; Adriaan Campo; Noelle Aarts; Marc Leman
Published in: Plos One, Issue 5, 2023, ISSN 1932-6203
Publisher: Public Library of Science
DOI: 10.1371/journal.pone.0284387

Impedance Learning for Human-Guided Robots in Contact With Unknown Environments

Author(s): Xueyan Xing; Etienne Burdet; Weiyong Si; Chenguang Yang; Yanan Li
Published in: Transactions on Robotics, Issue 6, 2023, ISSN 1552-3098
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2023.3281483