Automated Measurement of Engagement Level of Children with Autism Spectrum Conditions during Human-robot Interaction

Project Information

EngageME

Grant agreement ID: 701236

DOI 10.3030/701236

Project closed

EC signature date 11 March 2016

Start date 1 October 2016

End date 30 September 2019

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost € 239 860,80

EU contribution € 239 860,80

Coordinated by

UNIVERSITAET AUGSBURG
Germany

Publications

Conference proceedings (15)

RoboChain: A Secure Data-Sharing Framework for Human-Robot Interaction

Author(s): E. C. Ferrer, O. Rudovic, T. Hardjono, A. Pentland
Published in: The 10th International Conference on eHealth, Telemedicine, and Social Medicine (eTELEMED 2018), 2018
Publisher: ThinkMind Digital Library

Personalized Gaussian Processes for Future Prediction of Alzheimer's Disease Progression

Author(s): K. Peterson, O. Rudovic, R. Guerrero, R. W. Picard
Published in: NIPS'W on Machine Learning for Health, 2017
Publisher: arxiv

Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning

Author(s): D. L. Martinez, O. Rudovic, R. W. Picard
Published in: NIPS'W on Machine Learning for Health, 2017
Publisher: arxiv

Personalized Gaussian Processes for Forecasting of Alzheimer’s Disease Assessment Scale-Cognition Sub-Scale (ADAS-Cog13)

Author(s): Yuria Utsumil, Ognjen Oggi Rudovicl, Kelly Petersonl, Ricardo Guerrero, Rosalind W. Picardl
Published in: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2018, Page(s) 4007-4011, ISBN 978-1-5386-3646-6
Publisher: IEEE
DOI: 10.1109/embc.2018.8513253

DeepSpace: Mood-Based Image Texture Generation for Virtual Reality from Music

Author(s): Misha Sra, Prashanth Vijayaraghavan, Ognjen Rudovic, Pattie Maes, Deb Roy
Published in: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017, Page(s) 2289-2298, ISBN 978-1-5386-0733-6
Publisher: IEEE
DOI: 10.1109/cvprw.2017.283

PUnDA: Probabilistic Unsupervised Domain Adaptation for Knowledge Transfer Across Visual Categories

Author(s): Behnam Gholami, Ognjen Rudovic, Vladimir Pavlovic
Published in: 2017 IEEE International Conference on Computer Vision (ICCV), 2017, Page(s) 3601-3610, ISBN 978-1-5386-1032-9
Publisher: IEEE
DOI: 10.1109/iccv.2017.387

GIFGIF+: Collecting emotional animated GIFs with clustered multi-task learning

Author(s): Weixuan Chen, Ognjen Oggi Rudovic, Rosalind W. Picard
Published in: 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), 2017, Page(s) 510-517, ISBN 978-1-5386-0563-9
Publisher: IEEE
DOI: 10.1109/acii.2017.8273647

NAO-Dance Therapy for Children with ASD

Author(s): Ryo Suzuki, Jaeryoung Lee, Ognjen Rudovic
Published in: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction - HRI '17, 2017, Page(s) 295-296, ISBN 9781-450348850
Publisher: ACM Press
DOI: 10.1145/3029798.3038354

Personalized Automatic Estimation of Self-Reported Pain Intensity from Facial Expressions

Author(s): Daniel Lopez Martinez, Ognjen Rudovic, Rosalind Picard
Published in: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017, Page(s) 2318-2327, ISBN 978-1-5386-0733-6
Publisher: IEEE
DOI: 10.1109/cvprw.2017.286

DeepCoder: Semi-Parametric Variational Autoencoders for Automatic Facial Action Coding

Author(s): Dieu Linh Tran, Robert Walecki, Ognjen Rudovic, Stefanos Eleftheriadis, Bjorn Schuller, Maja Pantic
Published in: 2017 IEEE International Conference on Computer Vision (ICCV), 2017, Page(s) 3209-3218, ISBN 978-1-5386-1032-9
Publisher: IEEE
DOI: 10.1109/iccv.2017.346

Deep Structured Learning for Facial Action Unit Intensity Estimation

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Bjoern Schuller, Maja Pantic
Published in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, Page(s) 5709-5718, ISBN 978-1-5386-0457-1
Publisher: IEEE
DOI: 10.1109/cvpr.2017.605

Unsupervised domain adaptation with copula models

Author(s): Cuong D. Tran, Ognjen Oggi Rudovic, Vladimir Pavlovic
Published in: 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP), 2017, Page(s) 1-6, ISBN 978-1-5090-6341-3
Publisher: IEEE
DOI: 10.1109/mlsp.2017.8168131

Meta-Weighted Gaussian Process Experts for Personalized Forecasting of AD Cognitive Changes

Author(s): Rudovic, O., Utsumi, Y., Guerrero, R., Peterson, K., Rueckert, D., Picard, R. W.
Published in: Machine Learning for Healthcare Conference, 2019
Publisher: ML4HC

Personalized Estimation of Engagement from Videos Using Active Learning with Deep Reinforcement Learning

Author(s): Rudovic, O., Park, H-W., Busche, J., Schuller, B. , Breazeal, C., Picard, R. W.
Published in: IEEE CVPR -AMFG W, 2019
Publisher: IEEE

Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach

Author(s): Ognjen Rudovic, Meiru Zhang, Bjorn Schuller, Rosalind Picard
Published in: 2019 International Conference on Multimodal Interaction on - ICMI '19, 2019, Page(s) 6-15, ISBN 9781-450368605
Publisher: ACM Press
DOI: 10.1145/3340555.3353742

Book chapters (1)

A Mixture of Personalized Experts for Human Affect Estimation

Author(s): Michael Feffer, Ognjen Rudovic, Rosalind W. Picard
Published in: Machine Learning and Data Mining in Pattern Recognition, Issue 10935, 2018, Page(s) 316-330, ISBN 978-3-319-96132-3
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-96133-0_24

Peer reviewed articles (7)

Gaussian Process Domain Experts for Modeling of Facial Affect

Author(s): Stefanos Eleftheriadis, Ognjen Rudovic, Marc Peter Deisenroth, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 26/10, 2017, Page(s) 4697-4711, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2017.2721114

Multi-Instance Dynamic Ordinal Random Fields for Weakly Supervised Facial Behavior Analysis

Author(s): Adria Ruiz, Ognjen Rudovic, Xavier Binefa, Maja Pantic
Published in: IEEE Transactions on Image Processing, Issue 27/8, 2018, Page(s) 3969-3982, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2018.2830189

Personalized machine learning for robot perception of affect and engagement in autism therapy

Author(s): Ognjen Rudovic, Jaeryoung Lee, Miles Dai, Björn Schuller, Rosalind W. Picard
Published in: Science Robotics, Issue 3/19, 2018, Page(s) eaao6760, ISSN 2470-9476
Publisher: Science
DOI: 10.1126/scirobotics.aao6760

Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study

Author(s): Ognjen Rudovic, Jaeryoung Lee, Lea Mascarell-Maricic, Björn W. Schuller, Rosalind W. Picard
Published in: Frontiers in Robotics and AI, Issue 4, 2017, ISSN 2296-9144
Publisher: Frontiers
DOI: 10.3389/frobt.2017.00036

DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain

Author(s): Liu, Dianbo; Peng, Fengjiao; Shea, Andrew; Ognjen; Rudovic; Picard, Rosalind
Published in: Journal of Machine Learning Research, IJCAI AComp, Issue 3, 2017, ISSN 1532-4435
Publisher: MIT Press

N. Jaques, O. Rudovic, S. Taylor, A. Sano, R.W. Picard

Author(s): Predicting Tomorrow's Mood, Health, and Stress Level using Personalized Multitask Learning and Domain Adaptation
Published in: Journal of Machine Learning Research, IJCAI AComp., 2017, ISSN 1532-4435
Publisher: MIT Press

A Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity

Author(s): Robert Walecki, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic
Published in: IEEE Transactions on Affective Computing, 2017, Page(s) 1-1, ISSN 1949-3045
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TAFFC.2017.2728534