Robotic Manipulation for Nuclear Sort and Segregation

Livrables

Project website

Force cues based on integral error signals
Project interfaces and data types
Multi-modal, multi-category object modelling
Learning with the different types of instructions
Learning Active segmentation from human instructions
Real-time visual localisation and control
semi-autonomous learning for reactive grasping and disentangling objects
performance evaluation of the RoMaNS robotic manipulation system

Performance evaluation of the RoMaNS robotic manipulation system

Semi-autonomous learning for trajectory and grasp planning
measuring expert MSM operator population
Adaptive visual tracking for arbitrary objects without training
Mapping between human and robot hands
bench-mark performance measurement on standardised tasks

Bench-mark performance measurement on standardised tasks

Publications

A Visual-Based Shared Control Architecture for Remote Telemanipulation

Auteurs: Robuffo Giordano, Paolo; Abi-Farraj, Firas; Pedemonte, Nicolò
Publié dans: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'16, Oct 2016, Daejeon, South Korea, Numéro 1, 2016
Éditeur: IEEE

Towards Categorization and Pose Estimation of Sets of Occluded Objects in Cluttered Scenes from Depth Data and Generic Object Models Using Joint Parsing

Auteurs: H. Basevi, A. Leonardis.
Publié dans: ECCV Workshop on 6DOF Pose Estimation, 2016
Éditeur: Springer

Projected Inverse Dynamics Control and Optimal Control for Robots in Contact with the Environment: A Comparison

Auteurs: V. Ortenzi, R. Stolkin, J. Kuo, M. Mistry
Publié dans: IROS, 2015
Éditeur: IEEE

Towards advanced robotic manipulation for nuclear decommissioning: a pilot study on tele-operation and autonomy

Auteurs: N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Publié dans: IEEE Robotics and Automation for Humanitarian Applications (RAHA), 2016
Éditeur: IEEE

Regularized Covariance Estimation for Weighted Maximum Likelihood Policy Search Methods

Auteurs: A. Abdolmaleki, Lau, N., Reis, L. & Neumann, G.
Publié dans: IEEE Humanoids, 2015
Éditeur: IEEE

Kinematics-Based Estimation of Contact Constraints Using Only Proprioception

Auteurs: V. Ortenzi, H. Lin, M. Azad, R. Stolkin, Kuo Jeffrey, M. Mistry
Publié dans: IEEE Humanoids, 2016
Éditeur: IEEE

Autonomous vision-guided bi-manual grasping and manipulation

Auteurs: A. Rastegarpanah, R. Stolkin
Publié dans: IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO), 2017
Éditeur: IEEE

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Auteurs: Marturi, N., Ortenzi, V., Xiao, J., Adjigble, M., Stolkin, R. and Leonardis, A.
Publié dans: IEEE-RAS Int. Conf. Humanoid Robots (Humanoids), 2015
Éditeur: IEEE

Task-relevant grasp selection: a joint solution to planning grasps and manipulative motion trajectories

Auteurs: A. M.Ghalamzan E., N. Mavrakis, M. Kopicki, A. Leonardis, R. Stolkin
Publié dans: IROS, 2016
Éditeur: IEEE

The Kernel Kalman Rule - Efficient Nonparametric Inference with Recursive Least Squares

Auteurs: Gebhardt, G. H. W, Kupcsik, A. and Neumann, G.
Publié dans: National Conference on Artificial Intelligence (AAAI), 2017
Éditeur: AAAI

Towards robotic decommissioning of legacy nuclear plant: results of human-factors experiments with tele-robotic manipulation, and a discussion of challenges and approaches for decommissioning

Auteurs: M. Talha, C. Takahashi, A. Ghalamzan, J. Kuo, W. Ingamells, R. Stolkin
Publié dans: IEEE International Symposium on Safety, Security and Rescue Robotics, 2016
Éditeur: IEEE

Single Target Tracking Using Adaptive Clustered Decision Trees and Dynamic Multi-Level Appearance Models

Auteurs: J. Xiao, R. Stolkin and A. Leonardis
Publié dans: CVPR, 2015
Éditeur: IEEE

Optimal Control and Inverse Optimal Control by Distribution Matching

Auteurs: O. Arenz, Abdulsamad, H. and Neumann, G.
Publié dans: IROS, 2016
Éditeur: IEEE

Distractor-supported single target tracking in extremely cluttered scenes

Auteurs: J. Xiao, L. Qiao, R. Stolkin and A. Leonardis
Publié dans: ECCV, 2016
Éditeur: Springer

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Auteurs: T. Osa, Peters, J. and Neumann, G.
Publié dans: International Symposium on Experimental Robotics (ISER), 2016
Éditeur: ISER

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Auteurs: V. Ortenzi, N. Marturi, R. Stolkin, J. Kuo, M. Mistry
Publié dans: IROS, 2016
Éditeur: IEEE

Analysis of the inertia and dynamics of grasped objects, for choosing optimal grasps to enable torque-efficient post-grasp manipulations

Auteurs: N. Mavrakis, A. Ghalamzan, L. Baronti, R. Stolkin, M. Castellani
Publié dans: IEEE Humanoids, 2016
Éditeur: IEEE

Evaluating Deep Convolutional Neural Networks for Material Classification'

Auteurs: G. Kalliatakis, G. Stamatiadis, S. Ehsan, A. Leonardis, J. Gall, A. Sticlaru and K. McDonald-Maier
Publié dans: VISAPP, 2017
Éditeur: VISAPP

Visual-Based Shared Control Architecture for Remote Telemanipulation

Auteurs: Abi-Farraj, F., Pedemonte N., and Robuffo Giordano, P. A
Publié dans: IEEE Int. Conf. on Intelligent Robots and Systems (IROS), 2016
Éditeur: IEEE

Humanoid Teleoperation using Task-Relevant Haptic Feedback

Auteurs: Abi-Farraj , Firas; Henze , Bernd; Werner , Alexander; Panzirsch , Michael; Ott , Christian; Roa , Máximo ,
Publié dans: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'18, Oct 2018, Madrid, Spain. 2018, Numéro 1, 2017
Éditeur: IEEE/RSJ

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Auteurs: Naresh Marturi, Valerio Ortenzi, Jingjing Xiao, Maxime Adjigble, Rustam Stolkin, Ales Leonardis
Publié dans: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Page(s) 467-474, ISBN 978-1-4799-6885-5
Éditeur: IEEE
DOI: 10.1109/humanoids.2015.7363591

Grasp that optimises objectives along post-grasp trajectories

Auteurs: E, Amir M Ghalamzan; Mavrakis, Nikos; Stolkin, Rustam
Publié dans: Numéro 5, 2017
Éditeur: RSI

Optimal control and inverse optimal control by distribution matching

Auteurs: Oleg Arenz, Hany Abdulsamad, Gerhard Neumann
Publié dans: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Page(s) 4046-4053, ISBN 978-1-5090-3762-9
Éditeur: IEEE
DOI: 10.1109/iros.2016.7759596

Hybrid control trajectory optimization under uncertainty

Auteurs: Joni Pajarinen, Ville Kyrki, Michael Koval, Siddhartha Srinivasa, Jan Peters, Gerhard Neumann
Publié dans: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, Page(s) 5694-5701, ISBN 978-1-5386-2682-5
Éditeur: IEEE
DOI: 10.1109/IROS.2017.8206460

Model-Based Relative Entropy Stochastic Search

Auteurs: Abbas Abdolmaleki, Rodulf Lioutikov, Nuno Lua, Luis Paulo Reis, Jan Peters, Gerhard Neumann
Publié dans: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion - GECCO '16 Companion, 2016, Page(s) 153-154, ISBN 9781-450343237
Éditeur: ACM Press
DOI: 10.1145/2908961.2930952

A fully end-to-end deep learning approach for real-time simultaneous 3D reconstruction and material recognition

Auteurs: Cheng Zhao, Li Sun, Rustam Stolkin
Publié dans: 2017 18th International Conference on Advanced Robotics (ICAR), 2017, Page(s) 75-82, ISBN 978-1-5386-3157-7
Éditeur: IEEE
DOI: 10.1109/ICAR.2017.8023499

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Auteurs: Valerio Ortenzi, Naresh Marturi, Rustam Stolkin, Jeffrey A. Kuo, Michael Mistry
Publié dans: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Page(s) 3567-3574, ISBN 978-1-5090-3762-9
Éditeur: IEEE
DOI: 10.1109/iros.2016.7759525

Regularized covariance estimation for weighted maximum likelihood policy search methods

Auteurs: Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis, Gerhard Neumann
Publié dans: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Page(s) 154-159, ISBN 978-1-4799-6885-5
Éditeur: IEEE
DOI: 10.1109/humanoids.2015.7363529

Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting

Auteurs: Sun, Li; Aragon-Camarasa, Gerardo; Rogers, Simon; Stolkin, Rustam; Siebert, J. Paul
Publié dans: Numéro 12, 2017
Éditeur: IEEE

Safe Robotic Grasping: Minimum Impact-Force Grasp Selection

Auteurs: Mavrakis, Nikos; E., Amir M. Ghalamzan; Stolkin, Rustam
Publié dans: Numéro 10, 2017
Éditeur: IEEE

Towards advanced robotic manipulation for nuclear decommissioning: A pilot study on tele-operation and autonomy

Auteurs: Naresh Marturi, Alireza Rastegarpanah, Chie Takahashi, Maxime Adjigble, Rustam Stolkin, Sebastian Zurek, Marek Kopicki, Mohammed Talha, Jeffrey A. Kuo, Yasemin Bekiroglu
Publié dans: 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), 2016, Page(s) 1-8, ISBN 978-1-5090-5203-5
Éditeur: IEEE
DOI: 10.1109/raha.2016.7931866

User evaluation of a haptic-enabled shared-control approach for robotic telemanipulation

Auteurs: Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo
Publié dans: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Numéro 4, 2018
Éditeur: IEEE

A Learning-based Shared Control Architecture for Interactive Task Execution

Auteurs: Abi-Farraj , Firas; Osa , Takayuki; Pedemonte , Nicolò; Peters , Jan; Neumann , Gerhard; Robuffo Giordano , Paolo
Publié dans: https://hal.inria.fr/hal-01482137, Numéro 8, 2017
Éditeur: IEEE

Human-in-the-loop optimisation: mixed initiative grasping for optimally facilitating post-grasp manipulative actions

Auteurs: Ghalamzan , Amir ,; Abi-Farraj , Firas; Robuffo Giordano , Paolo; Stolkin , Rustam
Publié dans: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'17, Numéro 6, 2017
Éditeur: IEEE

Utilizing Human Feedback in POMDP Execution and Specification

Auteurs: Hoelscher, J.; Koert, D.; Peters, J.; Pajarinen, J.
Publié dans: 2018
Éditeur: IEEE

Learning monocular visual odometry with dense 3D mapping from dense 3D flow

Auteurs: C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Publié dans: IEEE Int. Conf. Intelligent Robots and Systems (IROS), 2018
Éditeur: IEEE

Model-Free Preference-Based Reinforcement Learning

Auteurs: Wirth, C.; Fürnkranz, J.; Neumann G
Publié dans: Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15), 2015
Éditeur: AAAI

Sample and Feedback Efficient Hierarchical Reinforcement Learning from Human Preferences

Auteurs: Pinsler, R.; Akrour, R.; Osa, T.; Peters, J.; Neumann, G
Publié dans: 2018
Éditeur: IEEE

Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models

Auteurs: Jingjing Xiao, Rustam Stolkin, Ales Leonardis
Publié dans: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, Page(s) 4978-4987, ISBN 978-1-4673-6964-0
Éditeur: IEEE
DOI: 10.1109/cvpr.2015.7299132

State-Regularized Policy Search for Linearized Dynamical Systems

Auteurs: Abdulsamad, H.; Arenz, O.; Peters, J.; Neumann, G
Publié dans: International Conference on Automated Planning and Scheduling (ICAPS), 2017
Éditeur: AAAI

Learning Robust Policies for Object Manipulation with Robot Swarms

Auteurs: Gebhardt, G.H.W.; Daun, K.; Schnaubelt, M.; Neumann, G
Publié dans: IEEE International Conference on Robotics and Automation, 2018
Éditeur: IEEE

Efficient Gradient-Free Variational Inference using Policy Search

Auteurs: Arenz, O.; Zhong, M.; Neumann, G
Publié dans: 35th International Conference on Machine Learning, 2018
Éditeur: IMLS

Iterative Cost Learning from Different Types of Human Feedback

Auteurs: Arenz, O.; Neumann, G
Publié dans: IROS 2016 Workshop on Human-Robot Collaboration, 2016
Éditeur: IEEE

Model-free and learning-free grasping by Local Contact Moment matching

Auteurs: M Adjigble, N Marturi, V Ortenzi, V Rajasekaran, P Corke, R Stolkin
Publié dans: 2018
Éditeur: IEEE

Continuously Adaptive Data Fusion and Model Relearning for Particle Filter Tracking With Multiple Features

Auteurs: Xiao J, Stolkin R, Oussalah M, Leonardis A.
Publié dans: IEEE Sensors, 2016, ISSN 1530-437X
Éditeur: Institute of Electrical and Electronics Engineers

Guiding Trajectory Optimization by Demonstrated Distributions

Auteurs: Takayuki Osa, Amir M. Ghalamzan Esfahani, Rustam Stolkin, Rudolf Lioutikov, Jan Peters, and Gerhard Neumann
Publié dans: IEEE ROBOTICS AND AUTOMATION LETTERS, Numéro 2, 2, April 2017, 2017, Page(s) 819, ISSN 2377-3766
Éditeur: IEEE

Assisting Movement Training and Execution With Visual and Haptic Feedback

Auteurs: Marco Ewerton, David Rother, Jakob Weimar, Gerrit Kollegger, Josef Wiemeyer, Jan Peters, Guilherme Maeda
Publié dans: Frontiers in Neurorobotics, Numéro 12, 2018, ISSN 1662-5218
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fnbot.2018.00024

Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications Which Lack Large-scale Annotated Training Data

Auteurs: Sun, Li; Zhao, Cheng; Stolkin, Rustam
Publié dans: IEEE Sensors, Numéro 16, 2018, Page(s) 3099, ISSN 1530-437X
Éditeur: Institute of Electrical and Electronics Engineers

Hierarchical Relative Entropy Policy Search

Auteurs: C. Daniel, Neumann, G., Kroemer, O. and Peters, J
Publié dans: Journal of Machine Learning, 2016, ISSN 1532-4435
Éditeur: MIT Press

Dynamic grasp and trajectory planning for moving objects

Auteurs: Naresh Marturi, Marek Kopicki, Alireza Rastegarpanah, Vijaykumar Rajasekaran, Maxime Adjigble, Rustam Stolkin, Aleš Leonardis, Yasemin Bekiroglu
Publié dans: Autonomous Robots, 2018, ISSN 0929-5593
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10514-018-9799-1

Haptic-based shared-control methods for a dual-arm system

Auteurs: Selvaggio , Mario; Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo; Siciliano , Bruno
Publié dans: IEEE Robotics and Automation Letters, IEEE 2018, 3 (4), pp.4249-4256, Numéro 1, 2018, ISSN 2377-3766
Éditeur: IEEE

Design and Evaluation of a Wearable Haptic Device for Skin Stretch, Pressure, and Vibrotactile Stimuli

Auteurs: Marco Aggravi, Florent Pause, Paolo Robuffo Giordano, Claudio Pacchierotti
Publié dans: IEEE Robotics and Automation Letters, Numéro 3/3, 2018, Page(s) 2166-2173, ISSN 2377-3766
Éditeur: IEEE
DOI: 10.1109/LRA.2018.2810887

Passive Task-Prioritized Shared-Control with Haptic Guidance

Auteurs: M. Selvaggio, P. Robuffo Giordano, F. Ficuciello, and B. Siciliano
Publié dans: Robotics and Automation Letters, 2018, ISSN 2377-3766
Éditeur: IEEE

Dynamic multi-level appearance models and adaptive clustered decision trees for single target tracking

Auteurs: J Xiao, R Stolkin, A Leonardis
Publié dans: Pattern Recognition, 2017, ISSN 0031-3203
Éditeur: Pergamon Press

An Algorithmic Perspective on Imitation Learning

Auteurs: Osa, T.; Pajarinen, J.; Neumann, G.; Bagnell, J.A.; Abbeel, P.; Peters, J
Publié dans: Foundations and Trends in Robotics, 2018, ISSN 1935-8253
Éditeur: Now Publishers

Dense RGB-D semantic mapping with pixel-voxel neural network

Auteurs: C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Publié dans: Sensors, 2018, ISSN 1424-8220
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)

A Survey of Preference-Based Reinforcement Learning Methods

Auteurs: Wirth, C.; Akrour, R.; Fürnkranz, J.; Neumann G
Publié dans: Journal of Machine Learning Research (JMLR), 2017, ISSN 1532-4435
Éditeur: MIT Press

A local-global coupled-layer puppet model for robust online human pose tracking

Auteurs: Ma, M., Marturi, N., Li, Y., Stolkin, R., Leonardis, A
Publié dans: Computer Vision and Image Understanding, 2016, ISSN 1077-3142
Éditeur: Academic Press

Torque-Based Balancing for a Humanoid Robot Performing High-Force Interaction Tasks

Auteurs: F. Abi-Farraj, B. Henze, C. Ott, P. Robuffo Giordano, and M. Roa
Publié dans: IEEE Robotics and Automation Letters, 2018, ISSN 2377-3766
Éditeur: IEEE

A Haptic Shared-Control Architecture for Guided Robotic Grasping in Unknown Environments

Auteurs: F. Abi-Farraj, C. Pacchierotti, O. Arenz, G. Neumann, and P. Robuffo Giordano
Publié dans: IEEE Transactions on Haptics, 2018, ISSN 1939-1412
Éditeur: Institute of Electrical and Electronics Engineers

Hierarchical Reinforcement Learning of Multiple Grasping Strategies with Human Instructions

Auteurs: Osa, T.; Peters, J.; Neumann, G
Publié dans: Advanced Robotics, 2018, ISSN 1568-5535
Éditeur: Taylor and Francis

Region-sequence based six-stream CNN features for general and fine-grained human action recognition in videos

Auteurs: M Ma, N Marturi, Y Li, A Leonardis, R Stolkin
Publié dans: Pattern Recognition, 2018, ISSN 0031-3203
Éditeur: Pergamon Press

Robust Fusion of Color and Depth Data for RGB-D Target Tracking Using Adaptive Range-Invariant Depth Models and Spatio-Temporal Consistency Constraints

Auteurs: J Xiao, R Stolkin, Y Gao, A Leonardis
Publié dans: IEEE Transactions on Cybernetics, 2018, ISSN 2168-2275
Éditeur: IEEE

Vision-based framework to estimate robot configuration and kinematic constraints.

Auteurs: N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Publié dans: IEEE/ASME Transactions on Mechatronics, 2018, ISSN 1083-4435
Éditeur: Institute of Electrical and Electronics Engineers

Hybrid motion/force control: a review

Auteurs: V Ortenzi, R Stolkin, J Kuo, M Mistry
Publié dans: Advanced Robotics, 2017, ISSN 0169-1864
Éditeur: Taylor & Francis

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Auteurs: Takayuki Osa, Jan Peters, Gerhard Neumann
Publié dans: 2016 International Symposium on Experimental Robotics, Numéro 1, 2017, Page(s) 160-172, ISBN 978-3-319-50114-7
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-50115-4_15

Livrables

Publications

Partager cette page

Télécharger