Final Report Summary - HIFI-PRINTER (high fidelity Presence and Interaction: convergence of computer graphics, vision and robotics for improving human-robot and human-computer interaction)
On one hand, based on the extensive prior research experience of the fellow in computer graphics and real-time virtual character simulation technologies (realistic rendering, natural animation, and believable face & body simulation), a novel mathematical, unified, real-time simulation framework has been researched in this project as one key enabling technology in human-computer interaction. This framework was be based on Geometric Algebra aiming to avoid previous different, disjoint geometric graphics techniques by unifying these heterogeneous character simulation technologies to allow for their seamless abstraction and application in their humanoid robotic counterparts.
One the other hand, the ability of virtual characters or humanoids to visually perceive and understand articulated human motion (be that gestures, actions, expressions, etc) and to appropriately react or imitate this motion depending on the requirements of the specific task at hand is another key enabling technology in which the fellow was trained explicitly by the host FORTH-Computational Vision and Robotics Laboratory in this project. So far the fellow has been utilizing extensively such vision-based techniques in his graphics and presence research career, but most often as “black-boxes” without having being formally introduced to their intrinsic characteristics. The host in this project has exposed directly the fellow in the latest vision and robotics technologies and also empower him to directly implement them via the new unified framework in both robotic humanoids as well as ambient intelligent virtual characters. Via a specialized Career Development Plan, coupled with other vision, robotics and human physiology-related structured and complementary training, the host has provided the ideal theoretical as well as practical validation environment through which the fellow has reached new, unprecedented levels of professional maturity and significantly enhanced and diversified his research career path.
Several significant publications (http://www.ics.forth.gr/hifi-printer/?page_id=95) in the top scientific conferences in the field have been realized (e.g. SIGGRAPH ASIA, Eurographics) as well as a forthcoming book chapter and edited book to be published by Springer Verlag.