Periodic Reporting for period 2 - REPLICATE (cReative-asset harvEsting PipeLine to Inspire Collective-AuThoring and Experimentation)
Période du rapport: 2017-07-01 au 2018-12-31
MOTIVATION:
The REPLICATE consortium recognises the needs of Europe's Creativity Industries in three specific, interrelated areas that are hindering innovation in the sector:
1) Asset production: Synthetically-generated 3D-assets are expensive and time consuming to create. Likewise, the production of digital clones of real-world objects either requires professional setups to achieve realistic replications or models lack quality and flexibility when captured with consumer-grade devices.
2) Asset inflexibility: Objects cannot be reused across the spectrum of creative domains (e.g. Augmented Reality (AR), Virtual Reality (VR), Gaming, 3D printing, design, etc.).
3) High entry requirements: Digital creative environments and tools to enable this are non-intuitive, non-portable, expensive to setup, and require expert use.
These issues inspired the REPLICATE team to realise a project that would satiate the Creative Industries’ growing demand for new forms of diverse 3D assets and revolutionary constructor tools. We believe that the utilisation of new user experiences like AR and Mixed Reality (MR) into the Creativity pipeline could make the experience fun, engaging, flexible and more effective.
OBJECTIVES:
REPLICATE’s main goal is to stimulate and support collaborative creativity for everyone anywhere and anytime (ubiquitous co-creativity). To achieve this goal, the project will address different aspects that currently complicate the process of content creation and collaborative co-creation.
We will exploit the growing performance and ubiquity of Smartphones and Tablets combined with the increasing speed of data networks to enable the creation and reuse of digital assets through collaborative user participation. Social platforms, immersive games and MR technologies reinforce such developments through their ‘attractivity’ value and user acceptance, thereby delivering high citizen penetration potential.
REPLICATE aims to build upon leading research into the use of Smartphones and their sensors to deliver robust image-based 3D reconstruction of objects and their surroundings via highly visual, tactile and haptic user interfaces. In order to deliver real-time, interactive tools for high-quality 3D asset production, the project will balance device-based vs. cloud-based computational loading, rather than simply replacing regular computers by mobile devices. In this way, REPLICATE will facilitate everyone to take part in the creative process, anywhere and anytime, through a seamless user experience, ranging from the capturing of the real-world, modifying and adjusting objects for flexible usage, and then finally repurposing them via co-creative, MR workspaces to form novel creative media or through physical expression via rapid prototyping.
The REPLICATE consortium recognises the needs of Europe's Creativity Industries in three specific, interrelated areas that are hindering innovation in the sector:
1) Asset production: Synthetically-generated 3D-assets are expensive and time consuming to create. Likewise, the production of digital clones of real-world objects either requires professional setups to achieve realistic replications or models lack quality and flexibility when captured with consumer-grade devices.
2) Asset inflexibility: Objects cannot be reused across the spectrum of creative domains (e.g. Augmented Reality (AR), Virtual Reality (VR), Gaming, 3D printing, design, etc.).
3) High entry requirements: Digital creative environments and tools to enable this are non-intuitive, non-portable, expensive to setup, and require expert use.
These issues inspired the REPLICATE team to realise a project that would satiate the Creative Industries’ growing demand for new forms of diverse 3D assets and revolutionary constructor tools. We believe that the utilisation of new user experiences like AR and Mixed Reality (MR) into the Creativity pipeline could make the experience fun, engaging, flexible and more effective.
OBJECTIVES:
REPLICATE’s main goal is to stimulate and support collaborative creativity for everyone anywhere and anytime (ubiquitous co-creativity). To achieve this goal, the project will address different aspects that currently complicate the process of content creation and collaborative co-creation.
We will exploit the growing performance and ubiquity of Smartphones and Tablets combined with the increasing speed of data networks to enable the creation and reuse of digital assets through collaborative user participation. Social platforms, immersive games and MR technologies reinforce such developments through their ‘attractivity’ value and user acceptance, thereby delivering high citizen penetration potential.
REPLICATE aims to build upon leading research into the use of Smartphones and their sensors to deliver robust image-based 3D reconstruction of objects and their surroundings via highly visual, tactile and haptic user interfaces. In order to deliver real-time, interactive tools for high-quality 3D asset production, the project will balance device-based vs. cloud-based computational loading, rather than simply replacing regular computers by mobile devices. In this way, REPLICATE will facilitate everyone to take part in the creative process, anywhere and anytime, through a seamless user experience, ranging from the capturing of the real-world, modifying and adjusting objects for flexible usage, and then finally repurposing them via co-creative, MR workspaces to form novel creative media or through physical expression via rapid prototyping.
Maximise social and economic impact:
We aimed to achieve sustainable growth in the CCI sector by focusing our dissemination and exploitation activities in a wide range of Creative Industry subsectors and existing clusters where growth potential is greatest. We aimed to stimulate indirect impact via new businesses, applications and services in ‘spill-overs’ in other economic areas such as tourism or Cultural Heritage, fueling content for ICT, benefits for education, social inclusion and social innovation, underpinned by direct links to business incubation activities.
IMPACT: The project has provided solid advancements in many creative areas, including AR, VR and 360 video, which impact directly on a huge spectrum of creative people that utilise these technologies in their workflow, through to swift design visualisation in areas such as Architecture and the realisation of design prototypes. The major novel contributions of the project are in the integration of state-of-the-art computer vision and 3D analysis algorithms with methods and tools from the rapidly evolving ICT areas of computer vision, mobile/cloud computing/storage and social/gaming platforms to provide a new, low-cost, and user-friendly framework for the Creative Industries in general.
We aimed to achieve sustainable growth in the CCI sector by focusing our dissemination and exploitation activities in a wide range of Creative Industry subsectors and existing clusters where growth potential is greatest. We aimed to stimulate indirect impact via new businesses, applications and services in ‘spill-overs’ in other economic areas such as tourism or Cultural Heritage, fueling content for ICT, benefits for education, social inclusion and social innovation, underpinned by direct links to business incubation activities.
IMPACT: The project has provided solid advancements in many creative areas, including AR, VR and 360 video, which impact directly on a huge spectrum of creative people that utilise these technologies in their workflow, through to swift design visualisation in areas such as Architecture and the realisation of design prototypes. The major novel contributions of the project are in the integration of state-of-the-art computer vision and 3D analysis algorithms with methods and tools from the rapidly evolving ICT areas of computer vision, mobile/cloud computing/storage and social/gaming platforms to provide a new, low-cost, and user-friendly framework for the Creative Industries in general.