Project description
Integrating big data analytics for smart cities
Current big data analytics systems are confined to providing either immediate reactive feedback (data-in-motion) or intensive analysis of vast amounts of data (data-at-rest). This prevents combining the two types of complementary data for processing in real time. The EU-funded CLASS project has developed a novel software architecture that integrates data-in-motion and data-at-rest to allow real-time processing of large amounts of complex data and distribution from edge to cloud. The framework has been demonstrated in mobility applications for smart cities using prototype connected vehicles and an infrastructure capable of processing data in real time from geographically distributed sources, traffic infrastructures, Internet of Things devices and so on.
Objective
Big data applications processing extreme amounts of complex data are nowadays being integrated with even more challenging requirements such as the need of continuously processing vast amount of information in real-time.
Current data analytics systems are usually designed following two conflicting priorities to provide (i) a quick and reactive response (referred to as data-in-motion analysis), possibly in real-time based on continuous data flows; or (ii) a thorough and more computationally intensive feedback (referred to as data-at-rest analysis), which typically implies aggregating more information into larger models. Given the apparently incompatible requirements, these approaches have been tackled separately although they provide complementary capabilities.
CLASS aims to develop a novel software architecture to help big data developers to combine data-in-motion and data-at-rest analysis by efficiently distributing data and process mining along the compute continuum (from edge to cloud) in a complete and transparent way, while providing sound real-time guarantees. CLASS aims at adopting (1) innovative distributed architectures from the high-performance domain; (2) timing analysis methods and energy-efficient parallel architectures from the embedded domain; and (3) data analytics platforms and programming models from the big-data domain.
The capabilities of the CLASS framework will be demonstrated on a real smart-city use case, featuring a heavy sensor infrastructure to collect real-time data across a wide urban area, and prototype cars equipped with heterogeneous sensors/actuators, V2I connectivity, and cluster support to present the innovative capabilities to drivers. Representative applications for traffic management and advanced driving assistance domains have been selected to efficiently process very large heterogeneous data streams in real-time, providing innovative services while preparing the technological background for the advent of autonomous vehicles
Fields of science
Not validated
Not validated
Keywords
Programme(s)
Topic(s)
Funding Scheme
RIA - Research and Innovation actionCoordinator
08034 Barcelona
Spain