Industrial-Driven Big Data as a Self-Service Solution

Project Information

I-BiDaaS

Grant agreement ID: 780787

DOI 10.3030/780787

Project closed

EC signature date 30 October 2017

Start date 1 January 2018

End date 31 December 2020

Funded under

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Total cost € 4 997 035,00

EU contribution € 4 997 035,00

Coordinated by

IDRYMA TECHNOLOGIAS KAI EREVNAS
Greece

Deliverables

Documents, reports (23)

Big-Data-as-a-Self-Service Test and Integration Report v2

This deliverable is a 2nd version of the Big-Data-as-a-Self-Service Test and Integration report [T5.2, T5.3, T5.4].

Universal Messaging Bus (Final Version)

This report will document the I-BiDaaS integrated end-to-end solution for collecting, aggregating, pre-processing and transforming real-time streaming raw data (structured, unstructured, noisy and possibly incomplete) into structured messages of a common, unified, format [T2.2].

Experiments implementation - initial version

This is a initial report on the I-BiDaaS experiments implementation [T6.1, T6.2, T6.3].

The Data Fabrication Platform (DFP, Interim version)

This deliverable will describe the I-BIDaaS automated methodology for fabrication of synthetic and realistic data sets [T2.3].

The Data Fabrication Platform (DFP, Final Version)

This deliverable will describe the I-BIDaaS automated methodology for fabrication of synthetic and realistic data sets [T2.3].

Federated Resource Management for Data Analytics v2

This deliverable is the 2nd version of the report on the I-BiDaaS Federated Resource Management for Data Analytics [T5.1, T5.2].

Batch Processing Analytics module implementation final report

This is the final report in the I-BiDaaS Batch Processing Analytics module implementation [T3.1, T3.2, T3.3, T3.4].

Streaming analytics and predictions

This deliverable will report on the streaming analytics and predictions for I-BiDaaS [T4.1, 4.2, T4.3].

I-BiDaaS visualization and monitoring framework, and a multi-purpose interface

This deliverable will contain the implementation of the interactive visualization and monitoring toolkit for I-BiDaaS [T2.4].

Assessment report and impact analysis

This deliverable will contain an assessment report and impact analysis for I-BiDaaS [T6.4].

Batch Processing Analytics module implementation as part of I-BiDaaS solution

This deliverable will report in the Batch Processing Analytics module implementation as part of I-BiDaaS solution [T3.1, T3.2, T3.3, T3.4].

Federated Resource Management for Data Analytics v3

This deliverable is the final version of the report on the I-BiDaaS Federated Resource Management for Data Analytics [T5.1, T5.2].

Third report on Dissemination strategy and activities

This deliverable is the third year report on the I-BiDaaS Dissemination strategy and activities [T7.2].

Experiments implementation

This deliverable will report on the implementation of the I-BiDaaS experiments [T6.1, T6.2, T6.3].

Positioning of I-BiDaaS

This deliverable will report on the detailed functionality of the I-BiDaaS platform, according to the user’s needs, the state-of-the-art in distributed data and process mining, predictive analytics and real-time complex event processing over extremely large numbers of high volume streams that are produced in project’s industrial domains [T1.1, T1.2, T1.3, T1.4].

Second report on Dissemination strategy and activities

This deliverable is the second year report on the I-BiDaaS Dissemination strategy and activities [T7.2].

First report on Dissemination strategy and activities

This deliverable is the fist year report on the I-BiDaaS Dissemination strategy and activities [T7.2].

Federated Resource Management for Data Analytics v1

This deliverable is the 1st version of the report on the I-BiDaaS Federated Resource Management for Data Analytics [T5.1, T5.2].

Big-Data-as-a-Self-Service Test and Integration Report

This deliverable is a 1st version of the Big-Data-as-a-Self-Service Test and Integration report [T5.2, T5.3, T5.4].

Distributed event-processing engine

This deliverable will report on the I-BiDaaS Distributed event-processing engine [T4.1, 4.2].

Big-Data-as-a-Self-Service Test and Integration Report v3

This deliverable is the final version of the Big-Data-as-a-Self-Service Test and Integration report [T5.2, T5.3, T5.4].

Universal Messaging Bus (Interim Version)

This report will document the I-BiDaaS integrated end-to-end solution for collecting, aggregating, pre-processing and transforming real-time streaming raw data (structured, unstructured, noisy and possibly incomplete) into structured messages of a common, unified, format [T2.2].

Batch Processing Analytics module implementation

This deliverable will report on the I-BiDaaS Batch Processing Analytics module implementation [T3.1, T3.2, T3.3, T3.4].

Demonstrators, pilots, prototypes (1)

Project website

This deliverable the I-BiDaaS Website [T7.2]

Publications

Book chapters (3)

Big Data Analytics in the Manufacturing Sector: Guidelines and Lessons Learned through the Centro Ricerche FIAT (CRF) Case

Author(s): Andreas Alexopoulos; Yolanda Becerra; Omer Boehm; George Bravos; Vassilis Chatzigiannakis; Cesare Cugnasco; Giorgos Demetriou; Iliada Eleftheriou; Spiros Fotis; Gianmarco Genchi; Sotiris Ioannidis; Dusan Jakovetic; Leonidas Kallipolitis; Vlatka Katusic; Evangelia Kavakli; Despina Kopanaki; Christoforos Leventis; Miquel Martínez; Julien Mascolo; Nemanja Milosevic; Enric Pages; Gerald Ristow; Herna
Published in: Technologies and Applications for Big Data Value, Issue 16, 2021
Publisher: Springer Nature Switzerland AG
DOI: 10.5281/zenodo.4540169

Big Data Analytics in the Banking Sector: Guidelines and Lessons Learned from the CaixaBank Case

Author(s): Andreas Alexopoulos; Yolanda Becerra; Omer Boehm; George Bravos; Vasilis Chatzigiannakis; Cesare Cugnasco; Giorgos Demetriou; Iliada Eleftheriou; Lidija Fodor; Spiros Fotis; Sotiris Ioannidis; Dusan Jakovetic; Leonidas Kallipolitis; Vlatka Katusic; Evangelia Kavakli; Despina Kopanaki; Christoforos Leventis; Mario Maawad Marcos; Ramon Martin de Pozuelo; Miquel Martínez; Nemanja Milosevic; Enric Pa
Published in: Technologies and Applications for Big Data Value, Issue 5, 2021
Publisher: Springer Nature Switzerland AG
DOI: 10.5281/zenodo.4540175

Challenges in Resource Provisioning for the Execution of Data Wrangling Workflows on the Cloud: A Case Study

Author(s): Abdullah Khalid A. Almasaud, Agresh Bharadwaj, Sandra Sampaio, Rizos Sakellariou
Published in: Database and Expert Systems Applications - 31st International Conference, DEXA 2020, Bratislava, Slovakia, September 14–17, 2020, Proceedings, Part II, Issue 12392, 2020, Page(s) 66-75, ISBN 978-3-030-59050-5
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-59051-2_5

Conference proceedings (20)

Parallel Differentially Private K-Means Implementation Using COMPSs Framework

Author(s): Sukpisit, Sukgamon; Skrbic, Srdjan; Jakovetic, Dusan
Published in: 10th International Conference on Information Society and Technology (ICIST 2020), Issue 13, 2020, Page(s) 222-225
Publisher: Springer
DOI: 10.5281/zenodo.4314276

Pythia: Scheduling of Concurrent Network Packet Processing Applications on Heterogeneous Devices

Author(s): Giannis Giakoumakis, Eva Papadogiannaki, Giorgos Vasiliadis, Sotiris Ioannidis
Published in: 2020 6th IEEE Conference on Network Softwarization (NetSoft), 2020, Page(s) 145-149, ISBN 978-1-7281-5684-2
Publisher: IEEE
DOI: 10.1109/NetSoft48620.2020.9165447

Towards a Multi-Perspective Methodology for Big Data Requirements

Author(s): Evangelia Kavakli; Rizos Sakellariou,; Iliada Eleftheriou; Julien Etienne Mascolo
Published in: 2020 IEEE International Conference on Big Data (IEEE BigData 2020), Issue 13, 2020
Publisher: IEEE
DOI: 10.5281/zenodo.4317758

High performance encrypted network traffic inspection using hardware accelerators

Author(s): Eva Papadogiannaki; Giorgos Vasiliadis; Sotiris Ioannidis
Published in: The 14th International Conference on emerging Networking EXperiments and Technologies (CoNEXT 2018), Issue 5, 2018
Publisher: ACM
DOI: 10.5281/zenodo.2635460

Please Forget Where I Was Last Summer: The Privacy Risks of Public Location (Meta)Data

Author(s): Kostas Drakonakis, Panagiotis Ilia, Sotiris Ioannidis, Jason Polakis
Published in: Proceedings 2019 Network and Distributed System Security Symposium, Issue Network and Distributed Systems Security (NDSS) Symposium 2019, 2019, ISBN 1-891562-55-X
Publisher: Internet Society
DOI: 10.14722/ndss.2019.23151

Efficient Scheduling for Concurrently Executed Network Packet Processing Applications on Heterogeneous Hardware Architectures

Author(s): Giannis Giakoumakis; Eva Papadogiannaki; Giorgos Vasiliadis; Sotiris Ioannidis
Published in: The 14th International Conference on emerging Networking EXperiments and Technologies (CoNEXT 2018), Issue 8, 2018
Publisher: ACM
DOI: 10.5281/zenodo.2635468

Towards Specification of a Software Architecture for Cross-Sectoral Big Data Applications

Author(s): Arapakis, Ioannis; Becerra, Yolanda; Boehm, Omer; Bravos, George; Chatzigiannakis, Vassilis; Cugnasco, Cesare; Demetriou, Giorgos; Eleftheriou, Iliada; Mascolo, Julien; Fodor, Lidija; Ioannidis, Sotiris; Jakovetic, Dusan; Kallipolitis, Leonidas; Kavakli, Evangelia; Kopanaki, Despina; Kourtellis, Nicolas; Marcos, Mario Maawad; Martin de Pozuelo, Ramon; Milosevic, Nemanja; Morandi, Giuditta; Pages M
Published in: 2019 IEEE World Congress on Services, Issue 7, 2019
Publisher: IEEE
DOI: 10.5281/zenodo.3333486

There goes Wally: Anonymously sharing your location gives you away

Author(s): Apostolos Pyrgelis, Nicolas Kourtellis, Ilias Leontiadis, Joan Serra, Claudio Soriente
Published in: 2018 IEEE International Conference on Big Data (Big Data), 2018, Page(s) 1218-1227, ISBN 978-1-5386-5035-6
Publisher: IEEE
DOI: 10.1109/bigdata.2018.8622184

Spectral-like gradient method for distributed optimization

Author(s): Jakovetic, Dusan; Krejic, Natasa; Krklec Jerinkic, Natasa
Published in: IEEE EUROCON 2019, Issue 3, 2019
Publisher: IEEE
DOI: 10.5281/zenodo.3333533

Distributed Trust-Region Method With First Order Models

Author(s): Armacki, Aleksandar; Jakovetic, Dusan; Krejic, Natasa; Krklec Jerinkic, Natasa
Published in: EUROCON 2019, Issue 1, 2019
Publisher: IEEE
DOI: 10.5281/zenodo.3333539

A Simple Convolutional Generative Network for Next Item Recommendation

Author(s): Fajie Yuan, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose, Xiangnan He
Published in: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining - WSDM '19, 2019, Page(s) 582-590, ISBN 9781-450359405
Publisher: ACM Press
DOI: 10.1145/3289600.3290975

NON-ASYMPTOTIC RATES FOR COMMUNICATION EFFICIENT DISTRIBUTED ZEROTH ORDER STRONGLY CONVEX OPTIMIZATION

Author(s): Anit Kumar Sahu, Dusan Jakovetic, Dragana Bajovic, Soummya Kar
Published in: 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2018, Page(s) 628-632, ISBN 978-1-7281-1295-4
Publisher: IEEE
DOI: 10.1109/globalsip.2018.8646406

Distributed Zeroth Order Optimization Over Random Networks: A Kiefer-Wolfowitz Stochastic Approximation Approach

Author(s): Anit Kumar Sahu, Dusan Jakovetic, Dragana Bajovic, Soummya Kar
Published in: 2018 IEEE Conference on Decision and Control (CDC), 2018, Page(s) 4951-4958, ISBN 978-1-5386-1395-5
Publisher: IEEE
DOI: 10.1109/cdc.2018.8619044

Convergence Rates for Distributed Stochastic Optimization Over Random Networks

Author(s): Dusan Jakovetic, Dragana Bajovic, Anit Kumar Sahu, Soummya Kar
Published in: 2018 IEEE Conference on Decision and Control (CDC), 2018, Page(s) 4238-4245, ISBN 978-1-5386-1395-5
Publisher: IEEE
DOI: 10.1109/cdc.2018.8619228

An Architecture and Stochastic Method for Database Container Placement in the Edge-Fog-Cloud Continuum

Author(s): Kochovski Petar; Sakellariou Rizos; Bajec Marko; Drobintsev Pavel; Stankovski Vlado
Published in: 33rd IEEE International Parallel & Distributed Processing Symposium (IPDPS 2019), Issue 5, 2019
Publisher: IEEE
DOI: 10.5281/zenodo.2548463

Towards a Methodology for Evaluating Big Data Platforms

Author(s): Evangelia Kavakli, Rizos Sakellariou, Vlado Stankovski
Published in: 2019 IEEE World Congress on Services (SERVICES), 2019, Page(s) 380-381, ISBN 978-1-7281-3851-0
Publisher: IEEE
DOI: 10.1109/services.2019.00113

GPU-accelerated encrypted network traffic inspection

Author(s): Eva Papadogiannaki, Sotiris Ioannidis
Published in: ACM Celebration of Women in Computing: womENcourage 2019 (womENcourage 2019), 2019
Publisher: ACM
DOI: 10.5281/zenodo.3472929

TrustAV - Practical and Privacy Preserving Malware Analysis in the Cloud

Author(s): Dimitris Deyannis, Eva Papadogiannaki, Giorgos Kalivianakis, Giorgos Vasiliadis, Sotiris Ioannidis
Published in: Proceedings of the Tenth ACM Conference on Data and Application Security and Privacy, 2020, Page(s) 39-48, ISBN 9781450371070
Publisher: ACM
DOI: 10.1145/3374664.3375748

The OTree: Multidimensional Indexing with efficient data Sampling for HPC

Author(s): Cesare Cugnasco, Hadrien Calmet, Pol Santamaria, Raul Sirvent, Ane Beatriz Eguzkitza, Guillaume Houzeaux, Yolanda Becerra, Jordi Torres, Jesus Labarta
Published in: 2019 IEEE International Conference on Big Data (Big Data), 2019, Page(s) 433-440, ISBN 978-1-7281-0858-2
Publisher: IEEE
DOI: 10.1109/bigdata47090.2019.9006121

Head(er)Hunter: Fast Intrusion Detection using Packet Metadata Signatures

Author(s): Eva Papadogiannaki, Dimitris Deyannis, Sotiris Ioannidis
Published in: 2020 IEEE 25th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), 2020, Page(s) 1-6, ISBN 978-1-7281-6339-0
Publisher: IEEE
DOI: 10.1109/camad50429.2020.9209308

Thesis and dissertations (1)

A framework for multidimensional indexes on distributed and highly-available data stores

Author(s): Cesare Cugnasco, Yolanda Becerra, Jordi Torres
Published in: 2019
Publisher: Universitat Politècnica de Catalunya

Peer reviewed articles (4)

Communication efficient distributed weighted non-linear least squares estimation

Author(s): Anit Kumar Sahu, Dusan Jakovetic, Dragana Bajovic, Soummya Kar
Published in: EURASIP Journal on Advances in Signal Processing, Issue 2018/1, 2018, Page(s) 1-15, ISSN 1687-6180
Publisher: Springer
DOI: 10.1186/s13634-018-0586-0

Distributed second order methods with increasing number of working nodes

Author(s): Natasa Krklec Jerinkic, Dusan Jakovetic, Natasa Krejic, Dragana Bajovic
Published in: IEEE Transactions on Automatic Control, 2019, Page(s) 1-1, ISSN 0018-9286
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tac.2019.2922191

Acceleration of Intrusion Detection in Encrypted Network Traffic Using Heterogeneous Hardware

Author(s): Eva Papadogiannaki, Sotiris Ioannidis
Published in: Sensors, Issue 21/4, 2021, Page(s) 1140, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21041140

Exact spectral-like gradient method for distributed optimization

Author(s): Dušan Jakovetić, Nataša Krejić, Nataša Krklec Jerinkić
Published in: Computational Optimization and Applications, Issue 74/3, 2019, Page(s) 703-728, ISSN 0926-6003
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10589-019-00131-8

Other (1)

I-BiDaaS: Industrial-Driven Big Data as a Self-Service Solution

Author(s): Giorgos Vasiliadis; Dusan Jakovetic; Ilias Spais; Sotiris Ioannidis
Published in: 7th European Conference on Service-Oriented and Cloud Computing – EU Project Space track (ESOCC 2018), Issue 1, 2019
Publisher: Springer
DOI: 10.5281/zenodo.3355416