DEEP - Extreme Scale Technologies | DEEP-EST | Project | Results | H2020 | CORDIS

Rezultaty

Design, access information and initial contents for the training repository.

Initial software implementation of all software components. Report on status of their integration, functionality and capabilities.

Complete system-SW implementation

Full software implementation with the full required functionality, ready for deployment on the DEEP EST prototype.

Prototype programming environment implementation

Initial programming environment setup ready to be tested, including all involved components and interfaces.

Complete programming environment implementation

Fully functional and optimised programming environment available and ready to be deployed on the prototype.

Application use cases and traces

Use cases integrated in JUBE and Extrae trace files provided to WP2

Final DEEP-EST prototype report

Description of the final DEEP-EST prototype, including all its modules and components: CM, ESB, DAM, FN, fabri3, NAM and GCE, and a description of the infrastructure preparation and the prototype’s installation process.

Quality control plan

Definition of the quality control processes and templates for internal verification and document review for all project results and deliverables.

Policy briefing

Briefing for political deciders and lobbying groups detailing conclusions from project results and impact on HPC development in Europe.

Modular Supercomputer architecture assessment and outlook

Summary of architecture experience, outlook, and recommendations for future improvements.

Prototype assessment

Results of verification tests.

Final report on applications experience

Report performance improvements over the project, compare with other platforms, and detail porting efforts and ease-of-use.

Programming environment support report

Report on final optimisations and summary of the maintenance experience (e.g. installation on the system, bug correction, user feedback).

Tests for prototype assessment

Tests to be run on the prototype constructed in WP4 to make sure that it fulfils the specifications and criteria specified in D3.2.

Communication plan, toolkit and owned channels

Details of the communication and brand strategy including a toolkit with materials like logos and collateral templates and DEEP EST communication channels.

Design and specification of programming environment

Detailed specification of the overall programming model.

Initial application analysis and models

Initial results of the application analysis, modelling approach and first set of models created.

Software specification

High level specifications of the complete system software stack, including description of interfaces and interdependencies between the packages.

DEEP-EST benchmark suites

Describe the selected application and low-level benchmarks, and the workloads to be used by Tk2.1 and Tk2.2.

Application distribution strategy

Details the use of modules by the applications, including partitioning and mapping of the different parts to modules.

Software support report

Report on final software optimisations and summary of the maintenance experience (e.g. installation on the system, bug correction, user feedback).

Collection of software requirements

List of requirements that the WP5 and WP6 software must fulfil, and preliminary specification of the overall software architecture.

Final report

Description of the technical and scientific results of the project.

Application co-design input

Documents requirements of all applications for co-design; includes all data analytics SW requirements, compute, memory & communication performance, footprints, communication patterns, etc.

Benchmarking, evaluation and prediction report

Report detailing the benchmarking results in Tk2.1 and Tk2.2, as well as the final application models and Exascale predictions of Tk2.3 and Tk2.4.

Case study booklet

Success stories and best practices gained from the early access program.

Final outreach activity

Final brochure or project video, or an event or a combination of these. It will be decided during the project which will be deemed most appropriate.

Publikacje

DCDB Wintermute: Enabling Online and Holistic Operational Data Analytics on HPC Systems

Autorzy: Alessio Netti, Micha Müller, Carla Guillen, Michael Ott, Daniele Tafani, Gence Ozer, Martin Schulz
Opublikowane w: Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing, 2020, Strona(/y) 101-112, ISBN 9781450370523
Wydawca: ACM
DOI: 10.1145/3369583.3392674

A Linux Kernel Scheduler Extension for Multi-core Systems

Autorzy: Aleix Roca, Samuel Rodriguez, Albert Segura, Kevin Marquet, Vicenc Beltran
Opublikowane w: 2019 IEEE 26th International Conference on High Performance Computing, Data, and Analytics (HiPC), 2019, Strona(/y) 353-362, ISBN 978-1-7281-4535-8
Wydawca: IEEE
DOI: 10.1109/hipc.2019.00050

Towards Data-Flow Parallelization for Adaptive Mesh Refinement Applications

Autorzy: Kevin Sala, Alejandro Rico, Vicenc Beltran
Opublikowane w: 2020 IEEE International Conference on Cluster Computing (CLUSTER), 2020, Strona(/y) 314-325, ISBN 978-1-7281-6677-3
Wydawca: IEEE
DOI: 10.1109/cluster49012.2020.00042

From facility to application sensor data - modular, continuous and holistic monitoring with DCDB

Autorzy: Alessio Netti, Micha Müller, Axel Auweter, Carla Guillen, Michael Ott, Daniele Tafani, Martin Schulz
Opublikowane w: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Strona(/y) 1-27, ISBN 9781450362290
Wydawca: ACM
DOI: 10.1145/3295500.3356191

Application-Level Differential Checkpointing for HPC Applications with Dynamic Datasets

Autorzy: Kai Keller, Leonardo Bautista-Gomez
Opublikowane w: 2019 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), Numer Larnaca, Cyprus, 2019, Strona(/y) 52-61, ISBN 978-1-7281-0912-1
Wydawca: IEEE
DOI: 10.1109/ccgrid.2019.00015

Supercomputer Evolution at JSC

Autorzy: Estela Suarez; Eicker, Norbert; Lippert, Thomas
Opublikowane w: Jülich : John von Neumann Institute for Computing, Publication Series of the John von Neumann Institute for Computing (NIC) NIC Series 49, 1 - 12 (2018)., Numer 20, 2018, Strona(/y) 1-12, ISBN 978-3-95806-285-6
Wydawca: John von Neumann Institute

Radio-Astronomical Imaging with WSClean and Image-Domain Gridding

Autorzy: B. Veenboer, S. Van der Tol, A.R. Offringa, J.W. Romein, T.J. Dijkema
Opublikowane w: 2020 XXXIIIrd General Assembly and Scientific Symposium of the International Union of Radio Science, 2020
Wydawca: IEEE
DOI: 10.23919/ursigass49373.2020.9232218

Visualizing and Interpreting Unsupervised Solar Wind Classifications

Autorzy: Amaya, Jorge; Dupuis, Romain; Innocenti, Maria Elena; Lapenta, Giovanni
Opublikowane w: Front. Astron. Space Sci., Numer 1, 2020
Wydawca: Frontiers Media S.A.
DOI: 10.3389/fspas.2020.553207

Scalable Workflows for Remote Sensing Data Processing with the Deep-Est Modular Supercomputing Architecture

Autorzy: Ernir Erlingsson, Gabriele Cavallaro, Helmut Neukirchen, Morris Riedel
Opublikowane w: IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, 2019, Strona(/y) 5905-5908, ISBN 978-1-5386-9154-0
Wydawca: IEEE
DOI: 10.1109/igarss.2019.8898487

On the Applicability of PEBS based Online Memory Access Tracking for Heterogeneous Memory Management at Scale

Autorzy: Aleix Roca Nonell, Balazs Gerofi, Leonardo Bautista-Gomez, Dominique Martinet, Vicenç Beltran Querol, and Yutaka Ishikawa
Opublikowane w: MCHPC'18: Workshop on Memory Centric High Performance Computing, Numer 2018, 2018, Strona(/y) 50-57
Wydawca: ACM
DOI: 10.1145/3286475.3286477

Facilitating collaboration in high-performance computing projects with an interaction room

Autorzy: Matthias Book, Morris Riedel, Helmut Neukirchen, Markus Götz
Opublikowane w: Proceedings of the 4th ACM SIGPLAN International Workshop on Software Engineering for Parallel Systems - SEPS 2017, 2017, Strona(/y) 46-47, ISBN 9781-450355179
Wydawca: ACM Press
DOI: 10.1145/3141865.3142467

Supporting Software Engineering Practices in the Development of Data-Intensive HPC Applications with the JuML Framework

Autorzy: Markus Götz, Matthias Book, Christian Bodenstein, Morris Riedel
Opublikowane w: Proceedings of the 1st International Workshop on Software Engineering for High Performance Computing in Computational and Data-enabled Science & Engineering - SE-CoDeSE'17, 2017, Strona(/y) 1-8, ISBN 9781-450351355
Wydawca: ACM Press
DOI: 10.1145/3144763.3144765

Supercomputing Evolution at JSC

Autorzy: Suarez, Estela; Eicker, Norbert; Lippert, Thomas
Opublikowane w: Jülich : John von Neumann Institute for Computing, Publication Series of the John von Neumann Institute for Computing (NIC) NIC Series, 49, 1 - 12 (2018)., Numer 1, 2018
Wydawca: John von Neumann Institute for Computing

Scaling DBSCAN towards exascale computing for clustering of big data sets

Autorzy: E. Erlingsson, G. Cavallaro, M. Riedel, H. Neukirchen
Opublikowane w: Abstract at European Geosciences Union (EGU) General Assembly 2018. Geophysical Research Abstracts Vol. 20, 2018
Wydawca: Copernicus Publications

PowerSensor 2: A Fast Power Measurement Tool

Autorzy: John W. Romein, Bram Veenboer
Opublikowane w: 2018 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2018, Strona(/y) 111-113, ISBN 978-1-5386-5010-3
Wydawca: IEEE
DOI: 10.1109/ISPASS.2018.00020

The Influence of Sampling Methods on Pixel-Wise Hyperspectral Image Classification with 3D Convolutional Neural Networks

Autorzy: Julius Lange, Gabriele Cavallaro, Markus Gotz, Ernir Erlingsson, Morris Riedel
Opublikowane w: IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, 2018, Strona(/y) 2087-2090, ISBN 978-1-5386-7150-4
Wydawca: IEEE
DOI: 10.1109/igarss.2018.8518671

Modular supercomputing design supporting machine learning applications

Autorzy: E. Erlingsson, G. Cavallaro, A. Galonska, M. Riedel, H. Neukirchen
Opublikowane w: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2018, Strona(/y) 0159-0163, ISBN 978-953-233-095-3
Wydawca: IEEE
DOI: 10.23919/MIPRO.2018.8400031

Application Performance on a Cluster-Booster System

Autorzy: Anke Kreuzer, Norbert Eicker, Jorge Amaya, Estela Suarez
Opublikowane w: 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2018, Strona(/y) 69-78, ISBN 978-1-5386-5555-9
Wydawca: 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
DOI: 10.1109/IPDPSW.2018.00019

Scaling Support Vector Machines Towards Exascale Computing for Classification of Large-Scale High-Resolution Remote Sensing Images

Autorzy: Ernir Erlingsson, Gabriele Cavallaro, Morris Riedel, Helmut Neukirchen
Opublikowane w: IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, 2018, Strona(/y) 1792-1795, ISBN 978-1-5386-7150-4
Wydawca: IEEE
DOI: 10.1109/IGARSS.2018.8517378

Evaluating SLURM Simulator with Real-Machine SLURM and Vice Versa

Autorzy: Ana Jokanovic, Marco D'Amico, Julita Corbalan
Opublikowane w: 2018 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS), 2018, Strona(/y) 72-82, ISBN 978-1-7281-0182-8
Wydawca: IEEE
DOI: 10.1109/pmbs.2018.8641556

Enhancing Remote Sensing Applications towards Exascalewith the DEEP-EST Modular Supercomputer Architecture

Autorzy: Cavallaro, Gabriele; Erlingsson, Ernir; Riedel, Morris; Neukirchen, Helmut
Opublikowane w: Phi-week - ESA, Frascati, Italy, 2018-11-12 - 2018-11-16, Numer 1, 2018
Wydawca: EASC 2018

The DEEP-ER Project: I/O and Resiliency Extensions for the Cluster-Booster Architecture

Autorzy: Anke Kreuzer, Jorge Amaya, Norbert Eicker, Raphael Leger, Estela Suarez
Opublikowane w: 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), 2018, Strona(/y) 109-116, ISBN 978-1-5386-6614-2
Wydawca: IEEE
DOI: 10.1109/HPCC/SmartCity/DSS.2018.00046

Evaluating Worksharing Tasks on Distributed Environments

Autorzy: Marcos Maronas, Xavier Teruel, J. Mark Bull, Eduard Ayguade, Vicenc Beltran
Opublikowane w: 2020 IEEE International Conference on Cluster Computing (CLUSTER), 2020, Strona(/y) 69-80, ISBN 978-1-7281-6677-3
Wydawca: IEEE
DOI: 10.1109/cluster49012.2020.00017

Remote Sensing Data Analytics with the Udocker Container Tool using Multi-GPU Deep Learning Systems

Autorzy: Gabriele Cavallaro , Valentin Kozlov , Markus Götz , Morris Riedel
Opublikowane w: Proc. of the 2019 conference on Big Data from Space (BiDS’2019), 2019
Wydawca: Publications Office of the European Union
DOI: 10.2760/848593

Multi-Scale Convolutional SVM Networks for Multi-Class Classification Problems of Remote Sensing Images

Autorzy: Gabriele Cavallaro, Yakoub Bazi, Farid Melgani, Morris Riedel
Opublikowane w: IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, 2019, Strona(/y) 875-878, ISBN 978-1-5386-9154-0
Wydawca: IEEE
DOI: 10.1109/IGARSS.2019.8899831

Worksharing Tasks: An Efficient Way to Exploit Irregular and Fine-Grained Loop Parallelism

Autorzy: Marcos Maronas, Kevin Sala, Sergi Mateo, Eduard Ayguade, Vicenc Beltran
Opublikowane w: 2019 IEEE 26th International Conference on High Performance Computing, Data, and Analytics (HiPC), 2019, Strona(/y) 383-394, ISBN 978-1-7281-4535-8
Wydawca: IEEE
DOI: 10.1109/HiPC.2019.00053

Enabling exible job scheduling for heterogeneous modular supercomputers

Autorzy: Ana Jokanovic, Julita Corbalan
Opublikowane w: Advances in Computational Biology Conference (AdvCompBio) 2019, 2019
Wydawca: Barcelona Supercomputing Center
DOI: 10.7490/f1000research.1117727.1

Correlation-wise Smoothing: Lightweight Knowledge Extraction for HPC Monitoring Data

Autorzy: Netti, Alessio; Tafani, Daniele; Ott, Michael; Schulz, Martin
Opublikowane w: 35th IEEE International Parallel & Distributed Processing Symposium, Numer accepted for publication, to be published, 2021
Wydawca: IEEE

Modular Supercomputing Architecture: From Idea to Production

Autorzy: Estela Suarez, Norbert Eicker, Thomas Lippert
Opublikowane w: Contemporary High Performance Computing - From Petascale toward Exascale, Numer 3, 2019, Strona(/y) 223-255, ISBN 9781351036863
Wydawca: CRC Press
DOI: 10.1201/9781351036863-9

Performance Study of Non-volatile Memories on a High-End Supercomputer

Autorzy: Leonardo Bautista Gomez, Kai Keller, Osman Unsal
Opublikowane w: High Performance Computing - ISC High Performance 2018 International Workshops, Frankfurt/Main, Germany, June 28, 2018, Revised Selected Papers, Numer 11203, 2018, Strona(/y) 145-156, ISBN 978-3-030-02464-2
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-02465-9_10

Introducing the Task-Aware Storage I/O (TASIO) Library

Autorzy: Aleix Roca Nonell, Vicenç Beltran Querol, Sergi Mateo Bellido
Opublikowane w: OpenMP: Conquering the Full Hardware Spectrum - 15th International Workshop on OpenMP, IWOMP 2019, Auckland, New Zealand, September 11–13, 2019, Proceedings, Numer 11718, 2019, Strona(/y) 274-288, ISBN 978-3-030-28595-1
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-28596-8_19

Enhancing Resource Management Through Prediction-Based Policies

Autorzy: Antoni Navarro, Arthur F. Lorenzon, Eduard Ayguadé, Vicenç Beltran
Opublikowane w: Euro-Par 2020: Parallel Processing - 26th International Conference on Parallel and Distributed Computing, Warsaw, Poland, August 24–28, 2020, Proceedings, Numer 12247, 2020, Strona(/y) 493-509, ISBN 978-3-030-57674-5
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-57675-2_31

Radio-Astronomical Imaging: FPGAs vs GPUs

Autorzy: Bram Veenboer, John W. Romein
Opublikowane w: Euro-Par 2019: Parallel Processing - 25th International Conference on Parallel and Distributed Computing, Göttingen, Germany, August 26–30, 2019, Proceedings, Numer 11725, 2019, Strona(/y) 509-521, ISBN 978-3-030-29399-4
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-29400-7_36

Editorial: Reproducibility and Rigour in Computational Neuroscience

Autorzy: Sharon M. Crook, Andrew P. Davison, Robert A. McDougal, Hans Ekkehard Plesser
Opublikowane w: Frontiers in Neuroinformatics, Numer 14, 2020, ISSN 1662-5196
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fninf.2020.00023

Embedding particle-in-cell simulations in global magnetohydrodynamic simulations of the magnetosphere

Autorzy: Raymond J. Walker, Giovanni Lapenta, Jean Berchem, Mostafa El-Alaoui, David Schriver
Opublikowane w: Journal of Plasma Physics, Numer 85/1, 2019, ISSN 0022-3778
Wydawca: Cambridge University Press
DOI: 10.1017/s0022377819000072

ECsim-CYL: Energy Conserving Semi-Implicit particle in cell simulation in axially symmetric cylindrical coordinates

Autorzy: Diego Gonzalez-Herrero, Alfredo Micera, Elisabetta Boella, Jaeyoung Park, Giovanni Lapenta
Opublikowane w: Computer Physics Communications, Numer 236, 2019, Strona(/y) 153-163, ISSN 0010-4655
Wydawca: Elsevier BV
DOI: 10.1016/j.cpc.2018.10.026

Efficient Communication in Distributed Simulations of Spiking Neuronal Networks With Gap Junctions

Autorzy: Jakob Jordan, Moritz Helias, Markus Diesmann, Susanne Kunkel
Opublikowane w: Frontiers in Neuroinformatics, Numer 14, 2020, Strona(/y) 12, ISSN 1662-5196
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fninf.2020.00012

Extending the OpenCHK Model with advanced checkpoint features

Autorzy: Marcos Maroñas, Sergi Mateo, Kai Keller, Leonardo Bautista-Gomez, Eduard Ayguadé, Vicenç Beltran
Opublikowane w: Future Generation Computer Systems, Numer 112, 2020, Strona(/y) 738-750, ISSN 0167-739X
Wydawca: Elsevier BV
DOI: 10.1016/j.future.2020.06.003

The Scientific Case for Brain Simulations

Autorzy: Gaute T. Einevoll, Alain Destexhe, Markus Diesmann, Sonja Grün, Viktor Jirsa, Marc de Kamps, Michele Migliore, Torbjørn V. Ness, Hans E. Plesser, Felix Schürmann
Opublikowane w: Neuron, Numer 102/4, 2019, Strona(/y) 735-744, ISSN 0896-6273
Wydawca: Cell Press
DOI: 10.1016/j.neuron.2019.03.027

Reproducing Polychronization: A Guide to Maximizing the Reproducibility of Spiking Network Models

Autorzy: Robin Pauli, Philipp Weidel, Susanne Kunkel, Abigail Morrison
Opublikowane w: Frontiers in Neuroinformatics, Numer 12, 2018, ISSN 1662-5196
Wydawca: Frontiers Research Foundation
DOI: 10.3389/fninf.2018.00046

Accelerating Hybrid Monte Carlo simulations of the Hubbard model on the hexagonal lattice

Autorzy: Stefan Krieg, Thomas Luu, Johann Ostmeyer, Philippos Papaphilippou, Carsten Urbach
Opublikowane w: Computer Physics Communications, Numer 236, 2019, Strona(/y) 15-25, ISSN 0010-4655
Wydawca: Elsevier BV
DOI: 10.1016/j.cpc.2018.10.008

Performance analysis and implementation details of the Energy Conserving Semi-Implicit Method code (ECsim)

Autorzy: Diego Gonzalez-Herrero, Elisabetta Boella, Giovanni Lapenta
Opublikowane w: Computer Physics Communications, Numer 229, 2018, Strona(/y) 162-169, ISSN 0010-4655
Wydawca: Elsevier BV
DOI: 10.1016/j.cpc.2018.03.020

DEEP - Extreme Scale Technologies

Rezultaty

Publikacje

Udostępnij tę stronę

Pobierz