Project description
Optimising all levels of software to drive excellence in European exascale computing
Extreme-scale computing is enabling simulations of virtually limitless phenomena of unprecedented size and complexity. The underlying architectures and hardware capabilities are advancing fast, and challenges abound, especially in the context of hardware heterogeneity, where orchestration of compute, memory and storage capabilities is needed to ensure energy efficiency and sustainability with an eye on future conditions and developments. The EU-funded DEEP-SEA project is building upon proven software packages to create an open-source environment optimally supporting heterogeneous and modular supercomputers, guided by codesign with applications from seven high-impact scientific fields. Adapting all levels of the software stack will bring benefits to EU innovators and economies.
Objective
DEEP-SEA (“DEEP – Software for Exascale Architectures”) will deliver the programming environment for future European exascale systems, adapting all levels of the software (SW) stack – including low-level drivers, computation and communication libraries, resource management, and programming abstractions with associated runtime systems and tools – to support highly heterogeneous compute and memory configurations and to allow code optimisation across existing and future architectures and systems
At node-level the European Processor Initiative (EPI) will integrate general purpose CPUs and accelerators within the package and combine DDR and HBM memories. Consequently, DEEP-SEA will implement data placement policies for deep memory hierarchies, improving application performance on future EPI-based platforms. At system-level, CPUs and accelerators (e.g. various EPI chip configurations, or GPUs) are efficiently integrated following the Modular Supercomputer Architecture (MSA). The DEEP-SEA SW stack will enable dynamic resource allocation, application malleability, programming composability, and include tools to map applications to the MSA. Result is a SW environment enabling applications to run on the best suited hardware, in a scalable, and energy efficient manner.
Targeting a high Technology Readiness Level (TRL), the project builds upon SW developments from previous EU-projects and international open source packages widely used in the HPC community, extending them with focus on compute and memory heterogeneity. This enables close collaborations within the HPC community and Centres of Excellence (CoEs). The DEEP-SEA SW elements will be extended in a collaborative co-design approach with EU-applications, considering relations and dependencies between the various levels of the stack. Therefore, ambitious and highly-relevant EU-applications will drive the co-design, evaluate the DEEP-SEA software stack, and demonstrate its benefits for users of European compute centres.
Fields of science
Keywords
Programme(s)
Funding Scheme
RIA - Research and Innovation actionCoordinator
52428 Julich
Germany