Moteur de recherche d’entreprises européennes
Financement de l’UE (3 981 643 €) : Adaptive multi-tier intelligent data manager for Exascale Hor19/03/2021 Programme de recherche et d'innovation de l'UE « Horizon »
Vue d’ensemble
Texte
Adaptive multi-tier intelligent data manager for Exascale
The growing need to process extremely large data sets is one of the main drivers for building exascale HPC systems today. However, the flat storage hierarchies found in classic HPC architectures no longer satisfy the performance requirements of data-processing applications. Uncoordinated file access in combination with limited bandwidth make the centralised back-end parallel file system a serious bottleneck. At the same time, emerging multi-tier storage hierarchies come with the potential to remove this barrier. But maximising performance still requires careful control to avoid congestion and balance computational with storage performance. Unfortunately, appropriate interfaces and policies for managing such an enhanced I/O stack are still lacking. The main objective of the ADMIRE project is to establish this control by creating an active I/O stack that dynamically adjusts computation and storage requirements through intelligent global coordination, malleability of computation and I/O, and the scheduling of storage resources along all levels of the storage hierarchy. To achieve this, we will develop a software-defined framework based on the principles of scalable monitoring and control, separated control and data paths, and the orchestration of key system components and applications through embedded control points. Our software-only solution will allow the throughput of HPC systems and the performance of individual applications to be substantially increased – and consequently energy consumption to be decreased – by taking advantage of fast and power-efficient node-local storage tiers using novel, European ad-hoc storage systems and in-transit/in-situ processing facilities. Furthermore, our enhanced I/O stack will offer quality-of-service (QoS) and resilience. An integrated and operational prototype will be validated with several use cases from various domains, including climate/weather, life sciences, physics, remote sensing, and deep learning.
| Barcelona Supercomputing Center Centro Nacional de Supercomputacion | 304 375 € |
| Cineca Consorzio Interuniversitario | 116 250 € |
| Consorzio Interuniversitario Nazionale Per L'Informatica | 298 750 € |
| Datadirect Networks France | 425 000 € |
| E 4 Computer Engineering S.p.A. | 153 864 € |
| Forschungszentrum Julich GmbH | 300 887 € |
| Institut National de Recherche en Informatique et Automatique | 345 000 € |
| Instytut Chemii Bioorganicznej Polskiej Akademii Nauk | 275 250 € |
| Johannes Gutenberg-Universitat Mainz | 340 563 € |
| Kungliga Tekniska Hoegskolan | 156 438 € |
| MAX-Planck-Gesellschaft ZUR Forderung DER Wissenschaften e. V. | 130 000 € |
| Paratools SAS | 318 425 € |
| Technische Universitat Darmstadt | 432 905 € |
| Universidad Carlos III de Madrid | 383 938 € |
| Universita Degli Studi Di Milano | 0,00 € |
| Universita Degli Studi Di Napoli Parthenope | 0,00 € |
| Universita Degli Studi Di Torino | 0,00 € |
| Universita Di Pisa | 0,00 € |
| Universite de Bordeaux | 0,00 € |
https://cordis.europa.eu/project/id/956748
Cette annonce se réfère à une date antérieure et ne reflète pas nécessairement l’état actuel.