The amount of data gathered, shared and processed in frontier research is set to increase steeply in the coming decade, leading to unprecedented data processing, simulation and analysis needs. In particular, High Energy Physics and Radio Astronomy are gearing up for groundbreaking instruments, necessitating infrastructures many times larger than the current capabilities. In this context, the EU-funded SPECTRUM project brings together leading European science organisations and e-Infrastructure providers to formulate a Strategic Research, Innovation, and Deployment Agenda (SRIDA) along with a Technical Blueprint for a European computer and data continuum. This collaborative effort is set to create an Exabyte-scale research data federation and compute continuum, fostering data-intensive scientific collaborations across Europe.
The Challenge
What is the SPECTRUMCoP?
The SPECTRUM Community of Practice (CoP) aims to create a connected community of scientists and infrastructure managers having a mutual understanding of future needs, associated challenges and their possible solutions.
The goal of the CoP is to serve as a discussion forum across the HEP and RA domains to identify common directions for the design and operations of future systems, agreed processing models and solutions, and to provide feedback on investment to funding agencies and policy makers.
SPECTRUMCoP Working Groups
1
WG1: Data Management and Access
- Data Management – Including data location, movement, and registration.
- Data Access Protocols
- Data Archiving
- Security
Members:
- BAGNASCO Stefano (INFN, ET, Virgo) (CHAIR)
- BOCCALI Tommaso (INFN-PI)
- CARLINO Gianpaolo (INFN-NA)
- FEDE Eric (IN2P3)
- FERRARI Chiara (CNRS, OCA)
- HOLTIES Hanno (ASTRON)
- LASSNIG Mario (CERN)
- LAYCOCK Paul (UniGeneva)
- MANZI Andrea (EGI)
- MASCETTI Luca (CERN)
- MERINO Gonzalo (PIC)
- PATRASCOIU Mihai (CERN)
- PIANO Stefano (INFN)
- TSAREGORODTSEV Andrei (CNRS,IN2P3)
- WAGG Jeff (OCA)
2
WG2: Workflow management and organization
- Resource Discovery and Workflow Submission
- Resource Allocation
- Complex Workflows – including DAGs (Directed Acyclic Graphs), chain and more.
Members:
- BROEKEMA Chris (ASTRON)
- PACHECO PAGES Andreu (CERN)
- ANDRONICO Giuseppe (INFN)
- BOCCALI Tommaso (INFN-PI)
- DELL’AGNELLO Luca (INFN CNAF-T1) (CHAIR)
- FERRARI Chiara (CNRS,OCA)
- HAMAR Vanessa (CNRS, IN2P3)
- IACOBELLI Marco (ASTRON)
- MERINO Gonzalo (PIC)
- ORRU’ Emanuela (ASTRON)
- PEREZ-CALERO YZQUIERDO Antonio (CIEMAT, PIC)
- PIANO Stefano (INFN)
- PICCINELLI Andrea (Notredame)
- SPIGA Daniele (INFN-PG)
- TSAREGORODTSEV Andrei (CNRS,IN2P3)
- WAGG Jeff (OCA)
3
WG3: Compute Environment
- Expected Tools and Services – Describes the tools and services expected at centers, including virtualization and CVMFS (CernVM File System).
- Facility Expectations – Outlines expectations for facilities, including workflow execution times (“be able to execute workflows xx hours long”), memory requirements (“nodes with at least YY GB RAM”), networking capabilities (“networking in/out at least at YY Mbps per core”) and virtualization.
- Edge Services – Discusses edge services needed to establish environment(s).
- Library Provisioning – Discusses the minimal set of libraries and how to provide them, including virtualization, Spack, and module.
Members:
- BOZZI Concezio (INFN, LHCb, JENA-HPC) (CHAIR)
- ANDRONICO Giuseppe (INFN)
- BAGNASCO Stefano (INFN, ET, VIRGO)
- BOCCALI Tommaso (INFN-PI)
- BROEKEMA Chris (ASTRON)
- CAMPOS Isabel (CSIC)
- CESINI Daniele (INFN)
- DE SALVO Alessandro (INFN)
- DOLAR Sagar (SURF)
- FEDE Eric (IN2P3)
- FERRARI Chiara (CNRS, OCA)
- HAMAR Vanessa (CNRS, IN2P3)
- LUTZ Kristen (SURF)
- MERINO Gonzalo (PIC)
- SPIGA Daniele (INFN-PG)
- VALASSI Andrea (CERN)
- WAGG Jeff (OCA)
4
WG4: SW tools
- Machine Learning Frameworks
- Multithreading Frameworks
- Multi-Node Tools – Including MPI (Message Passing Interface) and similar tools
- Compilers, toolchains, …
- Quantum computing tools and frameworks
- Code Management Practices
Members:
- SWINBANK John (Astron) (CHAIR)
- VILOTTE Jean-Pierre (CNRS) (CHAIR)
- ANDRONICO Giuseppe (INFN)
- BOCCALI Tommaso (INFN-PI)
- CAMPOS Isabel (CSIC)
- DI FLORIO Adriano (CERN)
- FERRARI Chiara (CNRS, OCA)
- KRASZNAHORKAY Attila (CERN)
- STEWART Graeme Andrew (CERN)
- SWINBANK John (Astron)
- TEODORESCU Liliana (Brunel)
- VALASSI Andrea (CERN)
- WAGG Jeff (OCA)
- WULFF Eric (CERN)
5
WG5: Scientific Use cases
- Typical Use Cases – Describes typical use cases with quantitative descriptions.
- Requirements and Needs
- Best Practices Collection – Gathers best practices and existing documents.
- Data Fluxes and Paths
Members:
- FERRARI Chiara (CNRS, OCA) (CHAIR)
- GIRONE Maria (CERN) (CHAIR)
- SPECTRUM WP5 members (CHAIRS)
- ANDREOZZI Sergio (EGI)
- ANDRONICO Giuseppe (INFN)
- ANNOVI Alberto (INFN-PI)
- BESWICK Robert (University of Manchester)
- BOCCALI Tommaso (INFN-PI)
- CAMPOS Isabel (CSIC)
- CATMORE James (OSLO)
- COSMAI Dino (University of Bari)
- CREPE-RENAUDIN Sabine (IN2P3)
- CUNNINGHAM Nichol (SKAO)
- FERRARI Chiara (CNRS, OCA)
- GIRONE Maria (CERN)
- GIUSTI Leonardo (University of Milano Bicocca)
- GRANDI Claudio (INFN, CMS, WLCG review team)
- HU Haili (SURF)
- IACOBELLI Marco (ASTRON)
- ORRU’ Emanuela (ASTRON)
- PFALZNER Susanne (Jülich)
- SOUTHWICK David (CERN)
- WALCH-GASSNER Stefanie (University of Koeln)
- WAGG Jeff (OCA)
- WULFF Eric (CERN)
6
WG6: Facilities
- HPC Centers – Discusses drivers and future directions of HPC centers.
- Access to Quantum Computing Hardware
- Access to Commercial and Public Clouds
- Sustainability – Examines economic and carbon footprint aspects.
- Security – Including access and translation from global SSO to local credentials
Members:
- BERBERICH Florian (Jülich) (CHAIR)
- AFFINITO Fabio (Cineca)
- ANDRONICO Giuseppe (INFN)
- BOZZI Concezio (INFN, LHCb, JENA-HPC)
- CAMPOS Isabel (CSIC)
- CE Marco (University of MIlano Bicoccal)
- CESINI Daniele (INFN)
- CIFUENTES Luis (FZJ)
- DELL’AGNELLO Luca (INFN CNAF-T1)
- DOLAS Sagar (SURF)
- ENSSLIN Torsten (Max Planck Institute for Astrophysics)
- FERRARI Chiara (CNRS, OCA)
- HOPPE Hans-Christian (FZJ)
- JANETZKO Florian (FZJ)
- LUTZ Kristen (SURF)
- MASCETTI Luca (CERN)
- MERINO Gonzalo (PIC)
- PATRASCOIU Mihai (CERN)
- PEPE Michele (INFN-MIB)
- PFALZNER Susanne (Jülich)
- TEODORESCU Liliana (Brunel)
- WAGG Jeff (OCA)
- WALKER Rod (Ludwig-Maximilians-Universität München)
Join the SPECTRUM Community of Practice (SPECTRUMCoP)
You can express your interest to join the SPECTRUMCoP by sending an email to spectrumcop-expression-of-interest [AT] mailman.egi.eu. Or by filling in the following form.