The amount of data gathered, shared and processed in frontier research is set to increase steeply in the coming decade, leading to unprecedented data processing, simulation and analysis needs. In particular, High Energy Physics and Radio Astronomy are gearing up for groundbreaking instruments, necessitating infrastructures many times larger than the current capabilities. In this context, the EU-funded SPECTRUM project brings together leading European science organisations and e-Infrastructure providers to formulate a Strategic Research, Innovation, and Deployment Agenda (SRIDA) along with a Technical Blueprint for a European computer and data continuum. This collaborative effort is set to create an Exabyte-scale research data federation and compute continuum, fostering data-intensive scientific collaborations across Europe.
The Challenge
What is the SPECTRUMCoP?
The SPECTRUM Community of Practice (CoP) aims to create a connected community of scientists and infrastructure managers having a mutual understanding of future needs, associated challenges and their possible solutions.
The goal of the CoP is to serve as a discussion forum across the HEP and RA domains to identify common directions for the design and operations of future systems, agreed processing models and solutions, and to provide feedback on investment to funding agencies and policy makers.
SPECTRUMCoP Working Groups
1
- Data Management – Including data location, movement, and registration.
- Data Access Protocols
- Data Archiving
- Security
Members:
- BAGNASCO Stefano (INFN, ET, Virgo) (CHAIR)
- BOCCALI Tommaso (INFN-PI)
- CARLINO Gianpaolo (INFN-NA)
- HOLTIES Hanno (ASTRON)
- LASSNIG Mario (CERN)
- LAYCOCK Paul (UniGeneva)
- MASCETTI Luca (CERN)
- MERINO Gonzalo (PIC)
- PATRASCOIU Mihai (CERN)
- PIANO Stefano (INFN)
- WAGG Jeff (Freelance at the moment (previously SKAO))
2
- Resource Discovery and Workflow Submission
- Resource Allocation
- Complex Workflows – including DAGs (Directed Acyclic Graphs), chain and more.
Members:
- DELL’AGNELLO Luca (INFN CNAF-T1) (CHAIR)
- ANDRONICO Giuseppe (INFN)
- BOCCALI Tommaso (INFN-PI)
- BROEKEMA Chris (ASTRON)
- IACOBELLI Marco (ASTRON)
- MERINO Gonzalo (PIC)
- ORRU’ Emanuela (ASTRON)
- PACHECO PAGES Andreu (CERN)
- PIANO Stefano (INFN)
- PICCINELLI Andrea (Notredame)
- SPIGA Daniele (INFN-PG)
- WAGG Jeff (Freelance at the moment (previously SKAO))
3
- Expected Tools and Services – Describes the tools and services expected at centers, including virtualization and CVMFS (CernVM File System).
- Facility Expectations – Outlines expectations for facilities, including workflow execution times (“be able to execute workflows xx hours long”), memory requirements (“nodes with at least YY GB RAM”), networking capabilities (“networking in/out at least at YY Mbps per core”) and virtualization.
- Edge Services – Discusses edge services needed to establish environment(s).
- Library Provisioning – Discusses the minimal set of libraries and how to provide them, including virtualization, Spack, and module.
Members:
- BOZZI Concezio (INFN, LHCb, JENA-HPC) (CHAIR)
- ANDRONICO Giuseppe (INFN)
- BOCCALI Tommaso (INFN-PI)
- BROEKEMA Chris (ASTRON)
- CAMPOS Isabel (CSIC)
- CESINI Daniele (INFN)
- DE SALVO Alessandro (INFN)
- DOLAR Sagar (SURF)
- HU Haili (SURF)
- LUTZ Kristen (SURF)
- MERINO Gonzalo (PIC)
- SPIGA Daniele (INFN-PG)
- VALASSI Andrea (CERN)
- WAGG Jeff (Freelance at the moment (previously SKAO))
4
- Machine Learning Frameworks
- Multithreading Frameworks
- Multi-Node Tools – Including MPI (Message Passing Interface) and similar tools
- Compilers, toolchains, …
- Quantum computing tools and frameworks
- Code Management Practices
Members:
- SWINBANK John (Astron) (CHAIR)
- VILOTTE Jean-Pierre (CNRS) (CHAIR)
- ANDRONICO Giuseppe (INFN)
- BOCCALI Tommaso (INFN-PI)
- CAMPOS Isabel (CSIC)
- KRASZNAHORKAY Attila (CERN)
- LAYCOCK Paul (UniGeneva)
- STEWART Graeme Andrew (CERN)
- VALASSI Andrea (CERN)
- WAGG Jeff (Freelance at the moment (previously SKAO))
5
- Typical Use Cases – Describes typical use cases with quantitative descriptions.
- Requirements and Needs
- Best Practices Collection – Gathers best practices and existing documents.
- Data Fluxes and Paths
Members:
- FERRARI Chiara (CNRS, OCA) (CHAIR)
- GIRONE Maria (CERN) (CHAIR)
- SPECTRUM WP5 members (CHAIRS)
- ANDRONICO Giuseppe (INFN)
- ANNOVI Alberto (INFN-PI)
- BESWICK Robert (University of Manchester)
- BOCCALI Tommaso (INFN-PI)
- CAMPOS Isabel (CSIC)
- CATMORE James (OSLO)
- COSMAI Dino (University of Bari)
- CUNNINGHAM Nichol (SKAO)
- GIUSTI Leonardo (University of Milano Bicocca)
- GRANDI Claudio (INFN, CMS, WLCG review team)
- IACOBELLI Marco (ASTRON)
- ORRU’ Emanuela (ASTRON)
- PFALZNER Susanne (Jülich)
- WALCH-GASSNER Stefanie (University of Koeln)
- WAGG Jeff (Freelance at the moment (previously SKAO))
6
- HPC Centers – Discusses drivers and future directions of HPC centers.
- Access to Quantum Computing Hardware
- Access to Commercial and Public Clouds
- Sustainability – Examines economic and carbon footprint aspects.
- Security – Including access and translation from global SSO to local credentials
Members:
- HOPPE Hans-Christian (Jülich) (CHAIR)
- AFFINITO Fabio (Cineca)
- ANDRONICO Giuseppe (INFN)
- BOZZI Concezio (INFN, LHCb, JENA-HPC)
- CAMPOS Isabel (CSIC)
- CE Marco (University of MIlano Bicoccal)
- CESINI Daniele (INFN)
- DELL’AGNELLO Luca (INFN CNAF-T1)
- DOLAR Sagar (SURF)
- ENSSLIN Torsten (Max Planck Institute for Astrophysics))
- HU Haili (SURF)
- LUTZ Kristen (SURF)
- MASCETTI Luca (CERN)
- MERINO Gonzalo (PIC)
- PATRASCOIU Mihai (CERN)
- PEPE MIchele (INFN-MIB)
- PFALZNER Susanne (Jülich)
- WAGG Jeff (Freelance at the moment (previously SKAO))
- WALKER Rod (Ludwig-Maximilians-Universität München)
You can express your interest to join the SPECTRUMCoP by sending an email to spectrumcop-expression-of-interest [AT] mailman.egi.eu