1.
|
Optimization of distributed compute resources utilization in the CMS Global Pool
/ Mascheroni, Marco (UC, San Diego) ; Perez-Calero Yzquierdo, Antonio Maria (Madrid, CIEMAT) ; Kim, Hyunwoo (Fermilab) ; Florian Von Cube ; Zokaite, Vaiva (Vilnius U.) ; Frank Wurthwein
/CMS Collaboration
The CMS Submission Infrastructure is the primary system for managing computing resources for CMS workflows, including data processing, simulation, and analysis. It integrates geographically distributed resources from Grid, HPC, and cloud providers into federated pools managed by HTCondor and GlideinWMS, for a total of around 500k CPU cores. [...]
CMS-CR-2025-071.-
Geneva : CERN, 2025 - 9 p.
Fulltext: PDF;
In : 42nd International Conference on High Energy Physics (ICHEP 2024), Prague, Czech Republic, 18 - 24 Jul 2024
|
|
2.
|
|
3.
|
Adoption of a token-based authentication model for the CMS Submission Infrastructure.
/ Pérez-Calero Yzquierdo, Antonio (Madrid, CIEMAT ; PIC, Bellaterra) ; Mascheroni, Marco (UC, San Diego) ; Kizinevic, Edita (CERN) ; Khan, Farrukh Aftab (Fermilab) ; Kim, Hyunwoo (Fermilab) ; Flechas, Maria Acosta (Fermilab) ; Tsipinakis, Nikos (CERN) ; Haleem, Saqib (NCP, Islamabad) ; Würthwein, Frank (UC, San Diego)
/CMS Collaboration
The CMS Submission Infrastructure (SI) is the main computing resource provisioning system for CMS workloads. A number of HTCondor pools are employed to manage this infrastructure, which aggregates geographically distributed resources from the WLCG and other providers. [...]
arXiv:2405.14644.-
Geneva : CERN, 2024 - 6 p.
- Published in : EPJ Web Conf. 295 (2024) 04003
Fulltext: 2405.14644 - PDF; CR2023_170 - PDF; 24a38f66866e5065c5b8cfa45016bee6 - PDF; document - PDF; External link: Fermilab Library Server
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.04003
|
|
4.
|
The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
/ Pérez-Calero Yzquierdo, Antonio (Madrid, CIEMAT ; PIC, Bellaterra) ; Mascheroni, Marco (UC, San Diego) ; Kizinevic, Edita (CERN) ; Khan, Farrukh Aftab (Fermilab) ; Kim, Hyunwoo (Fermilab) ; Flechas, Maria Acosta (Fermilab) ; Tsipinakis, Nikos (CERN) ; Haleem, Saqib (NCP, Islamabad)
/CMS Collaboration
While the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC Run 3 and the future HL-LHC phase. [...]
arXiv:2405.14647.-
Geneva : CERN, 2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 04046
Fulltext: jt - PDF; 2405.14647 - PDF; CR2023_169 - PDF; document - PDF; External link: Fermilab Library Server
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.04046
|
|
5.
|
HPC resources for CMS offline computing: an integration and scalability challenge for the Submission Infrastructure
/ Pérez-Calero Yzquierdo, Antonio (Madrid, CIEMAT ; PIC, Bellaterra) ; Mascheroni, Marco (UC, San Diego) ; Kizinevic, Edita (CERN) ; Khan, Farrukh Aftab (Fermilab) ; Kim, Hyunwoo (Fermilab) ; Flechas, Maria Acosta (Fermilab) ; Tsipinakis, Nikos (CERN) ; Haleem, Saqib (NCP, Islamabad)
/CMS Collaboration
The computing resource needs of LHC experiments are expected to continue growing significantly during the Run 3 and into the HL-LHC era. The landscape of available resources will also evolve, as HPC and Cloud resources will provide a comparable, or even dominant, fraction of the total compute capacity. [...]
arXiv:2405.14631.-
Geneva : CERN, 2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01035
Fulltext: 2405.14631 - PDF; document - PDF; CR2023_168 - PDF; 5f90e54777e503471736fb7a0d539fca - PDF; External link: Fermilab Library Server
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01035
|
|
6.
|
Evolution of the CMS Submission Infrastructure to support heterogeneous resources in the LHC Run 3
/ Perez-Calero Yzquierdo, Antonio Maria (Madrid, CIEMAT) ; Kizinevic, Edita (CERN) ; Khan, Farrukh Aftab (Fermilab) ; Kim, Hyunwoo (Fermilab) ; Mascheroni, Marco (UC, San Diego) ; Acosta Flechas, Maria (Fermilab) ; Tsipinakis, Nikos (CERN) ; Haleem, Saqib (Quaid-i-Azam U.)
/CMS Collaboration
The landscape of computing power available for the CMS experiment is rapidly evolving, from a scenario dominated by x86 processors deployed at WLCG sites towards a more diverse mixture of Grid, HPC, and Cloud facilities, incorporating a higher fraction of non-CPU components such as GPUs. Using these facilities heterogeneous resources efficiently to process the vast amounts of data to be collected in the LHC Run3 and beyond, is key to CMS achieving its scientific goals. [...]
CMS-CR-2023-035.-
Geneva : CERN, 2023 - 6 p.
Fulltext: PDF;
In : 21st International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Bari, It, 24 - 28 Oct 2022
|
|
7.
|
Stability of the CMS Submission Infrastructure for the LHC Run 3
/ Perez-Calero Yzquierdo, Antonio Maria (Madrid, CIEMAT) ; Kizinevic, Edita (CERN) ; Khan, Farrukh Aftab (Fermilab) ; Kim, Hyunwoo (Fermilab) ; Mascheroni, Marco (UC, San Diego) ; Acosta Flechas, Maria (Fermilab) ; Tsipinakis, Nikos (CERN) ; Haleem, Saqib (Quaid-i-Azam U.)
/CMS Collaboration
The CMS Submission Infrastructure is the main computing resource provisioning system for CMS workflows, including data processing, simulation and analysis. It currently aggregates nearly 400k CPU cores distributed worldwide from Grid, HPC and cloud providers. [...]
CMS-CR-2023-033.-
Geneva : CERN, 2023 - 6 p.
Fulltext: PDF;
In : 21st International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Bari, It, 24 - 28 Oct 2022
|
|
8.
|
HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation
/ Holzman, Burt (Fermilab) ; Bauerdick, Lothar A.T. (Fermilab) ; Bockelman, Brian (Nebraska U.) ; Dykstra, Dave (Fermilab) ; Fisk, Ian (New York U.) ; Fuess, Stuart (Fermilab) ; Garzoglio, Gabriele (Fermilab) ; Girone, Maria (CERN) ; Gutsche, Oliver (Fermilab) ; Hufnagel, Dirk (Fermilab) et al.
Historically, high energy physics computing has been performed on large purpose-built computing systems. These began as single-site compute facilities, but have evolved into the distributed computing grids used today. [...]
arXiv:1710.00100; FERMILAB-PUB-17-092-CD.-
2017-09-29 - 15 p.
- Published in : Comput. Softw. Big Sci. 1 (2017) 1
Fulltext: arxiv:1710.00100 - PDF; fermilab-pub-17-092-cd - PDF; External link: Fermilab Accepted Manuscript
|
|