1.
|
Raythena: a vertically integrated scheduler for ATLAS applications on heterogeneous distributed resources
/ Muškinja, Miha (LBL, Berkeley) ; Calafiura, Paolo (LBL, Berkeley) ; Leggett, Charles (LBL, Berkeley) ; Shapoval, Illya (LBL, Berkeley) ; Tsulaia, Vakho (LBL, Berkeley)
/ATLAS Collaboration
The ATLAS experiment has successfully integrated HighPerformance Computing resources (HPCs) in its production system. Unlike the current generation of HPC systems, and the LHC computing grid, the next generation of supercomputers is expected to be extremely heterogeneous in nature: different systems will have radically different architectures, and most of them will provide partitions optimized for different kinds of workloads. [...]
2020 - 6 p.
- Published in : EPJ Web Conf. 245 (2020) 05042
Fulltext: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.05042
|
|
2.
|
Raythena: a vertically integrated scheduler for ATLAS applications on heterogeneous distributed resources
/ Muskinja, Miha (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Leggett, Charles (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Shapoval, Illya (Lawrence Berkeley National Laboratory and University of California, Berkeley)
/ATLAS Collaboration
The ATLAS experiment has successfully integrated High-Performance Computing (HPC) resources in its production system. Unlike the current generation of HPC systems, and the LHC computing grid, the next generation of supercomputers is expected to be extremely heterogeneous in nature: different systems will have radically different architectures, and most of them will provide partitions optimized for different kinds of workloads. [...]
ATL-SOFT-SLIDE-2019-812.-
Geneva : CERN, 2019
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
|
|
3.
|
Simulating HEP Workflows on Heterogeneous Architectures
/ Leggett, Charles (LBL, Berkeley) ; Shapoval, Illya (LBL, Berkeley)
/ATLAS
The next generation of supercomputing facilities, such as Oak Ridge's Summit and Lawrence Livermore's Sierra, show an increasing use of GPGPUs and other accelerators in order to achieve their high FLOP counts. This trend will only grow with exascale facilities. [...]
2018 - 1 p.
- Published in : 10.1109/eScience.2018.00087
In : 14th eScience IEEE International Conference, Amsterdam, Netherlands, 29 Oct - 1 Nov 2018, pp.343
|
|
4.
|
Geant4 performance optimization in the ATLAS experiment
/ Muškinja, Miha (LBL, Berkeley) ; Chapman, John Derek (Cambridge U.) ; Gray, Heather (LBL, Berkeley ; UC, Berkeley)
/ATLAS Collaboration
Software improvements in the ATLAS Geant4-based simulation are critical to keep up with evolving hardware and increasing luminosity. Geant4 simulation currently accounts for about 50% of CPU consumption in ATLAS and it is expected to remain the leading CPU load during Run 4 (HL-LHC upgrade) with an approximately 25% share in the most optimistic computing model. [...]
2020 - 7 p.
- Published in : EPJ Web Conf. 245 (2020) 02036
Fulltext from publisher: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.02036
|
|
5.
|
|
|
Production experience with the ATLAS Event Service
/ Benjamin, Douglas (Duke University, Department of Physics) ; Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Childers, John Taylor (Argonne National Laboratory) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
The ATLAS Event Service (AES) has been designed and implemented for efficient running of ATLAS production workflows on a variety of computing platforms, ranging from conventional Grid sites to opportunistic, often short-lived resources, such as spot market commercial clouds, supercomputers and volunteer computing. [...]
ATL-SOFT-PROC-2017-006.
-
2017. - 8 p.
Original Communication (restricted to ATLAS) - IOP Open Access Article - Full text
|
|
6.
|
|
|
The ATLAS Event Service: A New Approach to Event Processing
/ Calafiura, Paolo (LBL, Berkeley) ; De, Kaushik (Texas U., Arlington) ; Guan, Wen (Wisconsin U., Madison) ; Maeno, Tadashi (Brookhaven) ; Nilsson, Paul (Brookhaven) ; Oleynik, Danila (Texas U., Arlington) ; Panitkin, Sergey (Brookhaven) ; Tsulaia, Vakhtang (LBL, Berkeley) ; van Gemmeren, Peter (Argonne, HEP) ; Wenaus, Torre (Brookhaven)
The ATLAS Event Service (ES) implements a new fine grained approach to HEP event processing, designed to be agile and efficient in exploiting transient, short-lived resources such as HPC hole-filling, spot market commercial clouds, and volunteer computing. [...]
ATL-SOFT-PROC-2015-027.
-
2015. - 7 p.
Original Communication (restricted to ATLAS) - Full text - IOP Open Access article
|
|
7.
|
Fine-Grained Processing Towards HL-LHC Computing in ATLAS
/ Benjamin, Doug (Duke U.) ; Calafiura, Paolo (LBNL, Berkeley) ; Childers, Taylor (Argonne) ; De, Kaushik (Texas U., Arlington) ; Di Girolamo, Alessandro (CERN) ; Fullana, Esteban (Valencia U.) ; Guan, Wen (Wisconsin U., Madison) ; Maeno, Tadashi (Brookhaven Natl. Lab.) ; Magini, Nicolo (U. Genoa (main)) ; Nilsson, Paul (Brookhaven Natl. Lab.) et al.
/ATLAS
During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. [...]
2018 - 1 p.
- Published in : 10.1109/eScience.2018.00083
In : 14th eScience IEEE International Conference, Amsterdam, Netherlands, 29 Oct - 1 Nov 2018, pp.338
|
|
8.
|
|
Global heterogeneous resource harvesting: the next-generation PanDA Pilot for ATLAS
/ Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Anisenkov, Alexey (Budker Institute of Nuclear Physics, Siberian Branch of Russian Academy of Sciences) ; Lassnig, Mario (European Laboratory for Particle Physics, CERN) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Drizhuk, Daniil (NRC Kurchatov Institute Tier site)
The Production and Distributed Analysis system (PanDA), used for workload management in the ATLAS Experiment for over a decade, has in recent years expanded its reach to diverse new resource types such as HPCs, and innovative new workflows such as the Event Service. [...]
ATL-SOFT-PROC-2017-074.
-
2018-10-18. - 5 p.
Original Communication (restricted to ATLAS) - Full text - Full text
|
|
9.
|
Next Generation Workload Management System For Big Data on Heterogeneous Distributed Computing
/ Klimentov, A (Brookhaven) ; Buncic, P (CERN) ; De, K (Texas U., Arlington) ; Jha, S (Rutgers U., Piscataway) ; Maeno, T (Brookhaven) ; Mount, R (SLAC) ; Nilsson, P (Brookhaven) ; Oleynik, D (Texas U., Arlington) ; Panitkin, S (Brookhaven) ; Petrosyan, A (Texas U., Arlington) et al.
The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. [...]
2015 - 8 p.
- Published in : J. Phys.: Conf. Ser. 608 (2015) 012040
Fulltext: PDF;
In : 16th International workshop on Advanced Computing and Analysis Techniques in physics (ACAT), Prague, Czech Republic, 1 - 5 Sep 2014, pp.012040
|
|
10.
|
Towards an Event Streaming Service for ATLAS data processing
/ Magini, Nicolo (INFN Genova and Universita' di Genova, Dipartimento di Fisica) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Di Girolamo, Alessandro (European Laboratory for Particle Physics, CERN) ; Wenaus, Torre (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Lassnig, Mario (European Laboratory for Particle Physics, CERN) ; Walker, Rodney (Fakultaet fuer Physik, Ludwig-Maximilians-Universitaet Muenchen) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL))
/ATLAS Collaboration
The ATLAS experiment is gradually transitioning from the traditional file-based processing model to dynamic workflow management at the event level with the ATLAS Event Service (AES). The AES assigns fine-grained processing jobs to workers and streams out the data in quasi-real time, ensuring fully efficient utilization of all resources, including the most volatile. [...]
ATL-SOFT-SLIDE-2018-461.-
Geneva : CERN, 2018 - 15 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018
|
|