1.
|
|
|
Building and Using Containers on HPCs for the ATLAS Experiment
/ Yang, Wei (SLAC National Accelerator Laboratory) ; Benjamin, Douglas (Argonne National Laboratory) ; Childers, John Taylor (Argonne National Laboratory) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Panitkin, Sergey (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Zhao, Xin (Brookhaven National Laboratory (BNL))
The HPC environment presents several challenges to the ATLAS experiment in running their automated computational workflow smoothly and efficiently, in particular on issues such as software distribution and IO load. [...]
ATL-SOFT-PROC-2018-047.
-
2018.
Original Communication (restricted to ATLAS) - Full text
|
|
2.
|
Using Containers on HPCs for ATLAS Experiment
/ Benjamin, Douglas (Duke University, Department of Physics) ; Childers, John Taylor (Argonne National Laboratory) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Panitkin, Sergey (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Yang, Wei (SLAC National Accelerator Laboratory) ; Zhao, Xin (Brookhaven National Laboratory (BNL))
/ATLAS Collaboration
CVMFS helps ATLAS in distributing software to the Grid, and isolating software lookup to batch nodes’ local filesystems. But CVMFS is rarely available in HPC environments. [...]
ATL-SOFT-SLIDE-2018-467.-
Geneva : CERN, 2018
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018
|
|
3.
|
Building and using containers at HPC centres for the ATLAS experiment
/ Benjamin, Douglas (Duke U.) ; Childers, Taylor (Argonne (main)) ; Lesny, David (Illinois U., Urbana) ; Oleynik, Danila (Texas U., Arlington) ; Panitkin, Sergey (Brookhaven) ; Tsulaia, Vakho (LBL, Berkeley) ; Yang, Wei (SLAC) ; Zhao, Xin (Brookhaven)
/ATLAS Collaboration
The HPC environment presents several challenges to the ATLAS experiment in running their automated computational workflows smoothly and efficiently, in particular regarding issues such as software distribution and I/O load. A vital component of the LHC Computing Grid, CVMFS, is not always available in HPC environments. [...]
EDP Sciences, 2019 - 8 p.
- Published in : EPJ Web Conf. 214 (2019) 07005
Fulltext: PDF;
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018, pp.07005
|
|
4.
|
BigPanDA Experience on LCF and HPC for the ATLAS Experiment at the LHC and data intensive science
/ De, Kaushik (The University of Texas at Arlington) ; Barreiro Megino, Fernando Harald (The University of Texas at Arlington) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Mashinistov, Ruslan (P.N. Lebedev Physical Institute) ; Svirin, Pavlo (Brookhaven National Laboratory (BNL))
/ATLAS Collaboration
The PanDA software is used for workload management on distributed grid resources by the ATLAS experiment at the LHC. An effort was launched to extend PanDA, called BigPanDA, to access HPC resources, funded by the US Department of Energy (DOE-ASCR) [...]
ATL-SOFT-SLIDE-2018-710.-
Geneva : CERN, 2018
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
|
|
5.
|
|
|
Fine grained event processing on HPCs with the ATLAS Yoda system
/ Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Panitkin, Sergey (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
High performance computing facilities present unique challenges and opportunities for HENP event processing. [...]
ATL-SOFT-PROC-2015-004.
-
2015. - 5 p.
Original Communication (restricted to ATLAS) - Full text - IOP Open Access article
|
|
6.
|
Fine grained event processing on HPCs with the ATLAS Yoda system
/ Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Panitkin, Sergey (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
High performance computing facilities present unique challenges and opportunities for HENP event processing. The massive scale of many HPC systems means that fractionally small utilizations can yield large returns in processing throughput. [...]
ATL-SOFT-SLIDE-2015-143.-
Geneva : CERN, 2015 - 12 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015
|
|
7.
|
The ATLAS Event Service: A New Approach to Event Processing
/ Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Oleynik, Danila (Joint Institute for Nuclear Research) ; Panitkin, Sergey (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
The ATLAS Event Service (ES) implements a new fine grained approach to HEP event processing, designed to be agile and efficient in exploiting transient, short-lived resources such as HPC hole-filling, spot market commercial clouds, and volunteer computing. Input and output control and data flows, bookkeeping, monitoring, and data storage are all managed at the event level in an implementation capable of supporting ATLAS-scale distributed processing throughputs (about 4M CPU-hours/day). [...]
ATL-SOFT-SLIDE-2015-150.-
Geneva : CERN, 2015 - 17 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
|
|
8.
|
Xcache in the ATLAS Distributed Computing Environment
/ ATLAS Collaboration
Built upon the Xrootd Proxy Cache (Xcache), we developed additional features to adapt the ATLAS distributed computing and data environment, especially its data management system RUCIO, to help improve the cache hit rate, as well as features that make the Xcache easy to use, similar to the way the Squid cache is used by the HTTP protocol. We are optimizing Xcache for the HPC environments, and adapting the HL-LHC Data Lakes design as its component for data delivery [...]
ATL-SOFT-SLIDE-2018-396.-
Geneva : CERN, 2018
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018
|
|
9.
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Open Science Grid, and ATLAS High Level Trigger farm between the data taking periods. [...]
ATL-SOFT-SLIDE-2016-012.-
Geneva : CERN, 2016 - 1 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 17th INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, Valparaíso, Valparaíso, Chile, 18 - 22 Jan 2016
|
|
10.
|
|
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. [...]
ATL-SOFT-PROC-2016-001.
-
2016. - 5 p.
Original Communication (restricted to ATLAS) - Full text - Fulltext
|
|