1.
|
|
2.
|
Grid production with the ATLAS Event Service
/ ATLAS Collaboration
ATLAS has developed and previously presented a new computing architecture, the Event Service, that allows real time delivery of fine grained workloads which process dispatched events (or event ranges) and immediately streams outputs. The principal aim was to profit from opportunistic resources such as commercial cloud, supercomputing, and volunteer computing, and otherwise unused cycles on clusters and grids. [...]
ATL-SOFT-SLIDE-2018-385.-
Geneva : CERN, 2018 - 1 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018
|
|
3.
|
|
4.
|
|
|
Production experience with the ATLAS Event Service
/ Benjamin, Douglas (Duke University, Department of Physics) ; Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Childers, John Taylor (Argonne National Laboratory) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
The ATLAS Event Service (AES) has been designed and implemented for efficient running of ATLAS production workflows on a variety of computing platforms, ranging from conventional Grid sites to opportunistic, often short-lived resources, such as spot market commercial clouds, supercomputers and volunteer computing. [...]
ATL-SOFT-PROC-2017-006.
-
2017. - 8 p.
Original Communication (restricted to ATLAS) - IOP Open Access Article - Full text
|
|
5.
|
Production Experience with the ATLAS Event Service
/ Benjamin, Douglas (Duke University, Department of Physics) ; Calafiura, Paolo (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; Childers, John Taylor (Argonne National Laboratory) ; De, Kaushik (The University of Texas at Arlington) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
/ATLAS Collaboration
The ATLAS Event Service (ES) has been designed and implemented for efficient running of ATLAS production workflows on a variety of computing platforms, ranging from conventional Grid sites to opportunistic, often short-lived resources, such as spot market commercial clouds, supercomputers and volunteer computing. The Event Service architecture allows real time delivery of fine grained workloads to running payload applications which process dispatched events or event ranges and immediately stream the outputs to highly scalable Object Stores. [...]
ATL-SOFT-SLIDE-2016-678.-
Geneva : CERN, 2016 - 1 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 22nd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2016, San Francisco, Usa, 10 - 14 Oct 2016
|
|
6.
|
Fine-Grained Processing Towards HL-LHC Computing in ATLAS
/ Benjamin, Doug (Duke U.) ; Calafiura, Paolo (LBNL, Berkeley) ; Childers, Taylor (Argonne) ; De, Kaushik (Texas U., Arlington) ; Di Girolamo, Alessandro (CERN) ; Fullana, Esteban (Valencia U.) ; Guan, Wen (Wisconsin U., Madison) ; Maeno, Tadashi (Brookhaven Natl. Lab.) ; Magini, Nicolo (U. Genoa (main)) ; Nilsson, Paul (Brookhaven Natl. Lab.) et al.
/ATLAS
During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. [...]
2018 - 1 p.
- Published in : 10.1109/eScience.2018.00083
In : 14th eScience IEEE International Conference, Amsterdam, Netherlands, 29 Oct - 1 Nov 2018, pp.338
|
|
7.
|
|
Towards an Event Streaming Service for ATLAS data processing
/ Magini, Nicolo (Iowa State U. (main) ; INFN, Genoa) ; Di Girolamo, Alessandro (CERN) ; Guan, Wen (U. Wisconsin, Madison (main)) ; Wenaus, Torre (Brookhaven Natl. Lab.) ; Tsulaia, Vakhtang (LBNL, Berkeley) ; Lassnig, Mario (CERN) ; Walker, Rodney (LMU Munich (main)) ; Maeno, Tadashi (Brookhaven Natl. Lab.) ; Nilsson, Paul (Brookhaven Natl. Lab.) ; Brino, Alex (U. Udine (main))
The ATLAS experiment at the LHC is gradually transitioning from the traditional file-based processing model to dynamic workflow management at the event level with the ATLAS Event Service (AES). [...]
ATL-SOFT-PROC-2018-050.
-
2019. - 6 p.
Original Communication (restricted to ATLAS) - ATLAS Note - Fulltext from publisher
|
|
8.
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to overcome the dedicated resources available for ATLAS on the WLCG. Example of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at the Tier-2 and Tier-3 sites, opportunistic resources at the Open Science Grid, and ATLAS High Level Trigger farm between the data taking periods. [...]
ATL-SOFT-SLIDE-2016-012.-
Geneva : CERN, 2016 - 1 p.
Fulltext: PDF; External link: Original Communication (restricted to ATLAS)
In : 17th INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, Valparaíso, Valparaíso, Chile, 18 - 22 Jan 2016
|
|
9.
|
|
|
The ATLAS Event Service: A New Approach to Event Processing
/ Calafiura, Paolo (LBL, Berkeley) ; De, Kaushik (Texas U., Arlington) ; Guan, Wen (Wisconsin U., Madison) ; Maeno, Tadashi (Brookhaven) ; Nilsson, Paul (Brookhaven) ; Oleynik, Danila (Texas U., Arlington) ; Panitkin, Sergey (Brookhaven) ; Tsulaia, Vakhtang (LBL, Berkeley) ; van Gemmeren, Peter (Argonne, HEP) ; Wenaus, Torre (Brookhaven)
The ATLAS Event Service (ES) implements a new fine grained approach to HEP event processing, designed to be agile and efficient in exploiting transient, short-lived resources such as HPC hole-filling, spot market commercial clouds, and volunteer computing. [...]
ATL-SOFT-PROC-2015-027.
-
2015. - 7 p.
Original Communication (restricted to ATLAS) - Full text - IOP Open Access article
|
|
10.
|
|
|
Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
/ Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) et al.
Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. [...]
ATL-SOFT-PROC-2016-001.
-
2016. - 5 p.
Original Communication (restricted to ATLAS) - Full text - Fulltext
|
|