CERN Accelerating science

ATLAS Note
Report number	ATL-SOFT-PROC-2016-001
Title	Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
Author(s)	Benjamin, Douglas (Duke University, Department of Physics) ; Caballero, Jose (Brookhaven National Laboratory (BNL)) ; Ernst, Michael (Brookhaven National Laboratory (BNL)) ; Guan, Wen (Department of Physics, University of Wisconsin) ; Hover, John (Brookhaven National Laboratory (BNL)) ; Lesny, David (University of Illinois at Urbana-Champaign) ; Maeno, Tadashi (Brookhaven National Laboratory (BNL)) ; Nilsson, Paul (Brookhaven National Laboratory (BNL)) ; Tsulaia, Vakhtang (Lawrence Berkeley National Laboratory and University of California, Berkeley) ; van Gemmeren, Peter (Argonne National Laboratory) ; Vaniachine, Alexandre (Tomsk State University) ; Wang, Fuquan (Department of Physics, University of Wisconsin) ; Wenaus, Torre (Brookhaven National Laboratory (BNL))
Corporate Author(s)	The ATLAS collaboration
Publication	2016
Imprint	24 Feb 2016
Number of pages	5
In:	J. Phys.: Conf. Ser. 762 (2016) 012027
In:	17th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Valparaíso, Valparaíso, Chile, 18 - 22 Jan 2016, pp.012027
DOI	10.1088/1742-6596/762/1/012027
Subject category	Computing and Computers
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Free keywords	opportunistic computing ; fine-grained data processing
Abstract	Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. Examples of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at Tier 2 and Tier 3 sites, opportunistic resources at the Open Science Grid (OSG), and ATLAS High Level Trigger farm between the data taking periods. Because of specific aspects of opportunistic resources such as preemptive job scheduling and data I/O, their efficient usage requires workflow innovations provided by the ATLAS Event Service. Thanks to the finer granularity of the Event Service data processing workflow, the opportunistic resources are used more efficiently. We report on our progress in scaling opportunistic resource usage to double-digit levels in ATLAS production.
Copyright/License	Preprint: (License: CC-BY-4.0)

Corresponding record in: Inspire