| ATLAS Note | |
| Report number | ATL-SOFT-PROC-2017-036 |
| Title | Analysis of empty ATLAS pilot jobs |
| Author(s) | Love, Peter (Lancaster University, Department of Physics) ; Alef, M. (KIT, Karlsruhe, SCC) ; Dal Pra, S. (INFN, CNAF) ; Di Girolamo, A. (CERN) ; Forti, A. (Manchester U.) ; Templon, J. (NIKHEF, Amsterdam) ; Vamvakopoulos, E. (CC, Villeurbanne) |
| Corporate Author(s) | The ATLAS collaboration |
| Collaboration | ATLAS Collaboration |
| Publication | 2017 |
| Imprint | 02 Feb 2017 |
| Number of pages | 8 |
| In: | J. Phys.: Conf. Ser. 898 (2017) 092005 |
| In: | 22nd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2016, San Francisco, Usa, 10 - 14 Oct 2016, pp.092005 |
| DOI | 10.1088/1742-6596/898/9/092005 |
| Subject category | Particle Physics - Experiment |
| Accelerator/Facility, Experiment | CERN LHC ; ATLAS |
| Abstract | In this analysis we quantify the wallclock time used by short empty pilot jobs on a number of WLCG compute resources. Pilot factory logs and site batch logs are used to provide independent accounts of the usage. Results show a wide variation of wallclock time used by short jobs depending on the site and queue, and changing with time. For a reference dataset of all jobs in August 2016, the fraction of wallclock time used by empty jobs per studied site ranged from 0.1% to 0.8%. Aside from the wall time used by empty pilots, we also looked at how many pilots were empty as a fraction of all pilots sent. Binning the August dataset into days, empty fractions between 2% and 90% were observed. The higher fractions correlate well with periods of few actual payloads being sent to the site. |
| Copyright/License | publication: (License: CC-BY-3.0) |
Corresponding record in: Inspire
Record created 2017-02-02, last modified 2019-10-15
PDF