CERN Accelerating science

Article
Title Raythena: a vertically integrated scheduler for ATLAS applications on heterogeneous distributed resources
Author(s) Muškinja, Miha (LBL, Berkeley) ; Calafiura, Paolo (LBL, Berkeley) ; Leggett, Charles (LBL, Berkeley) ; Shapoval, Illya (LBL, Berkeley) ; Tsulaia, Vakho (LBL, Berkeley)
Collaboration ATLAS Collaboration
Publication 2020
Number of pages 6
In: EPJ Web Conf. 245 (2020) 05042
In: 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.05042
DOI 10.1051/epjconf/202024505042
Subject category Computing and Computers
Accelerator/Facility, Experiment CERN LHC ; ATLAS
Abstract The ATLAS experiment has successfully integrated HighPerformance Computing resources (HPCs) in its production system. Unlike the current generation of HPC systems, and the LHC computing grid, the next generation of supercomputers is expected to be extremely heterogeneous in nature: different systems will have radically different architectures, and most of them will provide partitions optimized for different kinds of workloads. In this work we explore the applicability of concepts and tools realized in Ray (the high-performance distributed execution framework targeting large-scale machine learning applications) to ATLAS event throughput optimization on heterogeneous distributed resources, ranging from traditional grid clusters to Exascale computers. We present a prototype of Raythena, a Ray-based implementation of the ATLAS Event Service (AES), a fine-grained event processing workflow aimed at improving the efficiency of ATLAS workflows on opportunistic resources, specifically HPCs. The AES is implemented as an event processing task farm that distributes packets of events to several worker processes running on multiple nodes. Each worker in the task farm runs an event-processing application (Athena) as a daemon. The whole system is orchestrated by Ray, which assigns work in a distributed, possibly heterogeneous, environment.For all its flexibility, the AES implementation is currently comprised of multiple separate layers that communicate through ad-hoc command-line and filebased interfaces. The goal of Raythena is to integrate these layers through a feature-rich, efficient application framework. Besides increasing usability and robustness, a vertically integrated scheduler will enable us to explore advanced concepts such as dynamically shaping of workflows to exploit currently available resources, particularly on heterogeneous systems.
Copyright/License © 2020-2025 The Authors (License: CC-BY-4.0)

Corresponding record in: Inspire


 ჩანაწერი შექმნილია 2021-02-23, ბოლოს შესწორებულია 2022-11-17


სრული ტექსტი:
სრული ტექსტის ჩამოტვირთვა
PDF