CERN Accelerating science

ATLAS Note
Report number	ATL-DAQ-PROC-2020-009
Title	ATLAS Operational Monitoring Data Archival and Visualization
Author(s)	Soloviev, Igor (University of California, Irvine) (+) ; Avolio, Giuseppe (European Laboratory for Particle Physics, CERN) ; Kazymov, Andrei (Joint Institute for Nuclear Research) ; Vasile, Matei Eugen (Horia Hulubei National Institute of Physics and Nuclear Engineering)
Corporate Author(s)	The ATLAS collaboration
Collaboration	ATLAS Collaboration
Publication	2020
Imprint	18 Feb 2020
Number of pages	mult.
In:	EPJ Web Conf. 245 (2020) 01020
In:	24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.01020
DOI	10.1051/epjconf/202024501020
Subject category	Particle Physics - Experiment
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Free keywords	monitoring ; time-series ; online ; PBEAST ; protobuf ; Grafana
Abstract	The Information Service (IS) is an integral part of the Trigger and Data Acquisition (TDAQ) system of the ATLAS experiment at the Large Hadron Collider (LHC) at CERN. The IS allows online publication of operational monitoring data, and it is used by all sub-systems and sub-detectors of the experiment to constantly monitor their hardware and software components including more than 25000 applications running on more than 3000 computers. The Persistent Back-End for the ATLAS Information System (PBEAST) service stores all raw operational monitoring data for the lifetime of the experiment and provides programming and graphical interfaces to access them including Grafana dashboards and notebooks based on the CERN SWAN platform. During the ATLAS data taking sessions (for the full LHC Run 2 period) PBEAST acquired data at an average information update rate of 200 kHz and stored 20 TB of highly compacted and compressed data per year. This paper reports how over six years the PBEAST became an essential piece of the experiment operations including details of the challenging requirements, the fails and successes of the various attempted implementations, the new types of monitoring data and the results of the time-series database technologies evaluations for the improvements during next LHC Run 3.
Copyright/License	© 2020-2024 The Authors (License: CC-BY-4.0)

Corresponding record in: Inspire