CERN Accelerating science

ATLAS Note
Report number	ATL-DAQ-PROC-2019-008
Title	Evaluating InfluxDB and ClickHouse database technologies for improvements of the ATLAS operational monitoring data archiving
Author(s)	Vasile, Matei Eugen (Horia Hulubei National Institute of Physics and Nuclear Engineering) (+) ; Avolio, Giuseppe (European Laboratory for Particle Physics, CERN) (+) ; Soloviev, Igor (University of California, Irvine) (+)
Corporate Author(s)	The ATLAS collaboration
Collaboration	ATLAS Collaboration
Publication	2020
Imprint	17 May 2019
Number of pages	5
In:	J. Phys.: Conf. Ser. 1525 (2020) 012027
In:	19th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Saas Fee, Switzerland, 11 - 15 Mar 2019, pp.012027
DOI	10.1088/1742-6596/1525/1/012027
Subject category	Particle Physics - Experiment
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Free keywords	TDAQ ; operational monitoring ; databases ; testing
Abstract	The Trigger and Data Acquisition system of the ATLAS experiment at the Large Hadron Collider at CERN is composed of a large number of distributed hardware and software components which provide the data-taking functionality of the overall system. During data taking, huge amounts of operational data are created in order to constantly monitor the system. The Persistent Back-End for the ATLAS Information System of TDAQ (P-BEAST) is a system based on a custom-built time-series database and it is used to archive and retrieve any operational monitoring data for the applications requesting it. P-BEAST stores about 18 TB of highly compacted and compressed raw monitoring data per year. Since P-BEAST's creation, several promising database technologies for fast access to time-series have become available. InfluxDB and ClickHouse were the most promising candidates for improving the performance and functionality of the current implementation of P-BEAST. This paper presents a short description of main features of both technologies and a description of the tests ran on both database systems. Then, the results of the performance testing performed using a subset of archived ATLAS operational monitoring data are presented and compared.
Related document	Slides ATL-DAQ-SLIDE-2019-084
Copyright/License	preprint: (License: CC-BY-4.0) publication: (License: CC-BY-3.0)

Corresponding record in: Inspire