| ATLAS Note | |
| Report number | ATL-DAQ-PROC-2017-039 |
| Title | EXPERIENCE WITH SPLUNK FOR ARCHIVING AND VISUALISATION OF OPERATIONAL DATA IN ATLAS TDAQ SYSTEM |
| Author(s) | Kazarov, Andrei (Petersburg Nuclear Physics Institute) ; Mineev, Mikhail (Joint Institute for Nuclear Research) ; Avolio, Giuseppe (European Laboratory for Particle Physics, CERN) ; Chitan, Adrian (Horia Hulubei National Institute of Physics and Nuclear Engineering) |
| Corporate Author(s) | The ATLAS collaboration |
| Collaboration | ATLAS Collaboration |
| Publication | 2017 |
| Imprint | 20 Oct 2017 |
| Number of pages | 4 |
| In: | J. Phys.: Conf. Ser. 1085 (2018) 032052 |
| In: | 18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Seattle, WA, USA, 21 - 25 Aug 2017, pp.032052 |
| DOI | 10.1088/1742-6596/1085/3/032052 |
| Subject category | Particle Physics - Experiment |
| Accelerator/Facility, Experiment | CERN LHC ; ATLAS |
| Free keywords | data archival ; data visualization ; splunk ; operational monitoring |
| Abstract | The ATLAS Trigger and Data Acquisition (TDAQ) is a large, distributed system composed of several thousands interconnected computers and tens of thousands software processes (applications). Applications produce a large amount of operational messages at the order of 10$^{4}$ messages per second, which need to be reliably stored and delivered to TDAQ operators in a quasi real-time manner, and also be available for post-mortem analysis by experts. We have selected SPLUNK, a commercial solution by Splunk Inc, as an all-in-one solution for storing different types of operational data in an indexed database, and a web-based framework for searching and presenting the indexed data and for rapid development of user-oriented dashboards accessible in a web browser. The paper describes capabilities of the Splunk framework, use cases, applications and web dashboards developed for facilitating the browsing and searching of TDAQ operational data by TDAQ operators and experts. |
| Copyright/License | Preprint: (License: CC-BY-4.0) publication: (License: CC-BY-3.0) |
Notice créée le 2017-10-20, modifiée le 2021-02-09
PDF