| Article | |
| Title | Implementing High Performance & Highly Reliable Time Series Acquisition Software for the CERN-Wide Accelerator Data Logging Service |
| Author(s) | Sobieszek, Marcin (CERN) ; Baggiolini, Vito (CERN) ; Mucha, Rafal (CERN) ; Roderick, Chris (CERN) ; Sowinski, Piotr (CERN) ; Wozniak, Jakub (CERN) |
| Publication | 2023 |
| Number of pages | 5 |
| In: | JACoW ICALEPCS 2023 (2023) THPDP068 |
| In: | 19th International Conference on Accelerator and Large Experimental Physics Control Systems (ICALEPCS 2023), Cape Town, South Africa, 7 - 13 Oct 2023, pp.THPDP068 |
| DOI | 10.18429/JACoW-ICALEPCS2023-THPDP068 |
| Subject category | Computing and Computers ; Accelerators and Storage Rings |
| Abstract | The CERN Accelerator Data Logging Service (NXCALS) stores data generated by the accelerator infrastructure and beam related devices. This amounts to 3.5TB of data per day, coming from more than 2.5 million signals from heterogeneous systems at various frequencies. Around 85% of this data is transmitted through the Controls Middleware (CMW) infrastructure. To reliably gather such volumes of data, the acquisition system must be highly available, resilient and robust. It also has to be highly efficient and easily scalable, given the regularly growing data rates and volumes, particularly for the increases expected to be produced by the future High Luminosity LHC. This paper describes the NXCALS time series acquisition software, known as Data Sources. System architecture, design choices, and recovery solutions for various failure scenarios (e.g. network disruptions or cluster split-brain problems) will be covered. Technical implementation details will be discussed, covering the clustering of Akka Actors collecting data from tens of thousands of CMW devices and sharing the lessons learned. The NXCALS system has been operational since 2018 and has demonstrated the capability to fulfil all aforementioned characteristics, while also ensuring self-healing capabilities and no data losses during redeployments. The engineering challenge, architecture, lessons learned, and the implementation of this acquisition system are not CERN-specific and are therefore relevant to other institutes facing comparable challenges. |
| Copyright/License | CC-BY-4.0 |
Corresponding record in: Inspire
レコード 生成： 2024-04-23, 最終変更： 2024-04-23
