CERN Accelerating science

Article
Title A Disk-based Archival Storage System Using the EOS Erasure Coding Implementation for the ALICE Experiment at the CERN LHC
Author(s) Ahn, Sang Un (KISTI, Daejeon) ; Betev, Latchezar (CERN) ; Bonfillou, Eric (CERN) ; Han, Heejune (KISTI, Daejeon) ; Kim, Jeongheon (KISTI, Daejeon) ; Lee, Seung Hee ; Panzer-Steindel, Bernd (CERN) ; Peters, Andreas Joachim (CERN) ; Yoon, Heejun (KISTI, Daejeon)
Publication 2022
Number of pages 10
In: JISTaP 10 (2022) 56-65
DOI 10.1633/JISTaP.2022.10.S.6
Subject category Computing and Computers
Accelerator/Facility, Experiment CERN LHC ; ALICE
Abstract Korea Institute of Science and Technology Information (KISTI) is a Worldwide LHC Computing Grid (WLCG) Tier-1 center mandated to preserve raw data produced from A Large Ion Collider Experiment (ALICE) experiment using the world’s largest particle accelerator, the Large Hadron Collider (LHC) at European Organization for Nuclear Research (CERN). Physical medium used widely for long-term data preservation is tape, thanks to its reliability and least price per capacity compared to other media such as optical disk, hard disk, and solid-state disk. However, decreasing numbers of manufacturers for both tape drives and cartridges, and patent disputes among them escalated risk of market. As alternative to tape-based data preservation strategy, we proposed disk-only erasure-coded archival storage system, Custodial Disk Storage (CDS), powered by Exascale Open Storage (EOS), an open-source storage management software developed by CERN. CDS system consists of 18 high density Just-Bunch-Of-Disks (JBOD) enclosures attached to 9 servers through 12 Gbps Serial Attached SCSI (SAS) Host Bus Adapter (HBA) interfaces via multiple paths for redundancy and multiplexing. For data protection, we introduced Reed-Solomon (RS) (16, 4) Erasure Coding (EC) layout, where the number of data and parity blocks are 12 and 4 respectively, which gives the annual data loss probability equivalent to 5×10-14. In this paper, we discuss CDS system design based on JBOD products, performance limitations, and data protection strategy accommodating EOS EC implementation. We present CDS operations for ALICE experiment and long-term power consumption measurement.
Copyright/License publication: (License: CC-BY-4.0)
© 2022-2024 The authors

Corresponding record in: Inspire


 Записът е създаден на 2023-05-19, последна промяна на 2023-08-09


Пълен текст:
Сваляне на пълен текст
PDF