1.
|
CERN Tape Archive: production status, migration from CASTOR and new features
/ Cano, Eric (CERN) ; Bahyl, Vladimír (CERN) ; Caffy, Cédric (CERN) ; Cancio, Germán (CERN) ; Davis, Michael (CERN) ; Kotlyar, Viktor (Kurchatov Inst., Moscow) ; Leduc, Julien (CERN) ; Lin, Tao (Beijing, Inst. High Energy Phys.) ; Murray, Steven (CERN)
During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments.The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. [...]
2020 - 8 p.
- Published in : EPJ Web Conf. 245 (2020) 04013
Fulltext: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04013
|
|
2.
|
CERN Tape Archive: a distributed, reliable and scalable scheduling system
/ Cano, Eric (CERN) ; Bahyl, Vladimír (CERN) ; Caffy, Cédric (CERN) ; Cancio, Germán (CERN) ; Davis, Michael (CERN) ; Keeble, Oliver (CERN) ; Kotlyar, Viktor (Kurchatov Inst., Moscow) ; Leduc, Julien (CERN) ; Murray, Steven (CERN)
The CERN Tape Archive (CTA) provides a tape backend to disk systems and, in conjunction with EOS, is managing the data of the LHC experiments at CERN.Magnetic tape storage offers the lowest cost per unit volume today, followed by hard disks and flash. In addition, current tape drives deliver a solid bandwidth (typically 360MB/s per device), but at the cost of high latencies, both for mounting a tape in the drive and for positioning when accessing non-adjacent files. [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02037
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02037
|
|
3.
|
LHC Data Storage: Preparing for the Challenges of Run-3
/ Arsuaga-Rios, Maria (CERN) ; Bahyl, Vladimír (CERN) ; Batalha, Manuel (CERN) ; Caffy, Cédric (CERN) ; Cano, Eric (CERN) ; Capitoni, Niccolo (CERN) ; Contescu, Cristian (CERN) ; Davis, Michael (CERN) ; Alvarez, David Fernandez (CERN) ; Guenther, Jaroslav (CERN) et al.
The CERN IT Storage Group ensures the symbiotic development and operations of storage and data transfer services for all CERN physics data, in particular the data generated by the four LHC experiments (ALICE, ATLAS, CMS and LHCb).In order to accomplish the objectives of the next run of the LHC (Run-3), the Storage Group has undertaken a thorough analysis of the experiments’ requirements, matching them to the appropriate storage and data transfer solutions, and undergoing a rigorous programme of testing to identify and solve any issues before the start of Run-3.In this paper, we present the main challenges presented by each of the four LHC experiments. We describe their workflows, in particular how they communicate with and use the key components provided by the Storage Group: the EOS disk storage system; its archival back-end, the CERN Tape Archive (CTA); and the File Transfer Service (FTS). [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02023
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02023
|
|
4.
|
|
A brief overview of the CTA mount scheduling logic
/ Caffy, Cedric (speaker) (CERN)
Accessing data in a tape archival system can be costly in terms of time. The time taken to mount a tape into a drive, to position the tape head to a file and to unmount the tape when this file has been read can take more than 2 minutes.
A tape drive cannot be used to archive or retrieve data during the mounting and unmounting of a tape. [...]
2021 - 1704.
HEP Computing; EOS workshop
External links: Talk details; Event details
In : EOS workshop
|
|
5.
|
An HTTP REST API for Tape-backed Storage
/ Afonso, João (CERN) ; Caffy, Cédric (CERN) ; Patrascoiu, Mihai (CERN) ; Leduc, Julien (CERN) ; Davis, Michael (CERN) ; Murray, Steven (CERN) ; Cortes, Pablo (CERN)
The goal of the HTTP REST API for Tape project is to provide a simple, minimalistic and uniform interface to manage data transfers between Storage Endpoints (SEs) where the source file is on tape. The project is a collaboration between the developers of WLCG storage systems (EOS+CTA, dCache, StoRM) and data transfer clients (gfal2, FTS).For some years, HTTP has been growing in popularity as the preferred data transfer protocol between many WLCG SEs. [...]
2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01008
Fulltext: PDF;
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01008
|
|
6.
|
|
CTA status at IHEP
/ yao, qiuling (speaker) (IHEP)
The presentation will provide an overview of the status and progress of CTA at IHEP. Last year, we completed the data migration from CASTOR to CTA, added new CTA instances for JUNO, HEPS, and LHCb Tier1. [...]
2024 - 828.
HEP Computing; CERN Tape Archive Workshop : CTA 2024
External links: Talk details; Event details
In : CERN Tape Archive Workshop : CTA 2024
|
|
7.
|
CERN Tape Archive - from development to production deployment
/ Davis, Michael C (CERN) ; Bahyl, Vladímir (CERN) ; Cancio, Germán (CERN) ; Cano, Eric (CERN) ; Leduc, Julien (CERN) ; Murray, Steven (CERN)
The first production version of the CERN Tape Archive (CTA) software is planned to be released during 2019. CTA is designed to replace CASTOR as the CERN tape archive solution, to face the scalability and performance challenges arriving with LHC Run–3. [...]
2019 - 9 p.
- Published in : EPJ Web Conf. 214 (2019) 04015
Fulltext from publisher: PDF;
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018, pp.04015
|
|
8.
|
The CERN Tape Archive Beyond CERN An Open Source Data Archival System for HEP
/ Davis, Michael (CERN) ; Afonso, João (CERN) ; Bachmann, Richard (CERN) ; Bahyl, Vladimír (CERN) ; Vera, Jorge Camarero (CERN) ; Leduc, Julien (CERN) ; Cortés, Pablo Oliver (CERN) ; Rademakers, Fons (CERN) ; Wardenær, Lasse (CERN) ; Yurchenko, Volodymyr (CERN)
The CERN Tape Archive (CTA) is the successor to CASTOR and the tape backend to EOS. It was designed to meet the needs of archival storage of data from LHC Run–3 and other experimental programmes at CERN.In the wider Worldwide LHC Computing Grid (WLCG), the tape software landscape is quite heterogeneous, but we are entering a period of consolidation. [...]
2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01048
Fulltext: PDF;
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01048
|
|
9.
|
Increasing the efficiency of tape-based storage backends
/ Bessone, N (CERN) ; Cancio, G (CERN) ; Murray, S (CERN) ; Taurelli, G (CERN)
HSM systems such as the CERN’s Advanced STORage manager (CASTOR) [1] are responsible for storing Petabytes of data which is first cached on disk and then persistently stored on tape media. The contents of these tapes are regularly repacked from older, lower-density media to new-generation, higher-density media in order to free up physical space and ensure long term data integrity and availability. [...]
CERN-IT-Note-2009-012.-
Geneva : CERN, 2010 - 6 p.
- Published in : J. Phys.: Conf. Ser. 219 (2010) 062038
Access to fulltext: PDF;
In : 17th International Conference on Computing in High Energy and Nuclear Physics, Prague, Czech Republic, 21 - 27 Mar 2009, pp.062038
|
|
10.
|
|