|
1.
|
An HTTP REST API for Tape-backed Storage
/ Afonso, João (CERN) ; Caffy, Cédric (CERN) ; Patrascoiu, Mihai (CERN) ; Leduc, Julien (CERN) ; Davis, Michael (CERN) ; Murray, Steven (CERN) ; Cortes, Pablo (CERN)
The goal of the HTTP REST API for Tape project is to provide a simple, minimalistic and uniform interface to manage data transfers between Storage Endpoints (SEs) where the source file is on tape. The project is a collaboration between the developers of WLCG storage systems (EOS+CTA, dCache, StoRM) and data transfer clients (gfal2, FTS).For some years, HTTP has been growing in popularity as the preferred data transfer protocol between many WLCG SEs. [...]
2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01008
Fulltext: PDF;
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01008
|
|
|
2.
|
FTS Service Evolution and LHC Run-3 Operations
/ Murray, Steven (CERN) ; Patrascoiu, Mihai (CERN) ; Mascetti, Luca (CERN) ; Lopes, Joao Pedro (CERN) ; Misra, Shubhangi (CERN) ; Junior, Eraldo Silva (Rio de Janeiro, CBPF)
The File Transfer Service (FTS) is a software system responsible for queuing, scheduling, dispatching and retrying file transfer requests, it is used by three of the LHC experiments, namely ATLAS, CMS and LHCb, as well as non LHC experiments including AMS, Dune and NA62. FTS is critical to the success of many experiments and the service must remain available and performant during the entire LHC Run-3. [...]
2024 - 8 p.
- Published in : EPJ Web Conf. 295 (2024) 01031
Fulltext: PDF;
In : 26th International Conference on Computing in High Energy & Nuclear Physics, Norfolk, Virginia, Us, 8 - 12 May 2023, pp.01031
|
|
|
3.
|
LHC Data Storage: Preparing for the Challenges of Run-3
/ Arsuaga-Rios, Maria (CERN) ; Bahyl, Vladimír (CERN) ; Batalha, Manuel (CERN) ; Caffy, Cédric (CERN) ; Cano, Eric (CERN) ; Capitoni, Niccolo (CERN) ; Contescu, Cristian (CERN) ; Davis, Michael (CERN) ; Alvarez, David Fernandez (CERN) ; Guenther, Jaroslav (CERN) et al.
The CERN IT Storage Group ensures the symbiotic development and operations of storage and data transfer services for all CERN physics data, in particular the data generated by the four LHC experiments (ALICE, ATLAS, CMS and LHCb).In order to accomplish the objectives of the next run of the LHC (Run-3), the Storage Group has undertaken a thorough analysis of the experiments’ requirements, matching them to the appropriate storage and data transfer solutions, and undergoing a rigorous programme of testing to identify and solve any issues before the start of Run-3.In this paper, we present the main challenges presented by each of the four LHC experiments. We describe their workflows, in particular how they communicate with and use the key components provided by the Storage Group: the EOS disk storage system; its archival back-end, the CERN Tape Archive (CTA); and the File Transfer Service (FTS). [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02023
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02023
|
|
|
4.
|
CERN Tape Archive: a distributed, reliable and scalable scheduling system
/ Cano, Eric (CERN) ; Bahyl, Vladimír (CERN) ; Caffy, Cédric (CERN) ; Cancio, Germán (CERN) ; Davis, Michael (CERN) ; Keeble, Oliver (CERN) ; Kotlyar, Viktor (Kurchatov Inst., Moscow) ; Leduc, Julien (CERN) ; Murray, Steven (CERN)
The CERN Tape Archive (CTA) provides a tape backend to disk systems and, in conjunction with EOS, is managing the data of the LHC experiments at CERN.Magnetic tape storage offers the lowest cost per unit volume today, followed by hard disks and flash. In addition, current tape drives deliver a solid bandwidth (typically 360MB/s per device), but at the cost of high latencies, both for mounting a tape in the drive and for positioning when accessing non-adjacent files. [...]
2021 - 10 p.
- Published in : EPJ Web Conf. 251 (2021) 02037
Fulltext: PDF;
In : 25th International Conference on Computing in High-Energy and Nuclear Physics (CHEP), Online, Online, 17 - 21 May 2021, pp.02037
|
|
|
5.
|
CERN Tape Archive: production status, migration from CASTOR and new features
/ Cano, Eric (CERN) ; Bahyl, Vladimír (CERN) ; Caffy, Cédric (CERN) ; Cancio, Germán (CERN) ; Davis, Michael (CERN) ; Kotlyar, Viktor (Kurchatov Inst., Moscow) ; Leduc, Julien (CERN) ; Lin, Tao (Beijing, Inst. High Energy Phys.) ; Murray, Steven (CERN)
During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments.The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. [...]
2020 - 8 p.
- Published in : EPJ Web Conf. 245 (2020) 04013
Fulltext: PDF;
In : 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 4 - 8 Nov 2019, pp.04013
|
|
|
6.
|
|
ALICE and the CTA Garbage Collectors
/ Murray, Steven (speaker) (CERN)
In the standard layout of an EOSCTA deployment there are two SSD buffers in front of the tape drives. One is called the “default” space and is used for writing files to tape and the other is called the “retrieve” space and is used for reading them back. [...]
2021 - 1177.
HEP Computing; EOS workshop
External links: Talk details; Event details
In : EOS workshop
|
|
|
7.
|
CERN Tape Archive - from development to production deployment
/ Davis, Michael C (CERN) ; Bahyl, Vladímir (CERN) ; Cancio, Germán (CERN) ; Cano, Eric (CERN) ; Leduc, Julien (CERN) ; Murray, Steven (CERN)
The first production version of the CERN Tape Archive (CTA) software is planned to be released during 2019. CTA is designed to replace CASTOR as the CERN tape archive solution, to face the scalability and performance challenges arriving with LHC Run–3. [...]
2019 - 9 p.
- Published in : EPJ Web Conf. 214 (2019) 04015
Fulltext from publisher: PDF;
In : 23rd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2018, Sofia, Bulgaria, 9 - 13 Jul 2018, pp.04015
|
|
|
8.
|
Experiences and challenges running CERN's high capacity tape archive
/ Cancio, Germ (CERN) ; Bahyl, Vladim (CERN) ; Kruse, Daniele Francesco (CERN) ; Leduc, Julien (CERN) ; Cano, Eric (CERN) ; Murray, Steven (CERN)
CERN's tape-based archive system has collected over 70 Petabytes of data during the first run of the LHC. The Long Shutdown is being used for migrating the complete 100 Petabytes data archive to higher-density tape media. [...]
2015 - 8 p.
- Published in : J. Phys.: Conf. Ser. 664 (2015) 042006
IOP Open Access article: PDF;
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015, pp.042006
|
|
|
9.
|
|
|
10.
|
The Run Control and Monitoring System of the CMS Experiment
/ Bauer, Gerry (MIT) ; Boyer, Vincent (CERN) ; Branson, James G (UCLA, Los Angeles) ; Brett, Angela Mary (CERN) ; Cano, Eric (CERN) ; Carboni, Andrea (CERN) ; Ciganek, Marek (CERN) ; Cittolin, Sergio (CERN) ; O'dell, Vivian (Fermilab) ; Erhan, Samim (CERN ; UC, San Diego) et al.
The CMS experiment at the LHC at CERN will start taking data in 2008. To configure, control and
monitor the experiment during data-taking the Run Control and Monitoring System (RCMS) was
developed. [...]
CMS-CR-2007-062.-
Geneva : CERN, 2007 - 8 p.
Fulltext: PDF;
|
|
email оповещение
или подпишитесь на 
RSS-канал.