1.
|
Full text - Fulltext - Full text
|
2.
|
Integration of End-User Cloud Storage for CMS Analysis
/ Riahi, Hassen (CERN) ; Aimar, Alberto (CERN) ; Álvarez Ayllón, Alejandro (CERN) ; Balcas, Justas (Caltech) ; Ciangottini, Diego (INFN, Perugia ; Perugia U.) ; Hernández, José M (Madrid, CIEMAT) ; Keeble, Oliver (CERN) ; Magini, Nicolò (Fermilab) ; Manzi, Andrea (CERN) ; Mascetti, Luca (CERN) et al.
End-user Cloud storage is increasing rapidly in popularity in research communities thanks to the collaboration capabilities it offers, namely synchronisation and sharing. CERN IT has implemented a model of such storage named, CERNBox, integrated with the CERN AuthN and AuthZ services. [...]
FERMILAB-PUB-17-650.-
2018 - 4 p.
- Published in : Future Gener. Comput. Syst. 78 (2018) 1079-1082
|
|
3.
|
|
4.
|
Unified Monitoring Architecture for IT and grid services
/ Aimar, A (CERN) ; Aguado Corman, A (CERN) ; Andrade, P (CERN) ; Belov, S (Dubna, JINR) ; Delgado Fernandez, J (CERN) ; Garrido Bear, B (CERN) ; Georgiou, M (CERN) ; Karavakis, E (CERN) ; Magnoni, L (CERN) ; Rama Ballesteros, R (CERN) et al.
This paper provides a detailed overview of the Unified Monitoring Architecture (UMA) that aims at merging the monitoring of the CERN IT data centres and the WLCG monitoring using common and widely-adopted open source technologies such as Flume, Elasticsearch, Hadoop, Spark, Kibana, Grafana and Zeppelin. It provides insights and details on the lessons learned, explaining the work performed in order to monitor the CERN IT data centres and the WLCG computing activities such as the job processing, data access and transfers, and the status of sites and services..
2017 - 7 p.
- Published in : J. Phys.: Conf. Ser. 898 (2017) 092033
Fulltext: PDF;
In : 22nd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2016, San Francisco, Usa, 10 - 14 Oct 2016, pp.092033
|
|
5.
|
A comparison of different database technologies for the CMS AsyncStageOut transfer database
/ Ciangottini, D (INFN, Perugia) ; Balcas, J (Caltech) ; Mascheroni, M (Fermilab) ; Rupeika, E A (Vilnius U.) ; Vaandering, E (Fermilab) ; Riahi, H (CERN) ; Silva, J M D (Sao Paulo, IFT) ; Hernandez, J M (Madrid, CIEMAT) ; Belforte, S (INFN, Trieste) ; Ivanov, T T (Sofiya U.)
AsyncStageOut (ASO) is the component of the CMS distributed data analysis system (CRAB) that manages users transfers in a centrally controlled way using the File Transfer System (FTS3) at CERN. It addresses a major weakness of the previous, decentralized model, namely that the transfer of the user’s output data to a single remote site was part of the job execution, resulting in inefficient use of job slots and an unacceptable failure rate. [...]
2017 - 6 p.
- Published in : J. Phys.: Conf. Ser. 898 (2017) 042048
Fulltext: PDF;
In : 22nd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2016, San Francisco, Usa, 10 - 14 Oct 2016, pp.042048
|
|
6.
|
AsyncStageOut: Distributed User Data Management for CMS Analysis
/ Riahi, H (CERN) ; Wildish, T (Princeton U.) ; Ciangottini, D (INFN, Perugia ; Perugia U.) ; Hernández, J M (Madrid, CIEMAT) ; Andreeva, J (CERN) ; Balcas, J (Vilnius U.) ; Karavakis, E (CERN) ; Mascheroni, M (INFN, Milan Bicocca) ; Tanasijczuk, A J (UC, San Diego) ; Vaandering, E W (Fermilab)
AsyncStageOut (ASO) is a new component of the distributed data analysis system of CMS, CRAB, designed for managing users' data. It addresses a major weakness of the previous model, namely that mass storage of output data was part of the job execution resulting in inefficient use of job slots and an unacceptable failure rate at the end of the jobs. [...]
FERMILAB-CONF-15-605-CD.-
2015 - 9 p.
- Published in : J. Phys.: Conf. Ser. 664 (2015) 062052
Fulltext: PDF; IOP Open Access article: PDF; External link: FERMILABCONF
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015, pp.062052
|
|
7.
|
FTS3: Quantitative Monitoring
/ Riahi, H (CERN) ; Salichos, M (CERN) ; Keeble, O (CERN) ; Andreeva, J (CERN) ; Ayllon, A A (CERN) ; Girolamo, A Di (CERN) ; Magini, N (Fermilab) ; Roiser, S (CERN) ; Simon, M K (CERN)
The overall success of LHC data processing depends heavily on stable, reliable and fast data distribution. The Worldwide LHC Computing Grid (WLCG) relies on the File Transfer Service (FTS) as the data movement middleware for moving sets of files from one site to another. [...]
2015 - 9 p.
- Published in : J. Phys.: Conf. Ser. 664 (2015) 062051
IOP Open Access article: PDF;
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015, pp.062051
|
|
8.
|
CMS distributed data analysis with CRAB3
/ Mascheroni, M (INFN, Milan Bicocca ; Milan Bicocca U.) ; Balcas, J (Vilnius U.) ; Belforte, S (INFN, Trieste ; Trieste U.) ; Bockelman, B P (Nebraska U.) ; Hernandez, J M (Madrid, CIEMAT) ; Ciangottini, D (INFN, Perugia ; Perugia U.) ; Konstantinov, P B (Sofiya, Inst. Phys.) ; Silva, J M D (Sao Paulo, IFT) ; Ali, M A B M (Malaya U.) ; Melo, A M (Vanderbilt U.) et al.
The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. [...]
FERMILAB-CONF-15-606-CD.-
2015 - 8 p.
- Published in : J. Phys.: Conf. Ser. 664 (2015) 062038
IOP Open Access article: PDF;
In : 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015, pp.062038
|
|
9.
|
|
10.
|
Experience in CMS with the common analysis framework project
/ Mascheroni, Marco (INFN, Milan Bicocca ; Milan Bicocca U.) ; Spiga, Daniele (CERN) ; Boccali, Tommaso (INFN, Pisa) ; Bonacorsi, Daniele (Bologna U. ; INFN, Bologna) ; Cinquilli, Mattia (CERN) ; Giordano, Domenico (CERN) ; Fanzago, Federica (INFN, Padua ; Padua U.) ; Fisk, Ian (Fermilab) ; Girone, Maria (CERN) ; Hernandez, Jose (Madrid, CIEMAT) et al.
ATLAS, CERN-IT, and CMS embarked on a project to develop a common system for analysis workflow management, resource provisioning and job scheduling. This distributed computing infrastructure was based on elements of PanDA and prior CMS workflow tools. [...]
2014 - 7 p.
- Published in : J. Phys.: Conf. Ser. 513 (2014) 032064
In : 20th International Conference on Computing in High Energy and Nuclear Physics 2013, Amsterdam, Netherlands, 14 - 18 Oct 2013, pp.032064
|
|