CERN Accelerating science

Article
Report number	arXiv:1507.07429 ; FERMILAB-CONF-15-661-CMS
Title	Optimizing CMS build infrastructure via Apache Mesos
Related title	Optimizing CMS build infrastructure via Apache Mesos
Author(s)	Abduracmanov, David (Fermilab) ; Degano, Alessandro (Turin U.) ; Elmer, Peter (Princeton U.) ; Eulisse, Giulio (Northeastern Hill U., Shillong) ; Mendez, David (Andes U., Bogota) ; Muzaffar, Shahzad (Fermilab)
Publication	2015-12-23
Imprint	20 Jul 2015
Number of pages	6
Note	Submitted to proceedings of the 21st International Conference on Computing in High Energy and Nuclear Physics (CHEP2015), Okinawa, Japan
In:	J. Phys.: Conf. Ser. 664 (2015) 062013
In:	21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 13 - 17 Apr 2015, pp.062013
DOI	10.1088/1742-6596/664/6/062013
Subject category	Computing and Computers
Accelerator/Facility, Experiment	CERN LHC ; CMS
Abstract	The Offline Software of the CMS Experiment at the Large Hadron Collider (LHC) at CERN consists of 6M lines of in-house code, developed over a decade by nearly 1000 physicists, as well as a comparable amount of general use open-source code. A critical ingredient to the success of the construction and early operation of the WLCG was the convergence, around the year 2000, on the use of a homogeneous environment of commodity x86-64 processors and Linux. Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It can run Hadoop, Jenkins, Spark, Aurora, and other applications on a dynamically shared pool of nodes. We present how we migrated our continuos integration system to schedule jobs on a relatively small Apache Mesos enabled cluster and how this resulted in better resource usage, higher peak performance and lower latency thanks to the dynamic scheduling capabilities of Mesos.
Copyright/License	arXiv nonexclusive-distrib. 1.0 publication: © 2015-2025 The Author(s) (License: CC-BY-3.0)

Corresponding record in: Inspire