| CMS Note | |
| Report number | CMS-CR-2011-018 |
| Title | Using Amazon's Elastic Compute Cloud to scale CMS' compute hardware dynamically. |
| Author(s) | Melo, Andrew Malone (Vanderbilt U.) |
| Publication | 2011 |
| Collaboration | CMS Collaboration |
| Imprint | 11 Jan 2011 |
| Number of pages | 6 |
| Presented at | Conference on Computing in High Energy and Nuclear Physics 2010, Taipei, Taiwan, 18 - 22 Oct 2010 |
| Subject category | Detectors and Experimental Techniques |
| Accelerator/Facility, Experiment | CERN LHC ; CMS |
| Keywords | General |
| Abstract | Large international scientific collaborations such as the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider have traditionally addressed their data reduction and analysis needs by building and maintaining dedicated computational infrastructure. Emerging cloud-computing services such as Amazon's Elastic Compute Cloud (EC2) offer short-term CPU and storage resources with costs based on usage. These services allow experiments to purchase computing resources as needed, without significant prior planning and without long term investments in facilities and their management. We have demonstrated that services such as EC2 can successfully be integrated into the production-computing model of CMS, and find that they work very well as worker nodes. The cost-structure and transient nature of EC2 services makes them inappropriate for some CMS production services and functions. We also found that the resources are not truely on-demand as limits and caps on usage are imposed. Our trial workflows allow us to make a cost comparison between EC2 resources and dedicated CMS resources at a University, and conclude that it is most cost effective to purchase dedicated resources for the base-line needs of experiments such as CMS. However, if the ability to use cloud-computing resources is built into an experiment's software framework before demand requires their use, cloud computing resources make sense for bursting during times when spikes in usage are required. |
| Copyright/License | Preprint: (License: CC-BY-4.0) |
Record created 2011-04-18, last modified 2018-06-07
