| ATLAS Slides | |
| Report number | ATL-SOFT-SLIDE-2017-661 |
| Title | Federating Distributed Storage For Clouds In ATLAS |
| Author(s) |
Berghaus, Frank (University of Victoria) ; Casteels, Kevin (University of Victoria) ; Di Girolamo, Alessandro (European Laboratory for Particle Physics, CERN) ; Ebert, Marcus (University of Victoria) ; Furano, Fabrizio (CERN Tier-0) ; Fernandez Galindo, Fernando (TRIUMF) ; Lassnig, Mario (European Laboratory for Particle Physics, CERN) ; Leavett-brown, Colin Roy (University of Victoria) ; Paterson, Michael (University of Victoria) ; Serfon, Cedric (University of Oslo) ; Seuster, Rolf (University of Victoria) ; Sobie, Randall (University of Victoria) ; Tafirout, Reda (TRIUMF) ; Taylor, Ryan P. (University of Victoria) |
| Corporate author(s) | The ATLAS collaboration |
| Submitted to | 18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Seattle, WA, USA, 21 - 25 Aug 2017 |
| Submitted by | [email protected] on 15 Aug 2017 |
| Subject category | Particle Physics - Experiment |
| Accelerator/Facility, Experiment | CERN LHC ; ATLAS |
| Free keywords | deferation ; data federation ; distributed data management ; cloud federation ; object store ; cloud computing ; iaas ; atlas ; atlas distributed computing ; adc ; ddm |
| Abstract | Input data for applications that run in cloud computing centres can be stored at distant repositories, often with multiple copies of the popular data stored at many sites. Locating and retrieving the remote data can be challenging, and we believe that federating the storage can address this problem. A federation would locate the closest copy of the data currently on the basis of GeoIP information. Currently we are using the DynaFed data federation software solution developed by CERN IT. DynaFed supports several industry standards for connection protocols like Amazon's S3, Microsofts Azure, as well as WebDav and HTTP. Protocol dependent authentication is hidden from the user by using their X509 certificate. We have setup an instance of DynaFed and integrated it into the ATLAS Data Distribution Management system. We report on the challenges faced during the installation and integration. We have tested ATLAS analysis jobs submitted by the PanDA production system and we report on our first experiences with its operation. |
レコード 生成： 2017-08-15, 最終変更： 2017-08-15
PDF- Add to personal basket
- Export as BibTeX, MARC, MARCXML, DC, EndNote, NLM, Authors Contributions, RefWorks