CERN Accelerating science

ATLAS Slides
Report number	ATL-SOFT-SLIDE-2015-123
Title	Integrating Network Awareness in ATLAS Distributed Computing Using the ANSE Project
Author(s)	Klimentov, Alexei (Brookhaven National Laboratory (BNL)) ; De, Kaushik (The University of Texas at Arlington) ; Petrosyan, Artem (Joint Institute for Nuclear Research) ; Batista, Jorge Horacio (University of Michigan, Department of Physics) ; Mc Kee, Shawn Patrick (University of Michigan, Department of Physics)
Corporate author(s)	The ATLAS collaboration
Submitted by	[email protected] on 30 Mar 2015
Subject category	Particle Physics - Experiment
Accelerator/Facility, Experiment	CERN LHC ; ATLAS
Free keywords	PanDA, ATLAS, network
Abstract	A crucial contributor to the success of the massively scaled global computing system that delivers the analysis needs of the LHC experiments is the networking infrastructure upon which the system is built. The experiments have been able to exploit excellent high-bandwidth networking in adapting their computing models for the most efficient utilization of resources. New advanced networking technologies now becoming available such as software defined networking hold the potential of further leveraging the network to optimize workflows and dataflows, through proactive control of the network fabric on the part of high level applications such as experiment workload management and data management systems. End to end monitoring of networks using perfSONAR combined with data flow performance metrics further allows applications to adapt based on real time conditions. We will describe efforts underway in ATLAS on integrating network awareness at the application level, particularly in workload management, building upon the ANSE (Advance Network Services for Experiments) project components. We will show how knowledge of network conditions, both historical and current, are used to optimize PanDA and other systems for ATLAS and describe how software control of end-to-end network paths can augment ATLAS's ability to effectively utilize its distributed resources.