002699856 001__ 2699856
002699856 003__ SzGeCERN
002699856 005__ 20220810142236.0
002699856 0247_ $$2DOI$$9EDP Sciences$$a10.1051/epjconf/201921405045
002699856 0248_ $$aoai:inspirehep.net:1761265$$pcerncds:CERN:FULLTEXT$$pcerncds:FULLTEXT$$pcerncds:CERN$$qINSPIRE:HEP$$qForCDS
002699856 035__ $$9http://inspirehep.net/oai2d$$aoai:inspirehep.net:1761265$$d2019-11-08T12:46:52Z$$h2019-11-09T05:00:09Z$$mmarcxml
002699856 035__ $$9Inspire$$a1761265
002699856 041__ $$aeng
002699856 100__ $$aBerzano, [email protected]$$uCERN$$uINFN, Italy$$vIstituto Nazionale di Fisica Nucleare (INFN), Italy
002699856 245__ $$9EDP Sciences$$aThe ALICE analysis framework for LHC Run 3
002699856 260__ $$c2019
002699856 300__ $$a9 p
002699856 520__ $$9EDP Sciences$$aThe ALICE experiment at the LHC (CERN) is currently developing a new software framework designed for Run 3: detector and software will have to cope with Pb–Pb collision rates 100 times higher than today, leading to the combination of core Online-Offline operations into a single framework called O$^2$. The analysis code is expected to run on a few large Analysis Facilities counting 20k cores and sustainin ga 100 GB/s throughput: this requires a conjoint effort between the definition of the data format, the configuration of the Analysis Facilities and the development of the Analysis Framework. We present the prototype of a new Analysis Object Data format based on timeframes and optimized for continuous readout. Such format is designed to be extensible and transported efficiently over the network. We also present the first iteration of the Analysis Framework, based on the O$^2$ Data Processing Layer and leveraging message passing across a topology of processes. We will also illustrate the implementation and benchmarking of a compatibility layer designed to mitigate the transition from the current event-oriented analysis model to the new time-oriented one. Finally, we will give a status report on the integration of the Analysis Framework and Analysis Facilities for Run 3 into the current organized analysis model in ALICE.
002699856 540__ $$3publication$$aCC-BY-4.0$$bEDP Sciences$$uhttps://creativecommons.org/licenses/by/4.0/
002699856 542__ $$3publication$$dThe Authors$$g2019
002699856 65017 $$2SzGeCERN$$aComputing and Computers
002699856 65017 $$2SzGeCERN$$aParticle Physics - Experiment
002699856 65017 $$2SzGeCERN$$aNuclear Physics - Experiment
002699856 690C_ $$aCERN
002699856 693__ $$aCERN LHC$$eALICE
002699856 700__ $$aDeckers, Roel$$uCERN
002699856 700__ $$aGrigoras, Costin$$uCERN
002699856 700__ $$aFloris, Michele$$uCERN
002699856 700__ $$aHristov, Peter$$uCERN
002699856 700__ $$aKrzewicki, Mikolaj$$uCERN$$uFrankfurt U., FIAS$$uGoethe U., Frankfurt (main)$$vJohann-Wolfgang-Goethe University and Frankfurt Institute for Advances Studies (FIAS), Frankfurt, Germany
002699856 700__ $$aZimmermann, Markus$$uCERN
002699856 773__ $$c05045$$pEPJ Web Conf.$$v214$$wC18-07-09.6$$y2019
002699856 8564_ $$81528291$$s208496$$uhttps://cds.cern.ch/record/2699856/files/10.1051_epjconf_201921405045.pdf$$yFulltext from publisher
002699856 960__ $$a13
002699856 962__ $$b2621974$$k05045$$nsofia20180709
002699856 980__ $$aARTICLE
002699856 980__ $$aConferencePaper
002699856 999C5 $$9refextract$$9CURATOR$$hR. Brun, F. Rademakers$$o1$$sNucl.Instrum.Meth.,A389,81$$tROOT—an object oriented data analysis framework$$xR. Brun, F. Rademakers, ROOT—an object oriented data analysis framework, Nuclear Instruments and MethodsinPhysics Research SectionA:Accelerators, Spectrometers, Detectors and Associated Equipment 389,81 (1997)$$y1997
002699856 999C5 $$9refextract$$9CURATOR$$adoi:10.22323/1.070.0007$$hG. Ganis, J. Iwaszkiewicz, F. Rademakers$$mData analysis with PROOF,inXII Advanced Computing and Analysis Techniques in Physics Research (SISSA Medialab,), Vol. 70, p. 007$$o2$$xG. Ganis, J. Iwaszkiewicz, F. Rademakers, Data analysis with PROOF,inXII Advanced Computing and Analysis Techniques in Physics Research (SISSA Medialab, 2009), Vol. 70, p. 007 , DOI: 10.22323/1.070.0007$$y2009
002699856 999C5 $$9refextract$$9CURATOR$$hJ. Blomer, C. Aguado-Sánchez, P. Buncic, A. Harutyunyan$$mDistributing LHC application software and conditions databases using the CernVM file system, in Journal of Physics: Conference Series$$o3$$sJ.Phys.Conf.Ser.,331,042003$$xJ. Blomer, C. Aguado-Sánchez, P. Buncic, A. Harutyunyan, Distributing LHC application software and conditions databases using the CernVM file system, in Journal of Physics: Conference Series (IOP Publishing, 2011), Vol. 331(4),p.042003$$y2011
002699856 999C5 $$9refextract$$9CURATOR$$hP. Buncic, M. Krzewicki, P. Vande Vyvre$$o4$$rCERN-LHCC-2015-006$$tTechnical design report for the upgrade of the online-offline computing system$$xP. Buncic, M. Krzewicki, P. Vande Vyvre, Technical design report for the upgrade of the online-offline computing system, CERN-LHCC-2015-006 (2015)$$y2015
002699856 999C5 $$9refextract$$9CURATOR$$hK. Schwarz$$min Computing in High-Energy and Nuclear Physics$$o5$$tA prototype for the ALICE Analysis Facility at GSI$$uhttps://indico.cern.ch/event/587955/contributions/2937941/$$xK. Schwarz, Aprototype for the ALICE Analysis Facility at GSI,in Computing in High-Energy and Nuclear Physics 2018 (2018), https://indico.cern.ch/event/587955/contributions/2937941/$$y2018
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o6$$tThe Lustre network file system$$uhttp://lustre.org/$$xThe Lustre network file system, http://lustre.org/ (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o7$$tApache Arrow$$uhttps://arrow.apache.org/$$xApache Arrow, https://arrow.apache.org/ (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27,)$$o8$$tThe Python Data Analysis Library$$uhttps://pandas.pydata.org/$$xThe Python Data Analysis Library, https://pandas.pydata.org/ (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$hM. Zaharia, R.S. Xin, P. Wendell, T. Das, M. Armbrust, A. Dave, X. Meng, J. Rosen, S. Venkataraman, M.J. Franklinetal$$o9$$sCommun.ACM,59,56$$tApache spark: aunified engine for big data processing$$xM. Zaharia, R.S. Xin, P. Wendell, T. Das, M. Armbrust, A. Dave, X. Meng, J. Rosen, S. Venkataraman, M.J. Franklinetal,., Apache spark: aunified engine for big data processing, Communicationsofthe ACM 59,56 (2016)$$y2016
002699856 999C5 $$9refextract$$9CURATOR$$hG. Eulisse, P. Konopka, M. Krzewicki, M. Richter, D. Rohr, S.C. Wenzel$$min Computing in High-Energy and Nuclear Physics$$o10$$tEvolution of the ALICE Software Framework for LHC Run3$$uhttps://indico.cern.ch/event/587955/contributions/2938144/$$xG. Eulisse, P. Konopka, M. Krzewicki, M. Richter, D. Rohr, S.C. Wenzel, Evolution of the ALICE Software Framework for LHC Run3, in Computing in High-Energy and Nuclear Physics 2018 (2018), https://indico.cern.ch/event/587955/contributions/2938144/$$y2018
002699856 999C5 $$9refextract$$9CURATOR$$hM. Al-Turany, A. Rybalchenko, D. Klein, T. Kollegger, A. Lebedev, A. Manafov, R. Karabow-icz, F. Uhlig, D. Kresan$$min Computing in High-Energy and Nuclear Physics$$o11$$tALFA: ALICE-FAIR new message queuing based framework$$uhttps://indico.cern.ch/event/587955/contributions/2938082/$$xM. Al-Turany, A. Rybalchenko, D. Klein, T. Kollegger, A. Lebedev, A. Manafov, R. Karabow-icz, F. Uhlig, D. Kresan, ALFA: ALICE-FAIR new message queuing based framework, in Computing in High-Energy and Nuclear Physics 2018 (2018), https://indico.cern.ch/event/587955/contributions/2938082/$$y2018
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o12$$tZeroMQ$$uhttp://zeromq.org/$$xZeroMQ, http://zeromq.org/ (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o13$$tData Processing Layer reference manual$$uhttps://github.com/AliceO2Group/AliceO2/blob/dev/Framework/Core/README.md$$xData Processing Layer reference manual, https://github.com/AliceO2Group/AliceO2/blob/dev/Framework/Core/README.md (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$hS.C. Wenzel$$min Computing in High-Energy and Nuclear Physics$$o14$$tAscalable and asynchronous detector simulation system basedonALFA$$uhttps://indico.cern.ch/event/587955/contributions/2937621/$$xS.C. Wenzel, Ascalable and asynchronous detector simulation system basedonALFA, in Computing in High-Energy and Nuclear Physics 2018 (2018), https://indico.cern.ch/event/587955/contributions/2937621/$$y2018
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o15$$tALICE contribution to ROOT that adds support for Apache Arrow datasetsto RDataFrame$$uhttps://github.com/root-project/root/pull/1712$$xALICE contributiontoROOT that adds support for Apache Arrow datasetstoRDataFrame, https://github.com/root-project/root/pull/1712(last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o16$$tO2 Arrow Column streamer$$uhttps://github.com/dberzano/AliceO2/blob/analysis/Framework/TestWorkflows/src/o2ArrowColumnStreamer.cxx$$xO2 Arrow Column streamer, https://github.com/dberzano/AliceO2/blob/analysis/Framework/TestWorkflows/src/o2ArrowColumnStreamer.cxx (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o17$$tO2 parallel decompressor$$uhttps://github.com/dberzano/AliceO2/blob/analysis/Framework/TestWorkflows/src/o2ParallelDecompressor.cxx$$xO2 parallel decompressor, https://github.com/dberzano/AliceO2/blob/analysis/Framework/TestWorkflows/src/o2ParallelDecompressor.cxx (last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$m(last accessed: March 27, 2019)$$o18$$tLZ4$$uhttps://github.com/lz4/lz4$$xLZ4, https://github.com/lz4/lz4(last accessed: March 27, 2019)
002699856 999C5 $$9refextract$$9CURATOR$$hB. Bockelman, Z. Zhang, J. Pivarski$$mOptimizing ROOTIOFor Analysis$$o19$$rarXiv:1711.02659$$xB. Bockelman, Z. Zhang, J. Pivarski, Optimizing ROOTIOFor Analysis, arXiv:1711.02659 (2018)$$y2018