-
The Analytical Method algorithm for trigger primitives generation at the LHC Drift Tubes detector
Authors:
G. Abbiendi,
J. Alcaraz Maestre,
A. Álvarez Fernández,
B. Álvarez González,
N. Amapane,
I. Bachiller,
L. Barcellan,
C. Baldanza,
C. Battilana,
M. Bellato,
G. Bencze,
M. Benettoni,
N. Beni,
A. Benvenuti,
A. Bergnoli,
L. C. Blanco Ramos,
L. Borgonovi,
A. Bragagnolo,
V. Cafaro,
A. Calderon,
E. Calvo,
R. Carlin,
C. A. Carrillo Montoya,
F. R. Cavallo,
J. M. Cela Ruiz
, et al. (121 additional authors not shown)
Abstract:
The Compact Muon Solenoid (CMS) experiment prepares its Phase-2 upgrade for the high-luminosity era of the LHC operation (HL-LHC). Due to the increase of occupancy, trigger latency and rates, the full electronics of the CMS Drift Tube (DT) chambers will need to be replaced. In the new design, the time bin for the digitisation of the chamber signals will be of around 1~ns, and the totality of the s…
▽ More
The Compact Muon Solenoid (CMS) experiment prepares its Phase-2 upgrade for the high-luminosity era of the LHC operation (HL-LHC). Due to the increase of occupancy, trigger latency and rates, the full electronics of the CMS Drift Tube (DT) chambers will need to be replaced. In the new design, the time bin for the digitisation of the chamber signals will be of around 1~ns, and the totality of the signals will be forwarded asynchronously to the service cavern at full resolution. The new backend system will be in charge of building the trigger primitives of each chamber. These trigger primitives contain the information at chamber level about the muon candidates position, direction, and collision time, and are used as input in the L1 CMS trigger. The added functionalities will improve the robustness of the system against ageing. An algorithm based on analytical solutions for reconstructing the DT trigger primitives, called Analytical Method, has been implemented both as a software C++ emulator and in firmware. Its performance has been estimated using the software emulator with simulated and real data samples, and through hardware implementation tests. Measured efficiencies are 96 to 98\% for all qualities and time and spatial resolutions are close to the ultimate performance of the DT chambers. A prototype chain of the HL-LHC electronics using the Analytical Method for trigger primitive generation has been installed during Long Shutdown 2 of the LHC and operated in CMS cosmic data taking campaigns in 2020 and 2021. Results from this validation step, the so-called Slice Test, are presented.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
To update or not to update? Neurons at equilibrium in deep models
Authors:
Andrea Bragagnolo,
Enzo Tartaglione,
Marco Grangetto
Abstract:
Recent advances in deep learning optimization showed that, with some a-posteriori information on fully-trained models, it is possible to match the same performance by simply training a subset of their parameters. Such a discovery has a broad impact from theory to applications, driving the research towards methods to identify the minimum subset of parameters to train without look-ahead information…
▽ More
Recent advances in deep learning optimization showed that, with some a-posteriori information on fully-trained models, it is possible to match the same performance by simply training a subset of their parameters. Such a discovery has a broad impact from theory to applications, driving the research towards methods to identify the minimum subset of parameters to train without look-ahead information exploitation. However, the methods proposed do not match the state-of-the-art performance, and rely on unstructured sparsely connected models. In this work we shift our focus from the single parameters to the behavior of the whole neuron, exploiting the concept of neuronal equilibrium (NEq). When a neuron is in a configuration at equilibrium (meaning that it has learned a specific input-output relationship), we can halt its update; on the contrary, when a neuron is at non-equilibrium, we let its state evolve towards an equilibrium state, updating its parameters. The proposed approach has been tested on different state-of-the-art learning strategies and tasks, validating NEq and observing that the neuronal equilibrium depends on the specific learning setup.
△ Less
Submitted 14 November, 2022; v1 submitted 19 July, 2022;
originally announced July 2022.
-
SeReNe: Sensitivity based Regularization of Neurons for Structured Sparsity in Neural Networks
Authors:
Enzo Tartaglione,
Andrea Bragagnolo,
Francesco Odierna,
Attilio Fiandrotti,
Marco Grangetto
Abstract:
Deep neural networks include millions of learnable parameters, making their deployment over resource-constrained devices problematic. SeReNe (Sensitivity-based Regularization of Neurons) is a method for learning sparse topologies with a structure, exploiting neural sensitivity as a regularizer. We define the sensitivity of a neuron as the variation of the network output with respect to the variati…
▽ More
Deep neural networks include millions of learnable parameters, making their deployment over resource-constrained devices problematic. SeReNe (Sensitivity-based Regularization of Neurons) is a method for learning sparse topologies with a structure, exploiting neural sensitivity as a regularizer. We define the sensitivity of a neuron as the variation of the network output with respect to the variation of the activity of the neuron. The lower the sensitivity of a neuron, the less the network output is perturbed if the neuron output changes. By including the neuron sensitivity in the cost function as a regularization term, we areable to prune neurons with low sensitivity. As entire neurons are pruned rather then single parameters, practical network footprint reduction becomes possible. Our experimental results on multiple network architectures and datasets yield competitive compression ratios with respect to state-of-the-art references.
△ Less
Submitted 7 February, 2021;
originally announced February 2021.
-
LOss-Based SensiTivity rEgulaRization: towards deep sparse neural networks
Authors:
Enzo Tartaglione,
Andrea Bragagnolo,
Attilio Fiandrotti,
Marco Grangetto
Abstract:
LOBSTER (LOss-Based SensiTivity rEgulaRization) is a method for training neural networks having a sparse topology. Let the sensitivity of a network parameter be the variation of the loss function with respect to the variation of the parameter. Parameters with low sensitivity, i.e. having little impact on the loss when perturbed, are shrunk and then pruned to sparsify the network. Our method allows…
▽ More
LOBSTER (LOss-Based SensiTivity rEgulaRization) is a method for training neural networks having a sparse topology. Let the sensitivity of a network parameter be the variation of the loss function with respect to the variation of the parameter. Parameters with low sensitivity, i.e. having little impact on the loss when perturbed, are shrunk and then pruned to sparsify the network. Our method allows to train a network from scratch, i.e. without preliminary learning or rewinding. Experiments on multiple architectures and datasets show competitive compression ratios with minimal computational overhead.
△ Less
Submitted 16 November, 2020;
originally announced November 2020.
-
Pruning artificial neural networks: a way to find well-generalizing, high-entropy sharp minima
Authors:
Enzo Tartaglione,
Andrea Bragagnolo,
Marco Grangetto
Abstract:
Recently, a race towards the simplification of deep networks has begun, showing that it is effectively possible to reduce the size of these models with minimal or no performance loss. However, there is a general lack in understanding why these pruning strategies are effective. In this work, we are going to compare and analyze pruned solutions with two different pruning approaches, one-shot and gra…
▽ More
Recently, a race towards the simplification of deep networks has begun, showing that it is effectively possible to reduce the size of these models with minimal or no performance loss. However, there is a general lack in understanding why these pruning strategies are effective. In this work, we are going to compare and analyze pruned solutions with two different pruning approaches, one-shot and gradual, showing the higher effectiveness of the latter. In particular, we find that gradual pruning allows access to narrow, well-generalizing minima, which are typically ignored when using one-shot approaches. In this work we also propose PSP-entropy, a measure to understand how a given neuron correlates to some specific learned classes. Interestingly, we observe that the features extracted by iteratively-pruned models are less correlated to specific classes, potentially making these models a better fit in transfer learning approaches.
△ Less
Submitted 30 April, 2020;
originally announced April 2020.
-
Study of the effects of radiation on the CMS Drift Tubes Muon Detector for the HL-LHC
Authors:
G. Abbiendi,
J. Alcaraz Maestre,
A. Álvarez Fernández,
B. Álvarez González,
N. Amapane,
I. Bachiller,
J. M. Barcala,
L. Barcellan,
C. Battilana,
M. Bellato,
G. Bencze,
M. Benettoni,
N. Beni,
A. Benvenuti,
L. C. Blanco Ramos,
A. Boletti,
A. Bragagnolo,
J. A. Brochero Cifuentes,
V. Cafaro,
A. Calderon,
E. Calvo,
A. Cappati,
R. Carlin,
C. A. Carrillo Montoya,
F. R. Cavallo
, et al. (118 additional authors not shown)
Abstract:
The CMS drift tubes (DT) muon detector, built for withstanding the LHC expected integrated and instantaneous luminosities, will be used also in the High Luminosity LHC (HL-LHC) at a 5 times larger instantaneous luminosity and, consequently, much higher levels of radiation, reaching about 10 times the LHC integrated luminosity. Initial irradiation tests of a spare DT chamber at the CERN gamma irrad…
▽ More
The CMS drift tubes (DT) muon detector, built for withstanding the LHC expected integrated and instantaneous luminosities, will be used also in the High Luminosity LHC (HL-LHC) at a 5 times larger instantaneous luminosity and, consequently, much higher levels of radiation, reaching about 10 times the LHC integrated luminosity. Initial irradiation tests of a spare DT chamber at the CERN gamma irradiation facility (GIF++), at large ($\sim$O(100)) acceleration factor, showed ageing effects resulting in a degradation of the DT cell performance. However, full CMS simulations have shown almost no impact in the muon reconstruction efficiency over the full barrel acceptance and for the full integrated luminosity. A second spare DT chamber was moved inside the GIF++ bunker in October 2017. The chamber was being irradiated at lower acceleration factors, and only 2 out of the 12 layers of the chamber were switched at working voltage when the radioactive source was active, being the other layers in standby. In this way the other non-aged layers are used as reference and as a precise and unbiased telescope of muon tracks for the efficiency computation of the aged layers of the chamber, when set at working voltage for measurements. An integrated dose equivalent to two times the expected integrated luminosity of the HL-LHC run has been absorbed by this second spare DT chamber and the final impact on the muon reconstruction efficiency is under study. Direct inspection of some extracted aged anode wires presented a melted resistive deposition of materials. Investigation on the outgassing of cell materials and of the gas components used at the GIF++ are underway. Strategies to mitigate the ageing effects are also being developed. From the long irradiation measurements of the second spare DT chamber, the effects of radiation in the performance of the DTs expected during the HL-LHC run will be presented.
△ Less
Submitted 12 December, 2019;
originally announced December 2019.
-
Opportunities in Flavour Physics at the HL-LHC and HE-LHC
Authors:
A. Cerri,
V. V. Gligorov,
S. Malvezzi,
J. Martin Camalich,
J. Zupan,
S. Akar,
J. Alimena,
B. C. Allanach,
W. Altmannshofer,
L. Anderlini,
F. Archilli,
P. Azzi,
S. Banerjee,
W. Barter,
A. E. Barton,
M. Bauer,
I. Belyaev,
S. Benson,
M. Bettler,
R. Bhattacharya,
S. Bifani,
A. Birnkraut,
F. Bishara,
T. Blake,
S. Blusk
, et al. (278 additional authors not shown)
Abstract:
Motivated by the success of the flavour physics programme carried out over the last decade at the Large Hadron Collider (LHC), we characterize in detail the physics potential of its High-Luminosity and High-Energy upgrades in this domain of physics. We document the extraordinary breadth of the HL/HE-LHC programme enabled by a putative Upgrade II of the dedicated flavour physics experiment LHCb and…
▽ More
Motivated by the success of the flavour physics programme carried out over the last decade at the Large Hadron Collider (LHC), we characterize in detail the physics potential of its High-Luminosity and High-Energy upgrades in this domain of physics. We document the extraordinary breadth of the HL/HE-LHC programme enabled by a putative Upgrade II of the dedicated flavour physics experiment LHCb and the evolution of the established flavour physics role of the ATLAS and CMS general purpose experiments. We connect the dedicated flavour physics programme to studies of the top quark, Higgs boson, and direct high-$p_T$ searches for new particles and force carriers. We discuss the complementarity of their discovery potential for physics beyond the Standard Model, affirming the necessity to fully exploit the LHC's flavour physics potential throughout its upgrade eras.
△ Less
Submitted 20 February, 2019; v1 submitted 18 December, 2018;
originally announced December 2018.