-
Ravnest: Decentralized Asynchronous Training on Heterogeneous Devices
Authors:
Anirudh Rajiv Menon,
Unnikrishnan Menon,
Kailash Ahirwar
Abstract:
Modern deep learning models, growing larger and more complex, have demonstrated exceptional generalization and accuracy due to training on huge datasets. This trend is expected to continue. However, the increasing size of these models poses challenges in training, as traditional centralized methods are limited by memory constraints at such scales. This paper proposes an asynchronous decentralized…
▽ More
Modern deep learning models, growing larger and more complex, have demonstrated exceptional generalization and accuracy due to training on huge datasets. This trend is expected to continue. However, the increasing size of these models poses challenges in training, as traditional centralized methods are limited by memory constraints at such scales. This paper proposes an asynchronous decentralized training paradigm for large modern deep learning models that harnesses the compute power of regular heterogeneous PCs with limited resources connected across the internet to achieve favourable performance metrics. Ravnest facilitates decentralized training by efficiently organizing compute nodes into clusters with similar data transfer rates and compute capabilities, without necessitating that each node hosts the entire model. These clusters engage in $\textit{Zero-Bubble Asynchronous Model Parallel}$ training, and a $\textit{Parallel Multi-Ring All-Reduce}$ method is employed to effectively execute global parameter averaging across all clusters. We have framed our asynchronous SGD loss function as a block structured optimization problem with delayed updates and derived an optimal convergence rate of $O\left(\frac{1}{\sqrt{K}}\right)$. We further discuss linear speedup with respect to the number of participating clusters and the bound on the staleness parameter.
△ Less
Submitted 23 May, 2024; v1 submitted 3 January, 2024;
originally announced January 2024.
-
Orientation of Finite Reynolds Number Anisotropic Particles Settling in Turbulence
Authors:
Anubhab Roy,
Stefan Kramel,
Udayshankar Menon,
Greg A. Voth,
Donald L. Koch
Abstract:
We present experimental and computational results for the orientation distributions of slender fibers and ramified particles settling in an isotropic turbulent flow. The rotational dynamics of the particles is modeled using a slender-body theory that includes the inertial torque due to sedimentation that tends to rotate the particles toward a broadside orientation. The particles are assumed to rot…
▽ More
We present experimental and computational results for the orientation distributions of slender fibers and ramified particles settling in an isotropic turbulent flow. The rotational dynamics of the particles is modeled using a slender-body theory that includes the inertial torque due to sedimentation that tends to rotate the particles toward a broadside orientation. The particles are assumed to rotate due to viscous forces associated with the turbulent velocity gradients occurring on the particle length scale. In the simulations, the turbulence is obtained from a stochastic model of the velocity gradient in a Lagrangian reference frame. In the experiments, the turbulence is generated by active jets in a vertical water tunnel. It is well known that axisymmetric particles rotate according to Jeffery's solution for the rotation of a spheroidal particle if one adopts an appropriate effective aspect ratio. We show that the same result applies to a ramified particle consisting of three coplanar fibers connected with equal angles at a central point which rotates like a thin oblate spheroid. The orientation statistics can be quantified with a single non-dimensional parameter, the settling factor $S_F$, defined as the ratio of rotations due to sedimentation and turbulent shear. For low values of $S_F$, we observe nearly isotropically oriented particles, whereas particles become strongly aligned near the horizontal plane for high values of $S_F$. The variance of the angle away from horizontal scales as $S_F^{-2}$ for $S_F \gg 1$, but the orientation distribution is non-Gaussian due to turbulent intermittency in this limit.
△ Less
Submitted 30 March, 2023;
originally announced March 2023.
-
An Efficient Application of Neuroevolution for Competitive Multiagent Learning
Authors:
Unnikrishnan Rajendran Menon,
Anirudh Rajiv Menon
Abstract:
Multiagent systems provide an ideal environment for the evaluation and analysis of real-world problems using reinforcement learning algorithms. Most traditional approaches to multiagent learning are affected by long training periods as well as high computational complexity. NEAT (NeuroEvolution of Augmenting Topologies) is a popular evolutionary strategy used to obtain the best performing neural n…
▽ More
Multiagent systems provide an ideal environment for the evaluation and analysis of real-world problems using reinforcement learning algorithms. Most traditional approaches to multiagent learning are affected by long training periods as well as high computational complexity. NEAT (NeuroEvolution of Augmenting Topologies) is a popular evolutionary strategy used to obtain the best performing neural network architecture often used to tackle optimization problems in the field of artificial intelligence. This paper utilizes the NEAT algorithm to achieve competitive multiagent learning on a modified pong game environment in an efficient manner. The competing agents abide by different rules while having similar observation space parameters. The proposed algorithm utilizes this property of the environment to define a singular neuroevolutionary procedure that obtains the optimal policy for all the agents. The compiled results indicate that the proposed implementation achieves ideal behaviour in a very short training period when compared to existing multiagent reinforcement learning models.
△ Less
Submitted 23 May, 2021;
originally announced May 2021.
-
A Novel Chaotic System for Text Encryption Optimized with Genetic Algorithm
Authors:
Unnikrishnan Menon,
Anirudh Rajiv Menon,
Atharva Hudlikar
Abstract:
With meteoric developments in communication systems and data storage technologies, the need for secure data transmission is more crucial than ever. The level of security provided by any cryptosystem relies on the sensitivity of the private key, size of the key space as well as the trapdoor function being used. In order to satisfy the aforementioned constraints, there has been a growing interest ov…
▽ More
With meteoric developments in communication systems and data storage technologies, the need for secure data transmission is more crucial than ever. The level of security provided by any cryptosystem relies on the sensitivity of the private key, size of the key space as well as the trapdoor function being used. In order to satisfy the aforementioned constraints, there has been a growing interest over the past few years, in studying the behavior of chaotic systems and their applications in various fields such as data encryption due to characteristics like randomness, unpredictability and sensitivity of the generated sequence to the initial value and its parameters. This paper utilizes a novel 2D chaotic function that displays a uniform bifurcation over a large range of parameters and exhibits high levels of chaotic behavior to generate a random sequence that is used to encrypt the input data. The proposed method uses a genetic algorithm to optimize the parameters of the map to enhance security for any given textual data. Various analyses demonstrate an adequately large key space and the existence of multiple global optima indicating the necessity of the proposed system and the security provided by it.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Design and Evaluation of Electric Bus Systems for Metropolitan Cities
Authors:
Unnikrishnan Menon,
Divyani Panda
Abstract:
Over the past decade, most of the metropolitan cities across the world have been witnessing a degrading trend in air quality index. Exhaust emission data observations show that promotion of public transport could be a potential way out of this gridlock. Due to environmental concerns, numerous public transport authorities harbor a great interest in introducing zero emission electric buses. A shift…
▽ More
Over the past decade, most of the metropolitan cities across the world have been witnessing a degrading trend in air quality index. Exhaust emission data observations show that promotion of public transport could be a potential way out of this gridlock. Due to environmental concerns, numerous public transport authorities harbor a great interest in introducing zero emission electric buses. A shift from conventional diesel buses to electric buses comes with several benefits in terms of reduction in local pollution, noise, and fuel consumption. This paper proposes the relevant vehicle technologies, powertrain, and charging systems, which, in combination, provides a comprehensive methodology to design an Electric Bus that can be deployed in metropolitan cities to mitigate emission concerns.
△ Less
Submitted 26 October, 2020;
originally announced October 2020.
-
Dragon Crypto -- An Innovative Cryptosystem
Authors:
Awnon Bhowmik,
Unnikrishnan Menon
Abstract:
In recent years cyber-attacks are continuously developing. This means that hackers can find their way around the traditional cryptosystems. This calls for new and more secure cryptosystems to take their place. This paper outlines a new cryptosystem based on the dragon curve fractal. The security level of this scheme is based on multiple private keys, that are crucial for effective encryption and d…
▽ More
In recent years cyber-attacks are continuously developing. This means that hackers can find their way around the traditional cryptosystems. This calls for new and more secure cryptosystems to take their place. This paper outlines a new cryptosystem based on the dragon curve fractal. The security level of this scheme is based on multiple private keys, that are crucial for effective encryption and decryption of data. This paper discusses, how core concepts emerging from fractal geometry can be used as a trapdoor function for this cryptosystem.
△ Less
Submitted 18 August, 2020;
originally announced August 2020.
-
Scytale -- An Evolutionary Cryptosystem
Authors:
Unnikrishnan Menon,
Atharva Hudlikar,
Divyani Panda
Abstract:
With the advent of quantum computing, and other advancements in computation and processing capabilities of modern systems, there arises a need to develop new trapdoor functions that will serve as the foundation for a new generation of encryption schemes. This paper explores the possibility of one such potential trapdoor function using concepts stemming from Reversible Cellular Automata (RCA) -- sp…
▽ More
With the advent of quantum computing, and other advancements in computation and processing capabilities of modern systems, there arises a need to develop new trapdoor functions that will serve as the foundation for a new generation of encryption schemes. This paper explores the possibility of one such potential trapdoor function using concepts stemming from Reversible Cellular Automata (RCA) -- specifically, the Critter's Rule set up in a Margolus Neighborhood. The proposed block encryption algorithm discusses how sensitive data can be manipulated and converted efficiently into a two dimensional sequence of bits, that can be iteratively evolved using the rules of the RCA and a private key to achieve a desirable level of encryption within a reasonable runtime. The performance benchmark and analysis results exemplify how well the proposed encryption algorithm stands against different forms of attacks.
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
