BASED REAL TIME SIMULATED

Thesis submitted to
Indian Institute of Information Technology, Nagpur
In partial fulfilment of the requirements for the award of degree of
NOLOGY
In

Information andCommnication Technology

by
Roll. No: T22ICT003
Supervisor(s)
Dr. Mayur Parate

Department of Computer Scence and Engineering

Indian Institute of
30 Sep 2024
Acknowledgements

At the outset, I am very grateful to the almighty God who has bestowed on me numerous blessings, allowing me to
finally pen this thesis. Other than my
express my deepest gratitude to him. I owe him a huge debt of gratitude fr all of
his invaluable advice, continuous support and patience during my M tech study. His immense knowledge and
plentiful experience have encouraged me in all the time of my academic research and daily life.
I’d want to express my gratitude for the help and support that I’ve received from the faculties of IIITN: Dr Nishant A
Ansari, HoD CSE, Dr OG Kakde, Director, IIITN and all the other teaching and non-teaching faculty members

Thank You,
Mohit Mahna
 Maj Mohit Mahna
National Defence Academy, Khadakwasla
Pune, MH, India
[email protected]
 Abstract— This paper introduces a new concept that real operational experience, boosting confidence and clarity
enables military teams to virtually try out their operations to every single soldier, resulting in much more efficient
before going in for the actual execution of those operations, in operations while saving time, effort, space, money and most
a real time, collaborative and afe environment. It is achieved
importantly, lives.
using a server to host a custom designed 3D virtual
environment mapped over an actual operational area.
Participants can join the server via their nted to them and also
with each other. Terminals and server will be connected via a
high bandwidth network to provide real time interaction
between the participants in the virtual environment.

The participants will have Head Mounted Displays with

Gyroscope to track head movements, a 360 Degree Treadmill,
a Sensory Jacket and Hand-Held Sensors as Input interfaces
which will track every movement of the individual from
Running, Crouching, Jumping to Cocking a rifle and trigger
operation. The system aims at overcoming the lack of
immersion, cohesion and understanding in present system of
training through a cost effective, administratively light and
easily implementable solution.

The idea is to fully utilize the capability of the most

advanced technology in order to impart the best and nearest to
real operational training

Keywords— Virtual Reality (VR),

In the current, fifth generation of modern warfare,
technology is everything. However, it will never replace the
ground operations required to occupy ground in a
conventional scenario and carry out effort could be saved by
employing VR (Virtual Reality) technology. It will enable
the military to carry out all kinds of operations ranging from
Surgical Strikes to PIT (Pre-Induction Training) in a safe,
simulated environment before actually deploying troops on
ground or expending any resources.

I. CURRENT SYSTEM AND NEED OF A NEW SYSTEM

A. Small Scale Operations (Small Team Concept)

For operations such as Surgical Strikes, Ambushes,
Search and Destroy Missions, map study and physical or
aerial recce is the only preparation that is possible. As all
troops will perceive a place and flow of operations
differently, they are not on the same level. Reliance of
success, is purely on briefing of the team commander and on
y carry out PIT for months. This takes a huge amount of
administrative effort,
g out of annual training camps etc, coordination and
synch within the unit is not enough. Different arms need to
work in tandem to achieve operationally effective results.
There is a requirement of strict synchronization to reduce
casualties and lead to successful and effective ops. At the
team or unit level or even during annual training camps, a
soldier is never able to experience the actual war scenario.

B. Need for Proposed System

If every soldier could experience the operations during
peace time, there would be absolute clarity during execution
of operations. Synchronizations and coordination could be
practiced on simulated operational, till perfection is
achieved. Soldiers will be well versed with how integrated
operations would work which they would have practiced
and experienced in the virtual world. There would be no
administrative load to cater for living areas, rations and
transport of such large amounts of troops and it will reduce
the training expenditures at the cost of a one-time
investment. To summarize, the system will provide next to
 II. IMPLEMENTATION The sensory vest keeps the individual in place and
along with the mechanical arm and allows the pod to
The system will consist of networked Virtual reality pod sense the rotation and vertical positioning of the body of
(ref fig 1) all connected to a server. Each individual will use the participant.
a separate virtual reality pod all connected to a server. The 360-degree Treadmill has very low friction and
tracks the frequency and intensity of steps. This allows a
A. Underlying Technology: Virtual Reality used to vary their speed, jump, walk, strafe or even walk
backwards.
The hand-held controllers allow tracking of a user’s
Virtual Reality (VR) is a next
hands. They include triggers and other buttons which
 join the same session.
allow using of weapons and equipment
 Network. A High bandwidth network (isolated
While many such devices are available, a
from the internet) will be required to connect
recommended model for indigenous production of pods
Virtual Pods to the server and transfer the very
is based on the ‘Omni One’ model (Ref Fig 4).
high quantities of data in real time.
 Software Simulated 3D Terrain. Immersive 3D
virtual environments mapped over actual
operational areas to act as the Training
Environment into which all individuals will be
loaded will have to be developed by Game Design.
 Controls. To simulate different kinds of
Environment and switch between them (Deserts,
Mountains, CI-CT etc)
 Screen. For Commanders to view and analyze the
level of training and the effectiveness of their
plans.
 Future. AI based self-improving Bots as opposition
to set difficulty levels in the future

Figure 2 : Flow Diagram of VR

C. Figure 4 : Virtual Simulation Pod
Functioning Integration of Technologies
The architecture of a single system establishment is seen
in Figure 2. Multiple VR pods will be located in a single  Each Individual will be assigned a VR Pod. All VR
pods will be connected to the server via a high-speed
establishment. To sulting networked architecture can be
network.
seen in Figure 3 below:
 Servers will be loaded with various simulated maps
based operational areas. (For example, how nCore
B. Figure 3 : Networked Architecture Gaming replicated the Galwan area in a virtual
multiplayer game).
Simulation Pod
 Once loaded, all the individuals join the simulated
environment to perform actual tasks that they will
The most important and alien term in the system is have to perform in Ops as per their role. The pod will
the VR simulation pod (Refer Figure 4). This pod will allow the individual to run in any direction, run
allow an interface between the human inputs and their ssively Multiplayer Online Role-Playing Game
output in the virtual world. (MMO-RPG).
It consists of a sensory vest that the individual
wears. This jacket is connected to a mechanical arm that  Using software, it will be possible to introduce
allows free movement within the base which is a 360- scenarios with armour attacks, arty shelling and air if
the operation requires. Even CBRN, Space attacks
and Rocket Artillery scenarios can be simulated and
grafted into the existing system.
degree treadmill. The individual wears a VR headset and
has hand held controllers. The controllers, VR glasses,  In the future, Intelligent Bots (Similar to those
Jacket and the 360-degree treadmills provide input to the developed by Open AI) will be introduced to make
server about the motion and actions that an individual the enemy resistance flawless in order to scale up
training levels to the highest standards.
performs. Each individual has his own pod which
restricts him physical while allowing all participants to  The system will have to evolve to cater for scenarios
interact within the virtual domain. ranging from virtual boot camp, to equipment
The VR headset is the audio and visual interface training, to battlefield and operation simulation.
between the virtual operational terrain and the
individual. All other sensors work towards providing
inputs to serve the audio and visual output that the user
receives though the VR headset.
 III. ADVANTAGES AND FUTURE SCOPE induvial, in a simulated environment shoots a rifle,
expended shells fly out the chamber, but if he cocks a
A. Benefits loaded rifle, live rounds fall out and the count of
ammunition reduces by 1.
 One time implementation  The British Army first implemented VR based
 Near real and effective training training in the Yorkshire Regiment and the Royal
 Fully immersive Experience Tank Regiment
 High Degree of Realism
 Real-Time interaction between all participants
 Troops will be more ‘Combat Stress’ ready as they
C. Future Scope
will experience near-real scenarios.
 Blended Environment (Integration of all arms and
services)  VR Simulation of Operational scenarios has a vast
 Greatly save Space, Time, Cost, Effort and non- horizon of upgrades possible post deployment.
operational Casualties  Open AI based ‘Self-Improving’ Bots
 Training of all terrains possible at a single location
 Possible to simulate CBRN environment which is  Integration of Simulators for Other Arms
presently not possible  Integration of multiple nodes over high-speed
 Allows Commanders at all levels to assess network for Simulating Large Scale or strategic
operational preparedness and test effectiveness of Operations
tactical and strategic plans.
 War Gaming and Annual Exercises may be held
 Allows execution of multiple plans before actual
or practiced here
operation and choose the most effective one.
 Integration with OpenAI to develop flawless  Simulation of other senses like including wind,
opponents and thereby constitute the most fool- temperature etc
proof plans.
 Makes Training and Fatigue Enjoyable
 Scalable, by only changing software
REFERENCES
 On the largest scale, Virtual Reality Wars may be
implemented to test the limits of our forces as a
whole in which different units at different times [1] Kresimir Cosic, Miroslav Slamic, “VR Based Adaptive
Stimulation in Estimation of Whiplash Injuries.”
enter the system and try to achieve their designated University of Zagreb, Polytechnic of Zagreb,
tasks as designed for actual operations publication Number 220839168
[2] Jan Goetgeluk’s company website
https://www.virtuix.com/
[3] Ian Gibson, “Virtual Reality,” University of
Singapore, IEEE Potentials · May 1998 DOI:
B. Models Implemented in Other Armies Around the World 10.11.2009 Publication number 3227386
[4] Earnest Clive, “Ready Player One” Novel based on
dependence on VR In the year 2044 which was the
 Israel used VR based training for Special Forces, inspiration for this concept.
Infantry and Sappers in order to achieve effective [5] Links from the internet that give insight on what a
results in ‘Operation Northern Shield’, which was finished model would entail:
launched to counter tunnel warfare implemented by https://futurism.com/army-soldiers-vr-combat-training
Hezbollahs and Palestinians. https://jasoren.com/vr-military-training-the-next-step-of-
combat-evolution/
 USA invented ‘Dismounted Soldier Training
https://www.futurevisual.com/blog/uses-vr-military-
System’ which is the first VR based training system training/
ever and is used for training their regular Infantry. https://finabel.org/virtual-reality-the-future-of-military-
 US Army has implemented VR based Simulated training/
Training since 2012. They have upgraded to be https://www.classvr.com/virtual-reality-industry-work/
vr-military-defence-training/
extremely realistic and are now using this system to
train Marines, Navy Seals and have now been https://www.vrs.org.uk/virtual-reality-military/
extended to various Police Departments across the https://www.ncoregames.com/
country. The level of reality is so detailed, that if an https://www.youtube.com/watch?v=VZyhQZSTIGQ