See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/379243876

Virtual Reality Lab using Unity3D for Educational Applications using ESP8266
for Digital Electronics

Article in GRENZE International Journal of Engineering and Technology · March 2024

CITATIONS READS

2 294

2 authors, including:

Sanjay S Tippannavar
Sri Jayachamarajendra College of Engineering
51 PUBLICATIONS 175 CITATIONS

SEE PROFILE

All content following this page was uploaded by Sanjay S Tippannavar on 25 March 2024.

The user has requested enhancement of the downloaded file.

 Grenze International Journal of Engineering and Technology, Jan Issue

Virtual Reality Lab using Unity3D for Educational

Applications using ESP8266 for Digital Electronics
Ramya M V1 and Sanjay S Tippannavar2
1
Department of Robotics and Automation, JSS Academy of Technical Education, Bengaluru, India
Email: [email protected]
2
Department of Electronics and Communication Engineering JSS Science and Technological University, Mysuru, India
Email: [email protected]

Abstract—The use of VR in technical education has several advantages. In a wide domain of

digital electronics, the study outlines efforts done to use VR to engineering education. To
conduct experiments in a digital lab, the section offers guided domain exploration. A.pk files are
used to store the created virtual laboratory. E-Labs' project: Virtual reality (VR) technology is
used to create the remote laboratory known as digital electronics. The E-labs are primarily
designed for fundamental and general gates experiments in digital electronics. This E-labs has
the extra benefit of having both hardware and software (Blended mode). The software
component is carried out with the aid of the programme unity, which is typically used to create
simulations and video games for computers, consoles, and mobile devices. A virtual 3D
environment was created for this project using Unity. Additionally, Blender software and
Tinkercad from Autodesk are used to create the models needed to construct a virtual 3D world.
The hardware portion includes a number of parts, including an Arduino Uno, a Wi-Fi module
(NodeMCU ESP8266), an LCD, ICs, LEDs, and a breadboard. The Wi-Fi model and LCD are
both linked to the Arduino. To show the results of the research, we utilise LEDs. A Wi-Fi
module is attached to the experiment section, which also contains ICs and LEDs. To see the
virtual world, the user needs put on a VR headset.They may choose the needed experiment that
they would want to carry out, and any modifications made to the virtual environment will also
be mirrored in the physical system.When there is a pandemic and students are unable to
undertake physical experiments at their schools or institutions, the E-labs are quite
helpful.Additionally, these E-Labs will pique students' interests and foster their desire to study
new things while enabling them to comprehend subjects at their own speed.

Index Terms— Unity, Virtual Reality, ESP8266, microprocessor. Blender, Laboratory, Signal
Processing, 3D, Open-SSL.

I. INTRODUCTION
In the teaching of science and engineering, laboratories are essential. The constructivist method of teaching
emphasises student-centered learning, where students create their own knowledge via practical application and
expanding on what they already know. This method is especially well suited for scientific education.
Technology has had a significant impact on both academic and industrial fields during the last several years. A
study plan usually includes the application of new technologies to explore pedagogical difficulties. The thought
that we would be able to continue to view ourselves as a civilisation If we adopted new technology to our

Grenze ID: 01.GIJET.10.1.525

© Grenze Scientific Society, 2024
learning system. Teachers should use innovative strategies to enhance instruction for a number of compelling
scientific and political reasons. It enables the development of online learning resources to prioritise its duties and
enhance future online students' academic achievement. Additionally, educating students on new technology will
enhance their work abilities, which is crucial for graduates of higher vocational colleges. In a virtual reality
setting, the virtual world simulates the real one; in an augmented reality setting, the system superimposes virtual
material and the actual setting to improve the real one.
Virtual Reality (VR), also known as immersion multimedia, replicates a virtual environment that resembles a
physical presence in real-world or imagined environments, enabling the user to interact with that environment.
Through engaging and memorable experiences, virtual reality may enhance learning. Virtual encounters have the
capacity to engage and motivate pupils in a unique and potent manner. Instead of replacing conventional
teaching techniques, virtual labs or remote labs should only be seen as an additional tool that may significantly
increase students' comprehension and motivation. Basic digital lab experiments, such as NAND (IC 7400), NOR
(IC 7402), OR (IC 7432), AND (IC 7408), and NOT gate (IC 7404), were applied in our research.

II. METHODOLOGY
System-based on actual equipment, remote experimental labs enable students to carry out practical work using a
computer linked to the internet. Our project's primary goal is to construct the E-Labs and carry out the digital lab
experiments described in the introduction, which aids students in bettering their comprehension and allowing
them to comprehend in their own environment.
The additional benefit of a remote lab is that because the virtual lab will be linked to the hardware system, any
modifications made there will also be reflected there.The hardware system is first created independently (without
interaction with the Virtual Lab). Arduino UNO, ICs, ESP8366 (Nodemcu), and a relay make up the system. To
confirm the operating conditions, a separate test is conducted on this system. The technology is further
connected with the lab for virtual reality after testing. The Hardware component essentially enables the user to
do physical experiments. Additionally, the Hardware section will reflect any modifications made to the software
or virtual lab. IOT is utilised to complete the integration, and an arduino and wifi module are also employed so
that any input from the user in the virtual lab will also be reflected in the hardware portion. The software
component, which uses a programme called Unity3D to create it, is connected with the hardware system.
Unity3D is utilised to construct a 3D environment. The cross-platform game engine was created by Unity
Technologies and is mostly used to create computer simulations and video games. Autodesk's Blender and
Tinkercad software is used to create the three-dimensional models. It is a 3D computer graphics programme that
is open-source, free, and used to create 3D printed models, motion graphics, interactive 3D apps, virtual reality,
and visual effects. The virtual environment is represented in the Figure 1 below.

Figure 1. Front-view of the proposed system

A. Software
The new project must first be set up in Unity 3D after installation. Once this is finished, the models will be
created in the blender and Tinkercad by Autodesk programmes, imported into the unity software, and then

1591
placed inside the unity. An example of a trainker kit that is utilised in our VR lab may be seen in the picture
below. The next phase is to build a 3D virtual lab environment with the aid of these models, after which the code
for the models that has been implemented for testing. The last step is to conduct lab tests and evaluate the results.
The software approach to the proposed system is depicted in Figure 2.

Figure 2. Flow diagram of the software setup

B. Hardware
An Arduino Uno is utilised to construct the hardware system, and a Wi-Fi module to link it to the IOT. The
breadboard will then be linked to the Arduino, and ICs and LEDs will be attached to this. The experimental
component of the hardware system is the ICs and LEDs. The output is shown on an LCD.A LED is used to show
the output's status of the laboratory.

Figure 3. Circuit diagram of the hardware setup

Figure 3 depicts the E-Labs' hardware connection and integration. Due to the fact that E-Labs is used to conduct
fundamental and universal gate tests, the hardware system has five separate ICs for each experiment, with
matching LEDs being utilised to display the results.

1592
III. RESULTS AND DISCUSSIONS
The hardware component of the proposed project is mostly utilised to assess the effectiveness of the experiments
being carried out in the VR lab. The hardware system comprises of an Arduino Uno, a NodeMCU (Wi-Fi-
Module), an LCD display (16*2), LEDs, and ICs. The LCD (liquid crystal display) and NodeMCU are both
linked to the Arduino uno.In addition, connect a 10k pot's wiper (output) to pin 3 of the LCD screen, which is
connected to +5V and GND. The LCD display's contrast is managed with this 10k pot. Additional inputs are
provided to the IC via GPIO pins on the NodeMCU, and output is presented using LEDs. Additional LEDs are
attached to the output pins of each IC. A 20000Mah electricity bank supplies the Hardware Kit with electricity.
Here, five digital electronics experiments—AND, NAND, NOR, NOT, and OR—have been carried out. The
user may choose the experiment they want to do and start it. Depending on the user's input, modifications will be
made to the hardware model as changes are made to the virtual world.

Figure 4. Hardware model of the proposed system

Hardware connections are shown in figure 4. The names of the associated experiments and gates are shown in
the LCD module when various gates are chosen from the Virtual Environment. The photographs in the collection
below show various experiments from the virtual environment that the virtual environment has picked up on.
Figure 5 depicts the hardware system/trainer kit detecting several experiments as chosen by the virtual
laboratory, as can be seen from the photographs.

a) b)

c) d)

1593
 e)
Figure 5. a) OR b) AND c) NAND d) NOT e) NOR logic’s implemented on the E_labs system

Building virtual environments is how the software portion of E-labs is described in the introductory section.
Software called Unity3D was used to build a 3D world. The cross-platform game engine was created by Unity
Technologies and is mostly used to create computer simulations and video games. The virtual laboratory was
once only a single room with a table and a few components. The user using a VR headset may observe this 3D
virtual lab from any angle. Integrating the virtual laboratory with the hardware system was the primary goal of
the development stage. Following a successful integration, the virtual laboratory's future development was taken
into consideration. A careful examination of the physical laboratory was conducted, paying particular attention
to the designs of the desks, the lighting, the components set up on the tables, the room's layout, etc. This
procedure provided as inspiration for the creation of a virtual laboratory that closely matches actual labs. After
observation, the virtual laboratory underwent additional development to replicate the immersive experience
attained in actual laboratories. The next stage of development included adjusting the lighting in the virtual lab to
resemble actual conditions and modifying the characteristics of various building elements, including the walls,
floors, and more, to watch how smoothly light reflected. Walls, the ceiling, and the floor all received new
materials.
The user who is wearing the headset may choose things in the VR lab and interact with them by gazing at them
using gaze control. After the VR lab was finished, fresh settings or sceneries were created. These were
developed to enable user interactivity for the headset wearer. The user was given instructions in these situations
on how to choose things using their gaze, etc. Figure 6 depicts the various cases, the UI and the experiment room
in the VR lab designed using Unity3D.

a) b)

1594
 c) d)

e) f)

g)
Figure 6. a) Welcome Screen b) Help Screen c) Options for the experiments d) Experiment room e) Instructions class in the
f) Workbench in the VR lab g) Virtual environment visualization from the application

IV. CONCLUSIONS
The use of virtual reality in education will make experiments more visually appealing, which will make them
easier for students to grasp and will spark their enthusiasm in learning new things. So let's sum up the E-Labs
initiative.Due to its use of both hardware and software (Blended mode), digital electronics has a lot of potential
in the educational sector and will also aid in helping students learn the concepts more quickly. The VR world
will change, and those changes will also affect the hardware. Consequently, this will both provide practical
information and enable students to experience visual impacts.

REFERENCES
[1] M. T. Valdez, C. Machado Ferreira and F. P. Maciel Barbosa, "Virtual Reality as support for Learning in Electrical
Engineering," 2017 27th EAEEIE Annual Conference (EAEEIE), 2017, pp. 1-5, doi: 10.1109/EAEEIE.2017.8768565.
[2] Huang, Xiuli; Han, Guangxin; He, Juhou; Du, Jie; Liang, Yushuai (2018). [IEEE 2018 Seventh International Conference
of Educational Innovation through Technology (EITT) - Auckland, New Zealand (2018.12.12-2018.12.14)] 2018

1595
 Seventh International Conference of Educational Innovation through Technology (EITT) - Design and Application of a
VR English Learning Game Based on the APT Model.
[3] D. M. Krum, E. A. Suma and M. Bolas, "Virtual reality to go: A USC ICT Mixed Reality Lab demonstration," 2012
IEEE Virtual Reality Workshops (VRW), 2012, pp. 179-180, doi: 10.1109/VR.2012.6180939.
[4] M. T. Abhishek, P. S. Aswin, N. C. Akhil, A. Souban, S. K. Muhammedali and A. Vial, "Virtual Lab Using Markerless
Augmented Reality," 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering
(TALE), 2018, pp. 1150-1153, doi: 10.1109/TALE.2018.8615245.
[5] M. Kumar, J. Emory and V. Choppella, "Usability Analysis of Virtual Labs," 2018 IEEE 18th International Conference
on Advanced Learning Technologies (ICALT), 2018, pp. 238-240, doi: 10.1109/ICALT.2018.00061.
[6] S. Abu Shanab, S. Odeh, R. Hodrob and M. Anabtawi, "Augmented reality internet labs versus hands-on and virtual
labs: A comparative study," Proceedings of 2012 International Conference on Interactive Mobile and Computer Aided
Learning (IMCL), 2012, pp. 17-21, doi: 10.1109/IMCL.2012.6396444.
[7] Rukangu, A., Tuttle, A., & Johnsen, K. (2021). Virtual Reality for Remote Controlled Robotics in Engineering
Education. 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
[8] Restivo, Maria Teresa; Quintas, Manuel Rodrigues; Rodrigues, Jose; Cardoso, Alberto (2015). [IEEE 2015 3rd
Experiment International Conference (exp.at'15) - Ponta Delgada (2015.6.2-2015.6.4)] 2015 3rd Experiment
International Conference (exp.at'15) - Next-generation experimental
[9] M. T. Valdez, C. Machado Ferreira and F. P. Maciel Barbosa, "Virtual Reality as support for Learning in Electrical
Engineering," 2015
[10] Frerich, Sulamith; Kruse, Daniel; Petermann, Marcus; Kilzer, Andreas (2014). [IEEE 2014 IEEE Global Engineering
Education Conference (EDUCON) - Istanbul (2014.4.3-2014.4.5)] 2014 IEEE Global Engineering Education
Conference (EDUCON) - Virtual Labs and Remote Labs: Practical experience for everyone. , (), 312–
314. doi:10.1109/EDUCON.2014.6826109
[11] Bell, J.T.; Fogler, H.C. (2004). [IEEE IEEE Virtual Reality 2004 - Chicago, IL, USA (27-31 March 2004)] IEEE Virtual
Reality 2004 - The application of virtual reality to (chemical engineering) education.
[12] Mihelj, M., Novak, D., & Begus, S. (2014). Virtual reality technology and applications, Springer.
[13] Huang, W. (2019). Examining the impact of head-mounted display virtual reality on the science self-efficacy of high
schoolers. Interactive Learning Environments, 1-13.
[14] Alvarez, Jorge; Diaz, Gabino; Macias, Manuel (2019). [IEEE 2019 IEEE International Conference on Engineering
Veracruz (ICEV) - Boca del Rio, Veracruz, Mexico (2019.10.14-2019.10.17)] 2019 IEEE International Conference on
Engineering Veracruz (ICEV) - Programming logical controllers using remote labs and virtual reality.
[15] Dorota Kamińska , Tomasz Sapiński , Sławomir Wiak , Toomas Tikk , Rain Eric Haamer, Egils Avots , Ahmed Helmi ,
Cagri Ozcinar and Gholamreza Anbarjafari, Virtual Reality and Its Applications in Education: Survey.
[16] Hamza, Khalid & Alhalabi, Bassem. (2001). Remote Labs!. Computers in the Schools. 19. 10.1300/J025v19v03_14.
[17] Jona, Kemi & Roque, Ricarose & Skolnik, Julia & Uttal, David & Rapp, David. (2011). Are Remote Labs Worth the
Cost? Insights From a Study of Student Perceptions of Remote Labs. iJOE. 7. 48-53. 10.3991/ijoe.v7i2.1394.
[18] Silva, Juarez & de Oliveira, Graceline & Silva, Isabela & Mafra, Paulo. (2020). Block.ino: Remote Lab for
Programming Teaching and Learning. 7. 41-47. 10.22161/ijaers.71.6.

1596

View publication stats