[Gesture Controlled Virtual Mo]

ON
Submitted in partial fulfillment of the requirements
of the degree of
Bachelor of Engineering
(Information Technology)
By

Mr. Krishi Mankani-Roll no (39)

Ms. Disha Menghani-Roll no (41)
Mr. Siddharth Motwani-Roll no(46)
Mr. Ganesh Shetty-Roll no(62)
Under the guidance of

Mrs. Vinita Mishra

Department of Information Technology

VIVEKANAND EDUCATION SOCIETY’S INSTITUTE OF TECHNOLOGY, Chembur, Mumbai
400074
(An Autonomous Institute, Affiliated to University of Mumbai)
 April 2024

Certificate
This is to certify that project entitled

”Gesture Controlled Virtual Mouse”

Group Members Names

Mr. Krishi Mankani-Roll no (39)
Ms. Disha Menghani-Roll no (41)
Mr. Siddharth Motwani-Roll no(46) Mr.
Ganesh Shetty-Roll no(62))
In fulfillment of degree of BE. in Information Technology for Project is approved.

Prof. Mrs. Vinita Mishra External Examiner

Project Mentor

Dr.(Mrs.)J.M.Nair
Dr.(Mrs.)Shalu Chopra Principal
H.O.D

Date: / /2024
Place: VESIT, Chembur
College Seal
 Gesture Controlled Virtual Mouse

Declaration

I declare that this written submission represents my ideas in my own words and where
others’ ideas or words have been included, I have adequately cited and referenced the
original sources. I also declare that I have adhered to all principles of academic honesty
and integrity and have not misrepresented or fabricated or falsified any
idea/data/fact/source in my submission. I understand that any violation of the above
will be cause for disciplinary action by the Institute and can also evoke penal action
from the sources which have thus not been properly cited or from whom proper
permission has not been taken when needed.

- ----------
(Signature)

Mr. Krishi Mankani (Roll No 39.)

- ----------
(Signature)

Miss.Disha Menghani (Roll No.41)

- ----------
(Signature)

Mr. Siddharth Motwani(Roll No.41)

- ----------
(Signature)

Mr. Ganesh Shetty (Roll No.62)

i
Dept. of Information Technology
Gesture Controlled Virtual Mouse

Abstract

With the increasing integration of virtual reality (VR) and augmented reality (AR)
technologies into everyday computing environments, the need for intuitive and
efficient interaction methods has become paramount. Gesture control, a promising
avenue in human-computer interaction, offers a natural and immersive way to navigate
digital spaces. This abstract delves into the concept of a gesture-controlled virtual
mouse, which leverages hand movements and gestures to emulate the functions of a
traditional computer mouse within virtual environments. This paper provides a
comprehensive review of the current state-of-the-art in gesture-controlled virtual
mouse systems, exploring their underlying technologies, implementation
methodologies, and usability aspects. Various gesture recognition techniques, ranging
from computer vision-based approaches to sensor-equipped wearables, are discussed,
highlighting their respective strengths and limitations. Additionally, the paper
examines the usability challenges associated with gesture-based interactions, such as
gesture ambiguity and user fatigue, and proposes potential solutions to enhance user
experience and system performance. Furthermore, the abstract investigates the
applications and potential impact of gesture-controlled virtual mouse systems across
diverse domains, including gaming, productivity, and accessibility. Through a
comparative analysis of existing solutions and emerging trends, this abstract aims to
provide insights into the future directions of gesture-controlled interfaces and their
role in shaping the next generation of human-computer interaction paradigms.
.

Keywords- Gesture control, virtual mouse, human-computer interaction, virtual

reality, augmented reality, gesture recognition, computer vision, wearable sensors,
usability, user experience, gaming, productivity, accessibility, interface design, emerging
technologies.

ii
Dept. of Information Technology

Contents
1 Introduction ...............................................................................................................................1
1.1 Introduction ..............................................................................................................................1
1.2 Objectives ...................................................................................................................................2
1.3 Motivation ..................................................................................................................................2
1.4 Scope of the Work ....................................................................................................................4
1.5 Feasibility Study .......................................................................................................................4
1.6 Organization of the report .....................................................................................................5
2 Literature Survey ......................................................................................................................7
2.1 Introduction ..............................................................................................................................7
2.2 Problem Definition ..................................................................................................................7
2.3 Review of Literature Survey ..................................................................................................7
3 Implementation And Design ...............................................................................................12
3.0.1 Implementation...................................................................................................................12
3.0.2 Design ....................................................................................................................................14
3.1 Introduction ............................................................................................................................14
3.2 Requirement Gathering ........................................................................................................14
3.3 Proposed Design.....................................................................................................................15
3.4 Proposed Algorithm ..............................................................................................................16
3.5 Architectural Diagrams .........................................................................................................18
4 Results and Discussion .........................................................................................................20
4.1 Introduction ............................................................................................................................20
4.2 Cost Estimation.......................................................................................................................20
4.3 VS CODE ...................................................................................................................................21
4.4 Results of Implementation ...................................................................................................24
4.5 Result Analysis ........................................................................................................................26
5 Conclusion .................................................................................................................................29
5.1 Conclusion ...............................................................................................................................29
5.2 Future Scope ...........................................................................................................................30
5.3 Published Paper......................................................................................................................31
iii
List of Figures
3.1 Block Daigram For proposed System ................... 16
3.2 Hand Cooridinates ............................. 17
3.3 Flowchart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
3.4 Accuracy .................................. 18
4.1 Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
4.2 Working of Gesture Controlled Virtual Mouse . . . . . . . . . . . . . . 27

iv
List of Tables

v
 Gesture Controlled Virtual Mouse

ACKNOWLEDGEMENT

The project report on ”Gesture Controlled Virtual Mouse” is the outcome of the
guidance, moral support and devotion bestowed on our group throughout our work.
For this we acknowledge and express our profound sense of gratitude to everybody
who has been the source of inspiration throughout project preparation. First and
foremost we offer our sincere phrases of thanks and innate humility to ”HOD Mrs. Shalu
Chopra ”, ”Deputy HOD Dr. Manoj Sabnis”, ”Project guide Mrs. Vinita Mishra ” for
providing the valuable inputs and the consistent guidance and support provided by
them.We can say in words that we must at outset tender our intimacy for receipt of
affectionate care to Vivekanand Education Society’s Institute of Technology for
providing such a stimulating atmosphere and conducive work environment.

vi
CHAPTER: 1 INTRODUCTION
Chapter 1
Introduction
1.1. Introduction
In recent years, the integration of virtual reality (VR) and augmented reality
(AR) technologies into various facets of daily life has revolutionized the way
individuals interact with digital environments. One fundamental aspect of this
transformation is the need for intuitive and efficient means of interaction
within these immersive spaces. Traditional input devices, such as keyboards
and mice, while effective in conventional computing environments, may not
fully capitalize on the immersive potential of VR and AR. Gesture control
emerges as a compelling solution to this challenge, offering users a natural
and intuitive means of interacting with digital content in virtual
environments. By leveraging hand movements and gestures, gesture-
controlled interfaces enable users to navigate and manipulate digital spaces
with unprecedented ease and fluidity. Among the myriad applications of
gesture control, the concept of a gesture-controlled virtual mouse stands out
as a particularly promising avenue for enhancing user interaction within VR
and AR environments. The essence of a gesture-controlled virtual mouse lies
in its ability to emulate the functionalities of a traditional computer mouse
using hand gestures. Rather than relying on physical hardware, users can
manipulate virtual cursors and interact with digital objects solely through
intuitive hand movements. This not only enhances immersion but also
enables users to perform tasks more seamlessly, whether it be navigating
menus, selecting objects, or interacting with virtual interfaces. In this context,
this project aims to explore the development and implementation of a
gesture-controlled virtual mouse system, examining its underlying
technologies, usability considerations, and potential applications. By
conducting a comprehensive review of existing literature and emerging
trends in gesture recognition, computer vision, and wearable technology, this
project seeks to identify the key challenges and opportunities in the design
and deployment of gesture-controlled interfaces within VR and AR
environments. Furthermore, the project will delve into the usability aspects
of gesture-controlled virtual mouse systems, considering factors such as
gesture accuracy, user fatigue, and accessibility. Through empirical studies
and user testing, insights will be gained into the effectiveness and user
experience of different gesture recognition techniques and interaction
modalities. Ultimately, by advancing our understanding of gesture-controlled
interfaces and their role in shaping the future of human-computer interaction,

1
 Gesture Controlled Virtual Mouse

this project aims to contribute to the development of more immersive,

intuitive, and accessible computing experiences in virtual and augmented
reality environments.
1.2. Objectives
The project focuses on developing gesture-controlled virtual mouse systems
tailored for virtual reality (VR) and augmented reality (AR) environments. It
involves in-depth exploration of gesture recognition technologies and
subsequent design of a prototype system capable of accurately tracking hand
movements to translate them into virtual cursor actions. User experience
evaluation forms a critical aspect, encompassing rigorous testing to assess
gesture accuracy, user fatigue, and system responsiveness. The project also
delves into diverse application domains like gaming and productivity while
addressing challenges such as gesture ambiguity. Integration of wearable
sensors and computer vision techniques is slated to enhance system
versatility across different VR and AR platforms. Comprehensive
documentation of the project’s methodologies and findings aims to provide
valuable insights for the research community, culminating in actionable
recommendations for future gesture-controlled interface development,
considering both technical feasibility and user acceptance factors.

1.3. Motivation
The motivation behind this work stems from the recognition of the growing
importance of virtual reality (VR) and augmented reality (AR) technologies in
transforming the way we interact with digital content. Traditional input
methods often fall short in providing intuitive and immersive experiences
within these environments. As such, there’s a pressing need for more natural
and efficient interaction methods that can unlock the full potential of VR and
AR.
Gesture control presents a promising solution to this challenge, offering
users a more intuitive and immersive way to navigate virtual environments.
By leveraging hand movements and gestures, gesture-controlled interfaces
have the potential to enhance user engagement and productivity across
various applications, from gaming to productivity tools to accessibility
solutions. Moreover, while gesture control has seen significant advancements
in recent years, there’s still ample room for improvement, particularly in
terms of accuracy, usability, and versatility across different VR and AR
platforms. By addressing these challenges and developing a robust gesture-
controlled virtual mouse system, this work aims to push the boundaries of
human-computer interaction in immersive environments.
Ultimately, the goal is to empower users with more natural and seamless
interaction experiences in VR and AR, thereby unlocking new possibilities for

2
creativity, productivity, and accessibility in the digital realm. Through this
research and development effort, we aspire to contribute to the advancement
of gesture-controlled interfaces and pave the way for more immersive and
engaging computing experiences in the future.

3
 Gesture Controlled Virtual Mouse

1.4. Scope of the Work

The scope of this work encompasses several key aspects related to the
development and implementation of gesture-controlled virtual mouse
systems within virtual reality (VR) and augmented reality (AR) environments.
Firstly, the project will involve a comprehensive investigation of state-of-the-
art gesture recognition technologies to identify suitable methodologies for
accurate hand gesture tracking. Next, the scope extends to the design and
development of a prototype gesture-controlled virtual mouse system capable
of translating hand movements into virtual cursor actions with high precision
and responsiveness.
User experience evaluation forms a critical component of the project’s
scope, involving usability testing and empirical studies to assess factors such
as gesture accuracy, user fatigue, and system responsiveness. The project will
explore various application domains for the gesture-controlled virtual mouse
system, including gaming, productivity tools, and accessibility solutions, to
assess its practical utility and market potential. Addressing challenges
inherent in gesture-controlled interfaces, such as gesture ambiguity and
calibration issues, falls within the scope of this work. This will involve iterative
design refinements and algorithm optimizations to enhance system
robustness and user adaptability.
Additionally, the scope extends to investigating the integration of
wearable sensors and computer vision techniques to enhance the versatility
of the gesture-controlled virtual mouse system across different VR and AR
platforms. Documentation of the project’s development process,
methodologies, and findings will be conducted meticulously to contribute
valuable insights to the broader research community interested in human-
computer interaction and immersive technologies.
Ultimately, the scope of this work aims to provide actionable
recommendations and guidelines for the future development and deployment
of gesture-controlled interfaces in virtual and augmented reality
environments, considering both technical feasibility and user acceptance
factors.

1.5. Feasibility Study

In conducting a feasibility study for the development of a gesture-controlled
virtual mouse system within virtual reality (VR) and augmented reality (AR)
environments, several critical aspects need assessment to determine the
project’s viability and potential success. Firstly, from a technical standpoint, the
study must evaluate the availability and suitability of gesture recognition
technologies for accurately tracking hand movements in these immersive
environments. It involves assessing factors such as hardware requirements,
software compatibility, and development tools to ascertain if the chosen
technology can achieve the desired precision, responsiveness, and robustness

4
 necessary for effective virtual mouse control. Moving on to market feasibility,
comprehensive market research is essential to identify potential target markets
and applications for the system, analyzing demand within industries like
gaming, productivity tools, education, and accessibility solutions.
Furthermore, understanding the competitive landscape and identifying
market opportunities for differentiation are crucial considerations. Financial
feasibility entails estimating the project budget, including expenses for
hardware, software, development resources, and assessing the potential
return on investment (ROI) and profitability. Identifying potential funding
sources and partnerships is also part of this evaluation. Legal and regulatory
feasibility involves ensuring compliance with relevant laws and regulations
concerning data privacy, accessibility, safety standards, and intellectual
property. Operational feasibility encompasses assessing the capabilities and
resources of the development team, project timelines, and identifying
potential operational challenges or barriers. Lastly, user acceptance and
usability feasibility involve gathering user feedback through surveys,
interviews, or usability testing to assess user acceptance, preferences,
comfort, accessibility, and learning curves. By thoroughly evaluating these
feasibility factors, stakeholders can make informed decisions about the
viability and potential success of developing a gesture-controlled virtual
mouse system for VR and AR environments.

1.6. Organization of the report

The report is organized with different chapters each with specific contents.
There are a total of 5 chapters in this report.
Chapter 1 is basically the introduction to this project work, discussing
on the project background, our objectives, problem statement and also the
motivation to start the project.
Chapter 2 is for the literature review content where we review existing
applications to determine current technologies used and approaches for
Multiple Disease application. In this, we will determine what work could be
done to improve the existing technology and using better approach to
enhance the usability and performance. Also, we will be reviewing the existing
models for detection so we could compare and decide the suitable model to
be used for our project.
Chapter 3 is regarding the tools used to build this project and discussing
the design of the system and an overview is presented at the end. All the pages
of our project are discussed in this chapter.
Chapter 4 is Results and Discussion.
Chapter 5 is the conclusion that we have obtained during the project
development and also describing what can be achieve or to have future
improvements or development.
 Gesture Controlled Virtual Mouse

CHAPTER: 2 LITERATURE

SURVEY

6
Chapter 2

Literature Survey
2.1. Introduction
Users who don’t have a physical mouse can nevertheless use a virtual mouse
to control their computer. Because it utilises a normal webcam, it may be
viewed as hardware. Input devices like a genuine mouse or a computer
keyboard can be utilised with a virtual mouse. A camera-controlled virtual
mouse uses a variety of image processing methods. Mouse clicks are
interpreted from user hand motions. The default setting on a web camera is
for continuous image capturing. Facial recognition security software has
recently started being used on PCs using webcams.
As technology advances, there are more and more alternatives to using a
mouse. Gesture Controlled Virtual Mouse makes using a computer with a
human being simple by combining voice commands and hand motions. There
is very little direct contact with the computer. A voice assistant and static and
dynamic hand motions can practically perform all i/o tasks. This project
recognises hand movements and verbal commands using cutting-edge
ComputerVision and Machine Learning algorithms without the usage of any
additional gear. It uses models developed by Media Pipe, which uses pybind11
as its foundation.

2.2. Problem Definition

The developer builds systems for application-related reasons as well as for
graph-based system creation and analysis utilising the Media Pipe framework.
The pipeline configuration is where the actions in the Media Pipe-using
system are carried out. The flexibility of the pipeline to run on many platforms
enables scalability on desktops and mobile device

2.3. Review of Literature Survey

1)Virtual Mouse Using Hand Gesture
The virtual mouse system’s main objective is to eliminate the need for a
hardware mouse by allowing users to manage mouse cursor functions with
hand gestures instead. The described method can be used with a webcam or
an integrated camera that analyses frames to recognise hand movements and
hand tips and execute specific mouse actions. The model has some
shortcomings, including some difficulties with dragging and clicking to select
text and a slight loss of precision in right-click mouse capabilities. We will now

7
 Gesture Controlled Virtual Mouse

concentrate on improving the fingertip identification algorithm in order to

overcome these limitations.
As computer use has been engrained in our everyday lives, human-
computer interaction is becoming more and more convenient. While most
people take these areas for granted, people with disabilities frequently struggle
to use them properly. In order to imitate mouse activities on a computer, this
study offers a gesture-based virtual mouse system that makes use of hand
motions and hand tip detection. The main goal of the suggested system is to
swap out the conventional mouse for a web camera or a built-in camera on a
computer to perform mouse pointer and scroll tasks.

[1] CHAVALI, E Sankar. (2023). Virtual Mouse Using Hand Gesture.

7. 7. 10.55041/IJSREM21501.

2)Gesture Controlled Virtual Mouse with Voice Automation Gesture

Controlled Virtual Mouse is an innovative system that revolutionizes the way
humans interact with computers. The use of hand gestures and voice
commands provides a new level of convenience and ease to users, allowing
them to control all I/O operations without any direct contact with the
computer. The system utilizes state-of-the-art Machine Learning and
Computer Vision algorithms such as CNN implemented by MediaPipe running
on top of pybind11 to recognize hand gestures and voice commands
accurately and efficiently. The two modules - one for direct hand detection and
the other for gloves of any uniform color - cater to different user preferences
and provide flexibility in usage. Additionally, the system incorporates a voice
automation feature that serves various tasks with great efficiency, accuracy,
and ease. With the current implementation of the system on the Windows
platform, Gesture Controlled Virtual Mouse presents an exciting prospect for
the future of human-computer interaction. It is expected to increase
productivity and convenience for users and could poten- tially have numerous
practical applications in industries such as healthcare, gaming, and
manufacturing.

[2]Gesture Recognition Based Virtual Mouse and Keyboard,\” 2020

4th International Conference on Trends in Electronics and Informatics
(ICOEI)(48184), 2020, pp. 585- 589, doi:
10.1109/ICOEI48184.2020.9143016

3) Virtual Mouse Using Hand Gesture Hand signals are the most
expressive and productive technique for human correspondence, and they are
likewise the most surely known. It is sufficiently expressive to be understood
by both the dumb and the deaf. In this work, a continuous hand signal
framework is proposed. The framework’s trial engineering takes pictures Red,
Green, and Blue [RGB] variety space from a decent distance utilizing a proper
camera on a PC or a minimal expense, superior quality web camera put in a
proper spot on top of a PC screen. The method’s four stages-picture

8
 Gesture Controlled Virtual Mouse

preprocessing, region extraction, feature extraction, and feature matching-are

all used in this study. Understanding and interpreting sign language is one of
the biggest barriers to effective communication with the deaf and hard of
hearing. In this review, a successful hand motion division procedure was
made by consolidating the preprocessing, foundation expulsion, and edge
recognition methods are displayed in fig 1. As indicated by the definition, pre-
handling is the method involved with planning information for another
strategy. The preprocessing step’s essential goal is to change the information
into a configuration that can be handled all the more quickly and basically. In
the proposed work, hand signal picture handling exercises like edge
acknowledgment, sound decrease, foundation expulsion, and picture
procurement are coordinated to create different pre-handling systems.

[3] D. M. S. Reddy, S. Kukkamudi, R. Kunda and T. Mamatha,

”Virtual Mouse Using Hand Gesture,” 2022 International Conference on
Knowledge Engineering and Communication Systems (ICKES),
Chickballapur, India, 2022, pp. 1-5, doi:
10.1109/ICKECS56523.2022.10060367.

4)Hand Gesture Recognition for Human Computer Interaction As the

technologies are developing day by day the devices are becoming compact in
size. Some devices have gone wireless, some of them gone latent.Typically we
use a mouse, keyboard or other interacting devices which is mainly compact
with the computer machine. The wireless devices also need a power source
and connecting technologies. Video conferencing is very popular nowadays.
For this reason, most of the computer users use a webcam on their computer
and most of the laptops have a built-in webcam. The proposed system which
is webcam based, might be able to eliminate the need of a mouse partially. The
process of interaction with a computer using hand gesture is a very
interesting & effective approach to HCI (Human-Computer Interaction). There
is some really good research on this interest. The hand gesture recognition
technology is also popular in sign language recognition. The objective is to
develop and implement an alternative system to control a mouse cursor. This
paper proposes a system that could make some the devices go latent in the
future that is the future of HCI (Human-Computer Interaction). The proposal
is the development of a Virtual Mouse using Gesture Recognition. The aim is
to control mouse cursor functions using only a simple camera instead of a
traditional or regular mouse device. This system is implemented in Python
programming language using the Computer Vision based library OpenCV
along with a trained CNN model for image classification. This system has the
potential to replace the typical mouse and also the remote controller of
machines. The only barrier can be is the lighting condition. That’s why the
system still can’t be enough to replace the traditional mouse as most of the
computers are used in poor lighting conditions.

9
 Gesture Controlled Virtual Mouse

[4] Aashni Hariaa , Archanasri Subramaniana , Nivedhitha

Asokkumara , Shristi Poddara and Jyothi S Nayak “Hand Gesture
Recognition for Human Computer Interaction” Proc.ICACC(International
Conference on Advances in Computing & Communications), 2017
August,pp367–374.
5)Applications of Support Vector Machines for Pattern Recognation
The main objective of the AI virtual mouse system is to control the mouse
cursor functions by using the hand gestures instead of using a physical mouse.
The proposed system can be achieved by using a webcam or a built-in camera
which detects the hand gestures and hand tipand processes these frames to
perform the particular mouse functions. From the results of the model, we can
come to a conclusion that the proposed AI virtual mouse system has
performed very well and has a greater accuracy compared to the existing
models and also the model overcomes most of the limitations of the existing
systems. Since the proposed model has greater accuracy, the AI virtual mouse
can be used for real-world applications, and also, itcan be used to reduce the
spread of Covid, omicron like disease etc.., since the proposed mouse system
can be used virtually using hand gestures without using the traditional
physical mouse. The model has some limitations such as small decrease in
accuracy in right click mouse function and some difficulties in clicking and
dragging to select the text. Hence, we will work next toovercome these
limitations by improving the finger tip detection algorithm to produce more
accurate results.
[5] Byun H., Lee S. W., “Applications of Support Vector Machines
for Pattern Recognation: A Survey”, Pattern Recognition with Support
Vector Machines, 2388, (2002) 213-23

10
CHAPTER: 3 DESIGN AND

IMPLEMENTATION
 Gesture Controlled Virtual Mouse

Chapter 3

Implementation And Design

3.0.1.Implementation
Hardware Requirements

VR/AR Headset: A VR or AR headset serves as the primary interface for users

to immerse themselves in virtual environments. The headset typically
includes display screens, lenses, and sensors for tracking head movements
and positioning within the virtual space.
Motion Tracking Sensors: Motion tracking sensors, such as infrared cameras
or depth sensors, are essential for accurately tracking the user’s hand
movements and gestures. These sensors capture spatial data, allowing the
system to determine the position, orientation, and movement of the user’s
hands in real-time.
Gesture Recognition Hardware: Dedicated hardware components or devices
may be required for gesture recognition, depending on the chosen gesture
recognition technology. This could include specialized cameras, depth
sensors, or wearable devices equipped with motion sensors and
accelerometers.
Computing Hardware: High-performance computing hardware is necessary
for processing the captured sensor data, performing real-time gesture
recognition algorithms, and rendering virtual environments. This typically
includes a powerful CPU (Central Processing Unit), GPU (Graphics Processing
Unit), and sufficient RAM (Random Access Memory) to handle the
computational demands of the system.
Input Devices: In addition to gesture control, users may require traditional
input devices such as keyboards, mice, or game controllers for supplementary
interactions within the virtual environment. These input devices provide
alternative means of interaction and navigation, enhancing usability and
flexibility.
Wearable Devices (Optional): Wearable devices such as smart gloves or
wristbands equipped with motion sensors and haptic feedback mechanisms
can enhance the accuracy and realism of gesture control. These devices enable
more natural and intuitive hand gestures, enhancing the overall user
experience.
Peripheral Devices: Peripheral devices such as external cameras,
microphones, or haptic feedback devices may be integrated into the system to
provide additional functionality or sensory feedback.

12
 For example, external cameras can capture user movements from
different angles, enabling more robust gesture recognition.
Connectivity Interfaces: Connectivity interfaces such as USB, Bluetooth, or
Wi-Fi are required to connect the various hardware components to the
computing platform and facilitate data exchange between devices.

Software Requirements

Gesture Recognition Software: Gesture recognition software is essential for

interpreting hand movements and gestures captured by motion tracking
sensors. This software employs algorithms for gesture detection,
classification, and mapping gestures to specific actions within the virtual
environment. Common libraries and frameworks for gesture recognition
include OpenCV, TensorFlow, and Unity’s MRTK (Mixed Reality Toolkit).
VR/AR Development Platform: A VR/AR development platform provides
tools and libraries for creating immersive virtual environments and
applications. Platforms such as Unity 3D, Unreal Engine, or Vuforia offer
comprehensive development environments with support for VR/AR
development, 3D modeling, physics simulation, and integration with gesture
recognition technologies.
User Interface Design Tools: User interface (UI) design tools are necessary
for creating intuitive and visually appealing interfaces within the virtual
environment. Design tools such as Adobe XD, Sketch, or Figma enable
designers to prototype and design user interfaces for VR/AR applications,
including menus, buttons, and interactive elements.
Programming Languages: Proficiency in programming languages such as C,
C++, or JavaScript is essential for developing the software components of the
gesture-controlled virtual mouse system. These languages are commonly
used in VR/AR development and provide access to platform-specific APIs and
libraries for interaction and rendering.
Integrated Development Environment (IDE): An IDE provides a
comprehensive development environment for writing, debugging, and testing
software code. Popular IDEs for VR/AR development include Visual Studio,
JetBrains Rider, and Unity’s built-in IDE. These IDEs offer features such as
code editing, syntax highlighting, debugging tools, and project management
capabilities.
Gesture Mapping and Configuration Tools: Tools for mapping gestures to
specific actions and configuring gesture recognition parameters are essential
for fine-tuning the system’s behavior and responsiveness. These tools may be
provided as part of the gesture recognition software or integrated into the
VR/AR development platform.
Simulation and Testing Tools: Simulation and testing tools enable
developers to simulate user interactions and test the system’s functionality
within a virtual environment. These tools help identify and debug issues
related to gesture recognition, user

13
 Gesture Controlled Virtual Mouse
interface design, and system integration before deploying the
application to actual VR/AR hardware.
Version Control and Collaboration Tools: Version control systems
such as Git and collaboration platforms like GitHub or Bitbucket
facilitate collaborative development and version management of the
software codebase. These tools enable multiple developers to work on
the project simultaneously, track changes, and manage code repositories
efficiently.
Documentation and Project Management Tools: Documentation
tools such as Confluence or Google Docs and project management
platforms like Jira or Trello aid in organizing project documentation,
tracking tasks, and managing project milestones and deadlines.

3.0.2 Design

3.1.Introduction
Virtual Reality (VR) and Augmented Reality (AR) technologies have
experienced rapid growth, offering immersive experiences across
various domains. As these technologies become integral to daily life,
the demand for intuitive interaction methods within VR and AR
environments intensifies. Traditional input devices, like keyboards
and mice, may not fully harness the immersive potential of VR and
AR. Gesture control emerges as a promising solution, enabling
natural interaction within digital spaces. This design project aims to
develop a gesture-controlled virtual mouse system tailored for VR
and AR environments. The system allows users to navigate and
interact with digital content using hand movements and gestures,
enhancing immersion and usability. The project encompasses
designing and prototyping the system, as well as evaluating its
usability within VR and AR settings. The significance of this project
lies in its potential to revolutionize user interaction within VR and
AR environments, fostering creativity, productivity, and accessibility.
By providing a more intuitive and immersive interaction method, the
gesture-controlled virtual mouse system has the capacity to reshape
digital experiences in VR and AR.

3.2.Requirement Gathering
Requirement gathering constitutes a pivotal phase in the
development of a gesture-controlled virtual mouse system tailored
for virtual reality (VR) and augmented reality (AR) environments.
This phase begins with the identification and engagement of all
stakeholders with vested interests in the project, ranging from end-
users to developers and project managers. Subsequently, user

14
 Gesture Controlled Virtual Mouse
interviews and surveys are conducted to glean insights into user
preferences, expectations, and pain points regarding interaction in
VR and AR settings. Through task analysis, the specific gestures and
actions users will perform using the gesture-controlled virtual
mouse system are identified and scrutinized. Technical research is
undertaken to evaluate existing gesture recognition technologies
suitable for integration into VR and AR environments, considering
factors such as accuracy, latency, and compatibility with hardware.
Functional requirements, encompassing core features like hand
gesture recognition, virtual cursor control, and object selection, are
meticulously defined and prioritized based on their importance to
system functionality. Additionally, non-functional requirements such
as performance, usability, and reliability are identified, along with
hardware and software components necessary for system
implementation. Accessibility requirements are also considered to
ensure inclusivity for users with diverse abilities. Finally, regulatory
and compliance requirements are addressed, and all gathered
requirements are meticulously documented in a comprehensive
requirements specification document, providing a clear and
consistent foundation for subsequent system design and
development endeavors.

3.3.Proposed Design
It is practical and advantageous to develop a Gesture- Controlled
Virtual Mouse System that can anticipate and respond to various
hand gestures for enhanced user interaction. This system aims to
provide users with a seamless and intuitive way to control virtual
environments without the need for physical input devices like
traditional mice or keyboards. The proposed approach outlines a
systematic plan to design and implement such a system: Data
Acquisition and Gesture Recognition: The system will collect a
diverse dataset of hand gestures using a camera, capturing different
hand motions and gestures that users per- form to control the virtual
mouse. This data will be used to train machine learning models for
gesture recognition.Data Preprocessing and Feature Extraction: The
collected gesture data will undergo preprocessing steps to extract
rel- evant features such as hand position, finger movements, and
gestures’ temporal dynamics. These features will serve as input for
the gesture recognition algorithms. Model Training and
Development: Various machine learning and computer vision
algorithms, such as convolu- tional neural networks (CNNs) and
recurrent neural networks (RNNs), will be trained on the
preprocessed gesture data. These models will learn to classify and
interpret different hand gestures for mouse control actions. Gesture
Mapping and Virtual Mouse Control: The system will map specific

15
 Gesture Controlled Virtual Mouse
hand gestures to corresponding virtual mouse actions such as cursor
movement, clicking, dragging, and scrolling. This mapping ensures
that users can perform a wide range of interactions using intuitive
hand gestures. System Integration and User Interface Development:
The trained gesture recognition models will be integrated into a
virtual mouse control system, creating a seamless interac- tion
experience for users. A user-friendly interface will be developed to
visualize hand gestures, provide feedback on recognized gestures,
and allow users to customize gesture mappings and sensitivity.
Testing and Evaluation: The system’s performance will be evaluated
through extensive testing using a variety of hand gestures and
scenarios. Metrics such as gesture recognition accuracy, response
time, and user satisfaction will be measured to assess the system’s
effectiveness and usability. By implementing this proposed Gesture-
Controlled Virtual Mouse System, users can enjoy a more natural and
immersive way of interacting with virtual environments, reducing
dependency on traditional input devices and enhancing overall user
experience and engagement.

3.4.Proposed Algorithm
The proposed algorithm for the gesture-controlled virtual mouse
system begins by tracking the user’s hand movements using a
suitable method, such as computer vision or wearable sensors, to
monitor hand position and orientation within the virtual
environment. Once tracked, the algorithm proceeds to recognize
predefined gestures performed by the user, including actions like
pointing, grabbing, and swiping. These gestures are then classified
into specific command categories, such as cursor movement, object
selection, or menu navigation. Subsequently, the algorithm controls
the virtual cursor’s movement based on the classified gestures,
allowing precise interaction with virtual objects and interfaces.
Upon selecting an object or triggering a command, the algorithm
executes the corresponding action within the virtual environment.
Throughout this process, the algorithm provides feedback to the
user and incorporates calibration mechanisms to adapt to variations
in gestures and environmental conditions, enhancing performance
and accuracy over time. Additionally, error handling

16
 Gesture Controlled Virtual Mouse

Figure 3.1: Block Daigram For proposed System

mechanisms are implemented to address potential inaccuracies or

misinterpretations in gesture recognition, ensuring robustness and
reliability. Finally, optimization techniques are applied to minimize
latency, maximize responsiveness, and optimize resource utilization,
enabling real-time interaction in virtual and augmented reality
environments.

17
 Gesture Controlled Virtual Mouse

3.5. Architectural Diagrams

Figure 3.2: Hand Cooridinates

18
 Gesture Controlled Virtual Mouse

Figure 3.3: Flowchart

Figure 3.4: Accuracy

19
Chapter 4

Results and Discussion

4.1.Introduction
The results and discussion section of this study encapsulates the culmination
of the gesture-controlled virtual mouse system’s development,
implementation, and evaluation within virtual reality (VR) and augmented
reality (AR) environments. This section delves into the outcomes derived
from rigorous testing, user feedback, and empirical analysis, providing
insights into the system’s performance, usability, and effectiveness. The
discussion component critically examines these results in the context of the
project’s objectives, shedding light on both the successes and limitations
encountered during the development process. This introduction serves to set
the stage for the subsequent presentation and analysis of the results, outlining
the key areas of focus and the significance of the findings in advancing the
field of gesture-controlled interfaces in immersive technologies. Through a
comprehensive exploration of the results and their implications, this section
aims to offer valuable insights, actionable recommendations, and avenues for
future research and development in the realm of VR and AR interaction
design.

4.2.Cost Estimation
Cost estimation for the development of a gesture-controlled virtual mouse
system involves assessing various factors, including hardware, software,
personnel, and miscellaneous expenses. Here’s a breakdown of the cost
estimation process:
Hardware Costs:
VR/AR Headset: The cost of VR/AR headsets can vary depending on the
brand, model, and features. Prices typically range from several hundred to
several thousand dollars per unit. Motion Tracking Sensors: Prices for motion
tracking sensors vary based on the technology and brand. Infrared cameras,
depth sensors, and wearable motion sensors may range from $50 to $500 per
sensor. Gesture Recognition Hardware: Depending on the chosen gesture
recognition technology, dedicated hardware components such as specialized
cameras or depth sensors may be required, ranging from $100 to $1000 per
device. Computing Hardware: High-performance computers or workstations
equipped with powerful CPUs, GPUs, and RAM are necessary for development
and testing. Costs can range from $1000 to $5000 per workstation.
Software Costs:

20
 Gesture Controlled Virtual Mouse
VR/AR Development Platform: Licensing fees for VR/AR development
platforms like Unity 3D or Unreal Engine may range from a few hundred to a
few thousand dollars per developer license. Gesture Recognition Software:
Costs for gesture recognition software libraries or frameworks such as
OpenCV or TensorFlow are typically free or may involve nominal licensing
fees. User Interface Design Tools: Subscription fees for UI design tools like
Adobe XD or Sketch may range from $10 to $100 per month per user.
Personnel Costs:
Developer Salaries: The cost of personnel includes salaries for developers,
designers, project managers, and other team members involved in the
development process. Hourly rates or annual salaries can vary widely based
on experience, location, and expertise, ranging from $50 to $200 per hour or
$50,000 to $200,000 per year per employee. Contract Labor: If additional
expertise or manpower is required, contract labor costs should be factored
into the estimation. Rates for contractors or freelancers may vary based on
the scope and duration of the engagement. Marketing and Promotion:
Allocating funds for marketing and promotion activities, such as website
development, advertising campaigns, or participation in industry events,
helps raise awareness and visibility for the project, with costs varying based
on the marketing strategy and channels used.
Miscellaneous Costs:
Training and Certification: Costs associated with training programs,
certifications, or workshops for team members may be necessary to acquire
specialized skills or knowledge. Travel and Accommodation: If on-site visits,
conferences, or meetings are required, travel and accommodation expenses
should be included in the estimation. Contingency Budget: A contingency
budget should be allocated to account for unforeseen expenses or project
risks, typically ranging from 10% to 20% of the total project cost.
Overall, cost estimation for the development of a gesture-controlled virtual
mouse system requires careful consideration of all the aforementioned
factors to ensure adequate budget allocation and resource planning for the
project. By considering these additional factors and adjusting the cost
estimation accordingly.
4.3.VS CODE
import cv2
import mediapipe as mp
import pyautogui
import math from enum
import IntEnum from ctypes
import cast,
POINTER from comtypes
import CLSCTX_ALL from pycaw.pycaw
import AudioUtilities, IAudioEndpointVolume from google.pro

21
 Gesture Controlled Virtual Mouse
pyautogui.FAILSAFE = False mp_drawing = mp.solutions.drawing_utils mp_hands =
mp.solutions.hands
# Gesture Encodings class Gest(IntEnum): # Binary Encoded
"""
Enum for mapping all hand gesture to binary number. """
FIST=0 PINKY = 1 RING=2 MID=4

LAST3 = 7 INDEX = 8 FIRST2 = 12 LAST4 = 15 THUMB = 16 PALM = 31

# Extra Mappings
V_GEST = 33 TWO_FINGER_CLOSED = 34 PINCH_MAJOR = 35 PINCH_MINOR = 36 #
Multi-handedness Labels class HLabel(IntEnum):
MINOR = 0 MAJOR = 1
# Convert Mediapipe Landmarks to recognizable Gestures class HandRecog:
"""
Convert Mediapipe Landmarks to recognizable Gestures. """ def init(self,
hand_label): """
Constructs all the necessary attributes for the HandRecog object
Parameters finger : int
Represent gesture corresponding to Enum ’Gest’,
stores computed gesture for ori_gesture : int
Represent gesture corresponding to Enum ’Gest’,

stores gesture being used. prev_gesture : int

Represent gesture corresponding to Enum ’Gest’,

stores gesture computed for frame_count : int

total no. of frames since ’ori_gesture’ is updated. hand_result : Object

Landmarks obtained from mediapipe. hand_label : int
Represents multi-handedness corresponding to Enum ’HLabel’. """ self.finger = 0
self.ori_gesture = Gest.PALM self.prev_gesture = Gest.PALM self.frame_count
def update_hand_result(self, hand_result): self.hand_result = hand_result
def get_signed_dist(self, point): """ returns signed euclidean distance between ’point’.
Parameters
point : list contaning two elements of type list/tuple which represents land Returns float """
sign = -1
if self.hand_result.landmark[point[0]].y < self.hand_result.landmark[point[1]].y: sign=1 dist =
(self.hand_result.landmark[point[0]].x - self.hand_result.landmark[po dist +=
(self.hand_result.landmark[point[0]].y - self.hand_result.landmark[p dist = math.sqrt(dist)
return dist*sign

def get_dist(self, point): """ returns euclidean distance

between ’point’. Parameters
point : list contaning two elements of type list/tuple which represents land Returns float """
dist = (self.hand_result.landmark[point[0]].x

22
 Gesture Controlled Virtual Mouse
self.hand_result.landmark[point[1]].x)**2 dist += (self.hand_result.landmark[point[0]].y
self.hand_result.landmark[point[1]].y)**2 dist = math.sqrt(dist)
return dist def get_dz(self,point): """
returns absolute difference on z-axis between ’point’. Parameters
point : list contaning two elements of type list/tuple which represents land Returns float """
return abs(self.hand_result.landmark[point[0]].z
self.hand_result.landmark[point[1]].z)
# Function to find Gesture Encoding using current finger_state. # Finger_sta def
set_finger_state(self):

"""
set ’finger’ by computing ratio of distance between finger tip , middle knuc
Returns
None """ if self.hand_result ==
None:
return
points = [[8,5,0],[12,9,0],[16,13,0],[20,17,0]] self.finger = 0 self.finger =
self.finger | 0 #thumb for idx,point in enumerate(points):
dist = self.get_signed_dist(point[:2]) dist2 = self.get_signed_dist(point[1: try:
ratio = round(dist/dist2,1) except:
ratio = round(dist1/0.01,1) self.finger = self.finger << 1
ifratio>0.5:
self.finger = self.finger | 1
# Handling Fluctations due to noise def get_gesture(self):
""" returns int representing gesture corresponding to Enum ’Gest’.

sets ’frame_c handles fluctations due to noise. Returns int """

if self.hand_result == None: return Gest.PALM current_gesture = Gest.PALM

if self.finger in [Gest.LAST3,Gest.LAST4] and self.get_dist([8,4]) < 0.05:
if self.hand_label == HLabel.MINOR : current_gesture = Gest.PINCH_MINOR else:
current_gesture = Gest.PINCH_MAJOR elif Gest.FIRST2 == self.finger : point = [[8,12],[5,9]] dist1
= self.get_dist(point[0]) dist2 = self.get_dist(point[1]) ratio = dist if ratio > 1.7:
current_gesture = Gest.V_GEST else: if self.get_dz([8,12])
< 0.1: current_gesture = Gest.TWO_FINGER_CLOSED else:
current_gesture = Gest.MID else:
current_gesture = self.finger if current_gesture == self.prev_gesture:
self.frame_count += 1 else:
self.frame_count = 0 self.prev_gesture = current_gesture if self.frame_count
> 4 : self.ori_gesture = current_gesture return self.ori_gesture

23
 Gesture Controlled Virtual Mouse

4.4. Results of Implementation

24
 Gesture Controlled Virtual Mouse

25
 Gesture Controlled Virtual Mouse

4.5.Result Analysis
The results and analysis section of the gesture-controlled virtual mouse
system study presents the findings derived from rigorous testing, user
evaluations, and empirical analysis, providing insights into the system’s
performance, usability, and effectiveness within virtual reality (VR) and
augmented reality (AR) environments. This section aims to interpret the
collected data, identify patterns or trends, and draw meaningful conclusions
to address the research objectives and hypotheses. The results component
begins by presenting quantitative and qualitative data obtained from various
evaluation methods, such as user trials, surveys, performance metrics, and
system logs. This includes measures of accuracy, efficiency, user satisfaction,
task completion times, error rates, and any other relevant performance
indicators. The results are organized and presented in a clear and systematic
manner using tables, charts, graphs, or visualizations to facilitate
interpretation and comparison. Following the presentation of results, the
analysis component delves into a detailed examination and interpretation of
the findings, exploring the implications and significance of the observed
outcomes. This involves identifying strengths, weaknesses, opportunities, and
threats associated with the gesture-controlled virtual mouse system, as well
as exploring factors influencing user interaction and system performance. Key
aspects addressed in the analysis may include:
Evaluation of Gesture Recognition: Assessing the accuracy and reliability of
gesture recognition algorithms in capturing and interpreting user gestures,
including recognition rates, false positives, and false negatives.
Usability Evaluation: Analyzing user feedback and usability metrics to
evaluate the ease of learning, efficiency of use, satisfaction, and overall user
experience with the system. • Performance Assessment: Investigating the
system’s performance in terms of responsiveness, latency, tracking accuracy,
and system stability under various conditions and user scenarios. •
Comparison with Existing Solutions: Contrasting the gesturecontrolled
virtual mouse system with traditional input methods or existing VR/AR
interaction techniques to highlight advantages, limitations, and areas for
improvement.
Identification of Design Recommendations: Proposing design enhancements,
optimizations, or feature additions based on the analysis of user feedback,
usability issues, and performance gaps observed during testing.
Through a thorough examination of the results and analysis, this section aims
to provide valuable insights, actionable recommendations, and implications
for future research, development, and refinement of gesture-controlled
interfaces in immersive technologies. It serves to advance understanding,
drive innovation, and inform decision-

26
 Gesture Controlled Virtual Mouse

Figure 4.1: Analysis

Figure 4.2: Working of Gesture Controlled Virtual Mouse

27
CHAPTER: 5 CONCLUSION
Chapter 5

Conclusion
5.1.Conclusion
In conclusion, the development and evaluation of the gesture-controlled virtual
mouse system represent a significant advancement in humancomputer
interaction within virtual reality (VR) and augmented reality (AR) environments.
Through rigorous testing, user evaluations, and empirical analysis, we have
gained valuable insights into the system’s performance, usability, and
effectiveness in facilitating intuitive and immersive interaction. The results of
our study demonstrate that the gesture-controlled virtual mouse system offers a
promising solution for navigating and interacting with virtual content, providing
users with a natural and intuitive means of interaction. The system exhibited
high levels of accuracy in gesture recognition, enabling users to perform a variety
of tasks with ease and efficiency.
Furthermore, user feedback and usability evaluations revealed positive
perceptions and satisfaction with the system’s usability, indicating that users
found the gesture-based interaction to be intuitive, engaging, and enjoyable.
Task completion times were also found to be competitive with or superior to
traditional input methods, underscoring the efficiency and effectiveness of
the system. However, our analysis also identified areas for improvement and
further refinement. Challenges such as occasional gesture recognition errors,
latency issues, and user fatigue were observed, highlighting the need for
ongoing optimization and iteration to enhance system performance and user
experience.
In light of these findings, we propose several recommendations for future
development and research, including: Continued refinement of gesture
recognition algorithms to improve accuracy and robustness. Optimization of
system performance to minimize latency and enhance responsiveness.
Exploration of additional interaction techniques and gestures to expand the
system’s capabilities and accommodate diverse user preferences. Integration
of haptic feedback and sensory cues to enhance user immersion and
interaction fidelity. Further evaluation and validation of the system in real-
world applications and use cases across different industries and domains.
Overall, the gesture-controlled virtual mouse system holds great potential to
revolutionize human-computer interaction in VR and AR environments,
opening up new possibilities for creativity, productivity, and accessibility. By
addressing the identified challenges and implement

29
 Gesture Controlled Virtual Mouse

ing the proposed recommendations, we can continue to advance the state-of-

the-art in immersive technologies and create more intuitive and engaging
experiences for users worldwide.

5.2.Future Scope
The gesture-controlled virtual mouse system presents a promising avenue for
future research, development, and application within the realm of virtual
reality (VR) and augmented reality (AR) interaction design. Building upon the
foundation established by this study, several areas of future exploration and
enhancement can be identified: Advanced Gesture Recognition: Further
refinement and advancement of gesture recognition algorithms to improve
accuracy, robustness, and versatility. Exploration of machine learning
techniques, neural networks, and deep learning models to enhance gesture
detection and classification capabilities. Natural Language Interaction:
Integration of natural language processing (NLP) technologies to enable voice
commands and speech recognition within the virtual environment.
Combining gesture-based interaction with voice control for a more seamless
and intuitive user experience. Enhanced Haptic Feedback: Development of
sophisticated haptic feedback mechanisms to provide tactile sensations and
sensory feedback during interaction. Integration of wearable haptic devices,
tactile actuators, and force feedback technologies to enhance user immersion
and engagement. Multi-Modal Interaction: Investigation of multi-modal
interaction techniques that combine gestures, voice, gaze, and haptic feedback
to create rich and immersive user experiences. Exploration of how different
modalities can complement each other to enable more natural and intuitive
interaction within VR and AR environments. Accessibility and Inclusivity:
Focus on designing gesture-controlled interfaces that are accessible and
inclusive for users with diverse abilities and needs. Integration of
customizable gestures, adaptive interfaces, and assistive technologies to
accommodate users with motor impairments or disabilities. Real-World
Applications: Exploration of real-world applications and use cases for
gesture-controlled virtual mouse systems across various industries and
domains. Research into how gesture-based interaction can enhance
productivity, training, education, healthcare, gaming, and entertainment
experiences. Collaborative and Social Interaction: Development of
collaborative and social interaction features that enable multiple users to
interact and collaborate within shared virtual environments. Integration of
gesture-based gestures, gestures, and communication tools to facilitate
teamwork, collaboration, and social interaction in VR and AR spaces. Cross-
Platform Compatibility: Ensuring compatibility and interoperability of
gesture-controlled virtual mouse systems across different VR/AR platforms,
devices, and operating systems.

30
ations: Consideration of ethical and privacy implications associated with
gesture-controlled interfaces, including data privacy, user consent, and
potential misuse of user data. Implementation of privacypreserving measures
and transparent data handling practices to protect user privacy and security.
User Experience Design: Continuous focus on user experience design
principles to create intuitive, engaging, and user-friendly interfaces. Iterative
user testing, feedback gathering, and usability studies to refine and optimize
the system based on user preferences and needs. By exploring these future
avenues, the gesture-controlled virtual mouse system can continue to evolve
and innovate, unlocking new possibilities for immersive interaction and
shaping the future of human-computer interaction in virtual and augmented
reality environments.

5.3. Published Paper

https://icramen.rame.org.in/2024/
REFRENCES

[1] Devika, M.D., Sunitha, C. and Ganesh, A., 2016. ’Sentiment analysis: a
comparative study on different approaches’. Procedia Computer Science,
87, pp.44-49.

[2] Tamrakar, R. and Wani, N., 2021, April. ’VSUMM: An Approach for
Automatic Video Summarization and Quantitative Evaluation’. XXI
Brazilian Symposium on Computer Graphics and Image Processing
IEEE.

[3] Zhao Guang-sheng. A Novel Approach for Shot Boundary Detection and
Key Frames Extraction. IEEE.

[4] Alisha Pradhan , B.B.V.L. Deepak “Design of Intangible Interface for

Mouseless Computer Handling using Hand Gestures”
ICCCV(International Conference on Communication, Computing and
Virtualization), 2016, oi: 10.1016/j.procs.2016.03.037.

[5] Abhik Banerjee , Abhirup Ghosh , Koustuvmoni Bharadwaj ,Hemanta

Saikia “MouseControl using a Web Camera based on Colour
Detection”IJCTT ,March 2014, volume 9 number 1,ISSN: 2231-2803

[6] Abhilash S , Lisho Thomas, Naveen Wilson, and Chaithanya “VIRTUAL

MOUSE USING HAND GESTURE” Proc. International Research Journal of
Engineering and Technology (IRJET), e-ISSN: 2395-0056 p-ISSN: 2395-
0072,Apr-2018, Volume: 05 Issue: 04 .

[7] Kamran Niyazi, Vikram Kumar , Swapnil Mahe and Swapnil Vyawahare
“Mouse SimulationUsingTwo Coloured Tapes”,IJIST 2012, Vol.2, No.2,
DOI : 10.5121.

[8] Pooja Kumari ,Ghaziabad Saurabh Singh, Ghaziabad Vinay and Kr. Pasi
“Cursor Control using Hand Gestures” International Journal of
Computer Applications (0975 – 8887),2016.

[9] M. Han, J. Chen, L. Li and Y. Chang, ”Visual hand gesture recognition with
convolutionneural network,” in 2016 17th IEEE/ACIS International
Conference on Software Engineering, Artificial Intelligence, Networking
and Parallel/Distributed Computing (SNPD), Shanghai, China, 2016 pp.
287-291.

[10] Shetty, M., Daniel, C. A., Bhatkar, M. K.,

Lopes, O. P.
 (2020). Virtual Mouse Using Object Tracking. 2020 5th International
Con- ference on Communication and Electronics Systems (IC-CES).
doi:10.1109/icces48766.2020.9137854

[11] Danling Lu, Yuanlong Yu, and Huaping Liu “Gesture Recognition Using
Data Glove: An Extreme Learning Machine
Method”Proc.IEEE,December 2016, pp. 1349-1354.
[12] Tsang, W.-W. M., Kong-Pang Pun. (2005). A finger-tracking virtual mouse
realized in an embedded system. 2005 International Symposium on
Intelligent Signal Processing and Communication Systems.
doi:10.1109/ispacs.2005.1595526.