International Journal of Scientific Research in Science, Engineering and Technology

Print ISSN: 2395-1990 | Online ISSN : 2394-4099 (www.ijsrset.com)

doi : https://doi.org/10.32628/IJSRSET23103152

Virtual Mouse Operations Using Webcam

C Saritha*1, Y Phanitha2, A Ramya Krishna3
1Assistant Professor, Department of CSE, Bhoj Reddy Engineering College for Women, Hyderabad, India
2,3Students, Department of CSE, Bhoj Reddy Engineering College for Women, Hyderabad, India

ARTICLEINFO ABSTRACT

With new changes seen in computer technology day by day, it has become
Article History:
quite essential for us to find specific new ways of interaction with
Accepted: 10 June 2023 computer systems as its need is increasing in society every day. Today,
Published: 24 June 2023 every device is making the use of touch screen technology on its systems,
which isn't affordable to be used in all applications. A specific interactive
Publication Issue module like a virtual mouse that makes use of Hand Tracking and Gestures
Volume 10, Issue 3 that will help us to interact can be an alternative way for the traditional
May-June-2023 touch screen and the physical mouse. The objective is to create a Hand
Tracking application that interacts with the system. This system proposed
Page Number is a Computer Vision-based mouse cursor control system, which uses hand
650-653 gestures that are being captured from a webcam through a Hand detection
technique. This system allows the user to navigate the system cursor using
their hand gestures that the computer webcam tracks and perform mouse
operations like left- click, right-click, and double click using different
hand gestures. Python and OpenCV library are used for real- time
computer vision to implement the system. The camera output is displayed
on the monitor.
Keywords : Virtual mouse, Hand tracking, Webcam, OpenCV, Python,
Gestures.

I. INTRODUCTION that rolls around as the mouse is moved. Times latterly,

the optical mouse was introduced, which replaced the
A mouse, in calculating terms, is a pointing device that hard rubber ball with an LED detector to descry
detects two- dimensional movements relative to a tabletop movement and also shoot the information to
surface. This movement is converted into the the computer for processing. In 2004, the ray mouse
movement of a pointer on a display that allows you to was also introduced to meliorate the delicacy of
control the Graphical User Interface (GUI) on a movement with the smallest hand movements and
computer platform. There are a lot of different types of overcome the limitations of the optical mouse, which
mice that have formerly been in modern day were the difficulties in tracking grandly- buffed
technology. There's the mechanical mouse that surfaces. Still, no matter how accurate it can be, there
determines the movements with a hard rubber ball are still limitations within the mouse itself in both

Copyright: © the author(s), publisher and licensee Technoscience Academy. This is an open-access article distributed under the
650
terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use,
distribution, and reproduction in any medium, provided the original work is properly cited
 C Saritha et al Int J Sci Res Sci Eng Technol, May-June-2023, 10 (3) : 650-653

physical and specialised terms. For illustration, a for real- time computer vision to apply the system. The
computer mouse is a consumable tackle device as it camera output is displayed on the monitor.
requires replacement in the long run. Either the mouse
buttons are degraded, causing unhappy clicks, or the II. METHODS
whole mouse is no longer detected by the computer In the Methodology, the procedure of each part is
itself. therefore, a virtual mortal computer commerce being explained step by step and their working.
device that replaces the physical mouse by using a
A. Webcam
webcam or any other image- capturing device can be a
The first important functioning tackle is a good
necessary way to use the touch screen.
working web camera. To capture the object used to
This device, which is the webcam, will be constantly
instruct the mouse and replace the working of it with
employed by software that monitors the gestures given
the object. So that formerly if the object is captured in
by the user to exercise them and translate the motion
our frames using OpenCV also it can be used as our
of a pointer, like a physical mouse. thus, a virtual
mouse to make the performing easier. The purpose of
mortal- computer commerce device that replaces the
the Webcam is landing the hand gesture and
physical mouse by using a webcam or any other image-
movements generated by humans and store its image
capturing device can be an alternative to the touch
in memory.
screen. This device, which is the webcam, will be
constantly utilised by software that monitors the B. Hand Tracking.
gestures given by the user. to reuse it and restate it into The movement of the pointer was controlled by the tip
the motion of a pointer, like a physical mouse. of the finger. so as to spot the tip of the finger, the
With new changes seen in computer technology day centre of the palm should first be set up. the strategy
by day, it has become relatively essential for us to find used for locating the hand centre was espoused from
specific new ways of interaction with computer and it has the advantage of being straightforward and
systems as its need is adding in society every day. easy to apply. The shortest distance between every
moment, every device is making the use of touch point inside the inscribed circle to the contour was
screen technology on its systems, which is not measured and the point with the largest distance was
affordable to be used in all operations. A specific recorded as the centre. the space between the centre of
interactive module like a virtual mouse that makes use hand and the hand contour was taken as the compass
of Hand Tracking and Gestures that will help us to of the hand. The hand centre was calculated for every
interact can be an indispensable way for the traditional successive frame and using the hand centre, the tip of
touch screen and the physical mouse. The ideal is to the finger would be known and used for hand tracking.
produce a Hand Tracking operation that interacts with The strategy used for relating the indicator and also the
the system. This system proposed is a Computer different fingers are described.
Vision- grounded mouse cursor control system, which
C. Gesture Recognition
uses hand gestures that are being captured from a
webcam through a Hand detection technique. The system is trained with hand gestures to fete
This system allows the user to navigate the system different gestures. Once the gesture is honoured, it’s
cursor using their hand gestures that the computer restated into a corresponding mouse movement, which
webcam tracks and perform mouse operations like left- is also executed on the virtual screen. The system is
click, right- click, and double click using different designed to be scalable and adaptable to different types
hand gestures. Python and OpenCV library are used of surroundings and devices.

International Journal of Scientific Research in Science, Engineering and Technology | www.ijsrset.com | Vol 10 | Issue 3 651
 C Saritha et al Int J Sci Res Sci Eng Technol, May-June-2023, 10 (3) : 650-653

There are two main ways for gesture recognition:

1. Fingertip identification
2. Number of fingers.

D. Cursor Control

Once the hand gestures are honoured, it will be an easy

matter of mapping completely different hand gestures
to specific mouse functions. It seems that controlling
the Personal Computer cursor, operations are
performed. The different operations that can be
performed are Right Click, Left Click, Double Click,
Real- Time Operation, Pause/ Play any videotape. Figure 2: Hand detected

III. RESULTS

The virtual mouse system is to develop an alternative

to the regular and traditional mouse system to perform
and control the mouse functions. The OpenCV library
has been used to track the hands that help to operate
on this system using the webcam or a built-in camera.
By using OpenCV, the mouse and its basic operations
like mouse pointing, selection, clicking and deselection
can be controlled.
Figure 3: Scrolling Gesture

Figure 4: Clicking operation not performed (as distance

Figure 1: No hand detected between fingers is greater than 40)

International Journal of Scientific Research in Science, Engineering and Technology | www.ijsrset.com | Vol 10 | Issue 3 652
 C Saritha et al Int J Sci Res Sci Eng Technol, May-June-2023, 10 (3) : 650-653

Recognition” IEEE Xplore Journal HYD-CON,

2020.
[3]. Onkar Yadav, Sagar Makwana, Pandhari Yadav,
Prof. Leena Raut, “Cursor Movement By Hand
Gesture”, International Journal Of Engineering
Sciences & Research Technology, ISSN: 2277-
9655, 2017.
[4]. D. A. Barhate and K. P. Rane, "A Survey of
Fingertip Character Identification in Open-Air
Using Image Processing and HCI," 3rd
International Conference for Convergence in
Figure 5: Clicking operation performed (As the distance Technology (I2CT) , pp. 1-4, 2018.
between fingers is less than 40) [5]. Mahajan J.R and C. S. Rawat, "Object Detection
and Tracking using Cognitive Approach," 2017
IV. CONCLUSION International Journal of Scientific Research in
The system controls the mouse pointer and executes its Network Security and Communication
operation using a real-time camera. This design is to (IJSRNSC), Vol.5, Issue.3, pp. 136-140, 2017.
form a system which will allow the hand gestures and [6]. Abhik Banerjee, Abhirup Ghosh, Koustuvmoni
control the computer/ laptop in line with those Bharadwaj, “Mouse Control using a Web Camera
gestures. The system will benefit mobile systems based on Color Detection”, IJCTT, vol.9, 2014.
where using pointing devices like the mouse is tough. [7]. A. Erdem, E. Yardimci, Y. Atalay, V. Cetin,
All the mouse tasks like left and right clicking, double “Computer vision-based mouse”, Acoustics,
clicking and beginning the operations using gestures Speech, and Signal Processing, Proceedings.
like tablet, maquila, command prompt etc. Before (ICASS). IEEE International Conference.
factual enforcing gesture comparison algorithms, skin
discovery and hand segmentation from kept frames
need to be done. The system is also developed in such Cite this article as :
a way that the user new to the system can simply have
C Saritha, Y Phanitha, A Ramya Krishna, "Virtual
to install the set up and not run the full system.
Mouse Operations Using Webcam", International
Journal of Scientific Research in Science, Engineering
V. REFERENCES
and Technology (IJSRSET), Online ISSN : 2394-4099,
Print ISSN : 2395-1990, Volume 10 Issue 3, pp. 650-653,
[1]. Monali Shetty, Christina A. Daniel, Manthan
May-June 2023. Available at doi :
K.Bhatkar, Ofrin P. Lopes, “Virtual Mouse Using
https://doi.org/10.32628/IJSRSET23103152
Object Tracking”, IEEE Conference Record #
Journal URL : https://ijsrset.com/IJSRSET23103152
48766, ISBN: 978-1-7281-5371-1, 2020.
[2]. Vantukala VishnuTeja Reddy, Thumma
Dhyanchand, Galla Vamsi Krishna, Satish
Maheshwaram, “Virtual Mouse Control Using
Colored Finger Tips and Hand Gesture

International Journal of Scientific Research in Science, Engineering and Technology | www.ijsrset.com | Vol 10 | Issue 3 653