Eye Tracking Technology: Mrunal P. Chaudhari

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 23

A Report On


Eye Tracking Technology”

Submitted In Partial Fulfillment of the Requirement

For The Award of Third Year of Bachelor of Technology

In Electronics & Telecommunication of

Dr. BABASAHEB AMBEDKAR TECHNOLOGICAL

UNIVERSITY, LONERE

Submitted By

Mrunal P. Chaudhari

Guide

Prof. A. C. Bhide

Department of Electronics &Telecommunication Engineering

ShriSantGadge Baba

College of Engineering and Technology, Bhusawal

DR.BABASAHEB AMBEDKAR TECHNOLOGICAL

UNIVERSITY, LONERE

2020-2021

S.S.G.B.C.O.E.T. 1 Page No.


ShriSantGadge Baba

College of Engineering and Technology,

Bhusawal 425203

Certificate
This is to certify that Mr.Mrunal P. Chaudhari has successfully

completed his Report on “Eye Tracking Technology” for the partial

fulfillment of the Third Year of Bachelor of Technology in the

Electronics & Telecommunication as prescribed by Dr.BABASAHEB

AMBEDKAR TECHNOLOGICAL UNIVERSITY, LONERE during

academic year 2020-2021.

Prof. A. C. Bhide Dr. G.A.Kulkarni


Guide H.O.D.

Dr. R. P. Singh
Principal

S.S.G.B.C.O.E.T. 2 Page No.


DECLARATION

I hereby declare that the seminar report entitled, “Eye Tracking


Technology” was carried out and written by me under the guidance of
Prof. A. C. Bhide, Assistant Professor, Department of Electronics and
Telecommunication Engineering, ShriSantGadge Baba College of
Engineering and Technology, Bhusawal.This work has not been
previously formed the basis for the award of any degree or diploma or
certificate nor has been submitted elsewhere for the award of any degree
or diploma.

Place: Bhusawal Mrunal P. Chaudhari


Date:

Abstract

S.S.G.B.C.O.E.T. 3 Page No.


The eyes are a rich source of information for
gathering context in our everyday lives.Using user's gaze
information as a form of input can enable a computer
system to gain more contextual information about the
user’s task, which in turn can be leveraged to design
interfaces which are more intuitive and intelligent. Eye
gaze tracking as a form of input was primarily developed
for users who are unable to make normal use of a
keyboard and pointing device. However, with the
increasing accuracy and decreasing cost of eye gaze
tracking systems it will soon be practical for able-bodied
users to use gaze as a form of input in addition to
keyboard and mouse. This dissertation explores how
gaze information can be effectively used as an
augmented input in addition to traditional input devices.
The dissertation also discusses some of the
problems and challenges of using gaze information as a
form of input and proposes solutions which, as
discovered over the course of the research, can be used to
mitigate these issues. Finally, it concludes with an
analysis of technology and economic trends which make
it likely for eye tracking systems to be produced at a low
enough cost, that when combined with the right
interaction techniques, they would create the
environment necessary for gaze augmented input devices
to become mass-market.

INDEX

S.S.G.B.C.O.E.T. 4 Page No.


Sr.No. Topic Name Page
No.
1. Introduction 6
2. History of Eye Tracking 7
3. Work Of Eye Tracker 8
4. Types of Eye Tracking Technology 10
5. Eye Tracking Using Machine Learning 14
6. Eye Tracking Using Internet of Things 15
7. Eye Tracking As An Input Device 16
8. Future Trends In Eye Tracking 17
9. Applications Of Eye Tracking 18
10. Benefits or Advantages of Eye Tracking 20
Technology
11. Drawbacks or disadvantages of Eye Tracking 21
Technology
12. Conclusion 22
13. References 23

Introduction

S.S.G.B.C.O.E.T. 5 Page No.


The eyes are one of the most expressive features of
the human body for nonverbal, implicit communication.
The design of interaction techniques which use gaze
information to provide additional context and
information to computing systems has the potential to
improve traditional forms of human-computer
interaction.
The keyboard and mouse which have long been the
dominant forms of input have bandwidth problem. That
is the bandwidth from the computer to the user is far
greater than the bandwidth from the user to the computer.
In this dissertation it is posit that gaze information, i.e.
information about what the user is looking at, can be
used as a practical form of input i.e. a way of
communicating information from the user to the
computer. Gaze information can be used as a practical
form of input. The goal is not to replace traditional input
devices but to provide viable alternatives which users
may choose to use depending upon their tasks abilities
and preferences. We chose the realm of desktop
interactions, since they are broadly applicable to all types
of computer users. In addition, the technology for
desktop eye tracking systems has improved sufficiently
to make it a viable input modality. The cost of these
systems remains an issue, but current technology and
economic trends indicate that low cost eye tracking
should be possible in the near future

History of Eye Tracking


S.S.G.B.C.O.E.T. 6 Page No.
The history of eye tracking can be traced as far back
as the late 19th century and early 20th century. Java used
direct visual observation to track eye movements in
1879. Ohm used mechanical techniques to track eye
movements by attaching a pencil at the end of a long
lever which was positioned on the cornea such that each
time the eye moved the pencil would make a mark. The
first recorded effort for eye tracking using a reflected
beam of light was done by Dodge and Cline in 1901.
Marx and Trendelenburg used a mirror attached to the
eye to view the reflected beam of light. Judd, McAllister
and Steel used motion picture photography for eye
tracking as far back as 1905. They inserted a white speck
into the eye which was then tracked in the motion picture
recording of the eye. Bus well used eye tracking studies
to examine how people look at pictures. Yarbus in his
pioneering work in the fifties used suction caps attached
to the eye to measure eye movements. Yarbus shows
several different designs of suction caps in his book and
his work laid the foundation for the research in the field
of eye movements

Work Of Eye Tracker


S.S.G.B.C.O.E.T. 7 Page No.
Most commercial eye-tracking systems available
today measure point-of-regard by the “corneal-
reflection/pupil-centre” method . These kinds of trackers
usually consist of a standard desktop computer with an
infrared camera mounted beneath a display monitor, with
image processing software to locate and identify the
features of the eye used for tracking. In operation,
infrared light from an LED embedded in the infrared
camera is first directed into the eye to create strong
reflections in target eye features to make them easier to
track (infrared light is used to avoid dazzling the user
with visible light). The light enters the retina and a large
proportion of it is reflected back, making the pupil
appear as a bright, well defined disc (known as the
“bright pupil” effect). The corneal reflection (or first
Purkinje image) is also generated by the infrared light,
appearing as a small, but sharp, glint (see Figure 1)

Fig. 1. Corneal reflection and bright pupil as seen in


the infrared camera
image.

Once the image processing software has identified


the centre of the pupil and the location of the corneal

S.S.G.B.C.O.E.T. 8 Page No.


reflection, the vector between them is measured, and,
with further trigonometric calculations, point-of-regard
can be found. Although it is possible to determine
approximate point-of-regard by the corneal reflection
alone (as shown in Figure 2), by tracking both features
eye movements can, critically, be disassociated from
head movements (Duchowski, 2003, Jacob & Karn,
2003).

Fig. 2. Corneal reflection position changing according


to point of regard

Video-based eye trackers need to be fine-tuned to


the particularities of each person’s eye movements by a
“calibration” process. This calibration works by
displaying a dot on the screen, and if the eye fixes for
longer than a certain threshold time and within a certain
area, the system records that pupil-centre/corneal-
reflection relationship as corresponding to a specific x,y
coordinate on the screen. This is repeated over a 9 to 13
point grid-pattern to gain an accurate calibration over the
whole screen.

Types of Eye Tracking Technology

S.S.G.B.C.O.E.T. 9 Page No.


1.Scleral Coil Contact Lens Method

The scleral search coil technique was first


introduced by Robinson in 1963 and uses a contact lens
with mirrors attached to a wire coil that moves in a
magnetic field. The field induces a voltage in the coil to
produce a signal that represents the eye position. An
integrated coil in the contact lens allows detecting the
orientation of the coil in a magnetic field. The eye
movements can be recorded by monitoring the infrared
wavelength range that is reflected by the mirror and
recorded by eye trackers for accurately moving an image
in line with the eye movement. A scleral search coil is
shown in Fig.

The scleral contact lens which was inserted in the


eye of the subject, contains an induction coil embedded
in the periphery of the lens. The subject’s head is kept
stationary inside a magnetic cage. The changes in the
magnetic field are then used to measure the subject’s eye
movements.

Fig. Scleral coil contact lens


2.Infrared oculography

S.S.G.B.C.O.E.T. 10 Page No.


The infrared oculography (IOG) technique measures the
strength of an infrared light that is mirrored from the
sclera, which provides a variety of information about the
eye position. Light can be produced from a pair of
glasses. This approach relies mainly on light and pupil
detection algorithms. To solve the issue of head
movement sensitivity, a reference point, which is known
as a corneal reflection or glint, is included using an
infrared light source when this technique is applied. Fig
shows the infrared light used and the typical setup of an
infrared oculography technique that is known to produce
fewer disturbances than an EOG.

Fig.. Infrared oculography approach setup

3.Electro oculography

S.S.G.B.C.O.E.T. 11 Page No.


Electro oculography (EOG) is a practicable and
inexpensive technique for human–computer interaction.
In this approach, sensors are attached to the area that
surrounds the eyes to detect an electric field that occurs
while the eyes are rotating by measuring fluctuations in
the skin. Horizontal and vertical eye movements are
documented disjointedly using electrodes. However, the
signal can be altered without eye movements. Fig. shows
a wearable EOG device with sensors attached.

EOG is not an approach for daily use; its


application can be beneficial to medical fields and
laboratories. This approach is linearly relative to eye
movements, and it can use head movements for tracking.

Fig. Electro oculography device

4.Video Oculography

S.S.G.B.C.O.E.T. 12 Page No.


A typical setup consists of a video camera that
records the movements of the eyes and a computer that
saves and analyses the gaze data. The VOG approach can
either use visible or infrared lights. The VOG is a non-
invasive system that performs the eye tracking remotely.
There are two ways to implement video eye tracking
based on the number of cameras used: the first approach
uses a single camera, whereas the other uses multiple
cameras . Both types of eye trackers, remote or head
mounted, have a major drawback if used in HCI systems
owing to changes in the head position. For remote
trackers, this can be resolved by using two stereo
cameras or one wide-angle camera to search for the
person in front and another to point to the person’s face
and zoom in. An example of VOG using two cameras is
shown in Fig..

Fig. 6. Video oculography using two cameras

Eye Tracking Using Machine Learning

S.S.G.B.C.O.E.T. 13 Page No.


ML is an approach to learn from previous data using
a variety of algorithms and find predictions to eventually
come up with a model that shows accurate results.
Several algorithms and techniques have been introduced
to eye tracking, including regression, neural networks,
naive Bayes classification, and a support vector machine
(SVM).

An SVM is an extremely effective and commonly


used ML approach in classification, object recognition,
and image querying.. In addition, SVM was used with a
variety of feature extraction and face recognition
algorithms in eye tracking techniques. With
electrooculography (EOG), it was used to detect signal-
saccades, fixations, and blinks to detect repetitive
patterns of eye movements. The minimum repetition,
minimum redundancy, and maximum relevance features
were combined with the SVM classifier and the person-
independent and leaveone-person-out strategies, to train
the model. Evaluation results showed an accuracy rate of
76.1% across all categories

An SVM and the Zernike movement (ZM) have


been used if the template matching algorithm or Haar
face detection algorithm is not able to detect the eyes .
ZM was especially helpful in reducing problematic
views, specifically in the case of upsidedown images or
unclear visibility owing to lighting issues.

Eye Tracking Using Internet of Things

S.S.G.B.C.O.E.T. 14 Page No.


Developments in mobile communication devices,
information technology, sensors, and data have led to a
significant enhancement in IoT and novel innovative
technologies and services. An IoT micro-sensor was used
to integrate objects into wireless networks that allow
objects to interact with one another and to interact with
other objects, leading to reliable and continuous
exchanges of relevant information improving the quality
of a user’s life. The expansion of IoT has taken over the
scope of homes, health care, environmental monitoring,
inventory.management, intelligent transportation, and
numerous other fields.
At present, important facilities such as the
monitoring of vehicle dynamics and smart navigation are
being provided using IoT, which can connect anything
electronic to an existing Internet connection. IoT can be
used as a car assistant, to reduce car accidents that occur
owing to driver drowsiness. IoT is also used to monitor
eye and head movements.

When a tracking system detects an abnormal eye


blinking rate, the driver will be alerted to stay awake. To
benefit from the use of IoT in eye tracking, Tourch7 was
incorporated using EyeDee technology.

Eye Tracking As An Input Device

S.S.G.B.C.O.E.T. 15 Page No.


Eye movements can be measured and used to enable
an individual actually to interact with an interface. Users
could position a cursor by simply looking at where they
want it to go, or “click” an icon by gazing at it for a
certain amount of time or by blinking. The first obvious
application of this capability is for disabled users who
cannot make use of their hands to control a mouse or
keyboard. However, intention can often be hard to
interpret; many eye movements are involuntary, leading
to a certain “Midas Touch”, in that you cannot look at
anything without immediately activating some part of the
interface. One solution to this problem is to use eye
movements in combination with other input devices to
make intentions clear. Speech commands can add extra
context to users’ intentions when eye movements may be
vague, and vice versa.

Virtual reality environments can also be controlled


by the use of eye movements. The large three-
dimensional spaces that users operate in often contain
far-away objects that have to be manipulated. Eye
movements seem to be the ideal tool in such a context, as
moving the eyes to span long distances requires little
effort compared with other control methods.

Future Trends In Eye Tracking

S.S.G.B.C.O.E.T. 16 Page No.


Future developments in eye tracking should centre
on standardizing what eye- movement metrics are used,
how they are referred to, and how they should be
interpreted in the context of interface design. For
example, no standard yet exists for the minimum
duration of a fixation, yet small differences in duration
thresholds can make it hard to compare studies on an
even footing. Eye-tracking technology also needs to be
improved to increase the validity and reliability of the
recorded data. The robustness and accuracy of data
capture needs to be increased, so that point-of-regard
measurement stays accurate without the need for
frequent re-calibration. Data- collection, -filtering and -
analysis software should be streamlined so that they can
work together without user intervention. The
intrusiveness of equipment should be decreased to make
users feel more comfortable, perhaps through the
development of smaller and lighter head-mounted
trackers. Finally, eye-tracking systems need to become
cheaper in order to make them a viable usability tool for
smaller commercial agencies and research labs. Once eye
tracking achieves these improvements in technology,
methodology, and cost, it can take its place as part of a
standard HCI toolkit.

Applications Of Eye Tracking

S.S.G.B.C.O.E.T. 17 Page No.


1. Academic and Scientific Research:
Without a doubt, the academic and scientific
research fields are currently making the most out of eye
tracking for cognitive, developmental, experimental and
media applications in psychology and neuroscience.
2. Market Research:
During the past few years, eye tracking for market
research has become increasingly important. Many
leading brands use the tool to evaluate their products,
designs, advertising or even the shopping behavior of
their customers to optimize the overall customer
experience.
3. Psychology Research:
Within this area, visual attention can be measured
and correlated with other measures such as how the brain
works. The visual attention research can be done for
normal populations as well as for specific subpopulations
that have conspicuous behavioral patterns or different
kinds of mental health disorders.
4. Medical Research:
Eye tracking in combination with conventional
research methods or other biosensors can even be helpful
for diagnosing diseases such as Attention Deficit
Hyperactivity Disorder (ADHD), Autism Spectrum
Disorder (ASD), Obsessive Compulsive Disorder
(OCD), Schizophrenia, Parkinson’s and Alzheimer’s
disease.
5. Usability Research:

S.S.G.B.C.O.E.T. 18 Page No.


Eye tracking for usability and user experience is an
emerging field using these methodologies. One classic
example is website testing. Here, attention to real estate,
communication, and call to action (CTA) can be
measured.
6. Packaging Research:
Generally, there is a lot of money invested into
designing packages of a product before they go to
market. This is the case especially for fast moving
consumer goods because the competition is very fierce.
7. PC and Gaming Research:
Eye tracking has also been introduced to the human-
computer interaction and gaming industry which now
enables for instance game designers to get a better
understanding of the game experience so that it is
somewhat possible to control the experience and create
features that push the boundaries of reality even more.
8. Human Factors and Simulation:
Automotive research has embraced eye tracking
glasses for a long time to gauge driver’s visual attention
– both with respect to navigation and layout of
dashboards. In the near future automobiles might be able
to be responsive towards their driver’s eye gaze, eye
movements or the dilation of the pupil.

Benefits or Advantages of Eye Tracking


Technology

S.S.G.B.C.O.E.T. 19 Page No.


Following are the benefits or advantages of Eye
Tracking Technology:
➨It increases computing and resource efficiency.

➨It helps to assess human conditions and behaviors.

➨It helps to learn from experts delivering skills.

➨It makes technology more intuitive.

➨It helps to communicate with machines in order to

automate manual tasks.

➨It increases user experience and performance in

playing games.

Drawbacks or disadvantages of Eye Tracking


Technology

S.S.G.B.C.O.E.T. 20 Page No.


Following are the drawbacks or disadvantages of
Eye Tracking Technology:

➨It is expensive technology due to costly hardware


requirements.

➨It does not work with few users who wear contact
lenses or have long eye lashes.

➨It requires some calibration time before it gives


satisfactory results. Hence few users deviate themselves
from using it.

➨Eye movements of some users are often unintentional.


This results into unwanted responses by the system.

➨It is difficult to control eye position accurately all the


times unlike mouse. Eye tracker provides in stable output
when it does not get appropriate image of the eye in
consecutive frames.

Conclusion
The future looks like it will be shaped in numerous
ways by the continued application of eye tracking

S.S.G.B.C.O.E.T. 21 Page No.


technology. The above of course aren’t the only fields to
be shaped by studying the movements of the eyes, but
have shown great promise to make the most of the
increasingly accessible technology.
Fields of use in which eye tracking is more
commonplace (psychology, advertising, human factors,
etc) are also benefiting from the increased knowledge of
their use, as well as the increased accessibility. The
number of publications within each field using these
devices continues to grow year on year.
Whichever way eye tracking is involved in
increasing knowledge in the future, we know that it’s
something we can look forward to.

References

S.S.G.B.C.O.E.T. 22 Page No.


 Adler FH & Fliegelman (1934). Influence of
fixation on the visual acuity. Arch. Ophthalmology
12, 475.

 Buswell, G.T. (1922). Fundamental reading habits:


A study of their development. Chicago, IL:
University of Chicago Press.

 Buswell G.T. (1935). How People Look at Pictures.


Chicago: Univ. Chicago Press 137–55. Hillsdale,
NJ: Erlbaum

 Duchowski, A. T. (2003). Eye tracking


methodology: Theory and practice.
London:Springer-Verlag Ltd.

S.S.G.B.C.O.E.T. 23 Page No.

You might also like