35 BlueEyesTech
35 BlueEyesTech
35 BlueEyesTech
net/publication/329782042
CITATIONS READS
0 347
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Blessed Olalekan Oyebola on 19 December 2018.
ABSTRACT
This paper attempts to provide knowledge about Blue eyes technology in modern engineering.
It is based on hard facts, research and experiences gathered from different authors, books,
journals, documents from websites in hope that it will serve as an adequate learning resource
for intended readers. The paper discussed Blue eyes technology to aid understanding and
significance of Blue eyes technology in modern engineering technology - identifying the
advantages of using artificial intelligence technology and the limitations of artificial
intelligence technology. The paper concludes by recognizing benefits of using blue eyes
technology in modern engineering, type of users that can operate the blue eyes technology
system, and its effectiveness in modern engineering.
Keywords: Artificial Intelligence, Blue Eye, Modern, Technology
INTRODUCTION
A Blue eye technology is aimed at creating computational machines that have perceptual and
sensory abilities like those of human, using non-obtrusive sensing method, employing most
modern video cameras and microphones to identify the user’s actions through the use of
imparted sensory abilities which allows the machine/computer to understand what a user
wants, where he is looking at, and even realize his physical or emotional states.
The basic idea behind this technology is to give the computer the human power. We all have
some perceptual abilities that are we can understand each other’s feelings for example we can
understand ones emotional state by analyzing his facial expression. If we add these perceptual
Research Questions
What are the benefits of using blue eyes technology in modern engineering?
What type of users can operate the blue eyes technology system?
Blue: in this term stands for Bluetooth, which enables reliable wireless communication
Eyes: because the eye movement enables us to obtain a lot of interesting and important
information.
Emotion computing: is the study and development of systems and devices that can
Manual and gaze input cascaded (MAGIC): This work explores a new direction in
Data acquisition unit (DAU): Data Acquisition Unit are to maintain Bluetooth
connections to get information from sensor and sending it over the wireless connection
to deliver the Alarm Messages sent from the Central System Unit to the operator and
buffers incoming sensor data, performs online data analysis records conclusion for
Simple user interest tracker (SUITOR): it tracks computer users through multiple
channels - gaze, web browsing, and application focus to determine their interests and to
ARTIFICIAL INTELLIGENCE
Artificial intelligence (AI) is intelligence exhibited by machines. In computer science, the field
of AI research defines itself as the study of "intelligent agents ": any device that perceives its
environment and takes actions that maximize its chance of success at some goal. Colloquially,
the term "artificial intelligence" is applied when a machine mimics "cognitive" functions that
humans associate with other human minds, such as "learning" and "problem solving" (known
thought to require intelligence are removed from the definition (Wikipedia, 2017).
It’s Benefits
Error Reduction: Artificial intelligence helps us in reducing the error and the chance of
No Breaks: Machines, unlike humans, do not require frequent breaks and refreshments, it
allow machine programming for long hours and can continuously perform without
Digital Assistants: Highly advanced organizations use ‘avatars’ which are replicas or
digital assistants who can actually interact with the users, thus saving the need of human
Repetitive Jobs: Repetitive jobs which are monotonous in nature can be carried out with
the help of machine intelligence. Machines think faster than humans and can be put to
Daily Application: Computed methods for automated reasoning, learning and perception
have become a common phenomenon in our everyday lives. We have our lady Siri or
Cortana to help us out. We are also hitting the road for long drives and trips with the help
of GPS. Smartphone in an apt and every day is an example of the how we use artificial
Precincts
High Cost: Creation of artificial intelligence requires huge costs as they are very complex
machines. Their repair and maintenance require huge costs. They have software programs
which need frequent up gradation to cater to the needs of the changing environment and the
need for the machines to be smarter by the day. In the case of severe breakdowns, the
procedure to recover lost codes and re-instating the system might require huge time and cost.
continues, whether human intelligence is to be replicated or not. Machines do not have any
emotions and moral values. They perform what is programmed and cannot make the judgment
of right or wrong. They cannot take decisions if they encounter a situation unfamiliar to them.
with experience. With time, it can lead to wear and tear. It stores a lot of data but the way it can
be accessed and used is very different from human intelligence. Machines are unable to alter
Unemployment: Replacement of humans with machines can lead to large scale unemployment.
the destructive use of their creative minds. Humans can unnecessarily be highly dependent on
the machines if the use of artificial intelligence becomes rampant. Humans will lose their
creative power and will become lazy. Also, if humans start thinking in a destructive way, they
can create havoc with these machines. Artificial intelligence in wrong hands is a serious threat
to mankind in general. It may lead to mass destruction. Also, there is a constant fear of
With the limitations mentioned above, Blue eyes technology is a preferred solution to combat
such disadvantages such as where there is high cost in creating artificial intelligence, creation
of blue eyes on the other hand is less expensive and less time consuming. For data security
unlike artificial intelligence where there is no safety of data, the users in blue eyes technology
don't have to worry about the security mechanism. It has a different level of data security
which is required;
These are some of the concrete security procedures that make this technology even more
different and unique. Where artificial intelligence cannot improve on experience, blue eyes
technology monitors and records operator’s daily activities so as prevent unnecessary human
errors. Unemployment is not admissible in blues eyes as the technology requires different users
to operate it for better performance and so on. Blue eyes technology uses different techniques
and technologies to solve these limitations which will be discussed in the next chapter.
THE TECHNIQUES
This paper seeks to view and improve the technology so as to combat the above limitations via
Blue eyes technology utilizing the following modern techniques; emotion computing, manual
and gaze input cascaded (magic) and simple user interest tracker (suitor). These techniques use
tools like microphones, cameras, and Bluetooth module and emotion mouse. The techniques
are elaborated with their descriptions to explain their importance to the implementation of Blue
eyes technology. It also includes the main features on the construction of Blue Eyes
Technology. The Hardware: DAU and CSU which consist of the physical components used
and the Software: Connection manager, Data analysis module and Visualization module for the
interface.
important to the computing community. There are two aspects of affective computing:
giving the computer the ability to detect emotions and giving the computer the ability to
express emotions. Not only are emotions crucial for rational decision making as Picard
state. An important element of incorporating emotion into computing is for productivity for a
Hand
Emotion Mouse: The device can measure heart rate, temperature, galvanic skin response and
minute bodily movements and matches them with six emotional states: happiness, surprise,
Sentic Mouse: It is a modified computer mouse that includes a directional pressure sensor for
(Binyamin, 2010).
Eye
Expression Glasses: A wearable device which allows any viewer to visualize the confusion and
interest levels of the wearer. Other recent developments in related technology are the attempt to
learn the needs of the user just by following the interaction between the user and the computer
ARTIFICIAL INTELLIGENCE: Artificial intelligence (AI) involves two basic ideas. First,
it involves studying the thought processes of human beings. Second, it deals with representing
those processes via machines (like computers, robots, etc.). AI is behavior of a machine,
which, if performed by a human being, would be called intelligent. It makes machines smarter
SPEECH RECOGNITION: The user speaks to the computer through a microphone, which,
in use; a simple system may contain a minimum of three filters. The more the number of filters
used, the higher the probability of accurate recognition. Presently, switched capacitor digital
filters are used because these can be custom-built in integrated circuit form. These are smaller
and cheaper than active filters using operational amplifiers. The filter output is then fed to the
ADC to translate the analogue signal into digital word. The ADC samples the filter outputs
many times a second. Each sample represents different amplitude of the signal. Evenly spaced
vertical lines represent the amplitude of the audio filter output at the instant of sampling. Each
value is then converted to a binary number proportional to the amplitude of the sample. A
central processor unit (CPU) controls the input circuits that are fed by the ADCS. A large
RAM (random access memory) stores all the digital values in a buffer area. This digital
information, representing the spoken word, is now accessed by the CPU to process it further.
The normal speech has a frequency range of 200 Hz to 7 kHz. Recognizing a telephone call is
more difficult as it has bandwidth limitation of 300 Hz to3.3 kHz. As explained earlier, the
spoken words are processed by the filters and ADCs. The binary representation of each of
These templates are stored in the memory. Once the storing process is completed, the system
can go into its active mode and is capable of identifying spoken words. As each word is
spoken, it is converted into binary equivalent and stored in RAM. The computer then starts
searching and compares the binary input pattern with the templates. It is to be noted that even
if the same speaker talks the same text, there are always slight variations in amplitude or
loudness of the signal, pitch, frequency difference, time gap, etc. Due to this reason, there is
never a perfect match between the template and binary input word. The pattern matching
process therefore uses statistical techniques and is designed to look for the best fit
(Academia.org).
This work explores a new direction in utilizing eye gaze for computer input. Gaze tracking has
long been considered as an alternative or potentially superior pointing method for computer
Reduction of manual stress and fatigue, since the cross screen long-distance cursor
accuracy is fundamentally limited by the nature of eye movement, the MAGIC pointing
techniques let the hand complete the pointing task, so they can be as accurate as any other
role of the eye gaze. To the user, pointing continues to be a manual task, with a cursor
Speed. Since the need for large magnitude pointing operations is less than with pure
manual cursor control, it is possible that MAGIC pointing will be faster than pure manual
pointing.
Improved subjective speed and ease-of-use. Since the manual pointing amplitude is
smaller, the user may perceive the MAGIC pointing system to operate faster and more
pleasantly than pure manual control, even if it operates at the same speed or more slowly.
Computers would have been much more powerful, had they gained perceptual and sensory
abilities of the living beings on the earth. What needs to be developed is an intimate
relationship between the computer and the humans, and the Simple User Interest Tracker
user is browsing, the SUITOR can help by fetching more information at his desktop. By simply
noticing where the user’s eyes focus on the computer screen, the SUITOR can be more precise
in determining his topic of interest. It can even deliver relevant information to a handheld
device. The success lies in how much the suitor can be intimate to the user (KUMAR, 2010).
System Overview
Blue eyes system monitors the status of the operator’s visual attention through measurement of
saccadic activity. The system checks parameters like heart beat rate and blood oxygenation
against abnormal and triggers user defined alarms. Blue Eyes system consists of a mobile
Bluetooth module providing wireless interface between sensors worn by the operator and the
central unit. ID cards assigned to each of the operators and adequate user profiles on the central
unit side provide necessary data personalization so the system consists of Mobile measuring
device (DAU) and Central System Unit (CSU) (Jothi, 2016). The Fig. 1 describes the system
overview.
DESIGN
Data Acquisition Unit is a mobile part of the Blue eyes system. Its main task is to fetch the
physiological data from the sensor and to send it to the central system to be processed. To
accomplish the task the device must manage wireless Bluetooth connections (connection
establishment, authentication and termination). Personal ID cards and PIN codes provide
key keyboard, a small LCD display and a beeper. When an exceptional situation is detected
the device uses them to notify the operator. Voice data is transferred using a small headset,
interfaced to the DAU with standard mini-jack plugs. The Data Acquisition Unit comprises
Central System Unit hardware is the second peer of the wireless connection. The box
contains a Bluetooth module (based on ROK101008) and a PCM codec for voice data
transmission. The module is interfaced to a PC using a parallel, serial and USB cable. The
audio data is accessible through standard mini-jack sockets To program operator's personal
using serial and PS/2 (power source) ports. Inside, there is Atmel 89C2051 microcontroller,
which handles UART transmission and I2C EEPROM (ID card) programming .Fig. 4 shows
The software
Blue Eyes software’s main task is to look after working operators' physiological condition. To
assure instant reaction on the operators' condition change the software performs real
time buffering of the incoming data, real-time physiological data analysis and alarm
triggering. The Blue Eyes software comprises several functional modules System core
facilitates the transfers flow between other system modules (e.g. transfers raw data from the
Connection Manager to data analyzers, processed data from the data analyzers to GUI
controls, other data analyzers, data logger etc.). The System Core fundamental are single-
producer-multi-consumer thread safe queues. Any number of consumers can register to receive
the data supplied by a producer. Every single consumer can register at any number of
producers, receiving therefore different types of data. Naturally, every consumer may be a
producer for other consumers. This approach enables high system scalability – new data
processing modules (i.e. filters, data analyzers and loggers) can be easily added by simply
registering as a costumer.
mobile Data Acquisition Units and the central system. The Connection Manager handles:
Connection authentication
Sending alerts
Data Analysis module performs the analysis of the raw sensor data in order to obtain
information about the operator’s physiological condition. The separately running Data
Analysis module supervises each of the working operators. The module consists of a number of
smaller analyzers extracting different types of information. The most important analyzers are:
Pulse rate analyzer - uses blood oxygenation signal to compute operator's pulse
rate
Custom analyzers - recognize other behaviors than those which are built-in the system.
The new modules are created using C4.5 decision tree induction algorithm.
Visualization module provides a user interface for the supervisors. It enables them to watch
each of the working operator’s physiological condition along with a preview of selected
video source and related sound stream. All the incoming alarm messages are instantly
signaled to the supervisor. The Visualization module can be set in an offline mode, where
parameters, alarms, video and audio data the supervisor is able to reconstruct the course of the
selected operator’s duty. The physiological data is presented using a set of custom-built
GUI controls:
A pie-chart used to present a percentage of time the operator was actively acquiring the
visual information
A VU-meter showing the present value of a parameter time series displaying a history of
selected parameters' value. Fig. 5 describes the Software analysis (Binyamin, 2010).
DISCUSSION
Why is Blue eyes technology necessary? Human errors are still one of the most frequent causes
of catastrophes and ecological disasters. The main reason is that the monitoring systems
concern only the state of the processes whereas human contribution to the overall performance
of the system is left unsupervised, he/she may not notice important changes of indications
causing financial or ecological consequences thereby creating a threat to human life. Blue eyes
system is developed to be the complex solution for monitoring and recording the operator’s
conscious brain involvement as well as his physiological condition such as weariness thereby
What type of users can operate the blue eyes technology system? Users belong to three
operator wears the DAU. The only functions offers to the operator are Authorization to the
Authorization: Operator has to enter his personal PIN into DAU, if PIN is accepted,
Receiving Alerts: This function supplies the operator with the most important alerts about
performance. The supervisor receives tools for inspecting present values of the parameters
(on-line browsing) as well as browsing the results of the long-term analysis (off-line
browsing).
delivered tools for adding new operators to the database, defining alarm conditions,
configuring logging tools and creating new analyzer modules (UK Essays, 2015).
In the automobile industry, by simply touching a computer input device such as a mouse, the
computer system is designed to be able to determine a person's emotional state. For cars, it
could be useful to help with critical decisions like: "I know you want to get into the fast lane,
but I'm afraid I can't do that. Your too upset right now" and therefore assist in driving safely.
Current interfaces between computers and humans can present information vividly, but have
no sense of whether that information is ever viewed or understood. In contrast, new real-time
Displays" and "Perceptive Environments", which can sense and respond to users that are
viewing them. Using stereo-vision techniques, we are able to detect, track, and identify users
It could be deployed in video games where, it could give individual challenges to customers
playing video games, typically targeting commercial business. The integration of children's
toys, technologies and computers is enabling new play experiences that were not
commercially feasible until recently. The Intel Play QX3 Computer Microscope, the Me2Cam
with Fun Fair, and the Computer Sound Morphers are commercially available smart toy
detection and the reconstruction of the course of operator’s work are merits of Blue eyes
Generic control rooms: (Blue eyes system can be applied in every working environment
Captain bridge
Video games
Automobile industries.
Small CMOS camera to monitor the operator’s point of gaze, single PCB (SMD technology),
low voltage ICs - LiIO battery power are recommended for DAU while data mining
At IBM’s lab researchers are tackling the lofty goal of designing smarter devices. Following
the movement of your eyes, the “gaze—tracking” technology uses MAGIC (Manual
Acquisition with Gaze-Initiated Cursor) to control your mouse. With MAGIC, the cursor
follows your eyes as you look around the screen. When your eyes spot on an object, you click
the mouse to select it (Studymafia). Why not free up your hand and let your eyes do all the
work? Researchers tried that and found that the hand is quicker than the eye, or at least more
accurate, says Morris, the research center director. Also, current versions of the gaze tracking
technology only come within an inch or so of its target. One limitation of today’s input devices
is that we have to tell them what we want. When you lay your hand on the Emotion Mouse, it
will measure how you are feeling and react accordingly. Aside from pointing devices,
researchers at Almaden are studying emotion technology for use in automobiles, video games,
remote controls and telephones. But it may be a decade before this type of technology is
possible to create a computer which can interact with us as we interact with each other with the
use of blue eye technology. It seems to be a fiction, but it will be the life lead by "BLUE
EYES" in the very near future. Ordinary household devices -- such as televisions, refrigerators,
and ovens - may be able to do their jobs when we look at them and speak to them, thereby
making us “lazy” and even possible more efficient in performance and giving more time to
think, be creative and innovate new ways to help each other (Technical pages, 2008).