Blue Eyes - Monitoring Human -
Operator System
Overview:
Human error is still one of the most frequent causes of
catastrophe and ecological disasters. The main reason is that the
monitoring systems concern only the state of the processes where as
human contribution to the overall performance of the system is left
unsupervised. Since the control instruments are automated to a large
extent, a human operator becomes a passive observer of the supervised
system, which results in weariness and vigilance drop. Thus, he may not
notice important changes of indications causing financial or ecological
consequences and a threat to human life.
It therefore is crucial to assure that the operator’s conscious brain
is involved in an active system supervising over the whole work time
period. It is possible to measure indirectly the level of the operator’s
conscious brain involvement using eye motility analysis.
1
Blue Eyes
INTRODUCTION:
What is BlueEyes?
• BLUE EYES is a technology, which aims at creating computational
machines that have perceptual and sensory abilities like those of
human beings.
• The basic idea behind this technology is to give computer human
power.
• For example, we can understand humans’ emotional state by his
facial expressions. If we add these perceptual abilities to
computers, we would enable them to work together with human
beings as intimate partners.
• It provides technical means for monitoring and recording human-
operator’s physiological condition.
What is BlueEyes not?
• Doesn’t predict nor interfere with operator’s thoughts.
• Cannot force directly the operator to work.
• How was the term blue-eyes coined?
2
Blue Eyes
• Blue in this term stands for Bluetooth, which enables reliable
wireless communication and the Eyes because the eye movement
enables us to obtain a lot of interesting and important information.
How are blue and eyes related?
• As the idea is to monitor and record operator’s basic physiological
parameters, the most important physiological activity is the
movement of eyes.
• For a computer to sense the eye movement, wiring between
operator and the system is required.
But, this is a serious limitation of the operator’s mobility and
disables his operations in large control rooms.
• So utilization of wireless technology becomes essential which can
be implemented through blue tooth technology.
Need for blue eyes?
• Is it necessary to make computer function what a human brain
does?
• Yes, human error is still one of the most frequent causes of
catastrophes (calamity) and ecological disasters, because human
contribution to the overall performance of the system is left
unsupervised.
3
Blue Eyes
• The control instruments within the machine have automated it to
large extent, thus Human operator becomes a passive observer of
the supervised system, resulting in weariness and vigilance drop,
but the user needs to active.
But Why?
• Is it really needed that a human brain be active?
• He may not notice important changes of indications causing
financial or ecological consequences, which is a threat to human
life.
• Thus, it’s crucial that operator’s brain is involved in an active
system supervising over the whole work time period.
What can we do with blue eyes technology?
It has the ability to gather information about you and interact with
you through special techniques like facial recognition, speech
recognition, etc.
It can even understand your emotions at the touch of the mouse.
It can verify your identity, feel your presence, and start interacting
with you.
The machine can understand what a user wants, where he is looking
at, and even realize his physical or emotional states.
It realizes the urgency of the situation through the mouse.
For instance if you ask the computer to dial to your friend at his
office, it understands the situation and establishes a connection.
4
Blue Eyes
It can reconstruct the course of operator’s work.
Key features of the system:
• Visual attention monitoring (eye motility analysis).
• Physiological condition monitoring (pulse rate, blood oxygenation).
• Operator’s position detection (standing, lying).
• Wireless data acquisition using Bluetooth technology.
• Real-time user-defined alarm triggering.
• Physiological data, operator's voice and overall view of the control
room recording
recorded data playback.
How can we give computer the human power?
It uses non-obtrusive sensing method, employing most
modern video cameras and microphones to identify the
users’ actions through the use of imparted sensory abilities.
The blue eyes system checks the physiological parameters
like eye movement, heart beat rate and blood oxygenation
against abnormal and undesirable values and triggers user-
defined alarms when necessary.
Blue eyes technology requires designing a personal area
network linking all the operators and the supervising
system.
5
Blue Eyes
As the operator using his sight and hearing, senses the
state of the controlled system, the supervising system will
look after his physiological condition.
The use of a miniature CMOS camera integrated into the
eye movement sensor will enable the system to calculate
the point of gaze and observe what the operator is actually
looking at.
Introducing voice recognition algorithm will facilitate the
communication between the operator and the central
system and simplify authorization process.
STRUCTURE:
Blue eyes system consists of a mobile measuring device
called
Data Acquisition Unit (DAU) and a central analytical system
called
Central System Unit (CSU).
OVERALL SYSTEM DIAGRAM
DATA ACQUISITION UNIT:
It maintains Bluetooth connections.
Gets information from the sensor.
Sends information over the wireless connection.
6
Blue Eyes
Delivers the alarm messages sent from the Central System Unit
(CSU) to the operator.
Handles personalized ID cards.
Jazz Multisensor:
• It’s an eye movement sensor, to provide necessary physiological
data in Data Acquisition Unit (DAU).
• It supplies raw digital data regarding eye position, the level of
blood oxygenation acceleration along horizontal and vertical axes
and ambient light intensity.
• Eye movement can be measured using direct infrared
oculographic transducers.
CENTRAL SYSTEM UNIT:
Maintains blue tooth connections in the other side.
Buffers incoming sensor data.
Performs on-line data analysis.
Records the conclusion for further exploration.
Provides visualization interface.
TYPES OF USERS:
Users belong to three categories:
• Operators
• Supervisors
7
Blue Eyes
• System administrators
Operator:
Operator is a person whose physiological parameters are
supervised.
The operator wears the DAU.
The only functions offers to the operator are Authorization to
the system and receiving alarm alerts.
Authorization: Operator has to enter his personal PIN into
DAU, if PIN is accepted, authorization is said to be complete.
Receiving Alerts: This function supplies the operator with the
most important alerts about his and his co-workers’ condition
and mobile device state.
Supervisor:
He is the person responsible for analyzing operators’ condition and
performance.
The supervisor receives tools for inspecting present values of the
parameters (on-line browsing) as well as browsing the results of the
long-term analysis (off-line browsing).
System Administrator:
He is the user that maintains the system.
8
Blue Eyes
The administrator is delivered tools for adding new operators to the
database. Defining alarm conditions.
Configuring logging tools.
Creating new analyzer modules.
ADMINISTRATIVE APPLICATIONS:
• Blue Eyes system can be applied in every working environment
requiring permanent operator's attention.
• At power plant control rooms.
• At captain bridges.
• At flight control centers.
• Professional drivers.
Conclusion:
• The wireless link between the sensors worn by the operator and the
supervising system makes it possible to improve overall reliability,
safety and assures proper quality of system performance.
• These new possibilities can cover areas such as industry,
transportation, military command centers or operation theaters.
9
Blue Eyes
• Researchers are attempting to add more capabilities to computers
that will allow them to interact like humans, recognize human
presents, talk, listen, or even guess their feelings.
• It avoids potential threats resulting from human errors, such as
weariness, oversight, tiredness.
REFERENCES:
1. Carpenter R. H. S., Movements of the eyes, 2nd edition, Pion
Limited, 1988, London.
2. Quinlan J. R., C4.5 programs for machine learning, Morgan
Kaufmann Publishers, 1993, San Mateo, California.
10
Blue Eyes
