CS8079 - HCI Technical Book
CS8079 - HCI Technical Book
1
Foundations of HCI
Syllabus
The Human : I/O channels – Memory – Reasoning and problem solving. The Computer :
Devices – Memory – processing and networks. Interaction : Models – frameworks –
Ergonomics – styles – elements – interactivity – Paradigms. Case Studies.
Contents
Introduction to HCI
I/O Channels
Memory
Reasoning and Problem Solving
Computer
Processing and Network
Interaction Models
Ergonomics
Interaction Styles
Paradigms
Case Study
Two Marks Questions with Answers
(1 - 1)
Human Computer 1- 2 Foundations of
Interaction HCI
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 3 Foundations of
Interaction HCI
Ensure privacy (protect personal information such as habits and address) &
security (protect sensitive information such as passwords, VISA card numbers)
Usability is one of the key concepts in HCI. It is concerned with making
systems easy to learn and use. Usable system is :
1. Easy to learn 2. Easy to remember how to use
3. Effective to use 4. Efficient to use
5. Safe to use 6. Enjoyable to use
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 4 Foundations of
Interaction HCI
4. Comfort Factors : Seating, equipment, layout.
5. User Interface : Input devices, output devices, dialogue structures, use of
colour, icons, commands, navigation, graphics, natural language, user
support, multimedia,
6. Task Factors : Easy, complex, novel, task allocation, monitoring, skills
7. Constraints : Cost, timescales, budgets, staff, equipment, buildings
8. System Functionality : Hardware, software, application
9. Productivity Factors : Increase output, increase quality, decrease costs,
decrease errors, increase innovation
1. Know Thy User : This principle simply states that the interaction and interface
should cater to the needs and capabilities of the target user of the system in
design. HCI designers and implementers proceed without a full understanding of
the user.
2. Understand the Task : Task refers to the job to be accomplished by the user
through the use of the interactive system. In fact, understanding the task at hand
is closely related to the interaction modeling and user analysis.
4. Strive for Consistency : In the longer term, one way to unburden the memory
load is to keep consistency. This applies to both within an application and across
different applications and both the interaction model and interface
implementation.
5. Remind Users and Refresh Their Memory : Any significant task will involve the use
of memory, so another good strategy is to employ interfaces that give continuous
reminders of important information and thereby refresh the user’s memory. The
human memory dissipates information quite quickly, and this is especially true
when switching tasks in multitasking situations.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 5 Foundations of
Interaction HCI
1.2 I/O Channels
Human interaction with the outside world occurs through information being
received and sent is called input - output channel.
Human input-output channels vision, hearing, touch, movement etc.
Human vision is a highly complex activity with a range of physical and
perceptual limitations, yet it is the primary source of information for the
average person.
Vision begins with light. The eye is a mechanism for receiving light and
transforming it into electrical energy. Light is reflected from objects in the
world and their image is focused upside down on the back of the eye.
Hearing : The sense of hearing is often considered secondary to sight, but we
tend to underestimate the amount of information that we receive through our
ears. The human ear can hear frequencies from about 20 Hz to 15 kHz.
Touch provides us with vital information about our environment. It tells us
when we touch something hot or cold, and can therefore act as a warning. It
also provides us with feedback when we attempt to lift an object, for example.
Movement : A simple action such as hitting a button in response to a question
involves a number of processing stages.
There are five senses : Sight, sound, touch, taste and smell.
Sight is the predominant sense for the majority of people, and most interactive
systems consequently use the visual channel as their primary means of
presentation, through graphics, text, video and animation.
However, sound is also an important channel, keeping us aware of our
surroundings, monitoring people and events around us, reacting to sudden
noises, providing clues and cues that switch our attention from one thing to
another. It can also have an emotional effect on us, particularly in the case of
music.
Music is almost completely an auditory experience, yet is able to alter moods,
conjure up visual images, and evoke atmospheres or scenes in the mind of the
listener.
Touch, too, provides important information: tactile feedback forms an intrinsic
part of the operation of many common tools - cars, musical instruments, pens,
anything that requires holding or moving. It can form a sensuous bond
between individuals, communicating a wealth of non-verbal information.
Taste and smell are often less appreciated but they also provide useful
information in daily life : checking if food is bad, detecting early signs of fire,
noticing that manure has been spread in a field, pleasure.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 6 Foundations of
Interaction HCI
1.2.1 Vision
Human vision is a highly complex activity. It is the primary source of
information for the normal person.
Visual perception are divided into two stages :
1. Physical reception of the stimulus from outside world
2. The processing and interpretation of that stimulus
On the one hand the physical properties of the eye and the visual system mean
that there are certain things that cannot be seen by the human; on the other
interpretative capabilities of visual processing allow images to be constructed
from incomplete information.
1. Human Eye
Fig. 1.2.1 shows human eye.
The major structures of the human eye are the sclera, cornea, choroid, ciliary
body, iris, pupil, retina, mocula and fovea, optic nerve, optic disc, vitreous
humor, aqueous humor, canal of schlemm, lens and conjunctiva.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 7 Foundations of
Interaction HCI
simple line image for example the length, straightness, or parallelism of lines,
appears distorted in virtue of other aspects of the image, e.g. other
background/foreground lines, or other intersecting shapes. These are
sometimes called ‘geometrical-optical illusions’.
Fig 1.2.2 shows Müller-Lyer Illusion.
Limitations of human eyes are color blindness, blind spot, visual acuity
(resolution), overly sensitive to motion etc.
Human vision is a highly complex activity with a range of physical and
perceptual limitations, yet it is the primary source of information for the
average person.
Vision begins with light. The eye is a mechanism for receiving light and
transforming it into electrical energy. Light is reflected from objects in the
world and their image is focused upside down on the back of the eye.
For any one, address the problems it can cause and so what has to be taken
account of in the interface .
Colour blindness means that a significant proportion (do you know how
many ?) of the population cannot disambiguate red and green.
So do not use colour only as the factor on buttons or displays, and be aware
that red and green next to each other may be viewed as the same by some,
influencing visualizations and so on.
2. Human Ear
Sounds can vary in a number of dimensions : pitch (or frequency), timbre (or
musical tone), and intensity (or loudness).
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 8 Foundations of
Interaction HCI
Not all sounds or variations is sound are audible to humans. The ear is capable
of hearing frequencies ranging from about 20 Hz up to about 15 kHz, and
differences of around 1.5 Hz can be discerned (though this is less accurate at
high frequencies).
Human ear is divided into three sections: outer ear, middle ear and Inner ear.
Outer ear is consists of Pinna and auditory canal. Pinna is attached to the head
and auditory canal along which sound waves are passed to the middle ear.
Pinna and auditory canal serve to amplify some sounds.
In contrast to vision, sound is a "volatile" medium in the sense that sounds do
not persist in the same way that visual images do.
The ear receives the vibrations and transmits them through various stages to
the auditory nerves. The ear comprises three sections: outer ear, middle ear
and inner ear.
Speech sounds can obviously be used to convey information. This is useful not
only for the visually impaired but also for any application where the user’s
attention has to be divided (for example, power plant control, flight control,
etc.).
Uses of non-speech sounds include the following :
a) Attention : To attract the user’s attention to a critical situation or to the
end of a process.
b)Status information : Continuous background sounds can be used to
convey status information. For example, monitoring the progress of a
process without the need for visual attention.
c) Confirmation : Sound associated with an action to confirm that the action
has been carried out. For example, associating a sound with deleting a file.
d)Navigation : Using changing sound to indicate where the user is in a
system. For example, what about sound to support navigation in
hypertext ?
3. Touch
Touch is our primary non-verbal communication channel for conveying
intimate emotions and as such essential for our physical and emotional
wellbeing.
Skin contains three types of sensory receptor : thermoreceptors, nociceptors
and mechanoreceptors.
Chemoreceptors detect the presence of chemicals.
Thermoreceptors detect changes in temperature.
Mechanoreceptors detect mechanical forces.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- 9 Foundations of
Interaction HCI
1.3 Memory
Memory is a vital part of how we perceive the world around us. Human beings
have both short term and long term memory capacities and we can create
better designs by understanding how memory works and how we can work
with that capacity rather than against it.
Memory is a collection of systems for the storage and recall of information
(personal experiences, emotions, facts, procedures, skills and habits).
Fig. 1.3.1 shows structure of memory.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
1.3.2 Short Term Memory
Short - term memory, also known as primary or active memory.
Short - term memory acts as a kind of “scratch-pad” for temporary recall of the
information which is being processed at any point in time.
It is the "smallest" part of memory, because it cannot hold much information
at any one time. Its size can be estimated by measuring memory span.
Information is usually stored in short - term memory in terms of the physical
qualities of the experience, such as what we see, do, taste, touch or hear.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Semantic memory is structured in some way to allow access to information,
representation of relationships between pieces
of information, and inference.
Semantic memory includes
things that are common
knowledge, such as the
names of colors, the sounds
of letters, the capitals of
countries and other basic
facts acquired over a
lifetime.
One model for the way in Fig. 1.3.2 Semantic network
which semantic memory is
structured
is as a network. Items are associated to each other in classes, and may
inherit attributes from parent classes. This model is known as a semantic
network.
Semantic memory typically refers to memory for word meanings, facts,
concepts, and general world knowledge.
Fig. 1.3.2 shows semantic memory network for FARM.
Notice that the primary category in this network is ''FARM'' and the memory
organization shows smaller subcategories associated with a farm (machines,
animals, crops).
Each sub-node would have additional information. For example, the sheep node
(connected to the animal node) might also connect to the following information
:
1.3.4 Difference between Short - Term Memory and Long - Term Memory
Information is stored for shorter time. Information is stored for longer time.
STM is stored and retrieved sequentially. LTM is stored and retrieved by association.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
1.4.1 Reasoning
Reasoning is the process by which we use the knowledge we have to draw
conclusions or infer something new about the domain of interest.
Types of reasoning : Deductive, Inductive and Abductive.
1. Deductive reasoning :
Deductive reasoning is a basic form of valid reasoning. Deductive reasoning, or
deduction, starts out with a general statement, or hypothesis, and examines
the possibilities to reach a specific, logical conclusion.
Deductive reasoning derives the logically necessary conclusion from the
given premises. For example : "All men are mortal. Harold is a man.
Therefore, Harold is mortal."
Example : When it rains, Rakshita’s old car won’t start. It’s raining.
Therefore, Rakshita’s old car won’t start.
For deductive reasoning to be sound, the hypothesis must be correct. It is
assumed that the premises, "All men are mortal" and "Harold is a man" are
true. Therefore, the conclusion is logical and true.
In deductive reasoning, if something is true of a class of things in general, it is
also true for all members of that class.
2. Inductive reasoning :
Inductive reasoning is the opposite of deductive reasoning. Inductive reasoning
makes broad generalizations from specific observations. Basically, there is
data, then conclusions are drawn from the data.
Example : Rakshita’s old car won’t start. It’s raining. Therefore
Rakshita’s old car won’t start when it’s raining.
Inductive reasoning involves drawing conclusions from facts, using logic. We
draw these kinds of conclusions all the time. If someone we know to have good
literary taste recommends a book, we may assume that means we will enjoy
the book.
Induction can be strong or weak. If an inductive argument is strong, the truth
of the premise would mean the conclusion is likely. If an inductive argument is
weak, the logic connecting the premise and conclusion is incorrect.
3. Abductive reasoning :
The third type of reasoning is abduction. Abduction reasons from a fact to the
action or state that caused it. This is the method we use to derive explanations
for the events we observe.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
For example, suppose we know that Sam always drives too fast when she has
been drinking. If we see Sam driving too fast we may infer that she has been
drinking.
Deduction moves from more general to Induction moves from more specific to
more specific. more general.
Gestalt Theory :
Gestalt theory focused on the mind’s perceptive.
Although Gestalt theory is attractive in terms of its description of human
problem solving, it does not provide sufficient evidence or structure to support
its theories. It does not explain when restructuring occurs or what insight is.
The Gestalt Principles are a set of laws arising from 1920s’ psychology,
describing how humans typically see objects by grouping similar elements,
recognizing patterns and simplifying complex images.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Gestalt theorists followed the basic principle that the whole is greater than the
sum of its parts. In other words, the whole (a picture, a car) carried a different
and altogether greater meaning than its individual components (paint, canvas,
brush; or tire, paint, metal, respectively).
In viewing the “whole,” a cognitive process takes place –the mind makes a leap
from understanding the parts to realizing the whole.
Perhaps the best known example of a gestalt is the vase/face profile which is
fully explained in the six Gestalt Principles detailed below :
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
The problem has an initial state and a goal state. Problem space may be huge
and heuristics are employed to select appropriate operators to reach the goal.
Means-end analysis : In this analysis, the initial state is compared with the goal
state and an operator chosen to reach the goal.
1.5 Computer
Computer system comprises various elements, each of which affects the user
of the system. It uses input device, output display devices.
Computer system consists of keyboard, mouse and screen. Computer is of
different configuration like desktop, laptop and PDAs.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Computer system is made up of various elements. Each of these elements
affects the interaction.
1. Input devices - Text entry and pointing
2. Output devices - Screen (small & large), digital paper
3. Virtual reality - Special interaction and display devices
4. Physical interaction - e.g. sound, haptic, bio-sensing
5. Paper - As output (print) and input (scan)
6. Memory - RAM & permanent media, capacity & access
7. Processing - Speed of processing, networks
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
The second HCI issue with batch processing was the inability for programmers
to interact with the computer while programs were running. The significance
of this was a program had to be completely arranged on punched cards before
being processed by the system.
There was no function or ability to interactively check each line, or chunk, of
code as it is written as programmers do today. This made errors very time
consuming and difficult to identify.
In addition, batch processing allowed for very little of the programming
creativity we see today. It was not until time-sharing provided the first multi-
access interactive computers in the 1960s that programmers were able to treat
their craft as a creative art.
1.5.1 Device
The devices dictate the styles of interaction that the system supports.
If we use different devices, then the interface will support a different style of
interaction.
Qwerty keyboard
QWERTY refers to the arrangement of keys on a standard English computer
keyboard or typewriter.
The name derives from the first six characters on the top alphabetic line of the
keyboard.
Traditional keyboards allow only one key press at a time. Higher rate of data
entry possible if multiple keys are pressed simultaneously.
The piano keyboard allows several finger presses at once and recognizes
different pressures and durations.
Chording : Chords represent several characters or entire word.
Fig. 1.5.1 shows QWERTY keyboard.
As you are reading this text, take a little break and look at your keyboard.
Seriously. Look only at the letter keys and start reading from the top left. It
starts off like this: Q - W - E - R - T - Y. This is also referred to as QWERTY.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Now look at another device with a keyboard - perhaps another computer, a
smart phone or a tablet. Devices like tablets don't have a physical keyboard,
but if you use an application in which typing is needed, a virtual keyword
comes up. Take a look at the layout of the letters. QWERTY again!
At that time, the layout was developed for mechanical typewriters. These have
keys, just like a modern-day keyboard, but when you press a key, a mechanical
arm is moved to type a character on a piece of paper.
When you start typing fast, these arms can jam easily. He examined common
letter combinations in the English language and made sure to place these
letters far apart from each other. This resulted in fewer jams and, in effect,
more efficient typing; however, by today's standards, the QWERTY layout
actually slows down typing, since jamming mechanical arms are no longer an
issue.
Dvorak keyboard
The Dvorak keyboard is an ergonomic alternative to the layout commonly
found on typewriters and computers known as “Qwerty”.
The Qwerty keyboard was designed in the 1870s to accommodate the slow
mechanical movement of early typewriters.
Fig. 1.5.2 shows Dvorak keyboard.
When it was designed, touch typing literally hadn’t even been thought of yet!
It’s hardly an efficient design for today’s use. By contrast, the Dvorak keyboard
was designed with emphasis on typist comfort, high productivity and ease of
learning; it’s much easier to learn.
It is biased towards right hand.
Chord Keyboard
Few keys (4 to 5 keys) are used. Fig. 1.5.3 shows chord keyboard.
Letters are produced by pressing one or more of the keys at once.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Handwriting recognition
Handwriting Recognition (HWR), also known as Handwritten Text Recognition
(HTR), is the ability of a computer to receive and interpret intelligible
handwritten input from sources such as paper documents, photographs, touch-
screens and other devices.
A handwriting recognition system's sensors can include a touch-sensitive
writing surface or a pen that contains sensors that detect angle, pressure and
direction. The software translates the handwriting into a graph and
recognizes the small changes in a person's handwriting from day to day and
over time.
Speech recognition
Speech recognition is a promising area of text entry, but it has been promising
for a number of years and is still only used in very limited situations.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
There is a natural enthusiasm for being able to talk to the machine and have
it respond to commands, since this form of interaction is one with which we
are very familiar.
1.5.2 Memory
Human short-term memory is volatile and has a limited capacity. Computer
RAM has essentially the same characteristics.
Your long-term memory is something like a computer’s hard drive. Both of
them take longer to respond, but can store a considerable quantity of data.
1. RAM and Short-term Memory
RAM is small, both in physical size and in the amount of data it can hold. It's
much smaller than your hard disk.
A typical computer may come with 256 million bytes of RAM and a hard disk
that can hold 40 billion bytes.
Random Access Memory (RAM) is a computer's short-term memory. None of
your programs, files, or Netflix streams would work without RAM, which is
your computer's working space.
RAM is called "random access" because any storage location can be accessed
directly.
Random Access Memory (RAM) is a general-purpose memory that usually
stores the user data in a program. RAM is volatile in the sense that it cannot
retain data in the absence of power; i.e., data is lost after the removal of
power.
The RAM in a system is either Static RAM (SRAM) or Dynamic RAM (DRAM).
The SRAMs are fast, with access time in the range of a few nanoseconds, which
makes them ideal memory chips in computer applications.
DRAMs are slower and because they are capacitor based they require
refreshing every several milliseconds. DRAMs have the advantage that their
power consumption is less than that of SRAMs.
Most microcontrollers have some amount of internal RAM, commonly 256
bytes, although some microcontrollers have more and some have less.
2. Disks and Long-term Memory
For most computer users the long term memory consists of disks, possibly with
small tapes for backup. The existence of backups, and appropriate software to
generate and retrieve them, is an important area for user security.
There are two main kinds of technology used in disks: magnetic disks and optical
disks.
The most common storage media, floppy disks and hard (or fixed) disks, are
coated with
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
magnetic material, like that found on an audio tape, on which the information is
stored.
With disks there are two access times to consider, the time taken to find the
right track on the disk, and the time to read the track.
1.6 Processing and Network
Speed of processing can seriously affect the user interface. These effects are
considered while designing an interactive system.
Myth of the infinitely fast machine :
The adverse effects of slow processing are made worse because the designers
labor under the myth of the infinitely fast machine. That is, they design and
document their systems as if response will be immediate.
Rather than blithely hoping that the eventual machine will be ‘fast enough’, the
designer ought to plan explicitly for slow responses where these are possible.
A good example, where buffering is clear and audible (if not visible) to the
user, is telephones.
Even if the user gets ahead of the telephone when entering a number, the
tones can be heard as they are sent over the line. Now this is probably an
accident of the design rather than deliberate policy, as there are so many other
problems with telephones as interfaces. However, this type of serendipitous
feedback should be emulated in other areas.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
o Tasks are operations to manipulate the concepts of a domain. A goal is
the desired output from a performed task.
o An interaction model is a design model that binds an application together
in a way that supports the conceptual models of its target users.
o It enables designers, developers, and stakeholders to understand and
explain how users move from objects to actions within a system.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
1.7.2 Mistake and Slips
1. Mistake
Mistakes are errors in choosing an objective or specifying a method of achieving it.
Examples of mistakes include : Making a poor judgment when overtaking,
leaving insufficient room to complete the man over run in the face of oncoming
traffic.
Classification of mistakes is skill - based, rule - based, and knowledge-based.
1. Skill based behaviour : Skill - based behavior occurs when workers are
extremely expert at their jobs, so they can do the everyday, routine tasks with
little or no thought or conscious attention. The most common form of errors in
skill-based behavior is slips.
2. Rule based behaviour : Rule-based behavior occurs when the normal
routine is no longer applicable but the new situation is one that is known, so
there is already a well-prescribed course of action: a rule.
3. Knowledge based behaviour : Knowledge - based procedures occur when
unfamiliar events occur, where neither existing skills nor rules apply. In this
case, there must be considerable reasoning and problem-solving. Plans might
be developed, tested, and then used or modified.
To reduce mistakes :
a) To avoid rule - based mistakes, increase worker situational awareness of high
- risk tasks on site and provide procedures for predictable non-routine, high -
risk tasks.
b) To avoid knowledge-based mistakes, ensure proper supervision for
inexperienced workers and provide job aids and diagrams to explain
procedures.
2. Slip
Slips are errors in carrying out an intended method for reaching an objective.
Examples of slips include : performing an action too soon in a procedure, or
leaving it too late, e.g. not putting your ear defenders on before starting the
drill.
1. Capture Error :
A type of slip where a more frequent and more practiced behavior takes place
when a similar, but less familiar, action was intended.
Examples include telling someone your home phone number when you
intended to give your work number or typing your name when you intended to
type another word that begins with the same few letters.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
2. Description Error :
Performing the right action for the wrong object, e.g. pouring your juice on
your cereal in the morning instead of the milk.
3. Mode Error :
A type of slip where a user performs an action appropriate to one situation in
another situation, common in software with multiple modes.
Examples include drawing software, where a user tries to use one drawing tool
as if it were another (e.g. brushing with the Fill tool), or text editors with both
a command mode and an insert mode, where a user accidentally types
commands and ends up inserting text.
To reduce slips :
1. Make all workers aware that slips and lapses do happen;
2. Use checklists to help confirm that all actions have been completed;
3. Include in your procedures the setting out of equipment, site layout and
methods of work to ensure there is a logical sequence;
4. Make sure checks are in place for complicated tasks; and
5. Try to ensure distractions and interruptions are minimized, e.g. mobile phone
policy
Sli Mistak
p e
Slips are error in carrying out an Mistakes are errors in choosing an
intended method for reaching an objective.
objective.
Error in executing action. Error in formulating intention & action.
1. The task is very familiar and requires 1. Doing too many things at the same time.
little
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
thought; 2.Doing too many complex tasks at once.
Fig. 1.7.1(a) General interaction framework Fig. 1.7.1(b) Translation between components
Each has its own unique language. Interaction necessitates translation between
languages
Problems in interaction occur when translation between one language and the
next is difficult, or impossible.
1. User intentions translated into actions at the interface.
2. Translated into alterations of system state,
3. Which in turn are reflected in the output display ?
4. Which is interpreted by the user ?
Some systems are harder to use than others.
Gulf of Execution - User’s formulation of actions may be different to those
actions allowed by the system.
Gulf of Evaluation - User’s expectation of the changed system state may be
different to the
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
actual presentation of this state.
Fig. 1.7.2 shows Framework for human computer interaction adapted from
ACM SIGCHI curriculum development group.
Dialog design and interface styles can be placed particularly along the input
branch of the framework, addressing both articulation and performance.
Presentation and screen design relate to the output branch of the framework.
The entire framework can be placed within a social and organizational context
that also affects the interaction. Each of these areas has important implications
for the design of interactive systems and the performance of the user.
Fig. 1.7.2 Framework for human computer interaction adapted from ACM SIGCHI curriculum
development group.
What influence does the social environment in which you work have on your interaction with
the computer ? What effect does the organization (commercial or academic) to which you
belong have on the interaction ?
Ans. : • The aim is to get the student to explore the social and environmental
influences which effect interaction, often without the user being aware of them.
The particular influences will vary from environment to environment but the
student should be encouraged to consider some or all of the following.
Work context to is the work shared ? Are the machine shared ?
Peer pressure is there pressure to compete or impress ?
Management pressure is there pressure to achieve ? Is the interaction to
carried out in the presence of management ?
Motivation means what motivates the interaction ? Does this encourage or
discourage experimentation ?
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Organizational goals : What is the objective of the organization ? (profit ?,
education ?, etc.) How does this affect the interaction ?
Organizational decision making - Who determines the system that you use ?
Do you have any choice or influence ? Does this influence the way you interact
with the system ?
In each case, student should discuss what influence this may have on the
interaction. It may be helpful to consider other possible environment in order
to identify hoe the interaction would differ under this different circumstances.
For example, if the student currently shares the machine with colleagues,
would his/her interaction practice change if she/he was given a private
machine ?
There are four main translations involved in the interaction framework viz. articulation,
performance, presentation and observation.
i) The compact disk player has a button for power off. However its
remote control does not have a power off button.
ii) It is difficult in the command line interface to determine the result
of copying and moving files in a hierarchical file system.
iii) User is unable to figure out which switches from the bank to
turn on to lit the front portion of a classroom.
iv)The user is unable to know whether the voice recorder is in playing or
recording state.
Specify in each of the above four cases which of the interaction framework translations are in
effective.
Ans. :
It suggests that is situations of stress, people will be less able to cope with complex
problem
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
solving or managing difficult interfaces, whereas if people are relaxed, they
will be more forgiving of limitations in the design.
This does not give us an excuse to design bad interfaces but does suggest that
if we build interfaces that promote to positive responses – for example by using
aesthetics or reward – then they are likely being more successful.
Positive affect is associated with other characteristics of people who tend to be
happier, like optimism, extraversion, and success.
Positive affect can be developed and cultivated. While affectivity is somewhat
inborn, meaning that some people are simply born with a greater propensity
for being in a good mood as part of their personality, there are many things
you can do to get into the habit if experiencing positive affect more often in
your life, and making your good moods even batter.
1.8 Ergonomics
Ergonomics means literally the study or measurement of work. In this
context, the term work signifies purposeful human function.
Ergonomics is the science of designing user interaction with equipment and
workplaces to fit the user.
Proper ergonomic design is necessary to prevent repetitive strain injuries,
which can develop over time and can lead to long-term disability.
Ergonomics is employed to fulfill the two goals of health and productivity. It is
relevant in the design of such things as safe furniture and easy-to-use
interfaces to machines.
Ergonomics is concerned with the ‘fit’ between people and their
technological tools and environments.
As well as addressing physical issues in the layout and arrangement of the
machine interface, ergonomics is concerned with the design of the work
environment itself.
All users should be comfortably able to see critical displays. For long periods of
use, the user should be seated for comfort and stability.
Seating should provide back support. If required to stand, the user should
have room to move around in order to reach all the controls.
Human factors issues arise in simple systems and consumer products as well.
Some examples include cellular telephones and other hand held devices that
continue to shrink yet grow more complex, millions of VCRs blinking "12:00"
across the world because very few people can figure out how to program them,
or alarm clocks that allow sleepy users to inadvertently turn off the alarm
when they mean to hit 'snooze'.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
A User Centered Design (UCD), also known as a systems approach or the
usability engineering life cycle aims to improve the user-system.
Ergonomics has a close relationship to human psychology in that it is also
concerned with the perceptual limitations of humans. For example, the use of
color in displays is an ergonomics issue.
Ergonomics examines not only the passive ambient situation but also the
unique advantages of the human operator and the contributions that can be
made if a work situation is designed to permit and encourage the person to
make the best use of his or her abilities.
Human abilities may be characterized not only with reference to the generic
human operator but also with respect to those more particular abilities that are
called upon in specific situations where high performance is essential.
For example, an automobile manufacturer will consider the range of physical
size and strength of the population of drivers who are expected to use a
particular model to ensure that the seats are comfortable, that the controls are
readily identifiable and within reach, that there is clear visibility to the front
and the rear, and that the internal instruments are easy to read.
Ease of entry and egress will also be taken into account.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
2. Lighting : It depends upon working environment. Adequate lighting should
be provided to allow users to see the computer screen.
3. Temperature : Extremes of hot or cold will affect performance.
4. Noise : Excessive noise can be harmful to health, causing the user pain, and
in acute cases, loss of hearing.
1.9 Interaction Styles
Interaction is a dialog between the computer and the user. Types of
common interface styles are as follows :
1. Command line interface 2. Menus
3. Natural language 4. Question/answer and query dialog
5. Form-fills and spreadsheets 6. WIMP
7. Point and click 8. Three-dimensional interfaces
2. Menus :
The set of available options is displayed on the screen, and selected using the
mouse, or numeric or alphabetic keys. These visible options rely on recognition
rather than recall, but still need to be meaningful and logically grouped.
Menus may be nested hierarchically, with the grouping and naming of menu
options the only cue for finding the required option.
3. Natural language :
Natural language is very difficult for a machine to understand. It is
ambiguous, syntactically and semantically. It is difficult to provide the machine
with context.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
5. Form-fills and spreadsheets :
Used primarily for data entry but also useful in data retrieval. The display
resembles a paper form, with slots to fill in. It may be based on an actual form
with which the user is familiar.
Spreadsheets are a sophisticated variation of form filling. The spreadsheet
comprises a grid of cells, each of which can contain a value or a formula.
6. WIMP :
WIMP stands for Windows, Icons, Menus and Pointers and is the default
interface style for the majority of interactive computer systems in use today,
especially in the PC and desktop workstation arena. Examples of WIMP
interfaces include Microsoft Windows for IBM PC compatibles, MacOS for
Apple Macintosh compatibles and various X Windows-based systems for UNIX.
7. Point and click :
The point-and-click style has been popularized by World Wide Web pages,
which incorporate all the above types of point-and-click navigation: highlighted
words, maps and iconic buttons.
8. Three-dimensional interfaces :
There is an increasing use of three-dimensional effects in user interfaces. The
most obvious example is virtual reality, but VR is only part of a range of 3D
techniques available to the interface designer.
We cannot be sure whether the boy is using the stick to hit the dog or
whether the dog is holding the stick when it is hit.
Even if a sentence’s structure is clear, we may find ambiguity in the meaning
of the words used.
Natural language interaction technology takes Natural Language Processing
(NLP) and Natural Language Understanding (NLU) to the next level.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
An analysis of "Carry Me" airlines conversational data, a fictitious name for an
airline, but based on real data, showed that questions about baggage are one
of the more frequent topics, however, when we drill down, it’s possible to see
that customers use “baggage” and “luggage” differently.
Luggage is much more likely to refer to carry-on bags. This type of information
is tremendously useful when building an NLI app that is sensitive to the
expectations of customers.
This is where analysis on unstructured data using NLI comes into its own
because human intuitions about conversational data are often wrong.
Businesses need the facts that NLI provides to guide them, otherwise
enterprises risk misunderstanding the voice of the customer.
It allows enterprises to create advanced dialogue systems that utilize memory,
personal preferences, and contextual understanding to deliver a proactive
natural language interface.
Natural language interaction removes the need for your customers to know
and understand your terminology.
The deep understanding that Natural language interaction delivers gives
enterprises the information they need to deliver a superior customer
experience and have a positive impact on their bottom line.
In interface design, natural-language interfaces are sought after for their
speed and ease of use, but most suffer the challenges to understanding wide
varieties of ambiguous input.
Natural - language interfaces are an active area of study in the field of natural-
language processing and computational linguistics. An intuitive general
natural-language interface is one of the active goals of the Semantic Web.
An important problem in Natural Language Generation (NLG) is obtaining and
representing in the system the knowledge required producing texts. This
includes the knowledge from which texts are generated and linguistic
knowledge required to produce the texts.
In some cases, information produced by HCI researchers or practitioners can
be exploited in this way for NLG systems. For example, task models can be
exploited to generate documentation and on-line help. They can provide both
the information to be included in the texts, and guide the structure of the texts
to be generated.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
1.9.2 Elements of WIMP
WIMP stands for windows, icons, menus and pointers and is the default
interface style for the majority of interactive computer systems in use today,
especially in the PC and desktop workstation arena.
Examples of WIMP interfaces include Microsoft Windows for IBM PC
compatibles, MacOS for Apple Macintosh compatibles and various X Windows-
based systems for UNIX.
Elements of the WIMP interfaces are called widgets, and they comprise the
toolkit for interaction between user and system.
1. Windows
Windows are areas of the screen that act like individual terminals for an
application. Behaviour of windows determined by the system’s window
manager.
Fig. 1.9.1 shows parts of windows.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
2. Icon
A small picture is used to represent a closed window, and this representation
is known as an icon
Icons are signs and represent a significant degree of cognitive complexity. A
good design of icons is important.
Fig. 1.9.2 shows various icon.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
4. Tool Bar
Toolbar is similar to a menu bar, but as the icons are smaller than the
equivalent text more functions can be simultaneously displayed.
Sometimes the content of the toolbar is fixed, but often users can customize it,
either changing which functions are made available, or choosing which of
several predefined toolbars is displayed.
5. Pointer
A pointer is the input device used to interact with GUI components.
The pointer (cursor) is the visual manifestation of the mouse or pointing
device and, as such, acts as the user’s proxy in the GUI environment.
Allow us to do actions and also provide us with contextual information (e.g. wait).
Examples are mouse, trackball, joystick, touchpad, finger, stylus, light pen.
Two primary purposes are position control of the on-screen tracker and
selection via buttons.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
simply do not know what the icons represent.
Once learned the meaning is often relatively easy to remember, but most users
do not want to spend time reading a manual, or even using online help to find
out what each button does, they simply reach for the menu.
There is an obvious solution, put the icons on the menus in the same way that
accelerator keys are written there. So in the ‘Edit’ menu one might find the
option.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
A paradigm may be personal or cultural, and we each have many different
paradigms for different contexts.
1. Time - sharing : In the 1940 and 1950s, the significant advances in computing
consisted of new hardware technologies.
Mechanical relays were replaced by vacuum electron tubes. Tubes were
replaced by transistors and transistors by integrated chips, all of which meant
that the amount of sheer computing power was increasing by orders of
magnitude.
2. Video Display Units (VDU) : Display screens could provide a more suitable
medium than a paper printout for presenting vast quantities of information.
5. Window systems and the WIMP interface : When you use a program such as a
word processor that has a WIMP interface it is often the case that the document
you are creating looks exactly the same on the screen as it will when it is printed
out. If this is the case then the program is described as being WYSIWYG. This
stands for What You See Is What You Get.
Advantages
Most operations are self-explanatory so that you do not have to remember
lots of commands. This makes GUIs particularly suitable for inexperienced
users.
Some operations are much easier using a GUI with a pointer. e.g. selecting
text or drawing pictures.
Often you can have more than one program running at the same time, each of
them using different windows.
Often GUIs are WYSIWYG. What you see on the screen is what you get if
you do a printout.
Often with a GUI many programs use a similar interface, so it is easier to learn
how to use a new program.
Most GUIs provide good help facilities.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Disadvantages
GUIs can take up a lot of memory and need to be run on a fast computer
Advantages :
Visually presents task concepts Reduces syntax
Allows easy learning Allows easy retention
Allows errors to be avoided Encourages exploration
Affords high subjective satisfaction
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
8. Computer Supported Cooperative Work (CSCW) : The study of how people work
together using computer technology. Computer Supported Cooperative Work
(CSCW) consists of software tools and technology that supports a group of
individuals working on projects at different sites. It is based on the principle of
group coordination and collaborative activities supported through computer
systems.
1.11 Case Study
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
action. More sophisticated undo facilities allow the user to retrace back more
than one command at a time.
Syntactic correctness of all actions, so that every operation is a legal operation
WYSYWYG: word-processors usually provide menus and buttons which the
user uses to articulate many commands.
These interaction mechanisms serve to constrain the input language to only
allow legal input from the user.
Replacement of complex command languages with actions to manipulate
directly the visible objects : The case for word processors is similar to that
described above for syntactic correctness. In addition, operations on portions
of text are achieved many times by allowing the user to directly highlight the
text with a mouse (or arrow keys).
Subsequent action on that text, such as moving it or copying it to somewhere
else, can then is achieved more directly by allowing the user to “drag” the
selected via the mouse to its new location.
Two Marks Questions with Answers
What is HCI ?
Ans. : Human-computer interaction is a discipline concerned with the design,
implementation and evaluation of interactive computing systems for human
use and with the study of major phenomenon surrounding them. HCI is study
of people, computer technology and the ways these influence each other. We
study HCI to determine how we can make this computer technology more
usable by people.
Define mistake and slips.
• Mistakes are errors in choosing an objective or specifying a method of
Ans. :
achieving it.
Slips are errors in carrying out an intended method for reaching an objective.
List the five senses.
Ans. : There are five senses : sight, sound, touch, taste and smell.
Define sensory memory.
Sensory memory is the shortest-term element of memory. It is the ability
Ans. :
to retain impressions of sensory information after the original stimuli have
ended. It acts as a kind of buffer for stimuli received through the five senses of
sight, hearing, smell, taste and touch, which are retained accurately. Short-
term memory can be accessed rapidly, in the order of 70 ms.
Explain three basic levels of skill.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 1- Foundations of
Interaction HCI
Ans.: Three basic levels of skill are as follows :
1.The learner uses general-purpose rules which interpret facts about a problem.
This is slow and demanding on memory access.
2.The learner develops rules specific to the task.
3.The rules are tuned to speed up performance.
What is reasoning ?
Reasoning is the process by which we use the knowledge we have to
Ans. :
draw conclusions or infer something new about the domain of interest.
List the Donald Norman’s seven stage of interaction.
Ans. : They are as follows :
1. Establishing the goal 2. Forming the intention
3. Specifying the action sequence 4. Executing the action
5. Perceiving the system state 6. Interpreting the system state
7. Evaluating the system state with respect to the goals and intentions.
What is Direct Manipulation (DM) ?
Ans. :Direct manipulation is an interaction style in which the objects of interest
in the UI are visible and can be acted upon via physical, reversible, incremental
actions that receive immediate feedback.
What is Ergonomics ?
Ans. : Ergonomics means literally the study or measurement of work. In this
context, the term work signifies purposeful human function. Ergonomics is the
science of designing user interaction with equipment and workplaces to fit the
user.
What are the two types of long term memory ?
Ans. : Types of long term memory is Episodic memory and Semantic memory.
List out all text entry devices.
Ans. :Text entry devices are alphanumeric keyboard, chord keyboards, phone
pad and T9 entry, handwriting recognition and speech recognition.
What is WIMP ?
Ans. : WIMP stands for windows, icons, menus and pointers and is the default
interface style for the majority of interactive computer systems in use today,
especially in the PC and desktop workstation arena. Examples of WIMP
interfaces include Microsoft Windows for IBM PC compatibles, MacOS for
Apple Macintosh compatibles and various X Windows- based systems for UNIX .
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
UNIT-II
2
Design and Software Process
Syllabus
Interactive Design : Basics, process,scenarios, navigation, screen design, iteration and
prototyping.
HCI in software process : Software life cycle, usability engineering, prototyping in practice,
design rationale.
Design rules : principles, standards, guidelines, rules. Evaluation techniques, universal design
Contents
Interactive Design
Scenarios
Navigation
Screen Design
Prototyping
HCI in software Process
Usability Engineering
Design Rationale
Design Rule
Evaluation Techniques
Universal Design
Two Marks Questions with Answers
(2 - 1)
Human Computer 2- 2 Design and Software
Interaction Process
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 3 Design and Software
Interaction Process
Requirements : What is wanted ? The first stage is establishing what exactly
is needed. There are a number of techniques used for this in HCI : interviewing
people, videotaping them, looking at the documents and objects that they work
with, observing them directly.
Analysis : The results of observation and interview need to be ordered in
some way to bring out key issues and communicate with later stages of design.
Design : There are numerous rules, guidelines and design principles that can
be used to help Iteration and prototyping Humans are complex and we cannot
expect to get designs right first time. We therefore need to evaluate a design to
see how well it is working and where there can be improvements.
Iteration and prototyping : Humans are complex and we cannot expect to
get designs right first time. We therefore need to evaluate a design to see how
well it is working and where there can be improvements.
Implementation and deployment : This will involve writing code, perhaps
making hardware, writing documentation and manuals – everything that goes
into a real system that can be given to others.
2.2 Scenarios
Scenarios are the core of any usability test as you have to correctly
communicate your participants, what you want them to do during the test.
Well crafted task scenario helps you focus on designing around the real needs
of the user and removes artificiality from the test.
As you can see, above scenario makes the task much more realistic as we’ve
provided user only a scenario which requires users to complete 3 different
tasks -
1. Signup/login on the app
2. Search for flight as per the schedule
3. Book the flight
A good scenario -
1. Short but enough information to perform the task
2. Use User’s language, not the product’s
3. Simple and Clear
4. Should address your tasks and concerns
1. Short but enough information to perform the task :
Time needed to read and understand the task has to be minimized as much
as possible. Having a long written task scenarios may require users to spend
undue time in reading and
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 4 Design and Software
Interaction Process
understanding what they have to do during the test which may indirectly
influence the overall time and effort to complete the task.
You have to find a balance in keeping the scenario short and relieving enough
information to perform the task. It’s also suggested to communicate the task
with users as the way you talk and not sound very scientific.
2. Use user’s language, not the product’s :
Main aim of conducting usability test is to understand how a user will use it in
their real environment without getting any support from external audience.
So, providing users with the enough detail is important but it should be in the
language that user can relate to and not the one which is used in product.
For example, You may have Icons, menu options or labeled button, in your UI.
Concern could be to see if users choose right Icons, menu options or labeled
button to complete a task or not.
3. Simple and Clear :
You will get desired result if and only if your task scenario is clear to your
users that means they have no ambiguity in understanding what you want them
to do.
4.Should address your tasks and concerns :
Every scenario we create has to address one or more tasks and each task
should be intended to address one or more concerns we have with the app/
website.
It’s must to have scenarios that are aligned with your business goals, for
example, if your concern is to improve sales in your e-commerce portal, you
would probably be interested in knowing whether it’s easy for your customers
to find and purchase a given product or not.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 5 Design and Software
Interaction Process
Over time many people are affected directly or indirectly by a system and these
people are called stakeholders.
Tracing the tenuous links between people could go on forever and user need to
draw boundaries as to whom you should consider. This depends very much on
the nature of the systems being designed.
When designing a system it is easy to design it as if you were the main user:
you assume your own interests and abilities.
People may also be able to tell you about how things really happen, not just
how the organization says they should happen. To encourage users to tell you
this, you will need to win their trust, since often the actual practices run
counter to corporate policy.
A professional in any field is very practiced and can do things in the domain. An
academic in the same field may not be able to do things, but she knows about
the things in the domain. These are different kinds of knowledge and skill.
Sometimes people know both, but not necessarily so. The best sports trainers
may not be the best athletes, the best painters may not be the best art critics.
Because of this it is important to watch what people do as well as hear what
they say. This may involve sitting and taking notes of how they spend a day,
watching particular activities, using a video camera or tape recorder.
It can be done in an informal manner or using developed methods such as
ethnography or contextual inquiry.
Another way to find out what people are doing is to look at the artifacts they
are using and creating. Look at a typical desk in an office. There are papers,
letters, files, perhaps a stapler, a computer, sticky notes.
One method that has been quite successful in helping design teams produce
user focused designs is the persona. A persona is a rich picture of an imaginary
person who represents your core user group.
2.3 Navigation
Navigation Design : Imagine yourself using a word processor. You interact at several
levels :
Widgets help you know how to use them for a particular selection or action.
Screens or windows – To understand the logical grouping of buttons.
Navigation within the application – To understand where you are in the
interaction.
Environment – You swap between applications, perhaps cut and paste.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 6 Design and Software
Interaction Process
In the web we have less control of how people enter a site and on a physical
device we have same layout of buttons and displays no matter what the
internal state (although we may treat them differently). Just in case you haven’t
already got the idea, the place to start when considering the structure of an
application is to think about actual use :
1) Who is going to use the application ?
2) How do they think about it ?
3) What will they do with it ?
This can then drive the second task – thinking about structure.
We will consider two main kinds of issue :
1) Local structure : Looking from one screen or page out.
2) Global structure : Structure of site, movement between screens.
Local structure
Much of interaction involves goal-seeking behaviour. In an ideal world if users
had perfect knowledge of what they wanted and how the system worked they
could simply take the shortest path to what they want.
At each point in the interaction they can make some assessment of whether
they are getting closer to their (often partially formed) goal.
To do this goal seeking, each state of the system or each screen needs to give
the user enough knowledge of what to do to get closer to their goal. To get you
started, here are four things to look for when looking at a single page, screen
or state of a device.
1. Knowing where you are
2. Knowing what you can do
3. Knowing where you are going – or what will happen
4. Knowing where you’ve been – or what you’ve done
The screen, web page or device displays should make clear where you are in
terms of the interaction or state of the system. Some websites show ‘bread
crumbs’ at the top of the screen, the path of title showing where the page is in
the site. Trade-off between appearance and ease of use may mean that this is
the right thing to do, but you should take care before confusing the user
needlessly.
You need to know where you are going when you click a button or what will
happen. It is better if users do not have to use this ‘try it and see’ interaction.
Icons are typically not self- explanatory and should always be accompanied by
labels or at the very least tooltips or some similar technique.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 7 Design and Software
Interaction Process
Special care has to be taken if the same command or button press means
something different contexts. System need to give some feedback to say what
has happen.
1. Layout :
Layout is the arrangement of items on the screen. Like items are grouped into areas
Areas can be further subdivided and each area is self-contained. Areas
should have a natural intuitive flow.
Users from western nations tend to read from left to right and top to bottom.
Users from other regions may have different flows.
Number of visual tools are available to help us suggest to the user appropriate
ways to read and interact with a screen or device.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 8 Design and Software
Interaction Process
Fig. 2.4.1 shows grouping related items in an order screen.
Fig. 2.4.1
Fig. 2.4.2
3. Layout Hierarchy :
Use boxes to group logical items. Fig. 2.4.3 shows layout hierarchy.
Use fonts for emphasize groupings, headings .
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- 9 Design and Software
Interaction Process
5. White space :
One way to make an element within an item stand out in a list UI design is to
simply leave it alone literally.
White space is one of the best ways to isolate the important elements in a list
item. Doing this draws the user’s attention more easily.
Essential role in screen layout. Use margins to draw eye around design.
White space is the area between design elements. It is also the space
within individual design elements, including the space between typography
glyphs (readable characters).
Despite its name, white space does not need to be white. It can be any
color, texture, pattern, or even a background image.
Fig. 2.4.4 shows use of white space.
Fig. 2.4.4
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Try to integrate figure and ground. Object should be scaled proportionally to
its background.
Don’t crowd controls together because crowding creates spatial tension and
inhibits scanning.
The Advantages of Using Whitespace :
1. Increased Content Legibility
2. More interaction
3. Ability to Highlight Call to Actions
4. Act as a separator.
6. Presenting information :
The way of presenting information on screen depends on the kind of
information : text, numbers, maps, tables.
Technology available to present it: character display, line drawing, graphics,
virtual reality; and, most important of all, on the purpose for which it is being
used.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Interaction Design : In this step, the structure of the UI must be set by naming
interaction flows. Method : e.g. Affinity Diagramming, each action can be
written on a Post-It note, and organised in clusters. The Post-It notes are then
rearranged to simplify user tasks.
Screen Design : Creating rough designs of the screens’ structure. These
layouts are linked together and usability test is performed with a user.
Testing : A user is asked to follow a realistic scenario/tasks on the sketched out
prototype.
2.5 Prototyping
A prototype is an example that serves as a basis for future models.
Prototyping gives designers an opportunity to research new alternatives and
test the existing design to confirm a product’s functionality prior to production.
Prototyping is an example of what is known as a hill-climbing approach.
Rapid Prototyping is an instructional design approach that combines the
design, developmental, and evaluation phases. It is a non-linear approach that
produces a sample working model that is a scaled-down representative version
of the whole course.
Three main approach of prototyping are throw-away, incremental and evolutionary.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
little more reality in the storyboards, but in effect the analyst is still in control
and steps the users through the system.
2. Paper prototype : Easy and fast to do. It helps you think of specifics.
Usually good as a first round prototype. It can still do usability testing, even
with paper.
3. Wireframe : Wireframes are the first stage of the design process and help
us to understand the key user journeys, information structuring, modes of
interaction and functionality.
Wireframes or ‘page schematic’ are a basic outline or skeleton of your key
website pages, drawn to show the elements of a page, their relationships,
position, and their relative importance.
They indicate the information types present, navigation, signposting, branding
and content areas. They are black and white schematics presented either in
PowerPoint or as a clickable web prototype.
4. Mock-up is a scale or full-size model of a design or device, used for design
evaluation, promotion. A mockup is a prototype if it provides at least part of
the functionality of a system and enables testing of a design. Mock-ups are
used by designers mainly to acquire feedback from users.
2.5.2 Hill-Climbing
Hill climbing is a mathematical optimization heuristic method used for solving
computationally challenging problems that have multiple solutions.
It is an iterative method belonging to the local search family which starts with
a random solution and then iteratively improves that solution one element at a
time until it arrives at a more or less optimized solution.
Prototyping is an example of what is known as a hill-climbing approach.
A prototype is an early sample, model, or release of a product built to test a
concept or process or to act as a thing to be replicated or learned from.
It is a term used in a variety of contexts, including semantics, design,
electronics, and software programming.
A prototype is designed to test and try a new design to enhance precision
by system analysts and users.
When you’re creating a prototyping strategy, it’s important to think about
the cost of change over time.
For physical products like a car, a toaster, the cost of making changes rises
dramatically over time throughout the design process, and even more
significantly upon release.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
With desktop software that gets distributed on, say, a CDROM, the cost rises
aren’t quite so dramatic, but it’s still pretty significant, harder to make changes
as you go throughout the design process, and much more difficult once you’ve
shipped it out to consumers.
Web sites, and other forms of software as a service, make it much easier to
make changes over time.
But the costs and difficulty of making changes is still increasing for a number
of reasons. Fig. 2.5.1 shows hill climbing approach.
Problems :
1. May hit a local maximum, not global one
2. Need good starting point, but how to find ?
Standard mechanism for finding best starting point : use experienced
designers, try different designs.
According to Norman, current UCD processes achieve good design. For
inspirational great
design, new ways to find starting points may be needed.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Rapid prototyping is about exposing bad design decisions as soon as possible
after they have been made.
Guidelines and usability engineering are more about trying to get the designer
not to make mistakes in the first place.
Design inertia is therefore much more prevalent in rapid prototyping
development than it is in other user centred design processes. Because
prototypes do not get thrown away in iterative design processes then design
inertia is even more prevalent.
Furthermore in spotting usability problems by user testing, the designer knows
that there is a problem, but not necessarily what causes that problem, or how
to fix it. Rapid prototyping identifies symptoms, not illnesses and not cures.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Fig. 2.6.1 shows waterfall model.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Usability engineering is used to determine to what degree a product or
prototype will be user-friendly. It often pertains to the field of software
development.
To be tested, usability is expressed in terms of :
1. Learnability : time and effort to reach a specified level of user
performance (ease of learning)
2. Throughput : for tasks accomplished by experienced users, the speed of
task execution and the errors made (ease of use)
3. Flexibility : multiplicity of ways the user and system exchange
information and the extend to which the system can accommodate changes
beyond those initially specified
4. Attitude : the positive attitude created in users by the system
“Usability data” is any information that is useful in measuring (or
identifying potential issues affecting) the usability attributes of a system under
evaluation.
Usability can be improved by means of
1. User-centred Design
2. Heuristic Testing
3. Usability Evaluation
4. Prototyping
5. Task Analysis
6. Collaborative Walk-through
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
In particular a design rationale can be used after a product has been
completed in order to analyse why a product was a success or failure.
If a similar product is being designed subsequently then its designers can refer
to a design rationale to discover why earlier products were designed the way
they were, and with the benefit of hindsight judge whether the earlier design
decisions were successful and warrant repeating.
Design rationales are particularly helpful in interactive system design because,
there is rarely one objectively correct solution to any problem, and some
solutions may contradict one another, or require trade-offs.
Design rationales require the designer to be explicit about how contradictions
were resolved and trade-offs were made.
Furthermore the design space may be very large and therefore it is not obvious
that a designer will even consider the best solution, never mind choose it.
A design rationale makes it clear which options from the design space were
considered and why. If an apparently better solution were later discovered
then it is obvious whether that solution had been considered and discarded for
some reason, or not considered at all.
Usability is very context dependent; what is good for one user may be dreadful
for another. If subsequent designs are made where the context of use does not
change then a design rationale can be reused without modification. If however
the context does change then new design decisions can be made for this new
context, but in the light of the decisions made for the older context.
It is beneficial to have access to the design rationale for several reasons :
1. In an explicit form, a design rationale provides a communication mechanism
among the members of a design team.
2. Accumulated knowledge in the form of design rationales for a set of
products can be reused to transfer what has worked in one situation to
another situation which has similar needs.
3. The effort required to produce a design rationale forces the designer to
deliberate more carefully about design decisions.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Presents arguments for design trade-offs
Organizes potentially large design space
Capturing contextual information
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Issues can be raised anew or can arise from other issues, positions or
arguments. In other words, any IBIS element can be questioned. In
Compendium notation : a question node can connect to any other IBIS node.
Ideas can only respond to questions, i.e. in Compendium “light bulb” nodes
can only link to question nodes. The arrow pointing from the idea to the
question depicts the “responds to” relationship.
Arguments can only be associated with ideas – i.e. in Compendium and nodes
can only link to “light bulb” nodes (with arrows pointing to the latter).
A Design Space Analysis does not produce a record of the design process but
is instead a coproduct of design and has to be constructed alongside the
artifact itself.
The key to an effective design space analysis using the QOC notation is
deciding the right questions to use to structure the space and the correct
criteria to judge the options.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
The initial questions raised must be sufficiently general that they cover a large
enough portion of the possible design space, but specific enough that a range
of options can be clearly identified. It can be difficult to decide the right set of
criteria with which to assess the options.
Another structure-oriented technique, called Decision Representation
Language (DRL), developed by Lee and Lai, structures the design space in a
similar fashion to QOC.
The goal of DRL is foremost to provide a vocabulary for representing the
qualitative aspects of decision making such as the issues raised, pro and con
arguments advanced, and dependency relations among alternatives and
constraints, that typically appear in a decision making process.
Once we have a language for representing these basic elements of decision
making, it becomes possible to provide services that use this language to
support decision making.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Learnability concerns the features of the interactive system that allow novice
users to understand how to use it initially and then how to attain a maximal
level of performance.
Predictability is a user-centered concept; it is deterministic behavior from the
perspective of the user. It is not enough for the behavior of the computer
system to be determined completely from its state, as the user must be able to
take advantage of the determinism.
The generalizability of an interactive system supports this activity, leading to a
more complete predictive model of the system for the user. We can apply
generalization to situations in which the user wants to apply knowledge that
helps achieve one particular goal to another situation where the goal is in some
way similar. Generalizability can be seen as a form of consistency.
Consistency relates to the likeness in behavior arising from similar situations
or similar task objectives. Consistency is probably the most widely mentioned
principle in the literature on user interface design.
Task Migratability :
It is transfer of control for execution of tasks between system and user. It
should be possible for the user or system to pass the control of a task over to
the other or promote the task from a completely internalized one to a shared
and cooperative venture.
Hence, a task that is internal to one can become internal to the other or shared
between the two partners. Example of task migratability is spell checking. It is
equipped with a dictionary, you are perfectly able to check your spelling by
reading through the entire paper and correcting mistakes as you spot them.
This task is perfectly suited to automation, as the computer can check words
against its own list of acceptable spellings.
It is not desirable, to leave this task completely to the discretion of the
computer, as most computerized dictionaries do not handle proper names
correctly, nor can they distinguish between correct and unintentional
duplications of words.
In those cases, the task is handed over to the user. The spell - check is best
performed in such a cooperative way.
In safety-critical applications, task migratability can decrease the likelihood of
an accident. For example, on the flight deck of an aircraft, there are so many
control tasks that must be performed that a pilot would be overwhelmed if he
had to perform them all.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
Effectiveness : The accuracy and completeness with which specified users can
achieve specified goals in particular environments.
Efficiency : The resources expended in relation to the accuracy and
completeness of goals achieved.
Satisfaction : The comfort and acceptability of the work system to its users and
other people affected by its use.
The strength of a standard lies in its ability to force large communities to
abide, the so- called authority.
The authority of a standard (or a guideline, for that matter) can only be
determined from its use in practice.
Some software products become de facto standards long before any formal
standards document is published, for example, the X windowing system).
Usability test of Microsoft
word : Task 1: Create New
Document
Task 2 : Save Document under
Custom Title Task 3 : Choose Custom
Font
Task 4: Paragraph
Formatting Task 5 : Creating
Table of Contents Task 6 :
Add Page Numbers
Task 7 : Upload/Format Image
Guidelines :
Basic categories of the Smith and Mosier guidelines are as follows :
1. Data Entry
2. Data Display
3. Sequence Control
4. User Guidance
5. Data Transmission
6. Data Protection
Smith and Mosier (1986) guidelines for data entry :
1. Consistency of data-entry transactions : Similar sequences of actions
should be used under all conditions.
2. Minimal input actions by user : Greater productivity, fewer chances for error.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
3. Minimal memory load on users : Should not be required to memorize
lengthy lists of commands.
4. Compatibility of data entry with data display.
5. Flexibility for user control of data entry.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
2.10 Evaluation Techniques
Evaluation role is to access designs and test systems to ensure that they
actually behave as we expect and meet user requirements.
Ideally, evaluation should occur throughout the design life cycle, with the
results of the evaluation feeding back into modifications to the design.
Goals of Evaluation :
1. To assess the extent and accessibility of the systems functionality
2. To assess user’s experience of the interaction
3. To identify any specific problems with the system.
Formalized way of imagining people's thoughts and actions when they use an
interface for the first time.
First select a task that the design is intended to support.
Then try to tell a believable story about each action a user has to take to do the
task.
To make the story believable, you have to motivate each of the user's actions,
relying on the user's general knowledge and on the prompts and feedback
provided by the interface. If you can't tell a believable story about an action,
then you've located a problem with the interface
Question assumptions about what the users will be thinking
Identify controls that may be missing or hard to find
Note inadequate feedback
Suggest difficulties with labels and prompts
Vocabulary Problem : On a piece of paper write the name you would give to a
program that tells about interesting activities occurring in some major
metropolitan area
Focus most clearly on problems that users will have when they first use
an interface, without training
Not a technique for evaluating the system over time (e.g., how quickly a user
moves from beginner to intermediate)
Most effective if designers can really create a mental picture of the actual
environment of use.
Prior to doing a walkthrough, you need four things :
1. You need a description of a prototype of the interface. It doesn't have to be
complete, but it should be fairly detailed. Things like exactly what words
are in a menu can make a big difference.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
2. You need a task description (for a representative task).
3. You need a complete, written list of the actions needed to complete the task.
4. You need an idea of who the users will be and what kind of experience
they'll bring to the job.
DECIDE Evaluation framework :
DECIDE is a framework that is used to guide evaluation
1. Determine the goals the evaluation addresses.
2. Explore the specific questions to be answered.
3. Choose the evaluation paradigm and techniques to answer the questions.
4. Identify the practical issues.
5. Decide how to deal with the ethical issues.
6. Evaluate, interpret and present the data.
Styles of evaluation :
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
2.10.1 Evaluation through Expert Analysis
Advantages :
Permits early evaluation of designs at the prototyping stage or without a mockup.
Helps the designer assess how the features of their design fit together to
support users’ work.
Provides useful feedback about action sequences.
Assists designer by providing reasons for trouble areas.
Provides indications of the users’ mental
Processes, which helps build a successful interface that accommodates users.
Disadvantages :
Relies on analysis rather on user testing.
Provides a detailed examination of a particular task rather than an overview
of the interface.
Provides no quantitative data.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
2.10.1.2 Nielsen’s Ten Heuristics
1. Visibility of system status : The system should always keep users informed
about what is going on, through appropriate feedback within reasonable
time.
2. Match between system and the real world : The system should speak the
users' language, with words, phrases and concepts familiar to the user,
rather than system- oriented terms. Follow real-world conventions, making
information appear in a natural and logical order.
3. User control and freedom : Users often choose system functions by mistake
and will need a clearly marked "emergency exit" to leave the unwanted
state without having to go through an extended dialogue. Support undo and
redo.
4. Consistency and standards : Users should not have to wonder whether
different words, situations, or actions mean the same thing. Follow platform
conventions.
5. Error prevention : Even better than good error messages is a careful design
which prevents a problem from occurring in the first place. Either eliminate
error-prone conditions or check for them and present users with a
confirmation option before they commit to the action.
6. Recognition rather than recall : Minimize the user's memory load by making
objects, actions, and options visible. The user should not have to remember
information from one part of the dialogue to another.
7. Flexibility and efficiency of use : Accelerators unseen by the novice user,
may often speed up the interaction for the expert user such that the system
can cater to both inexperienced and experienced users. Allow users to tailor
frequent actions.
8. Aesthetic and minimalist design: Dialogues should not contain information
which is irrelevant or rarely needed.
9. Help users recognize, diagnose, and recover from errors : Error messages
should be expressed in plain language, precisely indicate the problem, and
constructively suggest a solution.
10. Help and documentation : Even though it is better if the system can be
used without documentation, it may be necessary to provide help and
documentation.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
For example, the GOMS (Goals, Operators, Methods and Selection) model
predicts user performance with a particular interface and can be used to filter
particular design options. Similarly, lower-level modelling techniques such as
the keystroke-level model provide predictions of the time users will take to
perform low-level physical tasks.
Design methodologies, such as design rationale, also have a role to play in
assessment at the design stage. Design rationale provides a framework in
which design options can be evaluated.
Dialog models can also be used to estimate dialog sequences for problems,
such as unreachable states, circular dialogs and complexity. Models such as
state transition networks are useful for evaluating dialog designs prior to
implementation.
What is scenarios ?
Ans. : Scenarios are the core of any usability test as you have to correctly
communicate your participants, what you want them to do during the test. Well
crafted task scenario helps you focus on designing around the real needs of the
user and removes artificiality from the test.
What is usability ?
Ans. : Usability refers to the extent to which a product can be used by
specified users to achieve specified goals with effectiveness, efficiency and
satisfaction in a specified context of user.
Explain task migratability ?
Ans. : It is transfer of control for execution of tasks between system and user.
It should be possible for the user or system to pass the control of a task over to
the other or promote the task from a completely internalized one to a shared and
cooperative venture.
What is hill climbing ?
Ans. : Hill climbing is a mathematical optimization heuristic method used for
solving computationally challenging problems that have multiple solutions.
It is an iterative method belonging to the local search family which starts
with a random solution and then iteratively improves that solution one
element at a time until it arrives at a more or less optimized solution.
Write down the three categories of principles to support usability.
AU : April/May-18
Ans. : Learnability : the ease with which new users can begin effective
interaction and achieve maximal performance.
Flexibility : the multiplicity of ways in which the user and system exchange
information.
Robustness : the level of support provided to the user in determining
successful achievement and assessment of goals.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 2- Design and Software
Interaction Process
What do you mean universal design ? AU : April/May-18
Ans. : Universal design is the process of designing interactive systems that are
usable by anyone, with any range of abilities, using any technology platform.
The design and composition of an environment so that it may be accessed,
understood and used.
What is design rationale ?
Ans. : Design rationale is about explaining why a product has been designed the
way it has. Design rationale is about recording those decisions and the reasons
why they were made. A design rationale is a useful design tool because it
explicitly lays out the reasoning behind a design process and it forces
designers to be explicit about what they are doing and why they are doing it.
What is cognitive walkthrough ?
Ans. : A cognitive walkthrough is a structured approach to evaluating usability of
a product. It involves the tester, who is not a user, asking four simple questions
about the way a specific user journey is conducted. They will record the
outcomes of these questions, in their opinion, and use these observations to
improve the product further.
What is Heuristic evaluation ?
Ans. : Heuristic evaluation is a usability engineering method for finding usability
problems in a user interface design, thereby making them addressable and
solvable as part of an iterative design process. It involves a small set of expert
evaluators who examine the interface and assess its compliance with
“heuristics,” or recognized usability principles. Such processes help prevent
product failure post-release.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
UNIT-III
3
Models and Theories
Syllabus
HCI Models : Cognitive models : Socio-organizational issues and stakeholder requirements-
communication and collaboration models-Hypertext, Multimedia and WWW.
Contents
Cognitive Models
Cognitive Architectures
Socio-Organizational Issues and Stakeholder Requirements
Communication and Collaboration Models
World Wide Web
Two Marks Questions with Answers
(3 - 1)
Human Computer 3- 2 Models and
Interaction Theories
3.1.1 GOMS
The GOMS is an acronym for Goals, Operators, Methods and Selection. GOMS
is a task analysis technique.
GOMS is family of user interface modeling techniques.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 3 Models and
Interaction Theories
The GOMS model has four components: goals, operators, methods and selection
rules.
1. Goals - Tasks are deconstructed as a set of goals and subgoals. GOMS
the goals are taken to represent a ‘memory point’ for the user
2. Operators - Tasks can only be carried out by undertaking specific actions.
Example : to decide which search engine to use.
3. Methods - it represent ways of achieving a goal. Example : drag mouse over
field.
4. Selection Rules - The method that the user chooses is determined by selection
rules
Example : GOMS for photocopying a paper from journal
One possible GOMS description of the goal hierarchy for this task is given
below. Answers will vary depending on assumptions about the photocopier
used as the model for the exercise.
In this example, we will assume that the article is to be copied one page at a
time and that a cover over the imaging surface of the copier has to be in place
before the actual copy can be made.
Goal: PHOTOCOPY-PAPER
Goal: LOCATE-ARTICLE
Goal: PHOTOCOPY-PAGE repeat until no more
pages [Select Goal: SELECT-PAGE --> CHOOSE-
PAGE-TO-COPY] Goal: ORIENT-PAGE
OPEN -COVER
POSITION-PAGE
CLOSE-COVER
PRESS-BUTTON
Goal: VERIFY-
COPY LOCATE-
OUT-TRAY
EXAMINE-COPY
Goal: COLLECT-
COPY LOCATE-
OUT-TRAY
REMOVE-COPY (outer goal satisfied!)
Goal: RETRIEVE-JOURNAL
OPEN-COVER
REMOVE-
JOURNAL CLOSE-
COVER
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 4 Models and
Interaction Theories
Selection rules exist if a spoiled copy was printed. Consider the following :
Rule 1 : SELECT-PAGE if last page was copied successfully or start of
article.
Note : The goal SELECT-PAGE is only valid if we are at the start of the
article or the last copy was successful. If the last copy was spoiled the we
must recopy the current page, so only a re-orientation would be required.
Goal : PHOTOCOPY-PAPER
Goal : LOCATE-ARTICLE
Goal : PHOTOCOPY-PAGE repeat until no more pages
[Select Goal : SELECT-PAGE --> CHOOSE-PAGE-TO-COPY]
Goal : ORIENT-
PAGE OPEN -
COVER POSITION-
PAGE CLOSE-
COVER PRESS-
BUTTON Goal :
VERIFY-COPY
LOCATE-OUT-
TRAY EXAMINE-
COPY
Goal : RETRIEVE-JOURNAL
OPEN-COVER
REMOVE-
JOURNAL CLOSE-
COVER
Goal : COLLECT-
COPY LOCATE-OUT-
TRAY
REMOVE-COPY (outer goal satisfied!)
Closure to Outer Goal, must force user to collect copy last.
Advantages :
1. Easy to construct a simple GOMS model and saves time.
2. Helps discover usability problems.
3. Gives several qualitative and quantitative measures.
4. Less work than usability study.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 5 Models and
Interaction Theories
Disadvantages :
1. Only work for goal directed tasks.
2. Not for the novice user.
3. Not ideal for leading edge technology systems.
4. Not as easy as heuristics analysis, guidelines.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 7 Models and
Interaction Theories
(DELETE-GOAL perform unit
task) (UNBIND %LINE %COL)
)) (INSERT-SPACE-1
IF(AND (TEST-GOAL insert space)
(NOT (TEST-GOAL move cursor))
(NOT (TEST-CURSOR %LINE
%COL)))
THEN ( (ADD-GOAL move cursor to %LINE
%COL) )) (INSERT-SPACE-2
IF (AND (TEST-GOAL insert
space) (TEST-CURSOR %LINE
%COL))
THEN ( (DO-KEYSTROKE
‘I’) (DO-KEYSTROKE
SPACE) (DO-
KEYSTROKE ESC)
(DELETE-GOAL insert space))
To see how these rules work, imagine that the user has just seen the typing
mistake and thus the contents of working memory (w.m.) are,
(GOAL perform unit
task) (TEXT task is
insert space) (TEXT task
is at 5 23)
(CURSOR 8 7)
Text uses the text of the document that is being edited and CURSOR refers to
the placing cursor on the screen. The position (5, 23) is the line and column
of the typing error where the space is required. However, present cursor
location is at line 8 and column 7.
So the rule fires and its action is performed. This action has no external effect
in terms of keystrokes, but adds extra information to working memory.
The rules in CCT must not represent error-free performance. They can be
utilized to explain error phenomena, even if they cannot predict them. The CCT
rules are closely related to GOMS-like goal hierarchy; or alternatively, the
rules may be generated from such a hierarchy, or alternatively, it may analyze
the production rules to obtain the goal tree.
In fact, the CCT rules can characterize more difficult plans than the simple
sequential hierarchies of GOMS. However, one should regard CCT as an
engineering tool giving one a rough measure of learnability and difficulty
combined with a detailed description of user behaviour.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 8 Models and
Interaction Theories
Linguistic models represent the user-system grammar. Understanding the
user's behaviour and cognitive difficulty based on analysis of language between
user and system.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- 9 Models and
Interaction Theories
Backus - Naur Form (BNF) and Task - Action Grammar (TAG) are used to
represent this model.
Backus - Naur Form
BNF can be used to define the syntax of a language.
It is based on techniques developed for use with natural languages, but was
specifically designed for use with computing languages.
BNF defines a language in terms of Terminal symbols, Syntactic constructs
and productions.
Terminal symbols are the elementary symbols of the language, such as
words and punctuation marks.
In the case of computing languages, these may be variable -names,
operators, reserved words, etc.
Syntactic constructs (or non-terminal symbols) are phrases, sentences, etc.
In the case of computing languages, these may be conditions, statements,
programs, etc. TAG :
Task–Action Grammar (TAG) attempts to deal with some of these problems by
including elements such as parameterized grammar rules to emphasize
consistency and encoding the user’s world knowledge.
In BNF, three UNIX commands would be described as :
copy ::= cp + filename + filename | cp + filenames +
directory move ::= mv + filename + filename | mv +
filenames + directory link ::= ln + filename +
filename | ln + filenames + directory
No BNF measure could distinguish between this and a less consistent
grammar in which link ::= ln + filename + filename | ln + directory +
filenames
Consistency of argument order made explicit using a parameter, or semantic
feature for file operations.
Feature Possible values : Op = copy; move; link
Rules
file-op[Op] ::= command[Op] + filename + filename | command[Op] +
filenames + directory
command[Op = copy] ::=
cp command[Op = move]
::= mv command[Op =
link] ::= ln
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
3.1.4 Physical and Device Model : KLM model
The Keystroke - Level Model (KLM) predicts how long it will take an expert
user to accomplish a routine task without errors using an interactive computer
system.
The actions are termed keystroke level if they are at the level of actions like
pressing keys, moving the mouse, pressing buttons.
There is a standard set of operators for use in the KLM, whose execution
times have been estimated from experimental data.
The following is a step-by-step description of how to apply the KLM to estimate
the execution time required by a specified interface design :
1. Choose one or more representative task scenarios.
2. Have the design specified to the point that keystroke-level actions can be
listed for the specific task scenarios.
3. For each task scenario, figure out the best way to do the task, or the
way that you assume users will do it.
4. List the keystroke-level actions and the corresponding physical operators
involved in doing the task.
5. If necessary, include operators for when the user must wait for the system to
respond
6. Insert mental operators for when user has to stop and think.
7. Look up the standard execution time to each operator.
8. Add up the execution times for the operators.
9. The total of the operator times is the estimated time to complete the task.
The model decomposes the execution phase into five different physical motor
operators, a mental operator and a system response operator :
K : Keystroking, actually striking keys, including shifts and other modifier keys.
B : Pressing a mouse button.
P : Pointing, moving the mouse (or similar device) at a
target. H : Homing, switching the hand between
mouse and keyboard. D : Drawing lines using the
mouse.
M : Mentally preparing for a physical action.
R : System response which may be ignored if the user does not have to wait for it, a
sin copy typing.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
Example :
KLM (Keystore - Level) Model predicts expert error - free task completion
time (human performance) with interactive computing systems. Total
predicted time for a task is given by equation.
tEXECUTE = tK + tP + tH + tD + tM + tR. What does each of the above
timing represent ? Develop a KLM model and predict time for the
completion of the task “Change font and style for the word “KLM” to
bold, Arial” using mouse only.
Sol. : A task is broken into a series of subtasks. Total predicted time is the sum of
the subtask times :
tEXECUTE = tK + tP + tH + tD + tM
+t
Operators : R
K keystroking P pointing H homing
D drawing M mental prep R system response
Task : Change the font and style for word “KLM” to bold, Arial.
Operations :
Keyboard Subtasks
Select text
Convert to boldface
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
Type a (“Arial” appears at top of list)
Select “Arial”
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
tEXECUTE = 4 tM + 12 tK = 4 1.35 + 12 0.75 = 14.40 seconds
KL GOM
M S
Model creation is Quick and easy Time consuming to create model
KLM not used any selection rules GOMS uses selection rules
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
The architecture of ICS is built up by the coordinated activity of nine smaller
subsystems: five peripheral subsystems are in contact with the physical world
and four are central, dealing with mental processes.
Each subsystem has the same generic structure. A subsystem is described in
terms of its typed inputs and outputs along with a memory store for holding
typed information.
It has transformation functions for processing the input and producing the
output and permanently stored information.
Each of the nine subsystems is specialized for handling some aspect of external
or internal processing.
An example of a central subsystem is one for the processing of propositional
information, capturing the attributes and identities of entities and their
relationships with each other.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
CSCW studies the use of groupware. CSCW is the study of the tools and techniques
of groupware as well as their psychological, social, and organizational effects.
Examples :
1. Scientists collaborating on a technical issue
2. Authors editing a document together
3. Programmers debugging a system concurrently
4. Workers collaborating over a shared video conferencing application
5. Buyers and sellers meeting on eBay
Main Challenge : Support Awareness
1. Presence of collaborators
2. Behaviours and actions of collaborators
3. Presence of resources and arte-facts
4. Knowledge and expectations of counterparts.
3.3.2 Stake-Holders
A stakeholder is as anyone who is affected by the success or failure of the system.
Primary stakeholders are people who actually use the system, the end-users.
Secondary stakeholders are people who do not directly use the system, but
receive output from it or provide input to it.
Tertiary stakeholders are people who do not fall into either of the first two
categories but who are directly affected by the success or failure of the system.
Facilitating stakeholders are people who are involved with the design,
development and maintenance of the system.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
The airline booking system stakeholders can be classified as follows :
1. Primary stakeholders : travel agency staff, airline booking staff
2. Secondary stakeholders : customers, airline management
3. Tertiary stakeholders : competitors, civil aviation authorities, customers’
traveling companions, airline shareholders
4. Facilitating stakeholders : design team, IT department staff.
Socio - technical theory has at its core the idea that the design and
performance of any organisational system can only be understood and
improved if both ‘social’ and ‘technical’ aspects are brought together and
treated as interdependent parts of a complex system.
Organisational change programmes often fail because they are too focused on
one aspect of the system, commonly technology, and fail to analyse and
understand the complex interdependencies that exist.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
This is directly analogous to the design of a complex engineering product such
as a gas turbine engine. Just as any change to this complex engineering system
has to address the knock-on effects through the rest of the engine, so too does
any change within an organisational system.
Socio-Technical models of system design are of three types : USTM/CUSTOM,
OSTA and Ethics.
Potential benefits are as follows :
1. Strong engagement
2. Reliable and valid data on which to build understanding
3. A better understanding and analysis of how the system works now (the ‘as is’)
4. A more comprehensive understanding of how the system may be improved (the
‘to be’)
5. Greater chance of successful improvements.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
3.3.3.2 Open System Task Analysis (OSTA)
OSTA is an alternative socio-technical approach, which attempts to describe
what happens when a technical system is introduced into an organizational
work environment.
OSTA specifies both social and technical aspects of the system. It focus on tasks.
Fig. 3.3.2 shows OSTA.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
7. Performance satisfaction criteria are established, indicating the social and
technical requirements of the system.
8. The new technical system is specified.
Therefore, this approach first tries to define the situation (stages 1 and 2). The
definition of the situation occurs in 2 stages. First, a problem situation is
perceived and in stage 2, a better overview is gained by having the problem
situation expressed through communication with all involved parties.
After expressing the problem in the given situation, the approach tries to
deliver a precise definition of the system (stage 3), which is applied to produce
conceptual models of the system.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
These conceptual models in stage 4 include the consideration of
clients/customers, actors, transformations, world view, owners and the
environment. The precise root definition from stage 3 will have already
identified who all the involved people are.
Stages 3 and 4 are typically abstract modeling processes that do not relate
directly to the specific situation at hand, i.e. many scenarios can be considered
and simulated. This is an abstract modeling process that does not take place in
the real world.
Stages 5, 6 and 7 then go away from the abstract point of view and try to
embed the earlier processes into the real world
Stage 5 will expose gaps in the original root definition after incorporating the
expressed situational circumstances until a well-formed root definition has
been found.
In Stage 6, the conceptual model of the situation is compared with the original
expression of the situation
It is possible that Stage 6 exposes further changes that might be necessary.
In Stage 7, action takes place to improve the situation at hand with the help of
the designed system, but this may not succeed in the first place, so many
iterations might be necessary
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
3.4 Communication and Collaboration Models
1. Face-to-Face Communication
It involves speech, hearing, body language and eye-gaze. A person has to be
familiar with existing norms, to learn a new norm.
Another factor is the personal space, this varies based on the context,
environment, diversity and culture.
The above factor comes into pitcher, when there is a video conference between
two individuals from different background.
The factor of eye gaze is important during a video conference as the cameras
are usually mounted away from the monitor and it is important to have eye
contact during a conversation.
Back channels help giving the listener some clues or more information about
the conversation.
The role of interruptions like 'um's and 'ah's are very important as they can be
used by participants in a conversation to claim the turn.
2. Conversation
Transcripts can be used as a heavily annotated conversation structure, but
still lacks the back channel information.
Another structure is of turn-taking, this can be interpreted as Adjacency
pairs, e.g. : A-x, B-x, A-y, B-y.
Context varies according to the conversation.
The focus of the context can also varies, this means that it is difficult to keep
track of context using adjacency pairs.
Break-downs during conversations is often a case and can be noticed by
analyzing the transcripts. Reaching a common ground or grounding is very
essential to understand the shared context.
Speech act theory is based on the statements and its propositional meaning.
A state diagram can be constructed considering these acts as illocutionary
points in the diagram. This is called conversation for action.
3. Group working
The roles and relationship between the group individuals are different and may
change during the conversation.
Physical layout is important to consider here to maintain the factors in face-to-
face communication.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
3.4.1 Hypertext
Hypertext is text which contains links to other texts. The term was coined by
Ted Nelson around 1965. HyperMedia is a term used for hypertext which is
not constrained to be text : it can include graphics, video and sound, for
example. Apparently Ted Nelson was the first to use this term too.
Hypertext consists of nodes connected by links to form networks or webs.
Depending on the system, a node can be restricted to one medium (text,
graphics, sound, animation, or video) or can include multiple media.
Links can be unidirectional or bidirectional, labeled or typed, and can store
other information, such as author and creation date.
Anchors are points or regions in a node to which a link attaches, often
represented by a button or other marking that indicates a navigational
possibility.
When a user navigates to a new node, a new window may open or the existing
window may expand to incorporate the new information.
Like hypertext, multimedia began with experiments in the 1960s and 1970s
that matured into vigorous commercial activity in the 1980s and 1990s.
Key
Features :
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
1. Web provides a hypertext structure among the documents that it stores.
2. The documents contain links i.e. references to other documents or
resources. The structures of links can be arbitrarily complex and the set of
resources that can be added is unlimited.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
The main standard components of Web :
1. HyperText Markup Language (HTML)
2. Uniform Resource Locators (URLs)
3. HyperText Transfer Protocol (HTTP)
HTML specifies the contents and layout of web pages. The content contains
text, table, form, image, links, information for search engine, etc. The layout is
in the form of text format, background and frame. HTML is also used to specify
links and which resources are associated with them.
URL identifies a resource to let browser find it. HTTP URL is mostly widely
used today. An HTTP URL has two main jobs to do :
1. To identify which web server maintains the resource.
2. To identify which of the resources at that server is required.
HTTP defines a standard rule by which browsers and any other types of client
interact with web servers. Main features are :
1. Request - reply interaction
2. Content types may or may not be handled by browser - using plug-in or external
helper.
3. One resource per request so several requests can be made concurrently.
4. Simple access control : Any user with network connectivity to a web
server can access any of its published resources.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
3.5.2 Dynamic Web Content
i. The active web : This type involves complex forms of interactions on web.
The actual content may be fixed, but the user can change the form of
presentation. The web pages can be generated from database contents, and
the database information can be updated through the web.
ii. Fixed content – local interaction and changing view : Probably the
most overestimated aspect of the web in recent years has been java. In fact,
Java can be used to write server- end software and platform independent
standalone programs.
iii. Search : The user’s keywords are submitted to the server using an
HTML form; they are compared against pre-prepared indexes at the server.
iv. Dynamic content : The content of the web pages reacts to and is
updateable by the web user in dynamic web context. The user interacts
through a web browser with a web server. The Java Servlet Pages (JSP) and
Java Enterprise Beans (JEB) is used for this purpose. There is use of
‘business logic’ in data processing for e.g. online banking. These Java
enterprise beans takes data from corporate database using JDBC
connections.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
Browser - safe colors :
The color management system currently used by web browser software is
based on an 8-bit, 216-color palette.
The browser-safe color palette is a solution devised by Netscape to solve the
problem of displaying color graphics in a similar way on many kinds of display
screens, with browsers running under different operating systems.
Because a majority of the web audience years ago had 8-bit display screens,
256 colors was the upper limit for the color palette. But the various versions of
the windows operating system reserve 40 colors for displaying such graphic
interface elements as windows, menus, screen wallpaper, icons, and buttons,
which leaves just 216 colors to display everything else.
The 216 colors chosen by Netscape are identical in both the Macintosh and
Windows system palettes. Although the browser-safe color scheme originated
at Netscape, at present both of the dominant Web browsers use the same color
management system.
Most web users have computers and monitors set to "thousands" or "millions"
of colors, so the importance of the so - called web - safe palette has sharply
diminished in the past few years.
When the user has a monitor set to thousands or millions of colors all colors
display properly, so there is no longer any need to restrict your color choices to
the 216 Web-safe colors.
Two Marks Questions with Answers
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
Ans. : CUSTOM is a socio-technical methodology designed to be practical to
use in small organizations. It is based on the User Skills and Task Match (USTM)
approach, developed to allow design teams to understand and fully document
user requirements.
List the name of cognitive
models. Ans. : Cognitive Models
are as follows :
Goal and task hierarchies (GOMS, CCT)
Linguistic notations (BNF, TAG)
Physical and device models (KLM)
Automating Inspection Methods.
What is soft systems methodology ?
Ans. : Soft Systems Methodology (SSM) is a cyclic learning system which uses
models of human activity to explore with the actors in the real world problem
situation, their perceptions of that situation and their readiness to decide
upon purposeful action which accommodates different actor’s perceptions,
judgments and values.
List the advantages of GOMS.
Ans. : Advantages :
1. Easy to construct a simple GOMS model and saves time
2. Helps discover usability problems
3. Gives several qualitative and quantitative measures.
4. Less work than usability study.
What is cognitive models ?
Ans. : A cognitive model is the designer’s intended mental model for the user of
the system and set of ideas about how it is organized and operates.
Give the characteristics of direct
manipulation. Ans. : Acts as an extension of
real word.
Provides continuous visibility.
Actions are rapid and incremental with visible display of results.
Actions are incremental and easily reversible.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 3- Models and
Interaction Theories
Notes
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
UNIT-IV
4
Mobile HCI
Syllabus
Mobile Ecosystem : Platforms, Application framework – Types of Mobile Applications :
Widgets, Applications, Games – Mobile Information Architecture, Mobile 2.0, Mobile Design :
Elements of Mobile Design, Tools – Case Studies.
Contents
4.1 Mobile Ecosystem
4.2 Types of Mobile Applications ...................................April/May-17,........................Marks-16
Mobile Information Architecture
Mobile 2.0
4.5 Mobile Design ..........................................................April/May-17,18 ..................Marks-16
Two Marks Questions with Answers
(4 - 1)
Human Computer Mobile
Interaction HCI
UNIT-IV
Mobile HCI
Mobile Ecosystem
Mobile devices do not exist in a vacuum - a series of networks and
interconnected systems exist to support modern mobility. The utility of modern
mobile devices is greatly enhanced by software applications and their
supporting cloud services.
Fig. 4.1.1 shows layers of mobile ecosystem. Each layer is reliant on the others
to create a seamless, end-to-end experience.
Services
Applications
Application
Framework
OS
Platforms
Hardware Devices
Aggregators
Networks
Operators
4. Platforms :
Mobile platforms primary duty is to provide access to the devices. To run
software and services on each of these devices. Platforms are of three types :
licensed, proprietary and open source.
Open source is an approach to the design, development, and distribution of
software, offering practical accessibility to software’s source code.
Open source licenses must permit non-exclusive commercial exploitation of the
licensed work, must make available the work’s source code, and must permit
the creation of derivative works from the work itself.
Proprietary software is computer software which is the legal property of one
party. The terms of use for other parties is defined by contracts or licensing
agreements. These terms may include various privileges to share, alter,
dissemble, and use the software and its code.
Human Computer Mobile
Interaction HCI
5. Operating system :
Mobile OSs provide dedicated application stores for end users offering a
convenient and customized means of adding functionality.
Application stores pose an additional threat vector for attackers to distribute
malware or other harmful software to end users. This is especially true of third-
party application stores not directly supervised by mobile OS vendors.
Android is a software environment built for mobile devices. It is not a hardware
platform. While components of the underlying OS are written in C or C++,
user applications are built for Android in Java.
Android has been available as open source since October 2008. Google opened
the entire source code under an Apache License. With the Apache License,
vendors are free to add proprietary extensions without submitting those back
to the open source community.
Other mobile OS are Symbian, windows CE, Palm OS, Linux and Mac OS X etc.
6. Application framework :
First layer the developer can access is the application framework or API
released by one of the companies. An application framework is a software
library that provides a fundamental structure to support the development of
applications for a specific environment. An application framework acts as the
skeletal support to build an application.
Application frameworks often run on top of operating system sharing core
services such as communications, messaging, graphics, location, security,
authentication etc.
The Binary Runtime Environment for Wireless (BREW) gives developers a
mechanism for creating portable applications that will work on Code Division
Multiple Access (CDMA) - based handsets.
BREW manages all of the telephony functions on the device, thereby allowing
application developers to create advanced wireless applications without having
to program to the device's system-level interface.
S60 : S60 platform is formerly known as Series 60. It is application platform
for devices that run the Symbian OS. S60 applications can be created in Java,
the Symbian C++ framework etc.
Adobe Flash Lite is a lightweight version of Adobe Flash Player, a software
application published by Adobe Systems for viewing Flash content. Flash Lite
operates on devices that Flash Player cannot, such as mobile phones and other
portable electronic devices like Wii, Chumby and Iriver.
Cocoa Touch is the application development environment for building software
programs
Human Computer Mobile
Interaction HCI
to run on iOS for the iPhone and iPod Touch, iPadOS for the iPad, watchOS for the
Apple Watch, and tvOS for the fourth-generation Apple TV, from Apple Inc.
7. Applications :
For creating applications, application framework is used. Applications are
web browser, camera or media player.
Widgets
Mobile Widgets is a mobile application which gives a fast and simple access to
a set of mobile widgets.
These mobile widgets are a very short way to access news, fun and a multitude
of Internet contents and services.
The mobile website widgets create elements and containers for creating a
responsive mobile version of the website.
The widget examples should be viewed on a suitable device, in the iOS
Simulator or in a desktop browser using responsive mode.
The fig. 4.2.1 below shows the three different sizes of iPhone and the screen
width in portrait and landscape mode. It should be obvious that a fixed width
web page design is not going to perform well on the various sizes of phone.
Fig. 4.2.1
For a design to work on different devices, the page width has to vary from 320
px to 414 px in portrait mode and up to 736 px in landscape. This is achieved
by giving the items 100% width with a maximum width setting.
Human Computer Mobile
Interaction HCI
The maximum width setting is used to control the width of an item when
viewed in landscape mode. For example, an image with an aspect ratio of less
than 4 : 3 will be partially hidden when viewed in landscape mode so its
maximum width setting should be set to prevent the height from expanding
more than the device screen width which is actually the screen height in
landscape mode.
Items such as videos are played in full screen mode anyway so it is not
necessary to set their maximum width to any more than about 480 px.
Fig. 4.2.2
The Widget tab allows you to configure the functionality of the app. As widgets
are specifically designed to work with 2D or 3D data content, a set of widgets
for 2D apps is different from 3D apps.
Human Computer Mobile
Interaction HCI
In addition, the initial set of widgets may vary from theme to theme, as each
theme has its own preconfigured set of widgets. Following are the widgets
from the Foldable theme when you build 2D apps.
Limitations :
They typically require a compatible widget platform to be installed on the device.
They cannot run in any mobile web browser.
They require learning additional proprietary, non-web-standard techniques.
4.2.2 Applications
Mobile Web applications refer to applications for mobile devices that require
only a Web browser to be installed on the device.
They typically use HTML and Ajax, although they may make use of augmented
Rich Internet Application (RIA) technologies, such as Flash, JavaFX and
Silverlight, but are not written specifically for the device.
Rich, mobile Web applications have roughly equivalent usability to PC-rich web
applications (or RIAs), when designed specifically for smaller form factors.
Simple mobile Web applications limit the use of RIA technologies and are
designed to present information in a readable, action-oriented format.
Mobile Web applications differ from mobile native applications, in that they
use web technologies and are not limited to the underlying platform for
deployment.
Native Apps :
Native apps live on the device and are accessed through icons on the device
home screen. Native apps are installed through an application store (such as
Google Play or Apple’s App Store).
They are developed specifically for one platform, and can take full advantage of
all the device features, they can use the camera, the GPS, the accelerometer,
the compass, the list of contacts, and so on.
They can also incorporate gestures (either standard operating-system gestures
or new, app- defined gestures). And native apps can use the device’s
notification system and can work offline.
Hybrid apps :
Hybrid apps are part native apps, part web apps. Like native apps, they live in
an app store and can take advantage of the many device features available.
Like web apps, they rely on HTML being rendered in a browser, with the
caveat that the browser is embedded within the app.
Often, companies build hybrid apps as wrappers for an existing web page;
in that way, they hope to get a presence in the app store, without spending
significant effort for developing a different app.
Hybrid apps are also popular because they allow cross platform development
and thus significantly reduce development costs : that is, the same HTML code
components can be reused on different mobile operating systems.
Tools such as PhoneGap and Sencha Touch allow people to design and code
across platforms, using the power of HTML.
Advantages :
They are easy to create, using basic HTML, CSS, and JavaScript knowledge.
They are simple to deploy across multiple handsets.
Human Computer Mobile
Interaction HCI
Thet offer a better user experience and a rich design, tapping into device
features and offline use.
Content is accessible on any mobile web browser.
Disadvantages :
The optimal experience might not be available on all handsets.
They can be challenging (but not impossible) to support across multiple devices.
They don’t always support native application features, like offline mode,
location lookup, filesystem access, camera, and so on.
Pros :
1. They work on any mobile device.
2. They can be simple to set up and manage.
3. They can be incorporated into any web or mobile application.
Cons :
1. They are limited to 160 characters.
2. They provide limited text based experience.
4.2.4 Games
A mobile game is a game played on a mobile phone (feature phone or
smartphone), tablet, smartwatch, PDA, portable media player.
Human Computer Mobile
Interaction HCI
The final mobile medium is games, the most popular of all media available to
mobile devices. Technically games are really just native applications that use
the similar platform.
They are different from native applications for two reasons : they cannot be
easily duplicated with web technologies, and porting them to multiple mobile
platforms is a bit easier than typical platform - based applications.
Adobe’s Flash and the SVG (Scalable Vector Graphics) standard are the only
way for the mobile games on the Web now, and will likely be how it is done on
mobile devices in the future, the primary obstacle being the performance of the
device in dealing with vector graphics.
The game mechanics are the only thing that needs to adapt to the various
platforms. Like in console gaming, there are a great number of mobile game
porting shops that can quickly take a game written in one language and port it
to another.
Merits
• They provide a simple and easy way to create an immersive experience.
• They can be ported to multiple devices relatively easily.
Demerits
• They can be costly to develop as an original game title.
• They cannot easily be ported to the mobile web.
University Question
Q.1 Appraise the types of mobile applications with example. AU : April/May-17, Marks-
16
Fig. 4.3.4 shows such a wire - framing tool. Wireframes produced by these
toolscan be simulated to show interface behavior and depending on the tools,
the interface logic can be exported for actual code implementation (but usually
not).
Note that there are tools that allow the user to visually specify UI elements and
their configuration and then automatically generate code. Regardless of which
type of tool is used, it is important that the design and implementation stages
be separated.
Though wire-framing, the developer can specify and flesh out the kinds of
information displayed, the range of functions available and their priorities,
alternative sand interaction flow.
Mobile 2.0
The Web was a read-only medium for a majority of users. Upto 1990, web was
combination of a telephone book and yellow pages. Some user was knows
about hyperlinks.
When web 2.0 was invented by Tim O’Reilly, attitude towards the web was changed.
Web 2.0 tools allow libraries to enter into a genuine conversation with their
users. Libraries are able to seek out and receive patron feedback and respond
Human Computer Mobile
Interaction HCI
directly.
Human Computer Mobile
Interaction HCI
In 2003, noticeable shift in how people and businesses were using the web and
developing web-based applications.
Tim O'Reilly said that “Web 2.0 is the business revolution in the computer
industry caused by the move to the Internet as a platform, and an attempt to
understand the rules for success on that new platform”
Many web 2.0 companies are built almost entirely on user-generated content
and harnessing collective intelligence. Google, MySpace, Flickr, YouTube and
Wikipedia, users create the content, while the sites provide the platforms.
The user is not only contributing content and developing open source software,
but directing how media is delivered, and deciding which news and information
outlets you trust.
At that stage we thought the web 2.0 stack was fairly empty, but since those
days the extent that people collaborate, communication, and the range of tools
and technologies have rapidly changed.
Editing blogs and wikis did not require any knowledge of HTML any more.
Blogs and wikis allowed individuals and groups to claim their personal space
on the Web and fill it with content at relative ease.
The first online social networks entered the field at the same time as blogging
and wikis started to take off. Web 2.0 is the network as platform, spanning all
connected devices.
Web 2.0 applications are those that make the most of the intrinsic advantages
of that platform. It delivers software as a continually-updated service that gets
better the more people use it.
Consuming and remixing data from multiple sources, including individual
users, while providing their own data and services in a form that allows
remixing by others.
Web 3.0 :
Web 3.0, or the semantic web, is the web era we are currently in, or perhaps
the era we are currently creating.
Web 3.0, with its use of semantics and artificial intelligence is meant to be a
“smarter web”, one that knows what content you want to see and how you
want to see it so that it saves you time and improves your life.
Semantic web is really the participatory web, which today includes “classics”
such as YouTube, MySpace, eBay, Second Life, Blogger, RapidShare, Facebook
and so forth.
Web 2.0 is that users are willing to provide content as well as metadata. This
may take the form articles and facts organized in tables and categories in
Wikipedia, photos organized in
Human Computer Mobile
Interaction HCI
sets and according to tags in Flickr or structured information embedded into
homepages and blog postings using micro-formats.
A major disadvantage associated with web 2.0 is that the websites become
vulnerable to abuse since, anyone can edit the content of a web 2.0 site. It is
possible for a person to purposely damage or destroy the content of a website.
Web 2.0 also has to address the issues of privacy. Take the example of
YouTube. It allows any person to upload a video. But what if the video
recording was done without the knowledge of the person who is being shown
in the video ? Thus, many experts believe that web 2.0 might put the privacy
of a person at stake.
The basic idea of web 3.0 is to define structure data and link them in order to
more effective discovery, automation, integration, and reuse across various
applications. It is able to improve data management, support accessibility of
mobile internet, simulate creativity and innovation, encourage factor of
globalization phenomena, enhance customers’ satisfaction and help to organize
collaboration in social web.
Web 3.0 supports world wide database and web oriented architecture which in
earlier stage was described as a web of document
Mobile devices with web access extend the ubiquity of the Internet, offering
anywhere, anytime access to information. This makes it possible to share
information with colleagues and friends through photo and video media, as
well as by voice.
Consumers can quickly capture photos and videos with cameras embedded in
their mobile devices and share them with relatives and friend via email or post
them to MySpace or YouTube.
Elements of mobile designs are context, message, look and feel, layout,
typograph and graphics.
1. Context
Context is critical to mobile design; understanding the big picture of a user’s
interaction with a device enables designers to create better user experiences
on that device.
Mobile is based very much on the traditional understanding of context including :
a) Culture - Economic, religious, manners, legal, social, etc.
b) Environmental - The noise, the light, the space in which something is used,
privacy, etc.
c) The activity - Are they walking, driving, working, etc ?
d) The goals that the user has - Their status, social interaction, entertainment, etc.
Human Computer Mobile
Interaction HCI
e) The attention span the user has available - Continuous (full/partial) or
intermittent (full/partial).
f) The tasks the user wants to carry out - Make calls, send messages, etc.
g) The device on which the user operates - OS, hardware, capabilities, etc.
h) The connection available to the user - Speed, reliability, etc.
Contextual model is based around the user’s intentions rather than their
physical location and while there may be some shift between levels on each
device.
2. Message
The message is the overall mental impression we create explicitly through
visual design. Branding is the impression company name and logo gives
essentially reputation.
A “heavy” design with use of dark colors and lots of graphics will tell the
user to expect something more immersive.
3. Look and Feel
Establishing a look and feel usually comes from design inspiration.
Look refer to visual design and feel refer to overall customer experience of
using a product, service, environment, machine or tool.
On large mobile projects or in companies with multiple designers, a style guide
or pattern library is crucial, maintaining consistency in the look and feel and
reducing the need for each design decision to be justified.
4. Layout
Layout is an important design element, because it is how the user will visually
process the page, but the structural and visual components of layout often get
merged together, creating confusion and making design more difficult to
produce.
Layout plays a significant role in a graphic design. Layout refers to the
arrangement of elements on a page usually referring to specific placement of
image, text and style.
Understanding the layout of design is very important. If the layout is not
correctly understood, there is a probability that the message you wanted to
convey will be lost and the cost of advertising would go to waste.
There are two distinct types of navigation layouts for mobile devices: touch and
scroll.
Navigation is the skeleton of the APP, supporting the overall content and
information, so that content in accordance with the information architecture
organically combined, visually and clearly displayed in front of users so that
fragmented content becomes full and orderly. Meanwhile, the structured
arrangement at the same time also enhances the sense of ecology.
Human Computer Mobile
Interaction HCI
5. Color
Color is one of the most important elements of mobile design. When users open
your app, what is the first thing they observe ? That’s right, the main color.
The Internet is filled with studies and articles about the psychology behind
colors in marketing and all these principles apply also to mobile apps so you
have to think about the color while building your mobile interface and it to
your mobile app design elements.
A simple color could change everything about your mobile app. Take a look at
the scheme below and think about your users, their location, and their
characteristics. This way you will find the right complex of colors to match
your app’s style.
Color palettes : Defining color palettes can be useful for maintaining a
consistent use of color in mobile design. Color palettes typically consist of a
predefined number of colors to use throughout the design.
Selecting what colors to use varies from designer to designer, each having
different techniques and strategies for deciding on the colors.
Three basic ways to define a color palette : Sequential, Adaptive and Inspired.
a) Sequential :
In this case, there are primary, secondary, and tertiary colors. Often the
primary color is reserved as the “brand” color or the color that most closely
resembles the brand’s meaning. The secondary and tertiary colors are often
complementary colors that can be selected using a color wheel.
Primary color is the color displayed most frequently across your app’s
screens and components. Your primary color can be used to make a color
theme for your app, including dark and light primary color variants.
Secondary color provides more ways to accent and distinguish your
product. Having a secondary color is optional, and should be applied
sparingly to accent select parts of your user interface.
Secondary colors are best for : Floating action buttons, Selection controls,
like sliders and switches, Highlighting selected text, Progress bars, Links
and headlines.
b) Adaptive :
An adaptive palette is one in which we leverage the most common colors
present in a supporting graphic or image. When creating a design that is
meant to look native on the device, an adaptive palette can be used to
make sure that colors are consistent with the target mobile platform.
Human Computer Mobile
Interaction HCI
c) Inspired :
This is a design that is created from the great pieces of design we might
see online or offline, in which a picture of the design might inspire us. This
could be anything from an old poster in an alley, a business card, or some
packaging. Like with the adaptive palette, we actually extract the colors
from the source image, though we should never ever use the source
material in a design.
6. Typograph
Typography is the art and technique of arranging type to make written
language legible, readable, and appealing when displayed. The arrangement of
type involves selecting typefaces, point sizes, line lengths, line-spacing
(leading), and letter-spacing (tracking), and adjusting the space between pairs
of letters.
Fig. 4.5.1 shows example of typography.
Q.1 List and explain the elements of mobile design. AU : April/May-17, Marks-16
Q.2 Discuss the various elements of mobile design with a step by step method. Explain how to
design a registration page for movie ticket booking.AU : April/May-18, Marks-16
Two Marks Questions with Answers
Ans. : Types of mobile platforms are licensed, proprietary and open source.
Define color palette. AU : Nov/Dec-18
Ans. : Defining color palettes can be useful for maintaining a consistent use of
color in mobile design. Color palettes typically consist of a predefined number
of colors to use throughout the design. Selecting what colors to use varies from
designer to designer, each having different techniques and strategies for
deciding on the colors. Three basic ways to define a color palette : sequential,
adaptive and inspired.
Human Computer Mobile
Interaction HCI
Human Computer Mobile
Interaction HCI
Notes
UNIT-V
5
Web Interface Design
Syllabus
Designing Web Interfaces - Drag & Drop, Direct Selection, Contextual Tools, Overlays, Inlays
and Virtual Pages, Process Flow - Case Studies.
Contents
Designing Web Interface
Contextual Tools
OVERLAYS
Inlays
Virtual Pages
Process flow
Two Marks Questions with Answers
(5 - 1)
Human Computer 5- 2 Web Interface
Interaction Design
Interesting Moments :
Available events for cueing the user during drag and drop interactions are as
follows :
1. Page load : before any interaction occurs, user can pre-signify the
availability of drag and drop.
2. Mouse Hover : mouse pointer hovers over an object that is draggable.
3. Mouse down : user holds down the mouse button on the draggable object.
4. Drag initiated : after the mouse drag starts.
5. Drag leaves original location.
6. Drop accepted : drop occurs over a valid target and drop has been accepted.
7. Drop Rejected : drop occurs over an invalid target and drop has been rejected.
Actors : During each event you can visually manipulate a number of actors.
The page elements available include page, cursor, tool tip, drag object, drag
objects parent container and drop target.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 3 Web Interface
Interaction Design
Purpose of Drag and Drop are as follows :
a. Drag and drop module : used for rearranging the modules on a page.
b. Drag and Drop list : rearranging the lists.
c. Drag and drop object : used for changing relationship between objects.
d. Drag and drop action : invoking actions on a dropped object.
e. Drag and drop collection : maintaining collections through drag and drop.
2. Invitation to drag
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 4 Web Interface
Interaction Design
3. Dragging
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 5 Web Interface
Interaction Design
k) Drag Delegation with a Drop Target : Using DD, Delgate for dragging
multiple items and dropping on a drop target.
l) Using Drag plugins with Delegate : Using drag plugins with delegate.
m) List reorder w/Bubbling : This example shows how to make a sortable list
using custom event bubbling.
n) List reorder w/Scrolling : This example shows how to make a sortable list
using Custom event bubbling and node scrolling.
o) Portal Style Example : Portal style example using drag & drop event
bubbling and animation.
p) Photo Browser : Example photo browser application.
Toggle Selection :
A checkbox control has three states : unselected, selected, and indeterminate.
The last state represents a situation where a list of sub-options is grouped
under a parent option and sub-options are in both selected and unselected
states.
A toggle switch represents a physical switch that allows users to turn things on
or off, like a light switch.
Tapping a toggle switch is a two-step action: selection and execution, whereas
checkbox is just selection of an option and its execution usually requires
another control.
When deciding between a checkbox and toggle switch control, it is better to
focus on the usage context instead of their function.
a) Use Toggle switch for Instant response
An instant response of applied settings is required without an explicit action.
A setting requires an on/off or show/hide function to display the results.
User needs to perform instantaneous actions that do not need a review or
confirmation.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 6 Web Interface
Interaction Design
Fig. 5.1.1 : The options that require instant response are best selected using a toggle switch.
Fig. 5.1.2 : Checkboxes are preferred when an explicit action is required to apply settings
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 7 Web Interface
Interaction Design
Fig. 5.1.3 : Selecting multiple options in a list provides better experience using checkboxes
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 8 Web Interface
Interaction Design
Collected Selection :
Collected selection is a pattern for keeping track of selection as it spans multiple
pages.
In Gmail, you can select items as you from page to page. The selections are
remembered for each page.
If you select two items on page one, then move to page two and select three
items, there are only three items selected.
Toggle selection is used for selecting bookmarks for editing, deleting etc.
Object selection is used for initiating a drag drop.
Fitts’s Law :
Fitts's Law is an ergonomic principle that ties the size of a target and its
contextual proximity to ease of use.
Fitts stated that the size of the target object along with its distance from the
starting location could be directly measured, allowing him to model the ease at
which a person could perform the same action with a different target object.
Fitts’ law, at its simplest form, is common sense. The bigger an object and the
closer it is to us, the easier it is to move to.
Fitts’ law is a model that can help designers make educated decisions in user
interfaces and web page layouts. It can be used in conjunction with design
theories such as visual weight to give user interface items proper hierarchy
and placement.
Contextual Tools are as follows :
1. Always visible tools : place contextual tools directly in the content. Digg’s
“digg it” button is a simple Contextual Tool that is always visible.
2. Hover Reveal tools : Show contextual tools on mouse hover. Fig. 5.2.1 and
5.2.2 shows normal state and invitation.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- 9 Web Interface
Interaction Design
Normal state : the edit and delete tools are hidden in the normal state.
Invitation : on mouse hover, the tools are revealed. Tools are cut into the grey
bar, drawing the eye to the change.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- Web Interface
Interaction Design
1. Toggle reveal tools : A master switch to toggle on/off contextual tools for
the page. Toggle a tool mode for an area or page when the actions are not
the main flow. The tools to accomplish this are revealed on the activation of
the toggle.
2. Multilevel tools : progressively reveal actions based on user interaction.
3. Secondary menus : show a secondary menus.
Discoverability is a primary reason to choose always visible tools.
5.3 OVERLAYS
Overlays are really just lightweight pop ups. We use the term lightweight to
make a clear distinction between it and the normal idea of a browser pop up.
Browser pop ups are created as a new browser window lightweight overlays
are shown within the browser page as an overlay.
Older style browser pop ups are undesirable because : Browser pop ups
display a new browser window.
These windows often take time and a sizeable chunk of system resources to
create. Browser pop ups often display browser interface controls.
Due to security concerns, in internet explorer 7 the URL bar is a permanent
fixture on any browser pop-up window.
Types of overlay are dialog overlays, detail overlays, and input overlays.
1. Dialog Overlay : Dialog overlays replace the old-style browser pop ups.
Netflix provides a clear example of a very simple dialog overlay.
2. Detail Overlay : The second type of overlay is somewhat new to web
applications. The detail overlay allows an overlay to present additional
information when the user clicks or hovers over a link or section of content.
Toolkits now make it easier to create overlays
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- Web Interface
Interaction Design
across different browsers and to request additional information from the
server without refreshing the page.
3. Input Overlay : Input overlay is a lightweight overlay that brings additional
input information for each field tabbed into. American express uses this
technique in its registration for premium card such as its gold card
5.4 Inlays
Information, or dialog with the user needs to be an overlay. Another
approach is to inlay the information directly within the page itself.
Types of Inlays are as follows :
1. Dialog Inlay : A simple technique is to expand a part of the page, revealing a
dialog area within the page.
2. List Inlay : Lists are a great place to use inlays. Instead of requiring the user
to navigate to a new page for an item‘s detail or popping up the information
in an overlay, the information can be shown with a List Inlay in context.
3. Detail Inlay : A common idiom is to provide additional detail about items
shown on a page.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- Web Interface
Interaction Design
5. Zooming User Interface (ZUI) is a graphical environment where users can
change the scale of the viewed area in order to see more detail or less, and
browse through different documents. A ZUI is a type of Graphical User
Interface (GUI).
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- Web Interface
Interaction Design
Two Marks Questions with Answers
What is difference between Hover-Reveal tools and Toggle-Reveal
tools ? Ans. : Hover-Reveal Tools : Show Contextual Tools on
mouse hover.
Toggle-Reveal Tools : A master switch to toggle on/off Contextual Tools for the page.
What is meant by multi-level tools ?
Ans. : Multi-level tools is progressively reveal actions based on user interaction.
What is meant by radial menus ?
Ans. : Experienced users can rely on muscle memory rather than having to look
directly at the menu items. The proximity and targeting size make the menu
easy to navigate since the revealed menu items are all equally close at hand.
What is meant by dialog overlay ?
Ans. : Dialog overlay contains important information that the user should not
ignore. Both the Netflix purchase dialog and the Flickr rotate dialog are good
candidates for the lightbox Effect.
What is meant by Light box effect ?
Ans. : Lightbox is a JavaScript library that displays images and videos by filling
the screen, and dimming out the rest of the web page.
What is meant by detail overlay ?
Ans. : The detail overlay allows an overlay to present additional information
when the user clicks or hovers over a link or section of content. Toolkits now
make it easier to create overlays across different browsers and to request
additional information from the server without refreshing the page.
What is meant by Input overlay ?
Ans. : Input overlay is a lightweight overlay that brings additional input
information for each field tabbed into. American express uses this technique in
its registration for premium card such as gold card.
What is meant by detail inlay ?
Ans. : Detail inlay pattern shows a carousel of photos when the user clicks on the
“View photos” link. It uses a detail overlay to blow up a thumbnail when clicked on.
What is meant by virtual scrolling ?
Ans. : The virtual scrolling feature of data grid can be used to display large
amounts of records without paging. When scrolling with the vertical scrollbar,
the data grid executes Ajax requests to load and refresh the existing records.
The overall behavior is smooth and with no flicker.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge
Human Computer 5- Web Interface
Interaction Design
Define object selection. AU : April/May-18
Ans. : Types of overlay are Dialog Overlays, Detail Overlays, and Input Overlays.
What do you mean by inlay ? AU : Nov/Dec-18
Ans. : Not every bit of additional control, information, or dialog with the user
needs to be an overlay. Another approach is to inlay the information directly
within the page itself. To distinguish from the pop-up overlay, we call these in -
page panels Inlays.
Differentiate between modal and non - modal overlays. AU : Nov/Dec-17
Ans. : A modal dialog is a dialog that appears on top of the main content and
moves the system into a special mode requiring user interaction. In contrast,
nonmodal (or modeless) dialogs and windows do not disable the main content
: showing the dialog box doesn't change the functionality of the user interface.
®
TECHNICAL PUBLICATIONS - An up thrust for knowledge