Scribd
Upload
31 views12 pages

Human Computer Interaction

Uploaded by

UsmanHaider
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
31 views12 pages

Human Computer Interaction

Uploaded by

UsmanHaider
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 12

HUMAN COMPUTER

INTERACTION
Lecture 12

1
©2011
D E C I D E:

An evaluation framework

www.id-book.com 2 ©2011
AIMS
• Framework to guide evaluation
process.

• Usability Testing

www.id-book.com 3 ©2011
DECIDE: a framework to guide
evaluation

www.id-book.com 4 ©2011
1- Determine the goals
• What are the high-level goals of the
evaluation?
• Who wants it and why?
• What is the Goal of this Evaluation:
 Are you trying to check the consistency of
application?
 Are you trying to check how much time required to
perform the task by the users?
 Are you trying to evaluate the metaphors that has
been used within this application?
ww.id-book.com 5 ©2011
2- Explore the questions
• In order to make goals operational, questions
must be answered to satisfy them.

• For Example:
• The goal of finding out why some customers
prefer to purchase paper airline tickets rather
than e-tickets
– What are customers’ attitudes to e-tickets?
– Are they concerned about security?
– Is the interface for obtaining them poor?

www.id-book.com 6 ©2011
3- Choose the evaluation
approach & methods
• The evaluation method influences how data
is collected, analyzed and presented.

• E.g. field studies typically:


– Involve observation and interviews.
– Involve users in natural settings.
– Do not involve controlled tests.
– Produce qualitative data.

www.id-book.com 7 ©2011
4- Identify practical issues
For example, how to:

•Select users
•Select equipment
•Stay on budget and Time
•Stay on schedule
•Find evaluators

www.id-book.com 8 ©2011
5- Decide about ethical issues
• Develop an informed approval form

• So concerning them there are many


things that we need to be aware of
• There are many guidelines for ethical
issues.
– You should not engaged the participants
in any activity which they dislike or which
could harm them later on.

www.id-book.com 9 ©2011
6- Evaluate, interpret &
present data
• Methods used influence how data is
evaluated, interpreted and presented.
The following need to be considered:

• Reliability: The reliability or consistency of a


technique is how well it produces the same results
on separate occasions under the same
circumstances.
• Validity: Validity is concerned with whether the
evaluation technique measures what it is supposed
to measure.
www.id-book.com 10 ©2011
6- Evaluate, interpret &
present data Cont.
• Biases: Biases occur when the results are
distorted.

• Ecological validity: Ecological validity is


concerned how the environment in which an
evaluation is conducted influence or even distorts
the results.

www.id-book.com 11 ©2011
Key points
 Many issues to consider before conducting
an evaluation study.
 These include: goals of the study;
involvment or not of users; the methods to
use; practical & ethical issues; how data
will be collected, analyzed & presented.
 The DECIDE framework provides a
useful checklist for planning an
evaluation study.

www.id-book.com 12 ©2011

You might also like