ISYE6118 – Human Integrated System

Topic 2-Week 2-Session 4

Design and Evaluation Methods

 Learning Outcome

• To apply the design and evaluation methods

in human-integrated system problems
 Outline

Design and Evaluation

Methods
• Introduction of design and evaluation
• Front-End analysis
• Iterative design and testing
INTRODUCTION DESIGN
AND EVALUATION
 Introduction

The goal of human factors specialist is to make system successful

by enhancing performance, satisfaction and safety.

Concept of design, including activities as the following:

• Design or help design new products or system

• Modify the design of existing products
• Design ergonomically sound environment, i.e. workstation design.
• Perform safety-related, i.e. design warning label, instructions etc.
• Develop training program, including instruction manual
• Develop methods for training
• Apply ergonomic principles
 Cost/Benefit Analysis of
Human Factors Contribution

Human factors analysis is sometimes seen as an extra expense

that does not gain a monetary reward equal to or greater than
the cost of the analysis.

In cost/benefit analysis, one calculates the expected costs of the

human factors effort and estimates the potential benefits in
monetary terms.
 Hypothetical Costs
Table 1 shows a hypothetical example of the costs of conducting a usability
study for a software prototype.
 Human Factors in
the Product Design Lifecycle
The major goal in human factors is
to support the design of products I.e. product support, extend, and
in a cost-effective and timely transform user work.
fashion.

In order to maximize the benefit of final product, human factors

must be involved as early as possible in the product (or system)
design rather than performed as a final evaluation after product
design.

Product life cycle model is a model that add product

implementation, utilization and maintenance, and dismantling or
disposal.
Example - Human Factors in
the Product Design Lifecycle
FRONT-END ANALYSIS
 Front End Analysis

• The purpose of front-end analysis is to understand the

users, their needs and demands of the work situation.

• The following question before design solutions are

generated in the design stage:
– Who are the product/system users?
– What are the major functions to be performed by the system,
whether by person or machine? What task must be performed?
– What are the environmental conditions?
– What are the users preferences or requirements for the product?
 Performing
Various Analysis

User analysis Environmental analysis Function and task analysis

Function analysis
Task analysis
 How to
Perform a Task Analysis (1)

Define the analysis purpose and Collect task data

identify the type of data required
Complex decision making, problem solving, Observation
diagnosis Think-aloud verbal protocol
Large amounts of conceptual knowledge needed Surveys and questionnaires
Large and complex rule structures Limitations
 How to
Perform a Task Analysis (2)

Summarize task data Analyze task data

Lists, outlines and matrices Network analysis
Hierarchies Workload analysis
Flow charts, timelines and Maps Simulation and modeling
Safety analysis
Scenario specification
Example – Task Analysis
 Example –
Hierarchical
task analysis
 Example –
The Basic Task
 Example –
Graphical and
Matrices
ITERATIVE DESIGN AND TESTING
 Iterative Design and
testing
• The initial evaluation is based on the task analysis and is
followed by other activities.
– I.e. heuristic design evaluation, trade-off studies, prototyping,
and usability testing

• The questions answered during this stage of the design

process, as the following:
– Do the identified features and functions match user preferences and
met user requirements?
– Are there any existing constraints?
– What are the human factors criteria for design solutions?
– Which design alternatives best accommodate human limits?
 Providing Input
for System
Specifications
• System specifications usually include:
– The overall objectives the system supports
– Performance requirements & features
– Design constrains

• The challenge is to generate system specifications that

select possible features and engineering performance
requirements that best satisfy user objectives and goals.
 Quality
Function Deployment

• System specifications usually include:

– The overall objectives the system supports
– Performance requirements & features
– Design constrains

• The challenge is to generate system specifications that

select possible features and engineering performance
requirements that best satisfy user objectives and goals.
 What is QFD ?
 QFD1 - Product Planning Matrix

Correlation matrix

Quality Function Deployment (QFD) is a Target values

detailed planning technique aimed at Design requirements

translating the “voice of the customer”

Importance
Customer Competitor

ratings
into specifications at each major stage of requirements
Relationship
assessment
matrix
the product development process:
Absolute importance
• QFD1 - Product Planning
Technical difficulty
• QFD2 - Part Planning
Technical competitor
• QFD3 - Process Planning assessments

• QFD4 - Production Planning

Benefits Application Note:

• Products meet customer expectations better Customer involvement is essential during
• Provides improved design traceability the acquisition of customer requirements
• Reduced lead times through fewer design changes
and focus on key features
• Reduced product cost through use of appropriate
tolerances and reduced scrap
• Improved communication within organisation and
with customer
 Typical
QFD 1 Chart
Weak
Strong
Medium
Matrix
Relationship

New model

Competitor 1
Competitor 2

Current model

w
Ro

11
Weak -ve

35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
10
Company: Example

9
8
7
6
5
4
3
2
1
Weak +ve

Strong -ve
Strong +ve
Matrix
Correlation

.
.
EH&S
Safe
Usability

Rugged
Reliable
Target

Performance

Instant use
Minimize

Long lasting

subassemblies
Mazimize

Long shelf life

Fast recharge
Target

Easily serviced
Unevaluated

Quiet operation

Long battery life

Direction

Quick processes
Ease of manufacture
Easy to use chuck

Durability & reliability

Good running time

Comfortable to use

No design changes

Easy safe recycling

Minimum processes
=
?

EMC legislation
CONTROL ITEMS
Good drilling capacity

Robust components &

Convenient packaging
Right weight & balance
Clear instruction manual

Simple proven processes

Use as drill or screwdriver

Readily available materials

Customer Req

Easy to assemble / reassemble

Ranki
ng
Difficult/
new
forward
Carry
Competitors
(tech)

Importance
Absolute
0
0
0
0
2
5
0
1
1
2
1
2
1
2
0
1
2
4
2
4
5
5
0
2
4
2
3
4
0
4
5
3
3
5
0

Importance
?

34 0 Performance 1
8 131 Max hole size in wood 2 10 mm
7 135 Max hole size in steel 3 8 mm
22 58 Reversible 4
13 110 Time to fit drill bit in chuck 5 10 s
10 122 Capacity of chuck 6 0.5 mm - 10 mm
11 119 Force to tighten chuck 7 0.3 Nm
?

34 0 Ergonomics 8
19 66 Noise level at full load 9 85 dB (A)
6 156 Weight 0.4 kg
10
9 124 Position of center of gravity
To be defined
11
22 58 Max surface temperature at full load40° C
12
25 57 Trigger guard
13
28 47 *Click* action switches
14
?

34 0 Battery
15
3 168 Time to recharge 2 hr
16
1 229 Running time at full load 20 min
17
5 161 Number of battery charging cycles 100
Time to self-discharge to 50% 18
12 112 30 days
capacity 19
?

34 0 Battery charger
20
17 80 Double insulated
21 Market
18 76 AC connector
22 dependent
26 54 Input voltage 240v or 110v
23
?

34 0 Durability
24
14 106 Mean time between failures 400 hr
25 1m -> hard
4 164 Drop test
26 surface
2 196 Design life 1000 hr
27
?

34 0 Packaging & documentation

28
32 25 Package size & shape To be defined
29
31 32 Package crush test To be defined
30
16 83 Time to read instruction manual 3 min
31
?

34 0 Service
32
29 40 Mean time to diagnose faults To be defined
33
22 58 Time to disassemble 3 min
34
21 64 Mean time to repair 10 min
Number of special tools for 35
27 49 None
servicing 36
?

34 0 Manufacturing
37
14 106 Use DFA principles
Total number of manufacturing 38
30 39 Minimum
processes 39
19 66 Number of different raw materials Minimum
40
33 18 Material identification marks All
41
q.
Se
et
Targ

Req
Design
Dir

(cust)
Improvement

Competitors
 Product Planning
(QFD phase 1)
Correlation matrix
Basic
Elements Improvement direction
Target values

Design requirements

Importance
ratings
Customer Competitor
requirements assessment
Relationship
matrix

Technical competitor
assessments

Absolute importance
Absolute importance ranking

Technical difficulty
Simplified House of
Quality
 Functional Allocation

• Many functions can be accomplished by either a person or technology,

and human factors specialist must identify an appropriate function for
each.
• Determining each function to be performed by the system (automatic),
person (manual), or some combinations.
 Final Test and Evaluation

• Human factors specialist performs a great deal of

evaluation during the system design phases.

• Once product has been fully developed, it should undergo

final test and evaluation.

• In traditional engineering, system evaluation would

determine whether the physical system is functioning
correctly.
CONCLUSION
 Conclusion

• Several techniques used in human factors to

understand user needs and to design system to
meet the customer requirements.

• Limit of the visual system influence the nature of

the visual information that arrives at the brain for
more elaborate perceptual interpretation.
 References
Wickens, C. D., Lee, J. D., Liu, Y., & Gordon-Becker, S. E.
(2014). AnIntroduction to Human Factors Engineering. (2).
Pearson.ISBN 13: 978-1-292-02231-4.

Mark R. Lehto and Steven J. Landry. (2013). Introduction

to Human Factors and Ergonomics for Engineers, Second
Edition. CRC Press. ISBN 13: 978-1-4665-8416-7.

https://bit.ly/2r3YzHW
Thank You