0% found this document useful (0 votes)
68 views235 pages

Redesign UEQ Data Analysis Tool Version8

The document describes a data analysis tool for interpreting results from the User Experience Questionnaire (UEQ). The tool allows users to enter raw UEQ data and automatically calculates statistics and graphs to analyze the results. It provides worksheets to transform, analyze, and visualize the UEQ data in different languages. The tool is intended to simplify the analysis and presentation of UEQ data.

Uploaded by

killstreaker7
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
68 views235 pages

Redesign UEQ Data Analysis Tool Version8

The document describes a data analysis tool for interpreting results from the User Experience Questionnaire (UEQ). The tool allows users to enter raw UEQ data and automatically calculates statistics and graphs to analyze the results. It provides worksheets to transform, analyze, and visualize the UEQ data in different languages. The tool is intended to simplify the analysis and presentation of UEQ data.

Uploaded by

killstreaker7
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
You are on page 1/ 235

Data Analysis Tool

Author: Dr. Martin Schrepp

The goal of this tool is to make the analysis of UEQ (User Experience Questionnaire) data as easy as possible for you. You
simply enter the data obtained from your respondents into the Data worksheet. The tool then automatically calculates all
statistics necessary to interpret the results. In addition, several graphs are shown that you may want to use in your result
presentations. Simply copy them to your word processor of presentation tool.
The instructions in this tool are in English. To make the interpretation of the results easier and to have the charts in your
language you can switch the language in the following dropdown. This will only switch the items and scale names, not the
instructions in the Excel.

Choose your Language: English

Please Note: Changing the language will show the UEQ items and the UEQ dimensions in the selected language. All other
texts will remain in English.

The tool contains the following work sheets:


Data: Here you can enter the raw data of your evaluation. This is the only work sheet that you need to modify. Do not
change the content of the other work sheets, you may destroy unintentionally some of the formulas in the cells!
DT: The order of the items (i.e. if the positive term is left or right in an item) is randomized in the questionnaire to
minimized answer tendencies. Here the items are changed to a common order (negative term left, positive term right). Th
transformed data are used for all the further calculations.
Results: Main results of the questionnaire. Here the scale means and the mean and standard deviation per item are
calculated.
Confidence_Intervals: Confidence intervals for the scale means and for the mean of each item are calculated.
Answer_Distributions: Here you can see the distributions of the answers (values 1 to 7) for the single items. This can help
to find items that show a ploarization of opinions, i.e. where many negative and many positive answers can be found.
Scale_Consistency: Here the Cronbach-Alpha Coefficient and Guttmans Lambda2 coefficient per scale are calculated.
Check here if the scales have a sufficiently high values. Scales with a small value (<0.5) should be treated carefully in the
interpretation (if you have only a small sample size (< 50 responses) then interpret these values very carefully. In such case
a small value for these coefficients may result solely from sampling effects and may not indicate a real problem.
Benchmark: The benchmark shows you in an easy way how good the evaluated product is compared to the products in th
benchmark data set. There is also a graphic that shows for each scale how the results are related to the products in the
benchmark data set.
Inconsistencies: On this work sheet the data are analysed for inconsistent answers, i.e. answers from participants that
answered at least a part of the items randomly. You may want to remove these data before you calculate the results.
Sample_Size: If you observe big error bars concerning the scale means you may ask yourself if you need to collect
additional data. This sheet helps you to estimate how many data you need in order to reach a certain precision.
KPI_Calculation: There is an extension of the UEQ with 6 additional questions. This extension allows to calculate a KPI
(single number representing the overall user experience). This work sheet is only relevant if you used this extension. It
allows to enter the data obtained for the 6 additional questions and calculates the KPI.
Items: Contains the item and dimension names in the different languages. Used for switching the language. Please do not
modify date in this sheet.
nalysis Tool
. Martin Schrepp

perience Questionnaire) data as easy as possible for you. You


the Data worksheet. The tool then automatically calculates all
eral graphs are shown that you may want to use in your result
presentation tool.
rpretation of the results easier and to have the charts in your
down. This will only switch the items and scale names, not the

ms and the UEQ dimensions in the selected language. All other

This is the only work sheet that you need to modify. Do not
troy unintentionally some of the formulas in the cells!
right in an item) is randomized in the questionnaire to
to a common order (negative term left, positive term right). The

means and the mean and standard deviation per item are

eans and for the mean of each item are calculated.


f the answers (values 1 to 7) for the single items. This can help
e many negative and many positive answers can be found.
nd Guttmans Lambda2 coefficient per scale are calculated.
es with a small value (<0.5) should be treated carefully in the
sponses) then interpret these values very carefully. In such cases
ampling effects and may not indicate a real problem.
good the evaluated product is compared to the products in the
each scale how the results are related to the products in the

or inconsistent answers, i.e. answers from participants that


ant to remove these data before you calculate the results.
cale means you may ask yourself if you need to collect
y data you need in order to reach a certain precision.
dditional questions. This extension allows to calculate a KPI
his work sheet is only relevant if you used this extension. It
tions and calculates the KPI.
ent languages. Used for switching the language. Please do not
Please enter the data here!
Use the item numbers in the printed questionnaire and the categories 1 (if the alternative on the extreme left is
marked) to 7 (if the alternative on the extreme right is marked).
Leave the cell empty if the person has not answered the item. Please do not enter a special caracter in such cases,
since this would cause errors in the calculations.
You can enter data for a maximum of 1000 participants. If you need more, you have to adjust the fomulas in the
Excel.
The data analysis tool is delivered with some example data in this work sheet. Simply delete them before you enter
your data here.

Items
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
6 7 3 1 2 5 6 2 3 2 6 1 7 6 4 6 2 2 2 7 2 6 2 2 2
7 6 2 2 2 6 7 3 2 2 6 2 6 5 6 6 2 2 1 7 1 7 1 1 1
6 7 2 1 1 6 7 7 1 5 7 1 6 6 6 7 1 2 1 7 1 7 1 1 1
6 6 2 1 2 6 6 6 2 3 5 2 6 6 4 6 2 2 2 6 1 7 1 2 1
7 7 4 2 2 6 6 6 1 2 7 1 7 6 6 7 2 2 2 7 2 7 1 1 1
5 5 3 4 4 4 6 5 4 3 5 6 5 4 6 5 4 3 3 5 2 5 2 2 2
5 6 3 2 3 5 5 6 4 3 5 2 5 4 5 5 3 4 3 6 2 6 2 2 2
6 6 3 1 1 5 6 5 4 4 5 3 4 4 5 4 3 3 2 6 3 5 2 3 3
6 5 4 3 3 5 5 6 4 5 6 3 6 4 3 5 4 4 4 5 3 6 3 3 3
6 6 1 1 1 6 7 5 3 1 7 1 7 7 4 7 1 1 1 6 2 7 1 1 1
6 6 1 1 1 7 7 6 4 2 7 1 7 6 7 7 3 1 2 7 3 7 1 2 2
6 7 3 3 2 7 6 5 4 3 6 1 5 5 6 7 4 3 3 6 3 5 1 2 1
5 5 3 4 3 5 6 4 4 3 5 3 5 4 5 5 4 3 3 5 3 5 3 3 3
6 7 2 2 1 5 6 5 3 3 5 2 5 5 5 5 2 2 2 6 3 5 1 2 2
6 6 3 3 2 6 6 6 4 3 5 2 6 6 5 6 3 3 3 5 4 5 1 2 3
6 7 3 2 1 5 6 5 3 3 6 3 7 5 5 6 4 3 1 7 1 7 1 2 1
6 6 2 4 4 6 6 5 3 2 5 2 5 4 5 5 4 3 3 6 2 5 2 2 2
5 5 2 4 2 5 5 5 3 2 5 2 6 4 6 5 4 3 3 5 2 5 1 2 3
6 7 2 1 1 7 7 5 1 2 7 1 7 7 7 7 1 1 1 7 1 7 1 1 1
6 7 2 1 1 6 5 5 4 3 6 2 7 5 5 7 2 2 3 7 3 7 1 1 1
7 7 2 1 1 7 7 5 1 2 7 1 7 5 7 7 1 3 2 7 1 6 1 1 1
5 5 2 3 3 5 3 4 4 2 5 3 5 4 5 5 4 4 3 5 3 5 2 2 3
6 7 2 2 2 6 6 5 4 2 6 2 6 5 6 6 4 3 3 7 2 7 1 2 1
6 5 2 3 4 4 7 4 4 2 6 2 6 4 5 5 4 4 4 5 6 5 1 1 2
5 5 3 3 3 4 5 2 4 2 5 3 5 4 5 5 4 4 3 5 2 5 1 1 2
eme left is

n such cases,

ulas in the

ore you enter

26
6
7
6
6
7
6
7
4
4
7
6
6
5
7
5
7
6
7
7
7
7
6
7
6
5
Skala Perbaikan Awal
Attractiven 1.847 1.040
Perspicuity 1.880 1.640
Efficiency 1.880 1.080
Dependabil 1.350 1.150
Stimulatio 1.690 0.700
Novelty 1.600 0.170 Perbandingan Skala UEQ
Desain Pe
2.000
Skala Awal Perbaikan 1.800
Attractiven 1.04 1.85 1.600
Pragmatic 1.29 1.70 1.400
Hedonic 0.44 1.65 1.200
1.000
0.800
0.600
0.400
0.200
0.000
Attrac- Perspicuity Efficiency
tiveness

Perbaikan
Perbandingan Skala UEQ Evaluasi Awal Dengan
Desain Perbaikan

ttrac- Perspicuity Efficiency Dependability Stimulation Novelty


eness

Perbaikan Awal
Transformed Data
The order of the positive and negative term for an item is randomized in the questionnaire. Per dimension half of the
items start with the positive and half with the negative term.
Here you can find the transformed values per item. You can use these values for example for own statistical
calculations. The +3 represent the most positive and the -3 the most negative value.

Items
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
2 3 1 3 2 1 2 -2 1 2 2 3 3 2 0 2 2 2 2 3 2 2 2 2 2
3 2 2 2 2 2 3 -1 2 2 2 2 2 1 2 2 2 2 3 3 3 3 3 3 3
2 3 2 3 3 2 3 3 3 -1 3 3 2 2 2 3 3 2 3 3 3 3 3 3 3
2 2 2 3 2 2 2 2 2 1 1 2 2 2 0 2 2 2 2 2 3 3 3 2 3
3 3 0 2 2 2 2 2 3 2 3 3 3 2 2 3 2 2 2 3 2 3 3 3 3
1 1 1 0 0 0 2 1 0 1 1 -2 1 0 2 1 0 1 1 1 2 1 2 2 2
1 2 1 2 1 1 1 2 0 1 1 2 1 0 1 1 1 0 1 2 2 2 2 2 2
2 2 1 3 3 1 2 1 0 0 1 1 0 0 1 0 1 1 2 2 1 1 2 1 1
2 1 0 1 1 1 1 2 0 -1 2 1 2 0 -1 1 0 0 0 1 1 2 1 1 1
2 2 3 3 3 2 3 1 1 3 3 3 3 3 0 3 3 3 3 2 2 3 3 3 3
2 2 3 3 3 3 3 2 0 2 3 3 3 2 3 3 1 3 2 3 1 3 3 2 2
2 3 1 1 2 3 2 1 0 1 2 3 1 1 2 3 0 1 1 2 1 1 3 2 3
1 1 1 0 1 1 2 0 0 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1
2 3 2 2 3 1 2 1 1 1 1 2 1 1 1 1 2 2 2 2 1 1 3 2 2
2 2 1 1 2 2 2 2 0 1 1 2 2 2 1 2 1 1 1 1 0 1 3 2 1
2 3 1 2 3 1 2 1 1 1 2 1 3 1 1 2 0 1 3 3 3 3 3 2 3
2 2 2 0 0 2 2 1 1 2 1 2 1 0 1 1 0 1 1 2 2 1 2 2 2
1 1 2 0 2 1 1 1 1 2 1 2 2 0 2 1 0 1 1 1 2 1 3 2 1
2 3 2 3 3 3 3 1 3 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3
2 3 2 3 3 2 1 1 0 1 2 2 3 1 1 3 2 2 1 3 1 3 3 3 3
3 3 2 3 3 3 3 1 3 2 3 3 3 1 3 3 3 1 2 3 3 2 3 3 3
1 1 2 1 1 1 -1 0 0 2 1 1 1 0 1 1 0 0 1 1 1 1 2 2 1
2 3 2 2 2 2 2 1 0 2 2 2 2 1 2 2 0 1 1 3 2 3 3 2 3
2 1 2 1 0 0 3 0 0 2 2 2 2 0 1 1 0 0 0 1 -2 1 3 3 2
1 1 1 1 1 0 1 -2 0 2 1 1 1 0 1 1 0 0 1 1 2 1 3 3 2
sion half of the

tistical

Scale means per person


26 Attractiveness Perspicuity Efficiency Dependability Stimulation
2 2.17 2.75 2.00 1.00 1.75
3 2.33 2.25 2.75 1.50 2.25
2 2.67 2.75 3.00 3.00 2.50
2 2.17 2.50 2.50 1.75 2.00
3 2.83 2.50 3.00 2.25 2.00
2 0.67 1.00 1.00 0.75 0.75
3 1.33 1.75 1.50 1.25 0.75
0 0.83 1.50 1.25 1.25 1.75
0 1.00 1.25 1.00 1.00 0.75
3 2.83 2.50 2.25 2.50 2.75
2 2.33 2.25 2.25 2.00 3.00
2 2.33 1.50 1.50 1.00 2.00
1 0.83 0.75 0.75 0.50 1.25
3 1.67 1.75 1.75 1.50 2.00
1 1.83 1.25 1.25 1.25 1.75
3 1.83 2.75 2.50 1.50 1.75
2 1.50 1.25 1.50 0.75 1.25
3 1.17 1.25 1.50 0.75 1.25
3 2.83 3.00 3.00 2.50 3.00
3 2.33 2.50 2.25 1.50 2.00
3 2.67 3.00 2.75 2.25 2.50
2 1.00 1.00 1.00 0.50 0.25
3 2.00 2.25 2.25 1.00 1.75
2 1.67 0.50 1.25 0.50 0.75
1 1.33 1.25 1.25 0.00 0.50
Novelty
1.25
2.25
1.25
1.25
1.75
1.50
1.50
0.50
-0.50
2.25
2.50
1.50
1.00
1.75
1.00
1.50
1.75
2.25
2.50
1.75
2.50
1.75
2.25
1.75
1.25
Results
You can interpret the means of the scales. The UEQ does not produce an overall score for the user experience (you need t
questionnaire it does make no sense to built such an overall score (for example by calculating the mean over all scales), sin
listed to allow you to detect outliers in the evaluations. If an item shows big deviations to the evaluations of the other item
example, because of a special context in your evaluation) by a higher number of participants.
Values between -0.8and 0.8 represent a more or less neutral evaluation of the corresponding scale, values > 0,8 represen
The range of the scales is between -3 (horribly bad) and +3 (extremely good). But in real applications, in general, only value
a range of different persons with different opinions and answer tendencies (for example the avoidance of extreme answer
Thus, even a quite good value of +1.5 for a scale looks from the purely visual standpoint on a scale range of -3 to +3 not as
figure that depicts the scale means. Use the figure with the reduced scale -2 to +2 if you communicate the results to perso
in situations where you don't want to explain in detail how building mean values and answer tendencies influence the obs

Item Mean Variance Std. Dev. No. Left Right


1 1.9 0.4 0.6 25 annoying enjoyable
2 2.1 0.7 0.8 25 not understandable understandable
3 1.6 0.6 0.8 25 creative dull
4 1.8 1.3 1.1 25 easy to learn difficult to learn
5 1.9 1.1 1.0 25 valuable inferior
6 1.6 0.8 0.9 25 boring exciting
7 2.0 0.9 0.9 25 not interesting interesting
8 0.9 1.4 1.2 25 unpredictable predictable
9 0.9 1.3 1.1 25 fast slow
10 1.4 0.9 1.0 25 inventive conventional
11 1.8 0.7 0.8 25 obstructive supportive
12 1.9 1.2 1.1 25 good bad
13 1.9 0.8 0.9 25 complicated easy
14 1.0 1.0 1.0 25 unlikable pleasing
15 1.3 1.0 1.0 25 usual leading edge
16 1.8 0.9 0.9 25 unpleasant pleasant
17 1.1 1.4 1.2 25 secure not secure
18 1.3 0.9 0.9 25 motivating demotivating
19 1.6 0.8 0.9 25 meets expectations does not meet expectations
20 2.1 0.7 0.9 25 inefficient efficient
21 1.7 1.3 1.1 25 clear confusing
22 2.0 0.9 0.9 25 impractical practical
23 2.6 0.4 0.6 25 organized cluttered
24 2.2 0.4 0.7 25 attractive unattractive
25 2.2 0.7 0.8 25 friendly unfriendly
26 2.2 0.9 0.9 25 conservative innovative

Mean value per Item


1
2
3
4
5
6
7
8
9
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
0 1 2 3
he user experience (you need to use the KPI extension for this). Because of the construction of the
ng the mean over all scales), since this value can not be interpreted properly. The values for the single items are
he evaluations of the other items of the same scale this can be a hint that the item is misinterpreted (for
s.
ng scale, values > 0,8 represent a positive evaluation and values < -0,8 represent a negative evaluation.
plications, in general, only values in a restricted range will be observed. It is due to the calculation of means over
e avoidance of extreme answer categories) extremely unlikely to observe values above +2 or below -2.
a scale range of -3 to +3 not as positive as it really is. For this reason this sheet contains two variants for the
mmunicate the results to persons that have not much knolwedge on the interpretation of this type of data and
er tendencies influence the observed data.

Scale UEQ Scales (Mean and Variance)


Attractiveness Attractiveness 1.847 0.48
Perspicuity Perspicuity 1.880 0.57
Novelty Efficiency 1.880 0.52
Perspicuity Dependability 1.350 0.55
Stimulation Stimulation 1.690 0.60
Stimulation Novelty 1.600 0.46
Stimulation
Dependability 3
Efficiency
Novelty
Dependability 2
Attractiveness
Perspicuity
Attractiveness 1
Novelty
Attractiveness
Dependability 0
s ity y y on lty
es nc lit
Stimulation n icu cie bi lati ve
ve sp a u o
Dependability cti r Effi nd m N
r a Pe pe Sti
Efficiency Att De
Perspicuity
Efficiency 2
Efficiency
Attractiveness
Attractiveness
Novelty
1

0
ss ity nc
y y on ty
ne icu ic e bilit ati vel
e a l
cti
v rs
p
Effi nd m
u No
ra Pe pe Sti
Att De

Pragmatic and Hedonic Quality


Attractiveness 1.85
Pragmatic Quality 1.70
Hedonic Quality 1.65

The scales of the UEQ can be grouped into pragmatic quality (Perspicuity,
Efficiency, Dependability) and hedonic quality (Stimulation, Originality).
Pragmatic quality describes task related quality aspects, hedonic quality the
non-task related quality aspects. Below the mean of the three pragmatic
and hedonic quality aspects is calculated.

0
ss ty ty
e ne uali uali
v
cti cQ cQ
ra ati oni
3 Att ag
m
He
d
Pr
n lty
ove
N

n ty
vel
No
quality (Perspicuity,
ation, Originality).
ts, hedonic quality the
he three pragmatic

ty
uali
cQ
ni
Distribution of Answers per Item
Here you can see the distribution of answers to the single items. If there are items that show a polarization in the answers (ma
judgements and not much neutral judgements) may help to get deeper insigths concerning aspects of the product that are exp
subgroup of participants and quite negative by another subgroup.

Nr Item 1 2 3 4
1 annoying/enjoyable 0 0 0 0
2 not understandable/understandable 0 0 0 0
3 creative/dull 0 0 0 2
4 easy to learn/difficult to learn 0 0 0 4
5 valuable/inferior 0 0 0 3
6 boring/exciting 0 0 0 3
7 not interesting/interesting 0 0 1 0
8 unpredictable/predictable 0 2 1 3
9 fast/slow 0 0 0 13
10 inventive/conventional 0 0 2 1
11 obstructive/supportive 0 0 0 0
12 good/bad 0 1 0 0
13 complicated/easy 0 0 0 1
14 unlikable/pleasing 0 0 0 10
15 usual/leading edge 0 0 1 3
16 unpleasant/pleasant 0 0 0 1
17 secure/not secure 0 0 0 11
18 motivating/demotivating 0 0 0 5
19 meets expectations/does not meet expectations 0 0 0 2
20 inefficient/efficient 0 0 0 0
21 clear/confusing 0 1 0 1
22 impractical/practical 0 0 0 0
23 organized/cluttered 0 0 0 0
24 attractive/unattractive 0 0 0 0
25 friendly/unfriendly 0 0 0 0
26 conservative/innovative 0 0 0 2

Distribution of Answers per Item


annoying/enjoyable
not understandable/understandable
creative/dull
easy to learn/difficult to learn
valuable/inferior
boring/exciting
not interesting/interesting
unpredictable/predictable
fast/slow
inventive/conventional
obstructive/supportive
good/bad
complicated/easy
unlikable/pleasing
unpredictable/predictable
fast/slow
inventive/conventional
obstructive/supportive
good/bad
complicated/easy
unlikable/pleasing
usual/leading edge
unpleasant/pleasant
secure/not secure
motivating/demotivating
meets expectations/does not meet expectations
inefficient/efficient
clear/confusing
impractical/practical
organized/cluttered
attractive/unattractive
friendly/unfriendly
conservative/innovative
0% 10% 20% 30% 40% 50% 60% 70%

1 2 3 4 5 6 7
a polarization in the answers (many negative and many positve
spects of the product that are experienced as quite positive by one

5 6 7 Scale
6 16 3 Attractiveness
7 8 10 Perspicuity
9 12 2 Novelty
6 6 9 Perspicuity
5 8 9 Stimulation
9 9 4 Stimulation
5 12 7 Stimulation
12 6 1 Dependability
6 2 4 Efficiency
9 12 1 Novelty
11 8 6 Dependability
6 10 8 Attractiveness
8 8 8 Perspicuity
7 6 2 Attractiveness
11 7 3 Novelty
10 6 8 Attractiveness
4 6 4 Dependability
10 7 3 Stimulation
11 7 5 Dependability
8 7 10 Efficiency
8 9 6 Perspicuity
11 4 10 Efficiency
2 6 17 Efficiency
3 13 9 Attractiveness
6 8 11 Attractiveness
3 9 11 Novelty

Item
50% 60% 70% 80% 90% 100%
Correlations of the items per scale and reliability coefficients
Items that belong to the same scale should show in general a high correaltion.
Here you can find the correaltions of the items in a scale and some common coefficients, Cronbachs Alpha and Guttmans L

Cronbachs Alpha-Coefficient
The Alpha-Coefficient (Cronbach, 1951) is a measure for the consistency of a scale. There is no generally accepted rule how
authors assume that a scale should show an alpha value > 0.7 to be considered as sufficiently consistent, but these sugges
sound statistical facts. Thus, from an methodological standpoint such a use of a cut-off criterium is not really well-founded
have only a small sample (for example less than 50 answers) the value of the Alpha-Coefficient should be interpreted very
sampling errors and may not be an indicator for a problem with the scale.
If the value of the Alpha-Coefficient for a scale shows a massive deviation from a reasonable target value, for example 0.6
in the given context interpreted by several participants in an unexpected way. In such cases please check the single item s
hint if there is maybe a common misinterpretation of an item due to the context of the evaluation. In such cases the corre
5% confidence interval for the Alpha coefficient is calculated accordingly to Bonett, D.B. (2002), Sample Size Requirements
Educational and Behavioral Statistics, 27(4), 335-340.

Attractiveness Perspicuity Efficiency Dependability


Items Correlation Items Correlation Items Correlation Items
1, 12 0.55 2, 4 0.65 9, 20 0.57 8, 11
1, 14 0.49 2, 13 0.45 9, 22 0.51 8, 17
1, 16 0.55 2, 21 0.39 9, 23 0.39 8, 19
1, 24 0.39 4, 13 0.52 20, 22 0.78 11, 17
1, 25 0.56 4 , 21 0.34 20, 23 0.43 11, 19
12, 14 0.64 13, 21 0.25 22, 23 0.39 17, 19
12, 16 0.66 Average 0.43 Average 0.51 Average
12, 24 0.42 Alpha 0.75 Alpha 0.81 Alpha
12, 25 0.43 Conf. Int. 0.52 Conf. Int. 0.62 Conf. Int.
14, 16 0.79 Alpha (5%) 0.87 Alpha (5%) 0.90 Alpha (5%)
14, 24 0.44
14, 25 0.56
16, 24 0.60
16, 25 0.75
24, 25 0.68
Average 0.57
Alpha 0.89
Conf. Int. 0.79
Alpha (5%) 0.94

Guttmans Lambda2 coefficient


Another coefficient often reported as a measure of reliability of a scale is Guttmans Lambda2 coefficient. Lambda2 is a bett
lower bound for the real reliability of a scale). The coefficient Lambda1 also computed here is mainly needed for computin
NOTE: Theoretically, Lambda2 is higher than Alpha, but due to some rounding errors in the computation, it can happen tha

Attractiveness Perspicuity Efficiency Dependability


Lambda1 0.733230234 Lambda1 0.55539412 Lambda1 0.599273608 Lambda1

Items Covar^2 Items Covar^2 Items Covar^2 Items


1, 12 0.12 2, 4 0.37 9, 20 0.28 8, 11
1, 14 0.08 2, 13 0.12 9, 22 0.27 8, 17
1, 16 0.09 2, 21 0.14 9, 23 0.07 8, 19
1, 24 0.02 4, 13 0.28 20, 22 0.36 11, 17
1, 25 0.07 4 , 21 0.19 20, 23 0.05 11, 19
12, 14 0.46 13, 21 0.07 22, 23 0.05 17, 19
12, 16 0.45 Sum 1.16 Sum 1.09 Sum
12, 24 0.09 Lambda2 0.75 Lambda2 0.81 Lambda2
12, 25 0.14
14, 16 0.52
14, 24 0.08
14, 25 0.19
16, 24 0.13
16, 25 0.30
24, 25 0.12
Sum 2.87
Lambda2 0.89
onbachs Alpha and Guttmans Lambda2, that are typically used to estimate reliability of a scale.

no generally accepted rule how big the value of the coefficient should be. Many
y consistent, but these suggestions are more rules-of-thumb and not based on some
rium is not really well-founded (see for example Schmitt, N., 1996). Especially if you
nt should be interpreted very carefully. In such cases a low Alpha can result from

target value, for example 0.6 or 0.7, this can be a hint that some items of the scale are
please check the single item scores and correlations between the items. This can give a
uation. In such cases the corresponding scale should be interpreted very carefully. The
02), Sample Size Requirements for Testing and Estimating Coefficient Alpha, Journal of

Dependability Stimulation Novelty


Correlation Items Correlation Items Correlation
0.23 5, 6 0.57 3, 10 0.45
0.19 5, 7 0.34 3, 15 0.30
0.07 5, 18 0.66 3, 26 0.45
0.60 6, 7 0.42 10, 15 0.27
0.50 6, 18 0.60 10, 26 0.54
0.71 7, 18 0.58 15, 26 0.43
0.38 Average 0.53 Average 0.41
0.71 Alpha 0.82 Alpha 0.73
0.44 Conf. Int. 0.65 Conf. Int. 0.48
0.85 Alpha (5%) 0.91 Alpha (5%) 0.86

2 coefficient. Lambda2 is a better approximation of reliability than Cronbach's Alpha (both are a
s mainly needed for computing Lambda2.
computation, it can happen that the Excel-Sheet shows some violations of this!

Dependability Stimulation Novelty


0.51283019 Lambda1 0.61323066 Lambda1 0.54651685

Covar^2 Items Covar^2 Items Covar^2


0.05 5, 6 0.28 3, 10 0.10
0.06 5, 7 0.10 3, 15 0.05
0.01 5, 18 0.39 3, 26 0.10
0.30 6, 7 0.12 10, 15 0.06
0.13 6, 18 0.25 10, 26 0.21
0.53 7, 18 0.24 15, 26 0.15
1.07 Sum 1.38 Sum 0.67
0.70 Lambda2 0.81 Lambda2 0.73
Benchmark
The measured scale means are set in relation to existing values from a benchmark data set. This data set contains data fro
software, web pages, web shops, social networks).
The comparison of the results for the evaluated product with the data in the benchmark allows conclusions about the rela

Please help to increase the data basis for the benchmark! If you use the UEQ to evaluate products it would be quite helpf
participants in your study and the scale means. We will of course handle these information absolutely confidential and wil

Scale Mean Comparisson to benchmark


Attractiveness 1.85 Good
Perspicuity 1.88 Good
Efficiency 1.88 Good
Dependability 1.35 Above Average
Stimulation 1.69 Good
Novelty 1.60 Good

2.50

2.00

1.50

1.00

0.50

0.00
Attractiveness Perspicuity Efficiency Dependability Stimulation No
-0.50

-1.00

-1.50

Table to create the benchmark graph (purely technical, please ignore)


Scale Lower Border Bad
Attractiveness -1.00 0.7
Perspicuity -1.00 0.75
Efficiency -1.00 0.6
Dependability -1.00 0.78
Stimulation -1.00 0.5
Novelty -1.00 0.25
m a benchmark data set. This data set contains data from 20190 persons from 452 studies concerning different products (business

ata in the benchmark allows conclusions about the relative quality of the evaluated product compared to other products.

se the UEQ to evaluate products it would be quite helpful for us if you will share information concerning the type of product, the num
andle these information absolutely confidential and will use it solely to improve the benchmark.

Interpretation
In the range of the 10% best results
10% of results better, 75% of results worse
In the range of the 10% best results
25% of results better, 50% of results worse
10% of results better, 75% of results worse
10% of results better, 75% of results worse

Excellent
Good
Above Average
Below Average
Bad
Lower Border
Dependability Stimulation Novelty Mean

ore)
Below Average Above Average Good Excellent
0.49 0.41 0.26 0.64
0.5 0.52 0.26 0.47
0.44 0.44 0.4 0.6
0.37 0.33 0.23 0.8
0.5 0.35 0.35 0.8
0.5 0.39 0.47 0.89
nt products (business

er products.

ype of product, the number of

Mean
1.85
1.88
1.88
1.35
1.69
1.60
Confidence intervals for items and scales
Here the 5% confidence intervals for the scale means and the means of the single items are shown. The confidence interval is
mean.
The smaller the confidence interval is, the higher is the precision of the estimation and the more you can trust your results. Th
available data and on how consistenly the persons judged the evaluated product. The more consistent their opinion is the sma
The work sheet Sample_Size helps you to decide how many data you would need to achieve a certain width of the confidence

Confidence interval (p=0.05) per item


Item Mean Std. Dev. N Confidence Confidence interval
1 1.880 0.600 25 0.235 1.645 2.115
2 2.120 0.833 25 0.326 1.794 2.446
3 1.560 0.768 25 0.301 1.259 1.861
4 1.800 1.118 25 0.438 1.362 2.238
5 1.920 1.038 25 0.407 1.513 2.327
6 1.560 0.917 25 0.359 1.201 1.919
7 1.960 0.935 25 0.366 1.594 2.326
8 0.880 1.201 25 0.471 0.409 1.351
9 0.880 1.130 25 0.443 0.437 1.323
10 1.360 0.952 25 0.373 0.987 1.733
11 1.800 0.816 25 0.320 1.480 2.120
12 1.920 1.115 25 0.437 1.483 2.357
13 1.920 0.909 25 0.356 1.564 2.276
14 1.000 1.000 25 0.392 0.608 1.392
15 1.320 0.988 25 0.387 0.933 1.707
16 1.840 0.943 25 0.370 1.470 2.210
17 1.120 1.166 25 0.457 0.663 1.577
18 1.320 0.945 25 0.370 0.950 1.690
19 1.600 0.913 25 0.358 1.242 1.958
20 2.080 0.862 25 0.338 1.742 2.418
21 1.680 1.145 25 0.449 1.231 2.129
22 1.960 0.935 25 0.366 1.594 2.326
23 2.600 0.645 25 0.253 2.347 2.853
24 2.240 0.663 25 0.260 1.980 2.500
25 2.200 0.816 25 0.320 1.880 2.520
26 2.160 0.943 25 0.370 1.790 2.530
ems are shown. The confidence interval is a measure for the precision of the estimation of the scale

and the more you can trust your results. The width of the confidence interval depends on the number of
he more consistent their opinion is the smaller is the confidence interval.
o achieve a certain width of the confidence intervall.

Confidence intervals (p=0.05) per scale


Scale Mean Std. Dev. N Confidence Confidence interval
Attractiveness 1.847 0.692 25 0.271 1.575 2.118
Perspicuity 1.880 0.757 25 0.297 1.583 2.177
Efficiency 1.880 0.719 25 0.282 1.598 2.162
Dependability 1.350 0.743 25 0.291 1.059 1.641
Stimulation 1.690 0.771 25 0.302 1.388 1.992
Novelty 1.600 0.681 25 0.267 1.333 1.867
Sample size to reach a certain precision concerning the estimated scale means
If you have not many data points the error bars for the scale means in the Results Tab can be quite big. The error bars show
true value of the scale mean should be located with a 95% probability. Thus, big error bars stand for a not very precise me
A natural question is thus to ask, how many person you need (i.e. how big your sample should be) if you want to measure
tab tries to answer this question.
For a given precision E (deviation between true scale mean in the population and the estimated scale mean from the samp
standard deviation of the scale value in the population (the smaller this is the higher is the agreement between different p
ask) and the chance (error probability) P you still accept that the true scale mean is outside the area described by the erro
the confidence interval).
Of course the standard deviation of the scale value in the population is not known. For the data in this tab we estimate thi
already entered data. Thus, if you enter more data the estimation of this value and thus the values in the table below will c
The following table shows for typical values of E and P the required sample size. Please note that these are just rough estim
you need to achieve an accurate measurement!

Scale Standard Deviation


Attractiveness 0.69
Perspicuity 0.76
Efficiency 0.72
Dependability 0.74
Stimulation 0.77
Novelty 0.68

Condition Attractiveness Perspicuity Efficiency


Precision=0.5, Err.Prob.=0.1 5 6 6
Precision=0.5, Err.Prob.=0.05 7 9 8
Precision=0.5, Err.Prob.=0.01 13 15 14
Precision=0.25, Err.Prob.=0.1 21 25 22
Precision=0.25, Err.Prob.=0.05 29 35 32
Precision=0.25, Err.Prob.=0.01 51 61 55
Precision=0.1, Err.Prob.=0.1 130 156 141
Precision=0.1, Err.Prob.=0.05 184 220 198
Precision=0.1, Err.Prob.=0.01 319 382 344
ated scale means
be quite big. The error bars show the area (confidence interval) in which the
stand for a not very precise measurement.
uld be) if you want to measure the scale means with a certain precision. This

ated scale mean from the sample) the required sample size depends on the
agreement between different persons and thus the less persons you need to
the area described by the error bars (i.e. it will be with a probability 1-P inside

data in this tab we estimate this value from the standard deviation of the
e values in the table below will change!!
e that these are just rough estimations to give you an idea on how many data

Dependability Stimulation Novelty


6 6 5
8 9 7
15 16 12
24 26 20
34 37 28
59 63 49
150 162 126
212 229 178
367 396 309
Detect Suspicious Data
Especially if the UEQ is applied as an Online-Questionnaire not all participants will answer all items seriously. To
detect such more or less random or not serious answers, a simple heuristic is used. All items in a scale should
measure a similar UX quality aspect. The idea to detect random or not serious answers is to check how much the best
and worst evaluation of an item in a scale differs. If there is a big difference (>3) this is seen as an indicator for a
problematic data pattern. Of course such situations can also result from random response errors or a
misunderstanding of an item. Thus, it makes no sense to consider a response as problematic if this occurs just for a
single scale. But if this is true for 2 or 3 scales this is of course a clear hint that the response is somehow suspicious.
The table below shows the responses coded from -3 to 3. The table next to it shows for each scale if there is a
difference >3 between the best and worst item. The Critical? column shows for how many scales this is the case.
We suggest to remove answers from the data set that shows a value of 3 or higher in the Critical? column.

Items
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
2 3 1 3 2 1 2 -2 1 2 2 3 3 2 0 2 2 2 2 3 2 2 2 2 2
3 2 2 2 2 2 3 -1 2 2 2 2 2 1 2 2 2 2 3 3 3 3 3 3 3
2 3 2 3 3 2 3 3 3 -1 3 3 2 2 2 3 3 2 3 3 3 3 3 3 3
2 2 2 3 2 2 2 2 2 1 1 2 2 2 0 2 2 2 2 2 3 3 3 2 3
3 3 0 2 2 2 2 2 3 2 3 3 3 2 2 3 2 2 2 3 2 3 3 3 3
1 1 1 0 0 0 2 1 0 1 1 -2 1 0 2 1 0 1 1 1 2 1 2 2 2
1 2 1 2 1 1 1 2 0 1 1 2 1 0 1 1 1 0 1 2 2 2 2 2 2
2 2 1 3 3 1 2 1 0 0 1 1 0 0 1 0 1 1 2 2 1 1 2 1 1
2 1 0 1 1 1 1 2 0 -1 2 1 2 0 -1 1 0 0 0 1 1 2 1 1 1
2 2 3 3 3 2 3 1 1 3 3 3 3 3 0 3 3 3 3 2 2 3 3 3 3
2 2 3 3 3 3 3 2 0 2 3 3 3 2 3 3 1 3 2 3 1 3 3 2 2
2 3 1 1 2 3 2 1 0 1 2 3 1 1 2 3 0 1 1 2 1 1 3 2 3
1 1 1 0 1 1 2 0 0 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1
2 3 2 2 3 1 2 1 1 1 1 2 1 1 1 1 2 2 2 2 1 1 3 2 2
2 2 1 1 2 2 2 2 0 1 1 2 2 2 1 2 1 1 1 1 0 1 3 2 1
2 3 1 2 3 1 2 1 1 1 2 1 3 1 1 2 0 1 3 3 3 3 3 2 3
2 2 2 0 0 2 2 1 1 2 1 2 1 0 1 1 0 1 1 2 2 1 2 2 2
1 1 2 0 2 1 1 1 1 2 1 2 2 0 2 1 0 1 1 1 2 1 3 2 1
2 3 2 3 3 3 3 1 3 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3
2 3 2 3 3 2 1 1 0 1 2 2 3 1 1 3 2 2 1 3 1 3 3 3 3
3 3 2 3 3 3 3 1 3 2 3 3 3 1 3 3 3 1 2 3 3 2 3 3 3
1 1 2 1 1 1 -1 0 0 2 1 1 1 0 1 1 0 0 1 1 1 1 2 2 1
2 3 2 2 2 2 2 1 0 2 2 2 2 1 2 2 0 1 1 3 2 3 3 2 3
2 1 2 1 0 0 3 0 0 2 2 2 2 0 1 1 0 0 0 1 -2 1 3 3 2
1 1 1 1 1 0 1 -2 0 2 1 1 1 0 1 1 0 0 1 1 2 1 3 3 2
iously. To
e should
w much the best
cator for a

curs just for a


w suspicious.
here is a
s the case.
mn.

Scales with inconsistent answers


26 Attractiveness Perspicuity Efficiency Dependability Stimulation
2 1
3 1
2
2
3
2 1
3
0
0
3
2
2
1
3
1
3
2
3
3
3
3
2
3
2 1
1
ers
Novelty Critical?
1
1
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
KPI Calculation
This tab is only relevant if you use the KPI extension of the UEQ! This extended UEQ contains
6 additional questions, which ask for the importance of the UEQ scales for the participant.
With this information a KPI can be calculated, i.e. a single number that can be interpreted as
overall UX impression.
The questions concerning importance are scaled from 1 to 7. In case of missing values, i.e. if a
person has not given an importance rating for a scale, please enter the value "1".

Enter the data concerning the importance of the scales below!


Attractiveness Perspicuity Efficiency Dependability Stimulation Novelty SUM
5 5 7 6 6 5 34
7 7 7 7 7 7 42
6 5 7 6 6 5 35
5 5 6 6 4 4 30
6 6 7 7 5 5 36
2 7 7 7 2 2 27
7 7 7 7 3 5 36
5 5 6 7 3 4 30
7 6 6 7 5 6 37
7 6 7 7 6 6 39
7 7 7 6 5 7 39
5 5 5 5 5 5 30
5 6 5 5 5 5 31
7 7 7 7 6 6 40
7 7 7 7 1 4 33
6 7 7 7 7 6 40
2 6 6 7 4 5 30
7 6 6 5 6 4 34
6 6 7 7 6 5 37
6 7 7 7 6 6 39
5 6 6 5 6 3 31
6 7 6 6 6 6 37
6 6 5 7 5 5 34
6 6 7 7 5 5 36
6 6 6 7 7 6 38
5 5 6 6 5 5 32
5 1 7 7 2 4 26
7 5 7 7 7 6 39
7 7 7 5 7 7 40
6 7 7 7 6 7 40
6 6 6 7 6 7 38
7 5 6 5 4 6 33
7 7 7 7 7 7 42
7 7 7 7 7 7 42
6 7 7 7 5 5 37
6 7 7 7 7 7 41
6 6 7 7 5 6 37
5 5 7 7 5 6 35
7 7 7 7 7 7 42
5 6 6 6 6 5 34
5 5 5 5 5 5 30
7 7 7 7 7 7 42
7 6 7 5 6 6 37
7 7 7 7 7 7 42
7 7 7 7 7 7 42
7 6 6 6 5 6 36
6 7 7 6 6 7 39
5 7 6 7 4 3 32
6 7 7 6 7 7 40
4 4 4 5 5 5 27
4 5 3 5 4 4 25
6 6 7 6 6 5 36
7 7 7 6 7 5 39
6 7 7 7 6 6 39
7 7 7 7 7 7 42
6 7 7 6 4 5 35
6 7 6 7 5 6 37
6 6 4 7 5 6 34
7 7 7 7 7 7 42
7 7 7 7 6 6 40
6 7 7 7 6 6 39
6 7 7 7 5 6 38
5 5 4 4 4 4 26
6 7 6 5 6 6 36
4 7 7 7 6 7 38
4 7 7 6 4 4 32
2 5 6 5 5 4 27
3 7 7 7 1 4 29
2 5 4 3 2 2 18
5 5 6 3 4 4 27
6 6 7 7 6 6 38
5 7 7 7 6 5 37
5 5 7 7 5 4 33
7 6 7 6 6 6 38
6 6 7 5 3 2 29
7 7 7 7 7 7 42
5 6 7 5 5 5 33
7 7 6 7 7 7 41
6 6 7 7 5 5 36
5 4 6 6 4 5 30
7 7 7 7 7 6 41
7 7 7 7 7 7 42
7 6 6 7 5 6 37
6 6 7 6 7 7 39
6 5 6 6 5 5 33
7 7 7 7 7 7 42
3 7 7 7 4 5 33
6 7 7 7 5 5 37
7 7 7 7 5 6 39
7 7 7 7 5 5 38
3 6 7 7 3 3 29
7 7 7 7 7 7 42
3 6 7 6 2 3 27
6 7 7 6 6 6 38
7 7 7 7 4 7 39
7 7 6 4 4 5 33
5 7 6 7 4 3 32
5 7 6 7 4 5 34
6 3 7 5 6 5 32
6 7 6 7 5 5 36
5 7 7 7 3 5 34
7 7 7 7 7 7 42
7 7 7 7 7 7 42
6 7 7 6 5 6 37
5 7 7 5 4 6 34
5 7 6 7 6 7 38
2 7 7 7 5 6 34
3 7 7 5 4 3 29
6 7 7 6 5 6 37
6 6 6 5 6 6 35
7 5 7 7 7 6 39
7 5 7 7 7 7 40
5 7 7 6 2 5 32
6 7 7 7 6 6 39
4 5 5 4 3 4 25
5 7 7 5 3 3 30
5 6 6 6 5 6 34
7 7 7 7 7 7 42
6 5 6 6 6 6 35
5 5 6 5 4 4 29
6 6 7 6 6 7 38
5 7 7 7 4 3 33
7 7 7 5 7 7 40
5 7 4 7 3 6 32
5 6 5 6 4 5 31
5 7 7 7 3 5 34
7 7 4 5 3 3 29
4 3 6 5 5 5 28
5 7 7 7 6 4 36
7 7 7 7 3 4 35
5 5 6 7 5 5 33
5 6 5 5 6 6 33
3 6 6 6 3 3 27
7 7 7 7 5 7 40
6 7 7 6 5 3 34
5 6 6 7 4 4 32
5 5 6 4 5 5 30
6 7 7 6 5 6 37
7 4 7 5 5 5 33
5 6 7 7 5 5 35
6 7 6 6 6 6 37
6 4 6 6 5 5 32
6 5 6 4 6 6 33
7 6 7 7 1 4 32
6 6 7 6 4 3 32
6 6 7 7 5 6 37
5 7 7 7 5 5 36
6 7 7 5 6 7 38
6 6 6 7 5 5 35
6 7 6 6 6 5 36
4 6 6 6 4 4 30
5 5 6 5 4 4 29
6 6 6 5 4 5 32
2 7 7 6 3 4 29
5 4 5 5 6 6 31
4 5 6 6 4 4 29
7 7 7 5 6 6 38
5 7 7 7 4 4 34
7 7 7 7 7 7 42
7 6 6 6 7 6 38
5 5 7 6 6 6 35
7 6 7 7 7 7 41
6 5 7 5 6 5 34
7 7 6 6 6 6 38
6 5 6 6 6 6 35
6 5 6 5 4 5 31
5 6 7 6 7 5 36
7 7 7 7 7 7 42
3 5 5 4 4 4 25
6 6 6 5 4 5 32
5 6 6 7 5 5 34
5 5 6 7 4 5 32
4 5 4 4 4 5 26
3 5 5 5 2 5 25
6 6 7 5 3 5 32
7 7 7 7 7 7 42
6 7 6 6 4 5 34
3 6 6 6 3 6 30
5 6 7 6 4 4 32
5 6 6 6 6 2 31
6 6 7 7 4 4 34
7 7 7 7 7 7 42
7 7 7 7 7 7 42
5 7 7 7 4 3 33
5 6 6 6 6 6 35
6 7 6 7 6 6 38
5 7 7 7 5 5 36
5 6 7 6 3 4 31
5 6 5 6 5 5 32
6 6 6 7 5 5 35
5 6 7 7 3 4 32
7 7 7 7 7 7 42
6 7 5 4 3 4 29
6 7 7 5 4 6 35
7 7 7 7 6 6 40
6 6 7 6 6 4 35
6 6 6 6 4 4 32
5 1 6 7 4 5 28
6 6 7 6 6 6 37
5 6 7 7 5 7 37
6 6 7 7 5 5 36
5 6 6 6 4 5 32
5 7 7 7 4 4 34
6 7 7 7 4 5 36
7 7 6 7 6 6 39
5 5 6 6 5 5 32
5 5 6 6 4 7 33
5 6 6 4 5 5 31
5 5 5 5 5 6 31
7 6 7 6 7 6 39
6 6 6 7 5 5 35
4 3 5 5 5 5 27
6 6 7 6 5 6 36
6 6 7 6 6 6 37
6 7 6 7 6 6 38
5 7 7 7 5 5 36
5 7 7 7 4 5 35
5 7 7 7 5 2 33
7 3 7 7 2 6 32
4 6 6 6 5 5 32
7 7 7 7 7 7 42
7 7 7 7 6 6 40
6 7 7 6 3 2 31
7 7 7 7 7 7 42
7 7 6 6 7 7 40
4 5 7 4 4 5 29
7 7 7 7 5 7 40
5 7 7 7 7 6 39
4 4 5 5 4 5 27
6 6 6 6 5 6 35
5 6 4 5 6 5 31
6 6 7 7 6 6 38
6 7 7 7 4 4 35
5 6 7 7 5 5 35
7 6 5 6 7 6 37
6 6 7 6 3 4 32
5 5 6 6 5 6 33
2 6 7 7 2 3 27
5 5 7 7 6 6 36
6 6 6 3 3 6 30
6 7 7 6 7 6 39
5 6 6 6 2 3 28
6 5 6 6 4 4 31
2 6 6 6 6 6 32
5 7 7 7 5 5 36
5 4 5 6 3 4 27
5 7 7 7 4 4 34
5 6 5 5 5 5 31
7 6 7 7 7 5 39
5 6 6 6 6 6 35
6 6 6 6 6 6 36
6 6 6 7 4 4 33
6 6 6 5 6 6 35
7 7 7 7 7 7 42
7 7 7 7 7 6 41
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
KPI #VALUE! STD #VALUE! Confidence:

Calculated relative importance


Attractiveness Perspicuity Efficiency Dependability Stimulation
0.15 0.15 0.21 0.18 0.18
0.17 0.17 0.17 0.17 0.17
0.17 0.14 0.20 0.17 0.17
0.17 0.17 0.20 0.20 0.13
0.17 0.17 0.19 0.19 0.14
0.07 0.26 0.26 0.26 0.07
0.19 0.19 0.19 0.19 0.08
0.17 0.17 0.20 0.23 0.10
0.19 0.16 0.16 0.19 0.14
0.18 0.15 0.18 0.18 0.15
0.18 0.18 0.18 0.15 0.13
0.17 0.17 0.17 0.17 0.17
0.16 0.19 0.16 0.16 0.16
0.18 0.18 0.18 0.18 0.15
0.21 0.21 0.21 0.21 0.03
0.15 0.18 0.18 0.18 0.18
0.07 0.20 0.20 0.23 0.13
0.21 0.18 0.18 0.15 0.18
0.16 0.16 0.19 0.19 0.16
0.15 0.18 0.18 0.18 0.15
0.16 0.19 0.19 0.16 0.19
0.16 0.19 0.16 0.16 0.16
0.18 0.18 0.15 0.21 0.15
0.17 0.17 0.19 0.19 0.14
0.16 0.16 0.16 0.18 0.18
0.16 0.16 0.19 0.19 0.16
0.19 0.04 0.27 0.27 0.08
0.18 0.13 0.18 0.18 0.18
0.18 0.18 0.18 0.13 0.18
0.15 0.18 0.18 0.18 0.15
0.16 0.16 0.16 0.18 0.16
0.21 0.15 0.18 0.15 0.12
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.16 0.19 0.19 0.19 0.14
0.15 0.17 0.17 0.17 0.17
0.16 0.16 0.19 0.19 0.14
0.14 0.14 0.20 0.20 0.14
0.17 0.17 0.17 0.17 0.17
0.15 0.18 0.18 0.18 0.18
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.19 0.16 0.19 0.14 0.16
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.19 0.17 0.17 0.17 0.14
0.15 0.18 0.18 0.15 0.15
0.16 0.22 0.19 0.22 0.13
0.15 0.18 0.18 0.15 0.18
0.15 0.15 0.15 0.19 0.19
0.16 0.20 0.12 0.20 0.16
0.17 0.17 0.19 0.17 0.17
0.18 0.18 0.18 0.15 0.18
0.15 0.18 0.18 0.18 0.15
0.17 0.17 0.17 0.17 0.17
0.17 0.20 0.20 0.17 0.11
0.16 0.19 0.16 0.19 0.14
0.18 0.18 0.12 0.21 0.15
0.17 0.17 0.17 0.17 0.17
0.18 0.18 0.18 0.18 0.15
0.15 0.18 0.18 0.18 0.15
0.16 0.18 0.18 0.18 0.13
0.19 0.19 0.15 0.15 0.15
0.17 0.19 0.17 0.14 0.17
0.11 0.18 0.18 0.18 0.16
0.13 0.22 0.22 0.19 0.13
0.07 0.19 0.22 0.19 0.19
0.10 0.24 0.24 0.24 0.03
0.11 0.28 0.22 0.17 0.11
0.19 0.19 0.22 0.11 0.15
0.16 0.16 0.18 0.18 0.16
0.14 0.19 0.19 0.19 0.16
0.15 0.15 0.21 0.21 0.15
0.18 0.16 0.18 0.16 0.16
0.21 0.21 0.24 0.17 0.10
0.17 0.17 0.17 0.17 0.17
0.15 0.18 0.21 0.15 0.15
0.17 0.17 0.15 0.17 0.17
0.17 0.17 0.19 0.19 0.14
0.17 0.13 0.20 0.20 0.13
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.19 0.16 0.16 0.19 0.14
0.15 0.15 0.18 0.15 0.18
0.18 0.15 0.18 0.18 0.15
0.17 0.17 0.17 0.17 0.17
0.09 0.21 0.21 0.21 0.12
0.16 0.19 0.19 0.19 0.14
0.18 0.18 0.18 0.18 0.13
0.18 0.18 0.18 0.18 0.13
0.10 0.21 0.24 0.24 0.10
0.17 0.17 0.17 0.17 0.17
0.11 0.22 0.26 0.22 0.07
0.16 0.18 0.18 0.16 0.16
0.18 0.18 0.18 0.18 0.10
0.21 0.21 0.18 0.12 0.12
0.16 0.22 0.19 0.22 0.13
0.15 0.21 0.18 0.21 0.12
0.19 0.09 0.22 0.16 0.19
0.17 0.19 0.17 0.19 0.14
0.15 0.21 0.21 0.21 0.09
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.16 0.19 0.19 0.16 0.14
0.15 0.21 0.21 0.15 0.12
0.13 0.18 0.16 0.18 0.16
0.06 0.21 0.21 0.21 0.15
0.10 0.24 0.24 0.17 0.14
0.16 0.19 0.19 0.16 0.14
0.17 0.17 0.17 0.14 0.17
0.18 0.13 0.18 0.18 0.18
0.18 0.13 0.18 0.18 0.18
0.16 0.22 0.22 0.19 0.06
0.15 0.18 0.18 0.18 0.15
0.16 0.20 0.20 0.16 0.12
0.17 0.23 0.23 0.17 0.10
0.15 0.18 0.18 0.18 0.15
0.17 0.17 0.17 0.17 0.17
0.17 0.14 0.17 0.17 0.17
0.17 0.17 0.21 0.17 0.14
0.16 0.16 0.18 0.16 0.16
0.15 0.21 0.21 0.21 0.12
0.18 0.18 0.18 0.13 0.18
0.16 0.22 0.13 0.22 0.09
0.16 0.19 0.16 0.19 0.13
0.15 0.21 0.21 0.21 0.09
0.24 0.24 0.14 0.17 0.10
0.14 0.11 0.21 0.18 0.18
0.14 0.19 0.19 0.19 0.17
0.20 0.20 0.20 0.20 0.09
0.15 0.15 0.18 0.21 0.15
0.15 0.18 0.15 0.15 0.18
0.11 0.22 0.22 0.22 0.11
0.18 0.18 0.18 0.18 0.13
0.18 0.21 0.21 0.18 0.15
0.16 0.19 0.19 0.22 0.13
0.17 0.17 0.20 0.13 0.17
0.16 0.19 0.19 0.16 0.14
0.21 0.12 0.21 0.15 0.15
0.14 0.17 0.20 0.20 0.14
0.16 0.19 0.16 0.16 0.16
0.19 0.13 0.19 0.19 0.16
0.18 0.15 0.18 0.12 0.18
0.22 0.19 0.22 0.22 0.03
0.19 0.19 0.22 0.19 0.13
0.16 0.16 0.19 0.19 0.14
0.14 0.19 0.19 0.19 0.14
0.16 0.18 0.18 0.13 0.16
0.17 0.17 0.17 0.20 0.14
0.17 0.19 0.17 0.17 0.17
0.13 0.20 0.20 0.20 0.13
0.17 0.17 0.21 0.17 0.14
0.19 0.19 0.19 0.16 0.13
0.07 0.24 0.24 0.21 0.10
0.16 0.13 0.16 0.16 0.19
0.14 0.17 0.21 0.21 0.14
0.18 0.18 0.18 0.13 0.16
0.15 0.21 0.21 0.21 0.12
0.17 0.17 0.17 0.17 0.17
0.18 0.16 0.16 0.16 0.18
0.14 0.14 0.20 0.17 0.17
0.17 0.15 0.17 0.17 0.17
0.18 0.15 0.21 0.15 0.18
0.18 0.18 0.16 0.16 0.16
0.17 0.14 0.17 0.17 0.17
0.19 0.16 0.19 0.16 0.13
0.14 0.17 0.19 0.17 0.19
0.17 0.17 0.17 0.17 0.17
0.12 0.20 0.20 0.16 0.16
0.19 0.19 0.19 0.16 0.13
0.15 0.18 0.18 0.21 0.15
0.16 0.16 0.19 0.22 0.13
0.15 0.19 0.15 0.15 0.15
0.12 0.20 0.20 0.20 0.08
0.19 0.19 0.22 0.16 0.09
0.17 0.17 0.17 0.17 0.17
0.18 0.21 0.18 0.18 0.12
0.10 0.20 0.20 0.20 0.10
0.16 0.19 0.22 0.19 0.13
0.16 0.19 0.19 0.19 0.19
0.18 0.18 0.21 0.21 0.12
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.15 0.21 0.21 0.21 0.12
0.14 0.17 0.17 0.17 0.17
0.16 0.18 0.16 0.18 0.16
0.14 0.19 0.19 0.19 0.14
0.16 0.19 0.23 0.19 0.10
0.16 0.19 0.16 0.19 0.16
0.17 0.17 0.17 0.20 0.14
0.16 0.19 0.22 0.22 0.09
0.17 0.17 0.17 0.17 0.17
0.21 0.24 0.17 0.14 0.10
0.17 0.20 0.20 0.14 0.11
0.18 0.18 0.18 0.18 0.15
0.17 0.17 0.20 0.17 0.17
0.19 0.19 0.19 0.19 0.13
0.18 0.04 0.21 0.25 0.14
0.16 0.16 0.19 0.16 0.16
0.14 0.16 0.19 0.19 0.14
0.17 0.17 0.19 0.19 0.14
0.16 0.19 0.19 0.19 0.13
0.15 0.21 0.21 0.21 0.12
0.17 0.19 0.19 0.19 0.11
0.18 0.18 0.15 0.18 0.15
0.16 0.16 0.19 0.19 0.16
0.15 0.15 0.18 0.18 0.12
0.16 0.19 0.19 0.13 0.16
0.16 0.16 0.16 0.16 0.16
0.18 0.15 0.18 0.15 0.18
0.17 0.17 0.17 0.20 0.14
0.15 0.11 0.19 0.19 0.19
0.17 0.17 0.19 0.17 0.14
0.16 0.16 0.19 0.16 0.16
0.16 0.18 0.16 0.18 0.16
0.14 0.19 0.19 0.19 0.14
0.14 0.20 0.20 0.20 0.11
0.15 0.21 0.21 0.21 0.15
0.22 0.09 0.22 0.22 0.06
0.13 0.19 0.19 0.19 0.16
0.17 0.17 0.17 0.17 0.17
0.18 0.18 0.18 0.18 0.15
0.19 0.23 0.23 0.19 0.10
0.17 0.17 0.17 0.17 0.17
0.18 0.18 0.15 0.15 0.18
0.14 0.17 0.24 0.14 0.14
0.18 0.18 0.18 0.18 0.13
0.13 0.18 0.18 0.18 0.18
0.15 0.15 0.19 0.19 0.15
0.17 0.17 0.17 0.17 0.14
0.16 0.19 0.13 0.16 0.19
0.16 0.16 0.18 0.18 0.16
0.17 0.20 0.20 0.20 0.11
0.14 0.17 0.20 0.20 0.14
0.19 0.16 0.14 0.16 0.19
0.19 0.19 0.22 0.19 0.09
0.15 0.15 0.18 0.18 0.15
0.07 0.22 0.26 0.26 0.07
0.14 0.14 0.19 0.19 0.17
0.20 0.20 0.20 0.10 0.10
0.15 0.18 0.18 0.15 0.18
0.18 0.21 0.21 0.21 0.07
0.19 0.16 0.19 0.19 0.13
0.06 0.19 0.19 0.19 0.19
0.14 0.19 0.19 0.19 0.14
0.19 0.15 0.19 0.22 0.11
0.15 0.21 0.21 0.21 0.12
0.16 0.19 0.16 0.16 0.16
0.18 0.15 0.18 0.18 0.18
0.14 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
0.18 0.18 0.18 0.21 0.12
0.17 0.17 0.17 0.14 0.17
0.17 0.17 0.17 0.17 0.17
0.17 0.17 0.17 0.17 0.17
#VALUE!

Importance Ratings: Mean and Standard Deviation


Novelty KPI Skala Mean Std.Dev. N Confidence Confidence Interval
0.15 1.80 Attractiveness 5.64 1.21 255 0.15 5.49
0.17 2.22 Perspicuity 6.15 1.02 255 0.13 6.02
0.14 2.57 Efficiency 6.44 0.79 255 0.10 6.34
0.13 2.06 Dependability 6.22 0.94 255 0.12 6.11
0.14 2.43 Stimulation 5.09 1.43 255 0.17 4.91
0.07 0.93 Novelty 5.32 1.24 255 0.15 5.17
0.14 1.41
0.13 1.17
0.16 0.76
Importance Ratings
0.15 2.51
0.18 2.37 7.00
0.17 1.64
0.16 0.84 6.00
0.15 1.73
0.12 1.36
5.00
0.15 1.99
0.17 1.28
0.12 1.32 4.00

0.14 2.81
0.15 2.06 3.00
0.10 2.63
0.16 0.92 2.00
0.15 1.88
0.14 1.05
1.00
0.16 0.89
0.16 #VALUE!
0.15 #VALUE! 0.00
Attractiveness Perspicuity Efficiency Dependability Stimulation Novelty
0.15 #VALUE!
0.18 #VALUE!
0.18 #VALUE!
0.18 #VALUE!
0.18 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.14 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.18 #VALUE!
0.09 #VALUE!
0.18 #VALUE!
0.19 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.13 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.18 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.18 #VALUE!
0.13 #VALUE!
0.15 #VALUE!
0.14 #VALUE!
0.11 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.12 #VALUE!
0.16 #VALUE!
0.07 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.14 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.18 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.14 #VALUE!
0.15 #VALUE!
0.13 #VALUE!
0.10 #VALUE!
0.17 #VALUE!
0.11 #VALUE!
0.16 #VALUE!
0.18 #VALUE!
0.15 #VALUE!
0.09 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.15 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.18 #VALUE!
0.18 #VALUE!
0.18 #VALUE!
0.10 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.18 #VALUE!
0.16 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.10 #VALUE!
0.18 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.14 #VALUE!
0.18 #VALUE!
0.09 #VALUE!
0.18 #VALUE!
0.19 #VALUE!
0.16 #VALUE!
0.15 #VALUE!
0.10 #VALUE!
0.18 #VALUE!
0.11 #VALUE!
0.11 #VALUE!
0.15 #VALUE!
0.18 #VALUE!
0.11 #VALUE!
0.18 #VALUE!
0.09 #VALUE!
0.13 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.15 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.16 #VALUE!
0.18 #VALUE!
0.13 #VALUE!
0.09 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.18 #VALUE!
0.14 #VALUE!
0.14 #VALUE!
0.13 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.19 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.12 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.16 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.19 #VALUE!
0.20 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.20 #VALUE!
0.13 #VALUE!
0.06 #VALUE!
0.12 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.09 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.13 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.13 #VALUE!
0.17 #VALUE!
0.14 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.11 #VALUE!
0.13 #VALUE!
0.18 #VALUE!
0.16 #VALUE!
0.19 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.12 #VALUE!
0.14 #VALUE!
0.15 #VALUE!
0.16 #VALUE!
0.21 #VALUE!
0.16 #VALUE!
0.19 #VALUE!
0.15 #VALUE!
0.14 #VALUE!
0.19 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.16 #VALUE!
0.14 #VALUE!
0.14 #VALUE!
0.06 #VALUE!
0.19 #VALUE!
0.16 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
0.06 #VALUE!
0.17 #VALUE!
0.18 #VALUE!
0.17 #VALUE!
0.18 #VALUE!
0.15 #VALUE!
0.19 #VALUE!
0.17 #VALUE!
0.16 #VALUE!
0.16 #VALUE!
0.11 #VALUE!
0.14 #VALUE!
0.16 #VALUE!
0.13 #VALUE!
0.18 #VALUE!
0.11 #VALUE!
0.17 #VALUE!
0.20 #VALUE!
0.15 #VALUE!
0.11 #VALUE!
0.13 #VALUE!
0.19 #VALUE!
0.14 #VALUE!
0.15 #VALUE!
0.12 #VALUE!
0.16 #VALUE!
0.13 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.12 #VALUE!
0.17 #VALUE!
0.17 #VALUE!
0.15 #VALUE!
Confidence Interval
5.79
6.27
6.54
6.34
5.26
5.47

tion Novelty
Language L1 R1 L2 R2
German unerfreulich erfreulich unverständlich verständlich
English annoying enjoyable not understandableunderstandable
Spanish desagradable agradable no entendible entendible
Portuguese Desagradável Agradável Incompreensível Compreensível
Turkish can sıkıcı sevindirici anlaşılmaz anlaşılır
French Agaçant Agréable Incompréhensible Compréhensible
Italian incresioso gradito incomprensibile comprensibile
Russian неприятный доставляет удоволнепонятный понятный
Chinese 令人不快的 令人愉快的 费解的 易懂的
Japanese 楽しくない 楽しい わかりにくい わかりやすい
Indonesian menyusahkan menyenangkan tak dapat dipahamidapat dipahami
Dutch onplezierig plezierig onbegrijpelijk begrijpelijk
Estonian vastumeelne rõõmupakkuv arusaamatu arusaadav
Slovene nerazveseljiv razveseljiv nerazumljiv razumljiv
Swedish Irriterande Njutbar Obegriplig Begriplig
Greek ενοχλητικό απολαυστικό δυσνόητο κατανοητό
Polish irytujący przyjemny niezrozumiały zrozumiały
Hindi कष्टप्रद मनोरंजक समझ में आता है समझ में नहीं आता है
Bulgarian дразнещ приятен неразбираем разбираем
Czech otravný příjemný nepochopitelný pochopitelný
Malay menjengkelkan menyeronokkan sukar difahami mudah difahami
Persian ‫آزاردهنده‬ ‫رضایت بخش‬ ‫غیرقابل فهم‬ ‫قابل فهم‬
Thai น่าราคาญ น่าสนุ ก เขา้ ใจยาก เขา้ ใจงา่ ย
Danish kedeligt fornøjeligt uforståelige forståelige
Norwegian kjedelig fornøyelig uforståelig forståelig
Finnish ärsyttävä nautittava vaikeasti ymmärrethelposti ymmärrett
Hungarian idegesítő élvezetes érthetetlen érthető
Croatian dosadan zanimljiv nerazumljivi razumljivi
Bosnian dosadan zabavan nerazumljivi razumljivi
Hebrew ‫מעצבן‬ ‫מהנה‬ ‫אינם מובנים‬ ‫מובנים‬
Arabic ‫مزعج‬ ‫ممتع‬ ‫غير مفهوم‬ ‫مفهوم‬
Bengali বিরক্তিকর উপভোগ্য বোধগম্যনয় বোধগম্য
Kannada ಕಿರಿಕಿರಿ ಕಿರಿಕಿರಿ ಅರ್ಥವಾಗದ ಅರ್ಥವಾಗದ
Marathi त्रासदायक आनंददायक समजू शकत नाही समजण्यासारखा
Tamil எரிச்சலூட்டும் இன்பம் புரிந்து கொள்ள முடபுரிகிறது
Slovak obťažujúci pútavý nepochopiteľný pochopiteľný
L3 R3 L4 R4 L5
kreativ phantasielos leicht zu lernen schwer zu lernen wertvoll
creative dull easy to learn difficult to learn valuable
creativo sin imaginacion facil de aprender dificil de aprender valioso
Criativo Sem criatividade De Fácil aprendiza De difícil aprendiz Valioso
yaratıcı yaratıcı olmayan kolay öğrenilir öğrenmesi zor değerli
Moderne Sans fantaisie Appropriation simpAppropriation compApporte de la valeu
creativo privo di fantasia facile da capire difficile da capire di grande valore
креативный неизобретательнылегко освоить трудно освоить создает новые цен
富创造力的 平淡无奇的 容易学会的 难学会的 高品质的
創造的 創造的でない 覚えやすい 覚えにくい 価値がある
kreatif monoton mudah dipelajari sulit dipelajari bermanfaat
creatief saai makkelijk te leren moeilijk te leren waardevol
loominguline tavaline kerge kasutama õppraske kasutama õppväärtuslik
kreativen brez fantazije enostaven za učenj težak za učenje osvežilen
Kreativ Tråkig Lätt att lära sig Svår att lära sig Värdefull
δημιουργικό αναποτελεσματικό εύκολο στη μάθησηδύσκολο στη μάθη πολύτιμο
kreatywny nudny łatwy do nauki trudny do nauki wartościowy
रचनात्मक सुस्त जानने के लिए मुश्किल जानने के लिए आसान मूल्यवान
творчески скучен лесен за научаван труден за научава стойностен
tvůrčí nezáživný jednoduchý na naučobtížný na naučení hodnotný
ada kreativiti tidak bersifat kreatimudah dipelajari sukar dipelajari bermutu
‫خالق‬/‫سازنده‬ ‫بیهوده‬ ‫یادگیری آسان‬ ‫یادگیری سخت‬ ‫ارزشمند‬
สร้างสรรค ์ ราบเรี ยบ เรี ยนรู้ งา่ ย เรี ยนรู้ ยาก มีคุณคา่
kreativ kedelig nemme at lære svære at lære værdifulde
kreativ kjedelig lett å lære vanskelig å lære verdifullt
luova tylsä helposti opittavaa vaikeasti opittavaa arvokasta
kreatív egyhangú könnyen elsajátíthanehezen elsajátíthaértékes
kreativna glupa laki za naučiti složeni za naučiti vrijedni
kreativni dosadni laki za učenje teški za učenje vredni
‫יצירתיים‬ ‫משעממים‬ ‫קלים ללמידה‬ ‫קשים ללמידה‬ ‫רבי ערך‬
‫إبداعية‬ ‫مبتذلة‬ ُ
‫سهل التعل ّم‬ ُ
‫صعب التعل ّم‬ ‫قيِّم‬
সৃষ্টিশীল নিষ্প্রভ শেখাসহজ শেখাকঠিন মূল্যবান্
ಕ್ರಿಯಾಶೀಲತೆ ಕ್ರಿಯಾಶೀಲತೆ ಕಲಿಯಲುಸುಲಭ ಕಲಿಯಲುಸುಲಭ ಬೆಲೆಬಾಳುವ
सर्जनशील नीरस शिकणे सोपे शिकणे कठीण मूल्यवान
ஆக்கப் பூர்வமான மந்தமான படிப்பதற்கு சுலபம் கற்பதற்கு கடினம் மதிப்பு மிக்க
nápaditý tuctový intuitívny neintuitívny hodnotný
R5 L6 R6 L7 R7
minderwertig langweilig spannend uninteressant interessant
inferior boring exciting not interesting interesting
de poco valor aburrido emocionante no interesante interesante
Sem valor Aborrecido Excitante Desinteressante Interessante
adi sıkıcı heyecan verici ilginç olmayan ilginç
Peu de valeur ajoutEnnuyeux Captivant Inintéressant Intéressant
di poco valore noioso appassionante non interessante interessante
посредственный скучный захватывающий неинтересный интересный
低劣的 乏味的 带劲的 无趣的 有趣的
価値がない 退屈だ エキサイティングおもしろくない おもしろい
kurang bermanfaat membosankan mengasyikkan tidak menarik menarik
inferieur vervelend spannend oninteressant interessant
väärtusetu igav põnev ebahuvitav huvitav
uspavajoč dolgočasen napet nezanimiv zanimiv
Värdelös Tråkig Spännande Ointressant Intressant
υποδεέστερο βαρετό συναρπαστικό αδιάφορο ενδιαφέρον
gorszy nudny ekscytujący nieinteresujący interesujący
घटिया उबाऊ दिलचस्प दिलचस्प नहीं दिलचस्प
посредствен скучен вълнуващ безинтересен интересен
podřadný nudný vzrušující nezajímavý zajímavý
kurang bermutu membosankan menyeronokkan tidak menarik minamenarik minat
‫نامطلوب‬ ‫خسته کننده‬ ‫شورانگیز‬ ‫عدم جذابیت‬ ‫جذاب‬
ไร้คุณคา่ น่าเบื่อ น่าตื่นเตน้ ไม น
่ ่ า สนใจ น ่ า สนใจ
ringe kedelige spændende uinteressante interessante
mindre verdifullt kjedelig spennende uinteressant interessant
vähäarvoista pitkäveteistä jännittävää yksitoikkoista kiinnostavaa
jelentéktelen unalmas izgalmas nem érdekes érdekes
neodgovarajući dosadni uzbudljivi nezanimljivi zanimljivi
bezvredni dosadni uzbudljivi nezanimljivi zanimljivi
‫נחותים‬ ‫משעממים‬ ‫מלהיבים‬ ‫לא מעניינים‬ ‫מעניינים‬
‫متدني‬ ‫ممل‬ ‫مثير‬ ‫غير مثير لالهتمام‬ ‫مثير لالهتمام‬
নিকৃ ষ্ট একঘেয়ে উত্তেজনাপূর্ণ আকর্ষণীয়নয় মজাদার
ಬೆಲೆಬಾಳುವ ನೀರಸವಾದ ನೀರಸವಾದ ಕುತೂಹಲವಲ್ಲದ ಕುತೂಹಲವಲ್ಲದ
कनिष्ठ कं टाळवाणा बाहेर पडत आहे मनोरंजक नाही मनोरंजक
தாழ்வான சலிப்பான ஆர்வமான சுவாரஸ்யம் இல்லை சுவாரஸ்யம்
menejcenný nudný vzrušujúci nezaujímavý zaujímavý
L8 R8 L9 R9 L10
unberechenbar voraussagbar schnell langsam originell
unpredictable predictable fast slow inventive
impredecible predecible rapido lento original
Imprevisível Previsível Rápido Lento Original
tahmin edilemeyentahmin edilebilir hızlı yavaş özgün
Imprévisible Prévisible Rapide Lent Original
imprevedibile prevedibile veloce lento originale
непредсказуемый прогнозируемый быстрый медленный изобретательный
无法预测的 可预见的 快的 慢的 独创的
予想がつかない 予想がつきやすい速い 遅い 独特だ
tak dapat diprediksidapat diprediksi cepat lambat berdaya cipta
onvoorspelbaar voorspelbaar snel langzaam origineel
ootamatu ennustatav kiire aeglane leidlik
nepredvidljiv predvidljiv hiter počasen nov
Oförutsägbar Förutsägbar Snabb Långsam Uppfinningsrik
απρόβλεπτο προβλέψιμο γρήγορο αργό εφευρετικό
nieprzewidywalny przewidywalny szybki wolny pomysłowy
अप्रत्याशित उम्मीद के मुताबिक तेज धीमी आविष्कारशील
непредсказуем предсказуем бърз бавен идеен
nepředvídatelný předvídatelný rychlý pomalý vynalézavý
tidak boleh diramalboleh diramalkan cepat perlahan terdapat rekaan ba
‫غیرقابل پیش بینی‬ ‫قابل پیش بینی‬ ‫سریع‬ ‫آهسته‬ ‫مبتکر‬/‫نوآوری‬
ทานายไมไ่ ด้ ทานายได้ รวดเร็ว เชื่องชา้ ชา่ งประดิษฐ์
uforudsigelige forudsigelige hurtigt langsomt opfindsom
uforutsigbare forutsigbare raskt tregt oppfinnsom
arvaamatonta ennakoitavaa nopea hidas kekseliäs
kiszámíthatatlanok kiszámíthatók gyors lassú ötletes
nepredvidljive predvidljive brz spor inventivna
nepredvidljivi predvidljivi brz spor domišljati
‫אינן צפויות‬ ‫צפויות‬ ‫מהיר‬ ‫איטי‬ ‫פורצי דרך‬
‫غير متوقعة‬ ‫متوقعة‬ ‫سريع‬ ‫بطيء‬ ‫مستحدثة‬
অনিশ্চিত অনুমানযোগ্য দ্রুত ধীর উদ্ভাবক
ಊಹಿಸಲು ಸಾಧ್ಯವಾದ ಊಹಿಸಲು ಸಾಧ್ಯವಾದವೇಗ ವೇಗ ಹೊಸದಾಗಿ ಕಂಡುಹಿಡಿ
अंदाजकरतायेतनाही भविष्यवाणीके लीजाऊशकते जलद धीमा शोधक
யூகிக்க முடியவில்ல யூகிக்கக் கூடிய வேகமாக நிதானம் /மெதுவாககண்டுபிடிப்பு
nepredvídateľný predvídateľný rýchly pomalý moderný
R10 L11 R11 L12 R12
konventionell behindernd unterstützend gut schlecht
conventional obstructive supportive good bad
convencional obstructivo impulsor de apoyo bueno malo
Convencional Obstrutivo Condutor Bom Mau
geleneksel engelleyici destekleyici iyi kötü
Conventionnel Rigide Facilitant Bien Médiocre
convenzionale ostruttiva di supporto bene male
консервативный мешающий помогающий хороший плохой
常规的 碍手碍脚的 能提供辅助的 好的 差的
従来どおり 妨げになる 助けられる 良い 悪い
konvensional menghalangi mendukung baik buruk
conventioneel belemmerend ondersteunend goed slecht
konservatiivne takistav abistav hea halb
star se ne da upravljati se z lahkoto upravljdober slab
Fantasilös Hindrande Stödjande Bra Dålig
συμβατικό παρελκυστικό υποστηρικτικό καλό κακό
konwencjonalny przeszkadzający wspierający dobry zły
परम्परागत प्रतिरोधी सहायक अच्छा बुरा
конвенционален възпрепятстващ помагащ добър лош
obvyklý bránící podporující dobrý špatný
berdasarkan kebiasmenghalang menyokong baik tidak baik
‫سنتی‬/‫مرسوم‬ ‫مختل کننده‬ ‫پشتیبان‬ ‫خوب‬ ‫بد‬
ตามแบบแผน ขัดขวาง สนับสนุ น ดี แย ่
traditionsbunden hindrende understøttende godt dårligt
tradisjonell hindrende støttende bra dårlig
perinteinen vaikeuttavaa tukevaa hyvä huono
szokványos hátráltatók támogatók jó rossz
konvencionalna ometajuće korisne dobar loš
uobičajeni ometajući od pomoći dobar loš
‫שגרתיים‬ ‫מכשילות‬ ‫תומכות‬ ‫טוב‬ ‫גרוע‬
‫تقليدية‬ ‫عائقة‬ ‫داعمة‬ ‫جيد‬ ‫سيء‬
গতানুগতিক প্রতিবন্ধক সহায়ক ভালো খারাপ
ಹೊಸದಾಗಿ ಕಂಡುಹಿಡಿ ಪ್ರತಿರೋಧಿಸುವ ಪ್ರತಿರೋಧಿಸುವ ಒಳ್ಳೆಯ ಒಳ್ಳೆಯ
पारंपारिक अडवणूक करणारा आधार देणारा चांगले वाईट
வழக்கமான தடை செய்யும் ஆதரவு நல்ல கெட்ட
tradičný obmedzujúci podporujúci dobrý zlý
L13 R13 L14 R14 L15
kompliziert einfach abstoßend anziehend herkömmlich
complicated easy unlikable pleasing usual
complicado facil repeler atraer convencional
Complicado Fácil Desinteressante Atrativo Comum
karmaşık sade itici çekici alışıldık
Compliqué Simple Repoussant Attractif Habituel
complicato facile repellente attraente usuale
сложный простой отталкивающий заманчивый обыденный
复杂的 简单的 讨厌的 迷人的 传统的
複雑 簡単 嫌いだ 好きだ 普通
rumit sederhana tidak disukai menggembirakan lazim
complex eenvoudig afstotend aantrekkelijk gebruikelijk
keeruline lihtne eemaletõukav ligitõmbav tavaline
kompliciran enostaven odbijajoč privlačen zastarel
Komplicerad Enkel Möter inte behov Möter behov Bakåtsträvande
περίπλοκο εύκολο αντιπαθητικό συμπαθητικό συνηθισμένο
skomplikowany łatwy nieprzyjemny przyjemny zwykły
जटिल आसान नापसंद मनभावन हमेशा की तरह
сложен лесен неприятен приятен обикновен
složitý jednoduchý odpudivý přitažlivý tradiční
menyulitkan mudah tidak disukai disukai biasa
‫پیچیده‬ ‫آسان‬ ‫ناخوشایند‬ ‫خوشایند‬ ‫معمولی‬
ซั บซอ ้ น เรี ย บง า
่ ย ไม น
่ ่ า ชอบได ้ น ่ า ่
ชื นชอบได ้ ดู ทั ่ ว ไป
indviklede nemme frastødende tiltalende sædvanlig
komplisert lett frastøtende tiltalende vanlig
monimutkaista helppoa vastenmielinen houkutteleva tavanomainen
bonyolult könnyű visszataszító vonzó átlagos
komplicirani jednostavni odbojna  privlačan uobičajena
složeni jednostavni odbojna  privlačno svakodnevni
‫מסובכים‬ ‫ קלים‬ ‫לא מושכת‬ ‫ושך‬  ‫רגילים‬
‫معقَّد‬ ‫ سهل‬ ‫غير جذابة‬ ‫جذابه‬  ‫اعتيادية‬
জটিল সহজ প্রত্যাখ্যান   আবেদন সাধারণ
ಕ್ಲಿಷ್ಟಕರ ಕ್ಲಿಷ್ಟಕರ ಆಕರ್ಷಣೀಯವಾಗಿಲ್ಲ  ಆಕರ್ಷಣೀಯವಾಗಿಲ್ಲ  ಸಾಮಾನ್ಯ
बिकट सोपे आकर्षक नाही आकर्षक नेहमीच्या
சிக்கலான சுலபம் நிராகரித்து  கவர்ச்சியூட்டுகிற சாதாரணமான
zložitý jednoduchý odpudzujúci potešujúci bežný
R15 L16 R16 L17 R17
neuartig unangenehm angenehm sicher unsicher
leading edge unpleasant pleasant secure not secure
novedoso incomodo comodo seguro inseguro
Vanguardista Incómodo Cómodo Seguro Inseguro
eşi görülmedik keyifsiz keyifli güvenli güvensiz
Avant-gardiste Désagréable Agréable Sécurisant Insécurisant
moderno sgradevole piacevole sicuro insicuro
передовой неприятный приятный надежный ненадежный
新颖的 令人难受的 适意的 稳当的 靠不住的
斬新的 嬉しくない 嬉しい 安全だ 安全でない
terdepan tidak nyaman nyaman aman tidak aman
nieuw onaangenaam aangenaam vertrouwd niet vertrouwd
uuenduslik ebameeldiv meeldiv turvaline ebaturvaline
modern neprijeten prijeten napovedljiv nenapovedljiv
I framkant Inte tilltalande Tilltalande Säker Inte säker
πρωτοπόρο δυσάρεστο ευχάριστο ασφαλές ανασφαλές
skrajny niemiły miły bezpieczny niebezpieczny
अग्रणी धार अप्रिय सुखद सुरक्षित सुरक्षित नहीं
иновативен противен приятен сигурен несигурен
moderní protivný milý jistý nejistý
mempunyai kelebihtidak menyenangkamenyenangkan terjamin tidak terjamin
‫پیشرو در فناوری‬ ‫مطلوب‬ ‫نامطلوب‬ ‫امن‬ ‫نا امن‬

ดูชันนา ไมน ่ ่ า ชม น ่ า ่
ชื นชม ปลอดภ ั ย ไม ป
่ ลอดภ ั ย
avanceret ubehageligt behageligt sikre usikre
ledende lite tiltalende tiltalende sikre ikke sikre
huippulaatuinen epämiellyttävä miellyttävä turvallista ei turvallista
élvonalban lévő kellemetlen kellemetlen biztonságosak nem biztonságosak
predvodnička neprijatan prijatan sigurne nesigurne
vrhunski neprijatan prijatan bezbedni nebezbedni
‫בחזית החדשנות‬ ‫לא נעים‬ ‫נעים‬ ‫בטוחות‬ ‫אינן בטוחות‬
‫استشرافية‬ ‫غير مريح‬ ‫مريح‬ ‫مضمونة‬ ‫غير مضمونة‬
নেতৃ স্থানীয় অপ্রীতিকর আনন্দদায়ক নিরাপদ নিরাপদনয়
ಸಾಮಾನ್ಯ ಅಹಿತವಾದ ಅಹಿತವಾದ ಸುರಕ್ಷಿತ ಸುರಕ್ಷಿತ
पुढचे टोक अप्रिय आनंददायी सुरक्षित सुरक्षित नाही
முன்னணி விளிம்பு விரும்பத் தகாத இனிமையான பாதுகாப்பு பாதுகாப்பு இல்லை
špičkový nepríjemný príjemný spoľahlivý nespoľahlivý
L18 R18 L19 R19 L20
aktivierend einschläfernd erwartungskonformnicht erwartungskoineffizient
motivating demotivating meets expectationsdoes not meet expeinefficient
activante adormecedor cubre expectativas no cubre expectativineficiente
Motivante Desmotivante Atende as expectatiNão atende as expeIneficiente
canlandırıcı uyutucu beklentilere uygun beklentileri karşıl verimsiz
Stimulant Soporifique Répond aux attenteNe répond pas aux Inefficace
attivante soporifero aspettativo non aspettativo inefficiente
увлекательный однообразный соответствует ож не соответствует неэффективный
令人兴奋的 令人昏昏欲睡的 符合预期的 不合期望的 低效的
モチベーションをモチベーションを期待に合う 期待に合わない 効率が悪い
memotivasi tidak memotivasi memenuhi ekspektatidak memenuhi ekstidak efisien
motiverend demotiverend volgens verwachtinniet volgens verwa inefficiënt
motiveeriv vähemotiveeriv vastab ootustele ei vasta ootustele ebaefektiivne
raznolik enoličen zanesljiv nezanesljiv ni učinkovit
Motiverande Omotiverande Möter förväntningarMöter inte förväntnIneffektiv
ενθαρρυντικό αποθαρρυντικό ανταποκρίνεται στιδεν ανταποκρίνεταιανεπαρκές
motywujący demotywujący spełnia oczekiwanianie spełnia oczekiwnieefektywny
प्रेरित प्रेरणाहीन अपेक्षाओं को पूरा करता अपेक्षाओं को पूरा नहीं करता अक्षम
мотивиращ демотивиращ отговаря на очакв не отговаря на оч неефикасен
motivující demotivující splňuje očekávání nesplňuje očekávánneefektivní
mendorong tidak mendorong memenuhi jangkaa tidak memenuhi ja tidak berkesan
‫ایجادانگیزه‬ ‫عدم ایجادانگیزه‬ ‫عدم مطابقت با انتظار مطابق انتظار‬ ‫عدم کفایت‬
เพิ่มแรงจูงใจ ลดแรงจูงใจ ตรงตามที่คาดหวัง ไมต่ รงตามที ่ ค าดหวั ง ไร้ ป ระสิ ทธิ ภาพ
motiverende demotiverende på højde med forveikke på højde med ineffektivt
motiverende demotiverende oppfyller forventni oppfyller ikke forv ineffektivt
motivoivaa ei-innostavaa odotuksiani vastaa odotuksiani vastaa tehoton
motiváló demotiváló megfelelnek az elv elvárásoknak nem hatékony
motivirajući demotivirajući ne ispunjavaju očekne ispunjavaju očekneučinkovit
motivišući sputavajući ne ispunjavaju očekne ispunjavaju očekneefikasan
‫אינן עומדות בציפיות אינן עומדות בציפיות פוגעים במוטיבציה לים את המוטיבציה‬ ‫לא יעיל‬
ِّ
‫مشجع‬ ّ ِ ‫غير ُم‬
‫شجع‬ ‫ال تفي بالتوقعات‬ ‫ال تفي بالتوقعات‬ ‫فعال‬
َّ ‫غير‬
অনুপ্রেরণাদায়ক অনুপ্রেরণাদায়ক নয় প্রত্যাশাপূরণকরে না প্রত্যাশাপূরণকরে না অকার্যকর
ಪ್ರೋತ್ಸಾಹವಾಗಿರುವುದಪ್ರೋತ್ಸಾಹವಾಗಿರುವುದನಿರೀಕ್ಷೆಯಂತೆ ನಡೆಯದನಿರೀಕ್ಷೆಯಂತೆ ನಡೆಯದದಕ್ಷವಲ್ಲದ
प्रेरणादायक अप्रेरणादायक अपेक्षा पूर्ण करत नाही अपेक्षा पूर्ण करत नाही अकार्यक्षम
ஊக்குவிக்கும் ஊக்குவிக்காத எதிர்பார்ப்புகளை பூ எதிர்பார்ப்புகளை பூ திறனற்ற
motivujúci demotivujúci spĺňajúci očakávaninespĺňajúci očakávaneefektívny
R20 L21 R21 L22 R22
effizient übersichtlich verwirrend unpragmatisch pragmatisch
efficient clear confusing impractical practical
eficiente claro confuso no pragmatico pragmatico
Eficiente Evidente Confuso Impraticável Prático
verimli açık kafa karıştırıcı yararsız yararlı
Efficace Clair Déroutant Non pragmatique Pragmatique
efficiente chiaro confuso non pragmatico pragmatico
эффективный наглядный запутанный непрактичный практичный
高效的 一目了然的 令人眼花缭乱的 不实用的 实用的
効率が良い すっきりしているごちゃごちゃして実用的でない 実用的だ
efisien jelas membingungkan tidak praktis praktis
efficiënt overzichtelijk verwarrend onpraktisch praktisch
efektiivne selge ebamäärane ebapraktiline praktiline
učinkovit pregleden ustvarja zmedo deluje zatikajoče deluje tekoče
Effektiv Tydlig Förvirrande Opraktisk Praktisk
επαρκές σαφές μπερδεμένο μη πρακτικό πρακτικό
efektywny przejrzysty zagmatwany niepraktyczny praktyczny
कु शल स्पष्ट भ्रमित अव्यावहारिक व्यावहारिक
ефикасен ясен объркващ непрактичен практичен
efektivní jasný matoucí nepraktický praktický
berkesan jelas mengelirukan tidak praktik praktik
‫مکفی‬ ‫واضح‬ ‫مبهم‬/‫گیج کننده‬ ‫غیرکاربردی‬ ‫کاربردی‬
มีประสิทธิภาพ ชั ดเจน สั บสน ปฏิบัติยาก ปฏิบัติงา่ ย
ydedygtigt tydelige forvirrende upraktisk praktisk
effektivt tydelig forvirrende upraktisk praktisk
tehokas selkeätä sekavaa epäkäytännöllinen käytännöllinen
hatékony világos nehezen értelmezhnem praktikus praktikus
učinkovit jasni zbunjujući nepraktičan praktičan
efikasan jasni zbunjujući nepraktičan praktičan
‫יעיל‬ ‫ברורים‬ ‫מבלבלים‬ ‫לא שימושי‬ ‫שימושי‬
‫فعال‬
َّ ‫واضح‬ ‫ُمربك‬ ‫غير عملي‬ ‫عملي‬
কার্যকর স্পষ্ট বিভ্রান্তিকর অবাস্তব বাস্তব
ದಕ್ಷವಲ್ಲದ ಸ್ಪಷ್ಟತೆ ಸ್ಪಷ್ಟತೆ ವಾಸ್ತವ್ಯವಲ್ಲದ ವಾಸ್ತವ್ಯವಲ್ಲದ
कार्यक्षम स्पष्ट गोंधळात टाकणारे अव्यवहार्य व्यावहारिक
திறன் தெளிவு குழப்பமான சாத்தியமற்றதாக சாத்தியமாகும்
efektívny jasný mätúci nepraktický praktický
L23 R23 L24 R24 L25
aufgeräumt überladen attraktiv unattraktiv sympathisch
organized cluttered attractive unattractive friendly
ordenado sobrecargado atractivo feo simpatico
Organizado Desorganizado Atraente Feio Simpático
derli toplu dağınık cazibeli cazibesiz sempatik
Sobre Surchargé Attrayant Rébarbatif Sympathique
ordinato sovraccarico attrattivo non attrattivo simpatico
организованный перегруженный красивый отвратительный доброжелательны
井然有序的 杂乱无章的 吸引人的 无吸引力的 引起好感的
整理されている 整理されていない魅力がある 魅力がない 感じがいい
terorganisasi berantakan atraktif tidak atraktif ramah pengguna
ordelijk rommelig aantrekkelijk onaantrekkelijk aardig
organiseeritud ülekoormatud atraktiivne ebaatraktiivne sümpaatne
prostoren prenatrpan lep grd simpatičen
Strukturerad Rörig Estetisk Oestetisk Användbar
οργανωμένο ανοργάνωτο ελκυστικό απωθητικό φιλικό
zorganizowany zagracony atrakcyjny nieatrakcyjny przyjazny
संगठित अव्यवस्थित आकर्षक अनाकर्षक अनुकू ल
подреден разхвърлян привлекателен непривлекателен лесен за ползване
uspořádaný roztříštěný pěkný ošklivý sympatický
teratur serabut menarik tidak menarik senang digunakan
‫سازماندهی شده‬ ‫بهم ریخته‬ ‫جلب توجه نمی کند جلب توجه کننده‬ ‫مساعد‬
ดูเป็ นระเบียบ ดูวุน
่ วาย ดึ ง ดู ดใจ ไม ด
่ ึ ง ดู ดใจ ดู เป็ น มิ ต ร
organiseret rodet attraktive unattraktive venligt
organisert rotete attraktive skjemmende vennlig
järjestelmällinen sekainen viehättävä epämiellyttävä käyttökelpoinen
jól szervezett szervezetlen szép nem szép barátságos
organiziran neuredan privlačno   neprivlačno prijateljski
organizovan natrpan privlačan  neprivlačan ugodan
‫מאורגן‬ ‫ מסורבל‬ ‫אטקרטיבי‬ ‫לא אטרקטיבי‬  ‫ידידותי‬
‫منظم‬
َّ ‫ مبعثر‬ ‫ج ّ َذاب‬ ‫غير ج َّذاب‬  ‫ودود‬
সংগঠিত এলোমেলো আকর্ষণীয়   অনাকর্ষণীয় বন্ধু ত্বপূর্ণ
ವ್ಯವಸ್ಥಿತವಾದ ವ್ಯವಸ್ಥಿತವಾದ ಆಕರ್ಷಕವಾಗಿದೆ  ಆಕರ್ಷಕವಾಗಿದೆ  ಸ್ನೇಹಪರವಾದ
संघटित गोंधळलेले आकर्षक आवडत नाही मित्रत्वाचा
ஏற்பாடு இரைச்சலான கவர்ச்சிகரமான   கவர்ச்சியற்றதாக  நட்பாக
prehľadný neprehľadný príťažlivý nepríťažlivý sympatický
R25 L26 R26 Attractiveness Perspicuity
unsympathisch konservativ innovativ Attraktivität Durchschaubarkeit
unfriendly conservative innovative Attractiveness Perspicuity
antipatico conservador innovador Atracción Transparencia
Antipático Conservador Inovador Atractividade Transparência
sempatik olmayan tutucu yenilikçi Çekicilik Anlaşılırlık
Inamical Conservateur Innovant Attraction Compréhensibilité
antipatico conservativo innovativo Attrattività Apprendibilità
недоброжелатель непримечательны инновационный привлекательность ясность
令人反感的 保守的 创新的 吸引力 明晰
感じが悪い 保守的 革新的 見栄え 明快さ
tidak ramah pengg konservatif inovatif Daya tarik Kejelasan
onaardig conservatief innovatief Aantrekkelijkheid Transparantie
ebasümpaatne konservatiivne uuenduslik Atraktiivsus Arusaadavus
nesimpatičen nevpadljiv vpadljiv Atraktivnost Preglednost
Inte användbar Konservativ Innovativ Attraktivitet Tydlighet
εχθρικό συντηρητικό καινοτόμο ελκυστικότητα Ευκρίνεια
nieprzyjazny konserwatywny innowacyjny Atrakcyjność Przejrzystość
प्रतिकू ल रूढ़िवादी नवीन आकर्षण स्पष्टता
труден за ползван консервативен новаторски Атрактивност Лесен за учене
nesympatický konzervativní inovativní Atraktivita Přehlednost
sukar digunakan konservatif inovatif Daya Tarikan Kejelasan
‫نامساعد‬ ‫محافظه کارانه‬ ‫نوآورانه‬ ‫جذابیت‬ ‫شفافیت‬
ดูไมเ่ ป็ นมิตร อนุ รักษ์นิยม เป็ นนวัตกรรม ความน่าดึงดูดใจ ความชั ดเจน
uvenligt konservativ innovative Tiltrækningskraft Klarhed
uvennlig ledende innovativ Attraktivitet Klarhet
vahingollinen vanhoillinen innovatiivinen Miellyttävyys Selkeys
barátságtalan konzervatív innovatív Kellem Áttekinthetőség
neprijateljski konzervativna inovativna Privlačnost Razumljivost
neugodan konzervativni inovativni Privlačnost Razumljivost
‫לא ידידותי‬ ‫שמרניים‬ ‫חדשניים‬ ‫בהירות אטרקטיביות‬
‫غير ودود‬ ‫محافظة‬ ‫ابتكارية‬ ‫الجاذبية‬ ‫الوضوح‬
বন্ধু ত্বসুলভ নয় রক্ষণশীল উদ্ভাবনী আকর্ষণীয়তা সুস্পষ্টতা
ಸ್ನೇಹಪರವಾದ ಪುರಾತನ ಪುರಾತನ ಆಕರ್ಷಕವಾದ ಪಾರದರ್ಶಕತೆ
अ मित्रत्वाचा पुराणमतवादी नाविन्यपूर्ण आकर्षण सुस्पष्टता
அன்பில்லாத பழமையான புதுமையான கவர்ச்சி தெளிவு குறித்த
nesympatický konzervatívny inovatívny Atraktívnosť Učebnosť
Efficiency Dependability Stimulation Novelty
Effizienz Steuerbarkeit Stimulation Originalität
Efficiency Dependability Stimulation Novelty
Eficiencia Controlabilidad Estimulación Novedad
Eficiência Controlo Estimulação Inovação
Verimlilik Güvenilirlik Canlılık Yenilikçilik
Efficacité Contrôlabilité Stimulation Originalité
Efficienca Controllabilità Stimolazione Originalità
эффективность надежность стимуляция новинка
效率 可靠性 促進 新奇
効率 信頼性 刺激 ノベルティ
Efisiensi Ketepatan Stimulasi Kebaruan
Efficiëntie Bestuurbaarheid Stimulatie Originaliteit
Tõhusus Usaldusväärsus Stimuleerimine Uudsus
Učinkovitost Vodljivost Stimulativnost Originalnost
Effektivitet Pålitlighet Stimulering Aktualitet
Αποδοτικότητα Αξιοπιστία Διέγερση Καινοτομία
Efektywność Zależność Poziom stymulacji Oryginalność
दक्षता विश्वसनीय उत्तेजना नवीनता
Ефикастност Контролируемост Стимулация Новаторство
Účinnost Spolehlivost Stimulace Originalita
Kecekapan Kebergantungan Pendorongan Terdapat kebaharuan
‫کارایی‬ ‫قابلیت اطمینان‬ ‫انگیزش‬ ‫نوآوری‬
อยา่ งมีประสิทธิภาพ ควบคุม การกระตุน้ ความแปลก
Ydeevne Pålidelighed Stimulering Nyhedsværdi
Effektivitet Pålitelighet Motivasjon Nyhet
Tehokkuus Toimintavarmuus Kannustavuus Uutuus
Hatékonyság Megbízhatóság Ösztönzés Újszerűség
Učinkovitost Pouzdanost Stimulacija Novina
Efikasnost Pouzdanost Stimulacija Novina
‫יעילות‬ ‫מהימנות‬ ‫תמרוץ‬ ‫חידוש‬
‫الكفاءة‬ ‫القابلية للتحكُّم‬ ‫التحريك‬ ‫الحداثة‬
দক্ষতা নির্ভ রতা উদ্দীপনা নূতনত্ব
ದಕ್ಷತೆ ಆಸರೆಯಾಗಿರುವುದು ಉತ್ತೇಜನ ಹೊಸತನ
कार्यक्षमता अवलंबित्व उत्तेजन नवलाईचीगोष्ट
திறன் (திறமை ) சார்ந்திருக்கும் தூண்டுதல் புதுமை
Účinnosť Ovládateľnosť Stimulácia Novinkou
Pragmatic Quality Hedonic Quality
Pragmatische Qualität Hedonische Qualität
Pragmatic Quality Hedonic Quality
Calidad Pragmática Calidad Hedónico
Qualidade Pragmática Qualidade Hedônica
Pragmatik Kalite Hedonik Kalite
Qualité Pragmatique Qualité Hédonique
Qualità Pragmatico Qualità eEonica
Прагматический качесгедонистической качества
务实的品质 享乐质量
実用的な品質 ヘドニック品質
Kualitas Pragmatis Kualitas Hedonis
Pragmatische KwaliteitHedonistische Kwaliteit
Pragmaatiline kvaliteetHedooniline kvaliteet (hinnang meeldivuse järgi)
pragmatično kakovostihedonsko kakovosti
Pragmatiska kvaliteter Hedoniska kvaliteter
ρεαλιστική ποιότητα ηδονική ποιότητας
Pragmatyczne jakości Hedoniczna jakości
व्यावहारिक गुणवत्ता सुखात्मक गुणवत्ता
прагматичен качествохедонистична качество
Pragmatická kvalita Hédonická kvalita
Kualiti yang berguna Kualiti Kesenangan
‫کیفیت استفاده‬ ‫کیفیت طراحی‬
คุณภาพในทางปฏิบัติ คุณภาพความเพลิดเพลิน
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatic Quality Hedonic Quality
Pragmatická kvalita Hedonická kvalita
Column1 Evaluasi AwaEvaluasi Desain Perbaikan
Attractivenes 1.04 1.85
Pragmatic Qu 1.29 1.70
Hedonic Qual 0.44 1.65

Perbandingan Skor UEQ Desain Awal & Perbaikan SIMON W


2.00
1.80
1.60
1.40
1.20
1.00
0.80
0.60
0.40
0.20
0.00
Attractiveness Pragmatic Quality

Evaluasi Awal Evaluasi Desain Perbaikan


Q Desain Awal & Perbaikan SIMON Warmadewa

Pragmatic Quality Hedonic Quality

Awal Evaluasi Desain Perbaikan

You might also like