STATISTICAL ANALYSIS

(continued-2)

Serkan Adıgüzel
PhD Candidate
 COURSE FLOW

• Non-parametric Tests • Parametric Tests

• The Mann-Whitney U Test • Independent samples t test
• The Wilcoxon Signed Rank Test • Paired samples t test
• The Kruskal-Wallis Test • The One-Way, Between-Subjects Analysis of Variance (ANOVA)
• The Friedman Test • The One-Way, Repeated Measures Analysis of Variance (ANOVA)
• In general,
• use parametric tests if the scores are normally distributed or dependent
variable is continuous
• use non-parametric tests if the scores are not normally distributed or
dependent variable is not continuous
THE MANN-WHITNEY U TEST
LET’S LOOK AT THE SPSS FILE

• n = 18
 THE MANN-WHITNEY U TEST

• The Mann–Whitney U test is the non-parametric alternative to the Independent-samples t-test. The test
is used to test for differences between two independent groups on ordinal data or non-normal
continuous data.
• Instead of comparing the means of the two groups, as in the case of the t-test, the Mann-Whitney U Test
compares medians.
• What do we need?
• Your sample data should follow a non-normal distribution or each group has less than 25 participants.
• This test doesn’t require continuous data.
• We must know the mean for each group on a dependent variable.
• Use an Mann-Whitney U Test when you want to compare the means of precisely two groups—no more and no
less! Typically, you perform this test to determine whether two population means are different.
• For an example of Mann-Whitney U Test , do students who learn using Method A have a different mean
score than those who learn using Method B?
 HOW TO RUN
THE MANN-WHITNEY U TEST

• Go to Analyze → Nonparametric Tests → Legacy Dialogs → 2 Independent Samples

• You will be presented with the Two-Independent-Samples Tests dialogue box, as shown below:
• A Test Variable(s): The dependent variable(s). This is the continuous variable whose
means will be compared between the two groups. You may run multiple t tests
simultaneously by selecting more than one test variable.
• B Grouping Variable: The independent variable. The categories (or groups) of the
independent variable will define which samples will be compared in the t test. The
grouping variable must have at least two categories (groups); it may have more than two
categories but a t test can only compare two groups, so you will need to specify which
two groups to compare. You can also use a continuous variable by specifying a cut point
to create two groups (i.e., values at or above the cut point and values below the cut point).
• C Define Groups: Click Define Groups to define the category indicators (groups) to use in
the t test. If the button is not active, make sure that you have already moved your
independent variable to the right in the Grouping Variable field. You must define the
categories of your grouping variable before you can run the Independent Samples t Test
procedure.
• D Options: The Options section is where you can set your desired confidence level for the
confidence interval for the mean difference, and specify how SPSS should handle
missing values.
• 1 Use specified values: If your grouping variable is categorical, select Use specified
values. Enter the values for the categories you wish to compare in the Group 1 and Group
2 fields. If your categories are numerically coded, you will enter the numeric codes. If
your group variable is string, you will enter the exact text strings representing the two
categories. If your grouping variable has more than two categories (e.g., takes on values
of 1, 2, 3, 4), you can specify two of the categories to be compared (SPSS will disregard the
other categories in this case).
• Note that when computing the test statistic, SPSS will subtract the mean of the Group 2
from the mean of Group 1. Changing the order of the subtraction affects the sign of the
results, but does not affect the magnitude of the results.
 HOW TO READ
THE MANN-WHITNEY U TEST OUTPUT
• The Descriptive Statistics table looks as follows:
• The Ranks table is the first table that provides information regarding the output of the actual Mann-Whitney
U test.
• The table below is very useful because it indicates which group can be considered as having the higher cholesterol
concentrations, overall; namely, the group with the highest mean rank.
• pecifically, the Test Statistics table provides the test statistic, U statistic, as well as the asymptotic
significance (2-tailed) p-value.

• From this data, it can be concluded that cholesterol concentration in the diet group was statistically
significantly higher than the exercise group (U = 110, p = .014). Depending on the size of your groups,
SPSS Statistics will produce both exact and asymptotic statistical significance levels. Understanding which
one to use is explained in our enhanced guide.
 HOW TO REPORT
INDEPENDENT SAMPLES T TEST

• Examples:
• A Mann-Whitney U test was performed to evaluate whether [dependent variable] differed
by [independent variable].
• The results indicated that (1) there was no significant difference between the [dependent
variable] of [group X of independent variable] and [group Y of independent variable] OR [group
X of independent variable] had significantly higher/lower (2) [dependent variable] than [group Y of
independent variable], U = [value of Mann-Whitney U] (3) (5) OR z = [value of z] (4) (5), p = [value
of p] (6).

• A Mann-Whitney U test was conducted on 24 cars to determine if a new fuel treatment lead to a difference in
mean miles per gallon. Each group had 12 cars. Results showed that the mean mpg was not statistically
significantly different between the two groups (z = -1.279, p = .201) at a significance level of 0.05. Based on
these results, the new fuel treatment does not have a significant impact on the miles per gallon of cars.
• U =192.000, p = .040 or
• z = -2.049, p = .040
THE WILCOXON SIGNED RANK
TEST
LET’S LOOK AT THE SPSS FILE

• n=8
 WILCOXON SIGNED RANK TEST

• The Wilcoxon signed-rank test is the nonparametric test equivalent to the paired samples t-test. As the
Wilcoxon signed-rank test does not assume normality in the data, it can be used when this assumption has
been violated and the use of the dependent t-test is inappropriate.

• What do we need?
• Dependent variable that is continuous or categorical
• Related samples/groups (i.e., dependent observations)
• Random sample of data from the population
• Non-normal distribution of the difference between the paired values
 HOW TO RUN
WILCOXON SIGNED RANK TEST

• Click Analyze > Nonparametric Tests > Legacy Dialogs > 2 Related Samples... on the top menu,
as shown below:
• You will be presented with the Two-Related-Samples Tests dialogue box, as shown below:
• If you want to generate descriptives or quartiles for your variables, select them by clicking on
the Options button and ticking the Descriptive and Quartiles checkboxes in the –Statistics–
area. Also, you can decide how to deal with missing values. You will end up with a screen
similar to the one below:
 HOW TO READ
WILCOXON SIGNED RANK TEST OUTPUT

• The Descriptive Statistics table is where SPSS Statistics has generated descriptive and quartile statistics for your
variables if you selected these options. If you did not select these options, this table will not appear in your
results. You can use the results from this table to describe the Pain Score scores before and after the
acupuncture treatment. As you have used a nonparametric test it is most likely that you should use the
quartiles information to describe both your groups.
• The Ranks table provides some interesting data on the comparison of participants' Before (Pre) and After (Post) Pain
Score. We can see from the table's legend that 11 participants had a higher pre-acupuncture treatment Pain Score than
after their treatment. However, 4 participants had a higher Pain Score after treatment and 10 participants saw no change
in their Pain Score.
• By examining the final Test Statistics table, we can discover whether these changes, due to acupuncture treatment, led
overall to a statistically significant difference in Pain Scores. We are looking for the "Asymp. Sig. (2-tailed)" value, which in
this case is 0.071. This is the p-value for the test. We report the Wilcoxon signed-ranks test using the Z statistic.
 HOW TO REPORT
WILCOXON SIGNED RANK TEST

• Examples:
• A Wilcoxon signed-rank test showed that a 4 week, twice weekly acupuncture treatment course did
not elicit a statistically significant change in lower back pain in individuals with existing lower back
pain (Z = -1.807, p = 0.071).
• “A Wilcoxon Signed-Ranks test indicated that the “Family car” commercial (mean rank = 10.6) was
rated more favorably than the “Youngster car” commercial (mean rank = 4.0), Z = -3.2, p = 0.001.”
• A Wilcoxon Signed Rank Test was performed to determine if there was a statistically significant
difference in the mean mpg before and after a car received fuel treatment. A total of 12 cars were
used in the analysis. The test revealed that there was a statistically significant difference in mean mpg
between the two groups (z = -2.013, p = 0.044). These results indicate that the fuel treatment had a
significant effect on the mpg of a car.
THE KRUSKAL-WALLIS TEST
LET’S LOOK AT THE SPSS FILE

• n = 15
 THE KRUSKAL-WALLIS TEST

• The Kruskal-Wallis test is a rank-based nonparametric test that can be used to determine if there are
statistically significant differences between two or more groups of an independent variable on a continuous or
ordinal dependent variable. It is considered the nonparametric alternative to the one-way ANOVA, and an
extension of the Mann-Whitney U test to allow the comparison of more than two independent groups.
• Your data must meet the following requirements:
• Dependent variable that is continuous or categorical
• Independent variable that is categorical (i.e., two or more groups)
• Independent samples/groups (i.e., independence of observations)
• Random sample of data from the population
• Non-normal distribution of the dependent variable for each group
• This test is also known as, one-way ANOVA on ranks
 HOW TO RUN
THE KRUSKAL-WALLIS TEST

• Click Analyze > Nonparametric Tests > Legacy Dialogs > K Independent Samples... on the top menu as shown
below:
• You will be presented with the "Tests for Several Independent Samples" dialogue box, as shown below:
• Transfer the dependent variable, Pain_Score , into the Test Variable List: box and the independent variable,
Drug_Treatment_Group, into the Grouping Variable: box. You can transfer these variables by either drag-and-dropping
each variable into the appropriate boxes or by highlighting (i.e., clicking on) each variable and using the appropriate Right
arrow button. You will end up with a screen similar to the one below:
• Click on the Define range button. You will be presented with the "Several Independent
Samples: Define Range" dialogue box, as shown below:
• Enter "1" into the Minimum: box and "3" into the Maximum box. These values represent
the range of codes you gave the groups of the independent variable,
Drug_Treatment_Group (i.e., Drug A was coded "1" through to Drug C which was coded
"3"). You will end up with a screen similar to below:
• Click on the Options button. You will be presented with the "Several Independent Samples:
Options" dialogue box, as shown below:
 HOW TO READ
THE KRUSKAL-WALLIS TEST OUTPUT

• You will be presented with the following output (assuming you did not select the Descriptive checkbox in the
"Several Independent Samples: Options" dialogue box):
 HOW TO REPORT
THE KRUSKAL-WALLIS TEST

• Examples:
• A Kruskal-Wallis test showed that there was a statistically significant difference in pain score between
the different drug treatments, χ2(2) = 8.520, p = 0.014, with a mean rank pain score of 35.33 for Drug
A, 34.83 for Drug B and 21.35 for Drug C.
THE FRIEDMAN TEST
LET’S LOOK AT THE SPSS FILE

• n=5
 THE FRIEDMAN TEST

• The Friedman test is the non-parametric alternative to the one-way ANOVA with repeated measures. It is used
to test for differences between groups when the dependent variable being measured is ordinal. It can also be
used for continuous data that has violated the assumptions necessary to run the one-way ANOVA with
repeated measures (e.g., data that has marked deviations from normality).
• Your data must meet the following requirements:
• Dependent variable that is continuous or categorical
• Dependent samples/groups
• Random sample of data from the population
• Non-normal distribution of the dependent variable for each group
 HOW TO RUN
THE FRIEDMAN TEST

• Click Analyze > Nonparametric Tests > Legacy Dialogs > K Related Samples... on the top menu, as shown
below:
• You will be presented with the Tests for Several Related Samples dialogue box, as shown below:
• Transfer the variables none, classical and dance to the Test Variables: box by using the Right arrow button or by
dragging-and-dropping the variables into the box. You will end up with the following screen:
• Click on the Statistics button. You will be presented with the following Several Related
Samples: Statistics dialogue box, as shown below:
 HOW TO READ
THE FRIEDMAN TEST OUTPUT

• The Descriptives Statistics table will be produced if you selected the Quartiles option:
• This is a very useful table because it can be used to present descriptive statistics in your results section for each
of the time points or conditions (depending on your study design) for your dependent variable. This usefulness
will be presented in the "Reporting the Output" section later.
• The Ranks table shows the mean rank for each of the related groups, as shown below:
• The Friedman test compares the mean ranks between the related groups and indicates how the groups differed, and it is
included for this reason. However, you are not very likely to actually report these values in your results section, but most
likely will report the median value for each related group.
• The Test Statistics table informs you of the actual result of the Friedman test, and whether there was an overall
statistically significant difference between the mean ranks of your related groups. For the example used in this
guide, the table looks as follows:
 HOW TO REPORT
THE FRIEDMAN TEST

• Examples:
• There was a statistically significant difference in perceived effort depending on which type of music
was listened to whilst running, χ2(2) = 7.600, p = 0.022.
• A Friedman test indicated that our commercials were rated differently, χ2(2) = 8.65, p = 0.013.
• Friedman test was conducted to determine whether Math test scores differ before, after the
1sttraining, and after 2nd training. The results show non-significant difference, χ2(2) = 2.571, p =
0.276. We, therefore, fail to reject the null hypothesis and conclude that there is no difference in Math
test scores before, after the first, and after the second training.
 NEXT WEEK’S PRESENTATIONS

• Parts;
• Hypothesis
• Variables
• Descriptive Datas (Gender, Age, Income, Education, ….)
• How to make statistical analysis about
• Descriptive Data Analysis
• Distribution Analysis
• Descriptive sampling data and hypothetical variable(s) analysis (relationship, affect)
• Hypothetical Variable Analysis (relationship, affect)
THANK YOU