Educational

Statistics
 Unit # 8
INFERENTIAL STATISTICS
ANOVA
 After completion of unit, the students
will be able to:
1. explain what ANOVA
is.
2.write down the logic behind using
ANOVA.
Learning 3. explain what F-distribution is.
Objectives 4. explain logic behind one-way
ANOVA.
5.explain the assumptions underlying one
way ANOVA.
6. explain multiple comparison
procedures.
 Analysis of Variance (ANOVA) is a
statistical procedure used to test the
ANOV degree to which two or more
A groups vary or differ in an
experiment.
 • Analysis of variance (ANOVA)
is a statistical technique that is
used to check if the means of
Introductio two or more groups are
n to Analysis significantly different from each
of other. ANOVA checks the
Varianc impact of one or more factors
by comparing the means of
e different samples.
(ANOVA
)
 Introduction to Analysis of Variance
(ANOVA)
• The t-tests have one very serious limitation –they are
restricted to tests of the significance of the difference
between only two groups.
• There are many times when we like to see if there
are significant differences among three, four, or
even more groups.
 Introduction to Analysis of Variance
(ANOVA)

The t-tests have one very

serious limitation –they are There are many times when
restricted to tests of the we like to see if there are
significance of the difference significant differences among
between only two groups. three, four, or even more
groups.
 Introduction to Analysis of Variance
(ANOVA)
• For example we cannot use t-test because more
than two groups are involved.
• To deal with such type of cases one of the most
useful techniques in statistics is analysis of
variance (abbreviated as ANOVA).
 Introduction to Analysis of Variance (ANOVA)

• Analysis of Variance (ANOVA) is a hypothesis testing procedure that

is used to evaluate mean differences between two or more treatments
(or population).
• Like all other inferential procedures. ANOVA uses sample data to as a
basis for drawing general conclusion about populations.
• Sometime, it may appear that ANOVA and t-test are two different
ways of doing exactly same thing: testing for mean differences.
Logic of ANOVA
 Types of Variance
Between Groups Design
• Variance simply means difference and to calculate the variance is a
process of measuring how big the differences are for a set of numbers.
• The between-treatment variance is measuring how much difference
exists between the treatment. In addition to measuring differences
between treatments, the overall conditions. The goal of ANOVA is to
evaluate the differences between treatments.
Within Groups
Design
Within each treatment
condition, we have a set
of individuals who are
treated exactly the same
and the researcher does
not do anything that
would cause these visual
participants to have
different scores.
Types of Variance
 Assumptions Underlying the One Way ANOVA
Assumption of Independence
According to this assumption the observations are random and
independent samples from the populations.
• The null hypothesis actually states that the samples come from
populations that have the same mean. The samples must be random
and independent if they are to be representative of the populations.
The value of one observation is not related to any other observation.
In other words, one individual’s score should not provide any clue as
to how any of the other individual.
 Assumption of Normality

• This assumption implies that the dependent variable is normally

distributed in each of the groups.
• The distributions of the population from which the samples are
selected are normal.
 Assumptions of Homogeneity of
Variance
• The variances of the distribution in the populations are equal.
• This assumption provides that the distribution in the population have
the same shapes, means, and variances; that is, they are the same
populations.
• In other words, the variances on the dependent variable are equal
across the groups.
Multiple Comparison
Procedure
• In one-way ANOVA “R2” measures the effect size, it suffers one
possible limitation –it does not indicate which group may be the
responsible for a significant effect.
• All that a significant R2 and F statistic say is that the means for
the groups are unlikely to have been sampled from a single hat of
means.
• Unfortunately, there is no simple, unequivocal statistical solution
to the problem of comparing for different levels of an ANOVA
factor.
 Sometimes, we want to look at more than
two groups of data and compare them.
We want to see if more than two groups of
data are different.
While we could use T-tests to compare the
means from two different groups of data, but
Procedure of we need a different kind of test when
ANOVA on comparing three or more groups.
We can use a 1-Way ANOVA test to compare
SPSS three or more groups or conditions in an
experiment.
A 1-Way ANOVA can help you find out if
the means for each group/condition are
significantly different from one another or if
they are relatively the same.
 • Suppose you want to study the effect of
sugar (IV) on memory for words (DV). You
have three groups (also called conditions)
in your experiment, sugar, a little sugar and
no sugar.
Example • Each participant only participates in one
of ANOVA condition of the experiment. Participants in
the first condition are not related in any way
on SPSS to participants in the second condition or
third condition.
• Because the participants in each condition
are not related in any way, we will use the
1-Way Between Subjects ANOVA.
 The F-distribution is a skewed distribution
of probabilities similar to a chi-squared
The F- distribution.
But where the chi-squared distribution deals
Distributi with the degree of freedom with one set of
on variables, the F-distribution deals with
multiple levels of events having different
degrees of freedom.
 Interpretation of the F-Statistic

• The denominator in the F-statistic normalizes our estimate of the variance

assuming that Ho is true. Hence, if F = 2, then our sample has two times as
much variance as we would expect if Ho were true. If F = 10, then our
sample has 10 times as much variance as we would expect if Ho were true.
Ten times is quite a bit more variance than we would expect. In fact, for
denominator degrees of freedom larger than 4 and any number of
numerator degrees of freedom, we would reject Ho at the 5% level with an
F-statistic of 10.
One Way ANOVA (Logic and Procedure)

• The one way analysis of variance (ANOVA) is an extension of independent two-

sample t-test. It is a statistical technique by which we can test if three or more
means are equal. It tests if the value of a single variable differs significantly
among three or more level of a factor. We can also say that one way ANOVA is a
procedure of testing hypothesis that K population means are equal, where K ≥ 2.
It compares the means of the samples or groups in order to make inferences about
the population means. Specifically, it tests the null hypothesis:
• Ho : μ1 = μ2 = μ3 = ... = μk
Where μ = group mean and k = number of groups
 One Way ANOVA (Logic and Procedure)

• If one way ANOVA yields statistically significant result, we accept the

alternate hypothesis (HA), which states that there are two group means that
are statistically significantly different from each other. Here it should be
kept in mind that one way ANOVA cannot tell which specific groups were
statistically significantly different from each other. To determine which
specific groups are different from each other, a researcher will have to use
post hoc test.
One Way ANOVA (Logic and Procedure)

• As there is only one independent variable or factor in one

way ANOVA so it is also called single factor ANOVA.
• The independent variable has nominal levels or a few
ordinal levels.
• Also, there is only one dependent variable and hypotheses
are formulated about the means of the group on dependent
variable.
• The dependent variable differentiates individuals on some
quantitative dimension.
Assumptions Underlying the One Way ANOVA
• There are three main assumptions
i) Assumption of Independence
According to this assumption the observations are random and
independent samples from the populations. The null hypothesis actually
states that the samples come from populations that have the same mean.
The samples must be random and independent if they are to be
representative of the populations. The value of one observation is not
related to any other observation. In other words, one individual’s score
should not provide any clue as to how any of the other individual should
score. That is, one event does not depend on another.
 Assumption of Normality
• The distributions of the population from which the samples are
selected are normal. This assumption implies that the dependent
variable is normally distributed in each of the groups.
Assumptions of Homogeneity of Variance
Logic Behind One Way
ANOVA
 • In using ANOVA manually we
need first to compute a total
sum of squares (SS total) and
Procedure for
then partition this value into
Using two components: between
ANOVA treatments and within
treatments.
The Total • It is the total sum of square for
Sum of the entire set of N scores. It
can be calculated using
Squares (SS computational formula for SS
Total)
Sum of Squares within
Treatments (SS Within)

The sum of square inside

each treatment can be
calculated as:
SS within = SS1 + SS2 +
… + SSn
= Σ SS Inside each
treatment
Sum of Squares Between Treatments (SS Between)
Multiple Comparison
Procedure
 Multiple Comparison Procedure
• Most of the multiple-comparisons methods are meant to pair-wise
comparisons of group means, to determine which are significantly
from which others.
• The main purpose of most multiple-comparison procedures is to
control the overall significance level, for some set of interferences
performed as a follow-up to ANOVA.
• This overall significance level is the probability, conditional on all the
null hypotheses being tested being true, of rejecting at least one of
them, or equivalently, of having at least one confidence interval not
include the true value.
 Multiple Comparison Procedure
• The various methods differ in how well they properly control the
overall significance level and in their relative power.
• To fully understand group differences in an ANOVA, researchers must
conduct tests of the differences between particular pairs of
experimental and control groups. ... A class of post hoc tests that
provide this type of detailed information for ANOVA results are called
“multiple comparison analysis” tests.