Lecture 10 - ANOVA
Lecture 10 - ANOVA
The assumptions of the ANOVA test are the same as the general assumptions for any parametric
test:
oThe dependent variable must be a continuous (interval or ratio) level of measurement. The
independent variables in ANOVA must be categorical (nominal or ordinal) variables
oThe population from which samples are drawn should be normally distributed.
oIndependence of cases: the sample cases should be independent of each other.
oHomogeneity of variance: Homogeneity means that the variance among the groups should be
approximately equal.
It is important to note that ANOVA is not robust to violations to the assumption of
independence. This is to say, that even if you violate the assumptions of homogeneity or normality,
you can conduct the test and basically trust the findings. However, the results of the ANOVA are
invalid if the independence assumption is violated.
Example
Your independent variable is social media use, and you assign groups to low, medium, and high
levels of social media use to find out if there is a difference in hours of sleep per night.
For example, suppose you want to check degree of jealousy among different attachment styles
namely secure, avoidant, and anxious-ambivalent.
The research hypothesis would be that the degree of jealousy differs among these three
populations.
For example, if you want to check whether there is a difference in life satisfaction among
different groups of ethnic backgrounds. (i.e. Punjabi, sindhi, Balochi, pathan, Kashmiri, Balti)
Types of ANOVA
One way ANOVA
Two way ANOVA
N way ANOVA
One-Way vs. Two-Way
ANOVA
A one-way ANOVA evaluates the impact of a sole factor on a sole response variable. The one-
way ANOVA is used to determine whether there are any statistically significant differences
between the means of three or more independent groups.
A two-way ANOVA is an extension of the one-way ANOVA. With a one-way, you have one
independent variable affecting a dependent variable. With a two-way ANOVA, there are two
independents.
For example, a two-way ANOVA allows a company to compare worker productivity based on two
independent variables, such as salary and skill set. It is utilized to observe the interaction
between the two factors and test the effect of two factors simultaneously.
One-Way ANOVA
Number of Factors: It analyzes one factor or independent variable.
Main Purpose: Its primary purpose is to compare the means of two or more groups to determine if
there are statistically significant differences among them.
Example: For instance, you might use it to compare the test scores of students in different classes.
Types of Variation and Sources: One-Way ANOVA considers two types of variation: within-group
(variation within each group) and between groups (variation between different groups).
Hypotheses Tested: It tests the null hypothesis and checks whether all group means are equal.
Interpretation of Results: One-Way ANOVA helps you determine if there are significant differences
in at least one group mean compared to the others.
Applicability: It is useful when comparing multiple independent groups with one categorical
independent variable.
Two-Way ANOVA
Number of Factors: It simultaneously analyzes two factors or independent variables.
Main Purpose: Its main goal is to assess the impact of two independent factors on a dependent variable
and whether their interaction significantly influences the dependent variable.
Example: It assesses how drug type and dosage levels independently and interactively affect outcomes.
Types of Variation and Sources: Two-Way ANOVA considers variation within each factor (within-group
variation for each factor) and the interaction between factors.
Hypotheses Tested: It tests multiple null hypotheses, including the main effects of each factor and the
interaction effect between the factors.
Interpretation of Results: Two-Way ANOVA provides insights into how each factor and their interaction
affect the dependent variable.
Applicability: It is appropriate when investigating the effects of two independent factors on a dependent
variable.
N-Way ANOVA
When researchers have more than two factors to consider, they turn to N-Way ANOVA, where
“n” represents the number of independent variables in the analysis. This could mean examining
how IQ scores are influenced by a combination of factors like country, gender, age group, and
ethnicity all at once. N-Way ANOVA allows for a comprehensive analysis of how these multiple
factors interact with each other and their combined effect on the dependent variable, providing
a deeper understanding of the dynamics at play.
Analysis of Variance
To understand the logic of analysis of variance, we consider variances.
Variance measures how far a set of data is spread out. Variance is the average of the squared
distances from each point to the mean.
In particular, there are two different ways of estimating population variances.
◦ within-groups estimate of the population variance
◦ between-groups estimate of the population variance
Within-group Variance
Within-groups estimate of variance is an estimate that how scores of individuals within a group
varies in the same group.
It focuses on variation within each of the groups being studied.
Between-group Variance
Between-groups estimate of the population variance is how mean of different groups are varied
from each other.
It focuses on the means of all the groups under study.
F ratio
F ratio is a ratio of the between-groups population variance estimate to the
within-groups population variance estimate.
F = Between- group estimate
within-group estimate
Effect Size
Effect size of ANOVA is called eta squared.
Effect size is a measure of the strength of the relationship between variables.
Effect sizes are important because whilst the one-way ANOVA tells you whether differences
between group means are "real" (i.e., different in the population), it does not tell you the
"size" of the difference.