SPSS Intermediate Advanced Statistical Techniques
SPSS Intermediate Advanced Statistical Techniques
Advanced Statistical
Techniques for Difference
Questions
Pawel Skuza
Statistical Consultant
eResearch@Flinders / Central Library
Statistical
Consulting
Website
http://www.flinders.
edu.au/library/rese
arch/eresearch/stati
stics-consulting/
or go to Flinders
University Website
A-Z
Index S
Statistical
Consultant
Introductory Level
Introduction to IBM SPSS
Introduction to Statistical Analysis
IBM SPSS - Intermediate Level
Understanding Your Data (Descriptive
Statistics, Graphs and Custom Tables)
Correlation and Multiple Regression
Logistic Regression and Survival
Analysis
Basic Statistical Techniques for
Difference Questions
Advanced Statistical Techniques
for Difference Questions
Longitudinal Data Analysis Repeated Measures ANOVA
Categorical Data Analysis
IBM SPSS - Advanced Level
Structural Equation Modelling using Amos
Linear Mixed Models
Longitudinal Data Analysis - Mixed and
Latent Variable Growth Curve Models
Scale Development
Complex Sample Survey Design / ABS and
FaHCSIA Confidentialised Datasets
(1) How to
check?
SPSS
Statistical Package for the Social Sciences
PASW
Predictive Analytics Software
START SOFTWARE
HELP ABOUT
http://www.flinders.edu.au/library/research/eresearch/statistics-consulting/spsslicenses-and-technical-support/licenses-for-university-and-home.cfm
Pawel Skuza 2013
Ratio Data
Differences between
measurements, true
zero exists
Temperature in Celsius,
Standardized exam score
Interval Data
Differences between
measurements but no
true zero
Ordinal Data
Ordered Categories
(rankings, order, or scaling)
Nominal Data
MEASUREMENT
Parametric
Statistics
Nonparametric
Statistics
Dependent Variable
Approximates Normal
(Scale) Data and
Assumptions Not
Markedly Violated
Dependent Variable
Clearly Ordinal Data or
the Assumptions Are
Markedly Violated
Dependent Variable is
Nominal or
(dichotomous) Data
Compare
Example 1
Figure 4.11 from Dancey, C. P., & Reidy, J. (2004). Statistics without maths
for psychology : using SPSS for Windows (3rd ed.). New York: Prentice
Hall.
Example 2
Table from Pallant, J. (2007). SPSS Survival Manual : A step by step guide
to data analysis using SPSS for Windows (SPSS Version 15) (3rd ed.).
Maidenhead, Berkshire. U.K. ; New York, NY: Open University Press.
Example 3
Flowchart from http://gjyp.nl/marta/Flowchart%20(English).pdf
Level of Measurement
of Dependent Variable
Independent
Samples or
Groups (Between)
Repeated Measures
or Related Samples
(Within)
Means
ONE-WAY ANOVA
GLM REPEATED
MEASURES ANOVA
Parametric
Statistics
Mean
Ranks
KRUSKALWALLIS H TEST
FRIEDMAN TEST
Nonparametric
Statistics
Counts
CHI-SQUARE
SIGNIFICANCE
TEST
COCHRAN Q TEST
Compare
Independent
Samples or
Groups (Between)
Repeated Measures
or Related Samples
(Within)
Dependent Variable
Approximates Normal
(Scale) Data and
Assumptions Not
Markedly Violated
Dependent Variable
Clearly Ordinal Data or
the Assumptions Are
Markedly Violated
Means
Analyze Compare
Means One-Way
ANOVA
Analyze General
Linear Model
Repeated Measures
Mean
Ranks
Analyze
Nonparametric Tests
k Independent
Samples
Analyze
Nonparametric Tests
k Related Samples
Dependent Variable is
Nominal or
(dichotomous) Data
Counts
Analyze
Descriptive Statistics
Crosstabs
Analyze
Nonparametric Tests
k Related Samples
ANOVA Terminology
Factor
Factor
Treatment
A categorical variable
Sometimes called the cause
Levels
The categories of the factor
The treatment levels
One
Two
Three
X11
X21
X31
X12
X22
X32
X13
X23
X33
Xn1
Xn2
Xn3
X1
X2
X3
s12
s22
s32
Treatment
levels
Replicates
and their
scores on a
dependent
variable
Replicate
The subjects
Balanced
The same number of replicates (subjects) in each treatment level
Unbalanced
Different number of replicates (subjects) in each treatment
condition
Pawel Skuza 2013
Null hypothesis
Alternative hypothesis
H o : 1 2 ... J
At least one
mean is
different
from the
other means
SST ( X 11 X ) 2 ( X 12 X ) 2 ... ( X ni n j X ) 2
Response ,
X
nj
SST ( X ij X ) 2
j 1 i 1
Where:
Group 1
Group 2
Group 3
Pawel Skuza 2013
Among-Group Variation
Among-Group Variation
SST = SSB + SSW
SS B n1 ( x1 x ) 2 n2 ( x2 x ) 2 ... nJ ( xJ x ) 2
Response, X
SS B n j ( X j X ) 2
j 1
Where:
X3
X1
X2
J = number of groups
nj = sample size from group j
Xj = sample mean from group j
Group 2
Group 3
Pawel Skuza 2013
Among-Group Variation
Within-Group Variation
SS B n j ( X j X ) 2
j 1
Variation Due to
Differences Among Groups
MSB
SSB
J 1
Response, X
X1
Group 1
Group 2
X2
X3
Group 3
Pawel Skuza 2013
Within-Group Variation
Within-Group Variation
nj
SSW ( X ij Xj ) 2
nj
SSW ( X ij X j ) 2
j 1 i 1
j 1 i 1
Where:
SSW = Sum of squares within groups
J = number of groups
SSW
NJ
MSW
SSW/degrees of freedom
j
Pawel Skuza 2013
SS B
MS B
J 1
MSW
SSW
NJ
MST
SST
N 1
Variation Due
to
Factor
(SSB)
Variation Due
to
Random Sampling
(SSW)
df=J-1
df=N-J
Mean Variation
Between Groups
(SSB)
Mean Variation
Within Groups
(SSC)
SStotal X ij X
J
SS B n j X j X
SSW X ij X j
Source of
Variation
SS
df
Among
Groups
SSB
J-1
Within
Groups
SSW
N-J
Total
SST =
SSB+SSW
N-1
MS
(Variance)
MSB =
MSW =
F ratio
SSB
F=
J-1
MSB
MSW
SSW
N-J
J = number of groups
N = sum of the sample sizes from all groups
df = degrees of freedom
Test statistic
MS B
MSW
Decision Rule:
Reject H0 if F > FU,
otherwise do not
reject H0
Degrees of freedom
df1 = J 1
df2 = N-J
(J = number of groups)
(N = sum of sample sizes from all populations)
= .05
0
Do not
reject H0
Assumptions
Reject H0
FU
Pawel Skuza 2013
Interval data
Independent samples
Multivariate normality
Homogeneity of variances
Absence of outliers
MORE IN
Assumptions
Effect Size
Eta squared
partial Eta squared
omega squared
Intraclass correlation
p2
Eta Squared
Eta squared is the proportion of the total
variance that is attributed to an effect
It is calculated as the ratio of the effect
variance (SSeffect) to the total variance
(SStotal)
ssB
ssT
I
Pawel Skuza 2013
Eta Squared
In our example it would be (4716/5836)=0.8080
Eta Squared
Very easy to calculate
But it is a biased statistic
ssB 4716
0.8080
ssT 5836
This means that schools (the treatment) account for over 80%
of the variation in student achievement
ANOVA
Distance
Between Groups
Within Groups
Total
Sum of
Squares
4716.400
1119.600
5836.000
df
2
12
14
Mean Square
2358.200
93.300
F
25.275
Sig.
.000
Omega Squared
p2
Exercise 1
Is there a difference in average students
mathematics achievement among four groups
established by fathers occupational status?
! Assumptions
http://www.pisa.oecd.org
p 1 1
11
16
21
26
31
36
41
46
51
56
Exercise 2
Is there a difference in average time students allocate
on mathematics among groups established by
students self expected occupational status?
! Assumptions
Exercise_2.sav
Simplified data from PISA 2003 Study Australia &
Indonesia
(The Programme for International Students Assessment)
http://www.pisa.oecd.org
Pawel Skuza 2013
Analysis of covariance
Analysis of covariance
Applications
Analysis of Covariance
Major applications
Increase test sensitivity (main effects and
interactions) by using the CV(s) to account for
more of the error variance therefore making
the error term smaller
Adjust DV scores to what they would be if
everyone scored the same on the CV(s)
This second application is used often in nonexperimental situations where subjects cannot be
randomly assigned
Pawel Skuza 2013
Analysis of Covariance
Default ANCOVA model:
All interactions between factors (as in
ANOVA)
Main effects of covariates
No interactions between factors and
covariates
No interactions between covariates
Assumptions
Typical ANOVA assumptions still hold
In addition there are few more:
(a) Linearity is assumed that each CV has
a linear relationship with the DV and other
CVs
Assumptions
(b) Homogeneity of Regression
the slope of the line predicting the DV from
the CV should be the same for each level
of the IV.
In other words the regression coefficient
(B) relating a CV to the DV should be the
same for each group.
Assumptions
(c) Reliability of Covariates
it is assumed that each CV is measured
without error (this is unrealistic).
Exercise 3
Is there a difference in average students
mathematics achievement among groups established
by fathers occupational status while controlling for
disciplinary climate in the classroom?
! Assumptions
Exercise_3.sav
http://www.pisa.oecd.org
Pawel Skuza 2013
10
Two-way ANOVA
Male
7/10/2013
One
Two
Three
X111
X211
X311
X121
X221
X321
X131
X231
X331
Xn11
X112
X212
X312
Xn21
X122
X222
X322
Xn31
X132
X232
X332
Xn12
Xn22
63 X
n32
Two-Way ANOVA
Assumptions
MORE IN
Garson, G. D. (2012). Univariate GLM, ANOVA, &
ANCOVA. Asheboro, NC: Statistical Associates
Publishers.
http://www.statisticalassociates.com/glm_univariate.htm
OR SIMILAR RESOURCES
11
Examples:
Interaction vs. No Interaction
SST
Total Variation
n-1
SSB
Factor B Variation
c1
SSAB
Variation due to interaction (r 1)(c 1)
between A and B
SSE
Random variation (Error)
rc(n 1)
No interaction:
Interaction is present:
Factor B Level
1
Factor B Level
3
Factor B Level
2
Factor B Level
1
Mean Response
SSA
Factor A Variation
Degrees
of
Freedom:
r1
Mean Response
Factor A Levels
Factor B Level
2
Factor B Level
3
Factor A Levels
Interaction
Main effects
Higher-way ANOVA
n-way => n factors
Full factorial model => all main effects,
plus all 2-way, 3-way, , n-way
interaction terms
If higher-order terms are non-significant
may want to remove from model to give
greater power to estimates of the lowerorder terms
Exercise 4
Is there a difference in average students reading
achievement among males and females who are
from two different types of family structure?
! Assumptions
Exercise_4.sav
Simplified data from PISA 2003 Study Australia &
Indonesia
(The Programme for International Students Assessment)
http://www.pisa.oecd.org
Pawel Skuza 2013
12
!!! Chapters 7,8 in Kinnear, Paul R., & Gray, Colin D. (2009). PASW
statistics 17 made simple (replaces SPSS statistics 17). London ; New York:
Psychology Press.
Online versions
Chapters 9 & 19, 22 in Noruis, Marija J. (2008). SPSS 16.0 [or later
versions] Statistical Procedures Companion. Upper Saddle River, NJ:
Prentice Hall.
Tutorial
Find illustrated, step-by-step
instructions for the basic features
Case studies
Hands-on examples of various types of
statistical procedures
Statistics coach
To help you find the procedure you
want to use
Other forums
http://groups.google.com/group/comp.soft-sys.stat.spss/topics?gvc=2
http://www.spssforum.com/
13
THANK YOU
Please provide us with your feedback by
completing the short survey.
14