Scribd
Upload
220 views

Linear Regression Analysis For Survey Data

This document discusses linear regression analysis for survey data. It explains how to use linear regression when the dependent variable is measured on a Likert scale by treating the scale as interval data. It also covers how to code nominal independent variables as dummy variables in a regression model. The document notes that for complex survey data, software is needed that accounts for the sample design, as standard regression assumptions may not hold. It provides an example of fitting a multiple regression model in JMP software to analyze relationships between variables in a student survey dataset.

Uploaded by

Malav Shah
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
220 views

Linear Regression Analysis For Survey Data

This document discusses linear regression analysis for survey data. It explains how to use linear regression when the dependent variable is measured on a Likert scale by treating the scale as interval data. It also covers how to code nominal independent variables as dummy variables in a regression model. The document notes that for complex survey data, software is needed that accounts for the sample design, as standard regression assumptions may not hold. It provides an example of fitting a multiple regression model in JMP software to analyze relationships between variables in a student survey dataset.

Uploaded by

Malav Shah
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 28

Linear Regression Analysis

for Survey Data


Professor Ron Fricker
Naval Postgraduate School
Monterey, California
1

Goals for this Lecture


Linear regression
How to think about it for Lickert scale
dependent variables
Coding nominal independent variables

Linear regression for complex surveys


Weighting
Regression in JMP
2

Regression in Surveys
Useful for modeling responses to survey
questions as function of (external)
sample data and/or other survey data
Sometimes easier/more efficient then highdimensional multi-way tables
Useful for summarizing how changes in the
Xs affect Y

(Simple) Linear Model


General expression for a linear model

yi = 0 + 1 xi + i

0 and 1 are model parameters


is the error or noise term

Error terms often assumed independent


2
observations from a N (0, ) distribution
Thus Yi ~ N ( 0 + 1 xi , 2 )
And E (Yi ) =

0 + 1 xi
4

Linear Model
Can think of it as modeling the expected value
of y,

E ( y | x ) = 0 + 1 x

where on a 5-point Lickert scale, the ys are


only measured very coarsely
Given some data, we will estimate the
parameters with coefficients

E ( y | x ) y = 0 + 1 x

where y is the predicted value of y


5

Estimating the Parameters


Parameters are fit to minimize the sums
of squared errors:
n
2
SSE = yi 0 + 1 xi
i =1

Resulting OLS estimators:


n

1 =

n
1 n
xi yi yi xi

n i =1 i =1
i =1

x xi

n i =1
i =1
n

and 0 = y 1 x

2
i

Using Likert Scale Survey Data as


Dependent Variable in Regression

Strongly agree

Agree

Neutral

Disagree

Strongly disagree

2-1=1
3-2=1
4-3=1
5-4=1

Coding imposes this


Is it reasonable?

Likert scale data is categorical (ordinal)


If use as dependent variable in regression,
make the assumption that distance between
categories is equal
Coding

My Take
Generally, Im okay with assumption for 5-point Likert
scale
Boils down to assuming Agree is halfway between
Neutral and Strongly agree

Not so much for Likert scales without neutral midpoint


or more than 5 points
If plan to analyze with regression, perhaps better to
use numerically labeled scale with more points:
Neither
agree nor
disagree

Strongly
agree

Strongly
disagree

From Simple to Multiple Regression


Simple linear regression: One Y variable
and one X variable (yi=0+ 1xi+)
Multiple regression: One Y variable and
multiple X variables
Like simple regression, were trying to
model how Y depends on X
Only now we are building models where Y
may depend on many Xs

yi=0+ 1x1i + + kxki +


9

Using Multiple Regression to


Control for Other Factors
Often interested in the effect of one particular
x on y
Effect of deployment on retention?

However, other xs also affect y


Retention varies by gender, family status, etc.

Multiple regression useful for isolating effect


of deployment after accounting for other xs
Controlling for the effects of gender and family
status on retention, we find that deployment
affects retention
10

Correlation Matrices
Useful Place to Start
JMP: Analyze > Multivariate Methods > Multivariate

Regression with Categorical


Independent Variables
How to put male and female
categories in a regression equation?
Code them as indicator (dummy) variables

Two ways of making dummy variables:


Male = 1, female = 0
Default in many programs
Male = 1, female = -1
Default in JMP for nominal variables
12

Coding Examples
0/1 coding
Compares calc_grade
to a baseline group
Regression equation:
females:
calc_grade=80.41 - 0.48 0
males:
calc_grade=80.41 0.48 1
-1/1 coding
Compares each group
to overall average
Regression equation:
females: calc_grade=80.18 + 0.24 1
males: calc_grade=80.18 + 0.24 (-1)

13

How to Code k Levels


Two coding schemes: 0/1 and 1/0/-1
Use k-1 indicator variables

E.g., three level variable: a, b,, & c


0/1: use one of the levels as a baseline
Var_a = 1 if level=a, 0 otherwise
Var_b = 1 if level=b, 0 otherwise
Var_c exclude as redundant (baseline)
Example:

14

How to Code k Levels (contd)


1/0/-1: use the mean as a baseline
Variable[a] = 1 if variable=a, 0 if variable=b,
-1 if variable=c
Variable[b] = 1 if variable=b, 0 if variable=a,
-1 if variable=c
Variable[c] exclude as redundant
Example

15

If Assumptions Met
...can use regression to do the usual
inference
Hypothesis tests on the slope and intercept
R-squared (fraction in the variation of y
explained by x)
Confidence and prediction intervals, etc.

However, one (usually unstated)


assumption is data comes from a
SRS
16

Regression in Complex Surveys


Problem:
Sample designs with unequal probability of section
will likely result in incorrectly estimated slope(s)
If design involves clustering, standard errors will
likely be wrong (too small)

We wont go into analytical details here


See Lohr chapter 11 if interested

Solution: Use software (not JMP) that


appropriately accounts for sample design
More at the end of the next lecture
17

A Note on Weights
and Weighted Least Squares
Weighted least squares often discussed in
statistics textbooks as a remedy for unequal
variances
Weights used are not the same as sampling
weights previously discussed

Some software packages also allow use of


weights when fitting regression
Generally, these are frequency weights again
not the same as survey sampling weights

Again, for complex designs, use software


designed for complex survey analysis
18

Population vs. Sample


Sometimes have a census of data: can
regression still be used?
Yes, as a way to summarize data

I.e., statistical inference from sample to


population no longer relevant
But regression can be a parsimonious
way to summarize relationships in data
Must still meet linearity assumption

Regression in JMP
In JMP, use Analyze > Fit Model to do
multiple regression
Fill in Y with (continuous) dependent
variable
Put Xs in model by highlighting and then
clicking Add
Use Remove to take out Xs
Click Run Model when done

Takes care of missing values and nonnumeric data automatically


20

From NPS New Student Survey:


Q1 by Country ANOVA vs. Regression

From NPS New Student Survey:


Q1 by Country and Gender

Regress Q1 on Country, Sex, Race,


Branch, Rank, and CurricNumber

23

Make and Analyze a New Variable


In-processing Total = sum(Q2a-Q2i)

10 15 20 25 30 35 40 45 50

24

Satisfaction with In-processing (1)


GSEAS worst at in-processing?

Or are CIVs and USAF least happy?

Satisfaction with In-processing (2)


Or are Singaporians unhappy?

Making a new variable

Satisfaction with In-processing (3)


Final model?

15

.01

.05 .10

.25

.50

.75

.90 .95

.99

10
5
0
-5
-10
-15
-20
-25
-3

-2

-1

Normal Quantile Plot

27

What We Have Just Learned


Linear regression
How to think about it for Lickert scale
dependent variables
Coding nominal independent variables

Linear regression for complex surveys


Weighting
Regression in JMP
28

You might also like