A Simplified Model for Learning Mixed

Methods Methodology

John W. Creswell, PhD

Senior Research Scientist, Michigan Mixed Methods
Research Program
University of Michigan, Ann Arbor, Michigan

11th International Qualitative Research

Association of Malaysia (IQRC)2023,
Preconference workshop
November 23, 2023,
DoubleTree by Hilton
at Putrajaya Lakeside, Malaysia
 Creswell’s Books Currently Available: Research Design, Qualitative
Research, Mixed Methods Research, and Narrative Research
General Research Design Qualitative Research
Literary
2023 6th Edition 2019 6th Edition 2020 2nd Edition
Narrative
Writing

2018 3rd Edition 2022 2nd Edition 2018 4th Edition

(2023)

Mixed Methods Research

A SIMPLIFIED MODEL
FOR LEARNING AND
CONDUCTING
MIXED METHODS
RESEARCH
To Engage Researchers in Mixed Methods Research,
We Need a Simplified Model

Why?

• Ever-expanding literature

international audience

new researchers
innovations –
state-of-the art procedures
process model
 ALL
M
MET IXED
A Simple 6-Step Model of
Mixed Methods Research 2022 BUIL
D
H
LITE ODS
RAT
URE
TOP S ON TH
ICS ESE
A MIXED METHOD PROBLEM DATA INVENTORY MIXED METHOD
Only QUAL AND only Focus on the DESIGNS
QUAN data not Quantitative and
enough Qualitative Data

Collect both Place this

Research Problem Data
Qualitative and
or Research Question Within a Set
Quantitative Data
Of Procedures
Or Designs
JOINT DISPLAY
TABLE
INTEGRATION METAINFERENCES
of the data bases

Conduct the
Study and Draw Inferences
Combine the Two Analyze the Or Insight from
Databases – Combined Data The Combined
Mixing the Data In a Table – Data Analysis
Representation

THEORY OR CONCEPTUAL FRAMEWORK/ETHICS/VALIDITY

 Useful Mixed Methods Terms

Mixed methods data: Quantitative closed-ended and qualitative open-ended data.

Mixed methods design: A set of procedures for conducting your study.

Mixed methods designs will be of two types: Core Designs and Complex
Designs

Diagram: A visual rendering of your procedures. One-page, simple diagram.

Integration: Point in the procedures where the qualitative and quantitative

data connect. The integration can be a) merging data b) connecting (building,
explaining) the data c) embedding the data. It will be indicated with a red
arrow in the diagrams.

Joint display: A table or graph that displays an integration of the qualitative

and quantitative data for integration data analysis. From this table the
researcher draws additional “insights” beyond quantitative and
qualitative data analysis.

Metainferences: The insights that emerges from analyzing the integration in a joint display.
This insight is in addition to what is learned from the quantitative and qualitative data.
Step 1. Is Your Research
Problem Best Addressed
Using Mixed Methods?
 Step 2. Do You Have Access to
Both Quantitative and Qualitative
Data?

Qualitative Data
((open-ended without response
categories)
• Open-ended interviews
• Open-ended observations
• Documents
• Audio-visual and social
media materials
Mixed Method is an Intuitive Methodology:
We Gather Both Quantitative and
Qualitative Data to Study Complex
Problems
Examples

MIXED METHOD MIXED METHODS MIXED METHODS

TRAFFIC ACCIDENT SPORTS DOCUMENTARY
ANNOUNCERS

MIXED METHODS MIXED METHODS

NEWSCAST PATIENT/DOCTOR
ENCOUNTER
 Step 3. What Mixed Methods Design will
You Use to Collect and Analyze the
Quantitative and Qualitative Data?

Chapter 3: CORE MIXED CHAPTER 4:

METHODS DESIGNS COMPLEX
DESIGNS THAT
INCLUDE CORE
DESIGNS

(Creswell
& Plano
Clark, 2018)
 A Convergent Design

ign
Core Des

One Phase Project

Qualitative Quantitative
Data Collection Data Collection
and Analysis and Analysis

Merge

To compare
results from both
Interpretation databases
 Explanatory Sequential Design

ign
Core Des

Two Phase Project

Phase 1 Phase 2
Quantitative Qualitative
Explained
Data Collection Data Collection Interpretation
and Analysis By (connecting) and Analysis

Use the qualitative data to help explain

the quantitative results
 An Exploratory Sequential Design

13

ign
Core Des
A Three-Phase Project

Phase 1 Phase 2
Qualitative Exploration Quantitative Design
Data Collection Builds into Phase –
and Analysis Instrument design,
new variables, or
intervention activities
Quantitative Test
Phase –
Instrument design Interpretation
or intervention design

Phase 3 To explore first to adapt

a quantitative assessment
and make it applicable to a sample
or population
 More Design Types

CORE DESIGNS COMPLEX DESIGNS

(FRAMEWORKS OR
PROCESSES)

Embedded
Within
 Example of a Complex Design:
A Mixed Methods Experimental Design

Quantitative Experiment
with an Intervention and
Pre- and Post-Test
Measures
Qualitative Qualitative
Interviews Interviews
Before Experiment After Experiment
(Exploratory Qualitative Interviews (Explanatory
Sequential Design) During Experiment Sequential Design)

(Convergent Design)

• Recruit participants • Explain outcomes

• Develop workable interventions • Examine participants’ experiences
• Modify experiment
• Develop good pre-post-test • Modify treatment
measures
 Example of a Complex Design: A
Mixed Methods Multiple Case Study
C o nv e r
g
Core D ent
Case Study Mixed Methods Design esign

Quantitative survey Qualitative interviews

Quantitative Qualitative
Data Analysis Data Analysis

Interpretation Interpretation
Merge Results and Decide on
Criteria for Case Selection

Case Description/Themes #1 Case Description/Themes #2 Case Description/Themes #3

Cross-Case Comparisons and Interpretation

 Example of a Complex Design: A Mixed
Methods Evaluation Study

Needs Assessment
Theory Conceptualization Instrument and Measures
Qualitative Stage Specific to Setting Development
• Interviews
• Observations Quantitative stage Quantitative stage
• Documents • Literature review stage • Measures and instruments

Exploratory Sequential Design

Program Implementation and test Program Follow up and Refinement

Quantitative stage Qualitative stage

• Experimental intervention • Interviews
based on quantitative measures • Observations
• Documents

Explanatory Sequential Design

 Step 4. We need to connect the
databases within the mixed methods
design.

Integration: Point in the procedure (or design) when

the quantitative and qualitative data bump up against
each other

Bumper Cars
 Where Do We Connect in Our Design?

Explanatory Sequential Mixed Methods

Design

Integration

Collect/analyze Collect/analyze
Quantitative Data Qualitative Data

• Collect N=250 surveys • Collect N=30

• Measure behaviors leading interviews with
to lowered cholesterol patients based
• Analyze data descriptively on surprising
and multivariately quantitative results
• Code data and
identify themes

Interpret how
qualitative results help
explain quantitative results
 Where Do We Connect in Our Design?
A Convergent Design (Core)

Core Des
ign A Convergent Design

One Phase
Qualitative
Project Phase #1 Quantitative
Data Collection Data Collection
and Analysis and Analysis

INTEGRATION Merge
RIGHT HERE Procedure: Merge
the data by putting
Intent: To compare (or them side-by-side
validate) results one Interpretation
database with
the other
 Where Do We Connect in Our Design?

Explanatory Sequential Design

ign
Core Des

Two Phase Project

Phase 1 Phase 2
Quantitative Qualitative
Explained
Data Collection Data Collection Interpretation
and Analysis By (connecting) and Analysis

Intent: Use the qualitative data to Procedure: Quantitative results are used to
help explain the quantitative results design the qualitative phase (questions and
participants)
Integration
Right Here
 Where Do We Connect in Our Design?
Mixed Methods Complex Experiment or Intervention Trial
Integration Integration
Right Here Right Here
Quantitative Experiment
with an Intervention and
Pre- and Post-Test
Measures
Qualitative Qualitative
Interviews Integration Interviews
Before Experiment Right Here After Experiment
(Exploratory (Explanatory
Sequential Design) Qualitative Interviews Sequential Design)
During Experiment
(Convergent Design)

Intent:
Intent:
• Recruit participants
Intent: • Explain outcomes
• Develop workable interventions
• Examine participants’ experiences • Modify experiment
• Develop good pre-post-test
• Modify treatment Procedure:
measures
Procedure: • Follow the
Procedure:
• Gather qualitative data during the experiment with
• Gather qualitative data before the
experiment qualitative data
experiment begins
collection
 We Compose an Integration Statement
That Fits Your Research Design
Two Dimensions of Integration:

q What is the purpose (or intent) for the two databases

to bump up against each other? (why)
q What is the procedure used to have the two databases
bump up against each other? (what)
comparing
merging
Convergent Design)

explaining
connecting

Explanatory Sequential
Design)

exploring
build

Exploratory Sequential Design

 Step 5. How Do We Analyze the Integration
To Learn from It?

ü Mixed methods data analysis

ü We analyze the quantitative and qualitative data

separately

ü Then we analyze the data across the quantitative

and qualitative databases

ü This cross -database analysis is facilitated by using

a table that contained both databases

ü This table is called a joint display (or other creative displays)

 Example of a Template for a Joint Display
for a Convergent Design
Qualitative Results
Theme 1 Theme 2 Theme 3 Theme 4
Quantitative
Scores
Quote Quote Quote Quote
High

Medium Quote Quote Quote Quote

Quote Quote Quote Quote

Low
Example of a Template for an Explanatory Sequential Design
Joint Display
How Qualitative
Helps to Explain
Quantitative Scores Qualitative Follow-Up Themes the Quantitative

High Scores Theme 1 Explanation

Theme 2 1
Theme 3
Explanation
Medium Scores Theme 4 2
Theme 5
Theme 6
Explanation
Theme 7 3
Low Scores
Theme 8
Theme 9
Example of a Template for an Exploratory Sequential Design
Joint Display
Design a Survey
Qualitative Quantitative Test
Instrument

Qualitative Quotes Quantitative Survey

Items Analyze the
Scores on
The Survey

Qualitative Codes Quantitative Survey Identify

Variables Variables

Identify
Qualitative Themes Quantitative Survey Scales
Scales
 Example of a Joint Display Using a Graph

Reprinted from “State Level Assessments, Graphic Displays, and Mixed Method” by P.A. Minugh, 2012, Invited presentation at the Eighth
International Congress of Qualitative Inquiry: Mixed Methods Day, University of Illinois at Urbana-Champaign.
Bustemante, 2015
Step 6. How Do We Draw Insight
From the Joint Display?

The Topic of Metainferences:

Drawing INSIGHT FROM THE

COMBINED DATA (Fetters, 2020)

How is this Done?

ü Add a column to the joint display for metainferences

ü Look across the rows and columns for insight

ü Identify insight, what insight emerges beyond the quantitative

and qualitative data

ü Compare this insight with expectations, theories, literature

Metainferences

Mixed Methods Metainferences

Inferences Inferences

Quantitative Qualitative
Results Results
 A Joint Display Template for a Convergent Design

METAINFERENCES
Theme 1 Theme 2 Theme 3 Theme 4
Scores

Quote Quote Quote Quote Insight

High

Medium Quote Quote Quote Quote Insight

Quote Quote Quote Quote Insight

Low

METAINFERENCES Insight Insight Insight Insight Insight

 Mixed Methods Metainferences

META
Theme 1 Theme 2 Theme 3 Theme 4 INFERENCES

Scores

Quote Quote Quote Quote Insight

High

Medium Quote Quote Quote Quote Insight

Quote Quote Quote Quote Insight

Low

META Insight Insight Insight Insight

Insight
INFERENCES
 Interconnected Research Phases in Almos
tA
A Mixed Method Study In Mix ll Literatur
ed e
Builds Methods
Off of
Complex Problem DATA INVENTORY Boxes
Focus on the MIXED METHOD
Only QUAL AND only
Quantitative and DESIGNS
QUAN not
Qualitative Data
Enough

Collect both Identify Procedures

Research Problem
Qualitative and For Using the Qualitative
or Research Question
Quantitative Data And Quantitative Data

INTEGRATE
The data bases JOINT DISPLAY
METAINFERENCES
TABLE

Integrate e the Two Conduct the

Draw Conclusion
Databases in the Study and
Or Insight from
Design Analyze the
The Combined
Combined Data
Analysis
In a Table

THEORY OR CONCEPTUAL FRAMEWORK/ETHICS/VALIDITY

 Advantages of Using the Simplied Model

• It provides specific steps for planning and

conducting a mixed methods study
• It includes state-of-the-art thinking about mixed
methods
• It provides a process model of connected steps
• It summarizes the key concepts today in mixed
methods research
A Simplified Model for Learning Mixed
Methods Methodology

John W. Creswell, PhD

Senior Research Scientist, Michigan Mixed Methods
Research Program
University of Michigan, Ann Arbor, Michigan

11th International Qualitative Research

Association of Malaysia (IQRC)2023,
Preconference workshop
November 23, 2023,
DoubleTree by Hilton
at Putrajaya Lakeside, Malaysia