Module 3: Common Research Designs and Data Collection Methods

Research
Common Data Collection Methods
Design

Surveys (e.g., personality inventories), Interviews (e.g., clinical interviews),

Descriptive Observations (e.g., observing behavior in a classroom), Secondary Data Analysis
(e.g., analyzing existing datasets on mental health)

Surveys (e.g., measuring anxiety and depression levels), Secondary Data Analysis
Correlational
(e.g., examining the relationship between social media use and well-being)

Experiments (e.g., testing the effectiveness of a new therapy), Pre- and Post-tests
Experimental
(e.g., measuring changes in mood after an intervention)

Quasi- Quasi-experiments (e.g., comparing the effectiveness of two different teaching

Experimental methods on student learning), Pre- and Post-tests, Observations

Interviews (e.g., in-depth study of a patient with a rare psychological disorder),

Case Study
Observations, Document Analysis (e.g., reviewing patient files)

Participant Observation (e.g., immersing oneself in a specific cultural group to

Ethnographic
understand their beliefs about mental illness), Interviews

Grounded Interviews (e.g., exploring the process of coping with grief), Observations,
Theory Document Analysis

Combination of any of the above (e.g., conducting surveys and interviews to

Mixed Methods
understand the impact of stress on academic performance)

Definition and Purpose

1. Surveys (e.g., measuring personality traits):
• Description: A structured set of questions used to gather information from a large number
of individuals. Surveys can be administered in various ways, including online, on paper, or
over the phone.
• Purpose: To collect data on demographics, attitudes, beliefs, behaviors, and personality
traits. In psychology, surveys are often used to measure psychological constructs like anxiety,
depression, self-esteem, and personality.

• Example: The Big Five Inventory (BFI) is a survey used to measure the five major personality
traits: Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism.
2. Interviews (e.g., clinical interviews):
• Description: A conversation between a researcher and a participant, where the researcher
asks questions to gather information about the participant's experiences, thoughts, and

Page 1 of 7
 feelings. Interviews can be structured (with a set of pre-determined questions), semi-
structured (with a general guide but allowing for flexibility), or unstructured (exploratory
and conversational).

• Purpose: To gain in-depth understanding of individual experiences, perspectives, and

motivations. In clinical psychology, interviews are used for assessment, diagnosis, and
treatment planning.
• Example: A clinical psychologist might conduct a semi-structured interview with a patient to
explore their symptoms of depression, including their mood, sleep patterns, and thoughts.
3. Focus Group Discussions (e.g., exploring attitudes towards mental health):

• Description: A small group discussion facilitated by a researcher, where participants are

encouraged to share their views and experiences on a particular topic.
• Purpose: To explore shared understandings, beliefs, and attitudes within a group. Focus
groups can be useful for understanding social and cultural influences on psychological
phenomena.
• Example: Researchers might conduct focus groups with members of a community to explore
their attitudes towards mental health stigma and help-seeking behavior.
4. Observation (e.g., observing children's behavior in a playgroup):
• Description: The systematic observation and recording of behavior in a naturalistic or
controlled setting.
• Purpose: To study behavior directly, without relying on self-report. Observation can be used
to study a wide range of behaviors, from social interactions to cognitive processes.

• Example: A researcher might observe children in a playgroup to study their social skills, such
as cooperation, sharing, and conflict resolution.
5. Secondary Data Analysis (e.g., analyzing existing datasets on mental health):
• Description: The analysis of existing data that were collected for a different purpose. This
data can include public datasets, medical records, census data, or other sources.
• Purpose: To explore research questions that may be difficult or impossible to address with
new data collection. Secondary data analysis can be cost-effective and time-saving.
• Example: A researcher might analyze existing datasets on mental health to examine trends
in suicide rates or to explore the relationship between socioeconomic status and mental
illness.
6. Experimental (e.g., testing the effectiveness of a new therapy for depression):
• Description: A research design in which the researcher manipulates one or more
independent variables (e.g., the type of therapy) to determine their effect on a dependent
variable (e.g., depression symptoms). Participants are often randomly assigned to different
conditions (e.g., therapy group vs. control group).

Page 2 of 7
 • Purpose: To establish cause-and-effect relationships between variables. Experiments are
considered the gold standard for determining the effectiveness of interventions.
• Example: A researcher might conduct an experiment to compare the effectiveness of
cognitive behavioral therapy (CBT) and mindfulness-based therapy for treating depression.
7. Case Study (e.g., in-depth study of a patient with a rare psychological disorder):
• Description: An in-depth investigation of a single individual, group, or event. Case studies
often involve the use of multiple data collection methods, such as interviews, observations,
and document analysis.
• Purpose: To provide rich, detailed information about a specific case. Case studies can be
useful for exploring rare or unusual phenomena or for generating hypotheses for future
research.
• Example: A researcher might conduct a case study of a patient with a rare psychological
disorder to understand the symptoms, course, and treatment of the disorder.
8. Ethnographic (e.g., studying a cultural group's beliefs about mental illness):
• Description: A research approach that involves immersing oneself in a particular culture or
community to understand their beliefs, values, and practices. Ethnographic research often
involves participant observation and interviews.
• Purpose: To provide a rich, contextual understanding of a culture or community.
Ethnographic research can be useful for understanding cultural influences on psychological
phenomena.
• Example: A researcher might conduct ethnographic research in a specific cultural group to
explore their beliefs about mental illness, including how it is defined, explained, and treated.

Strengths and Weaknesses

1. Surveys (e.g., measuring personality traits): Strengths: Can gather data from a large
sample of individuals quickly and cost-effectively. Allows for statistical analysis to identify
trends and relationships. Weaknesses: Relies on self-reported data, which can be subject to
biases (e.g., social desirability bias). May have low response rates, potentially affecting the
generalizability of the findings. Limited depth of information; may not capture the nuances of
individual experiences.
2. Interviews (e.g., clinical interviews): Strengths: Allows for in-depth exploration of complex
psychological issues, such as trauma or grief. Can gather rich qualitative data that provides
insights into individual experiences and perspectives. Weaknesses: Time-consuming and
expensive, limiting sample size. Requires skilled interviewers to establish rapport and elicit
honest responses. Potential for interviewer bias, where the interviewer's beliefs or
expectations influence the interviewee's responses.
3. Focus Group Discussions (e.g., exploring attitudes towards mental health): Strengths:
Can generate rich data through group interaction, revealing shared understandings and

Page 3 of 7
 diverse perspectives. Can be useful for exploring sensitive topics in a supportive environment.
Weaknesses: Group dynamics can influence individual responses (e.g., social loafing,
conformity). Requires skilled facilitation to ensure that all participants have an opportunity
to share their views. Small sample sizes, limiting generalizability.
4. Observation (e.g., observing children's behavior in a playgroup): Strengths: Provides
direct information about behavior in naturalistic settings. Can be used to study real-world
phenomena without relying on self-report. Weaknesses: Can be time-consuming and labor-
intensive. Observer bias can influence interpretations of behavior. Ethical considerations
related to privacy and informed consent.

5. Secondary Data Analysis (e.g., analyzing existing datasets on mental health): Strengths:
Cost-effective and time-saving, as the data has already been collected. Can provide access to
large datasets that would be difficult or impossible to collect independently. Weaknesses: The
data may not be perfectly relevant to the research question. The quality of the data may be
unknown, and there may be limitations in how the data were collected.
6. Experimental (e.g., testing the effectiveness of a new therapy for depression): Strengths:
Can establish cause-and-effect relationships between variables (e.g., therapy and depression).
Allows for controlled manipulation of variables to isolate the effects of the intervention.
Weaknesses: Can be artificial and difficult to generalize to real-world settings. Ethical
considerations related to the use of control groups and the potential for harm to participants.
7. Case Study (e.g., in-depth study of a patient with a rare psychological disorder):
Strengths: Provides rich, detailed information about a specific individual or case. Can be useful
for exploring rare or unusual phenomena. Weaknesses: Limited generalizability; findings may
not apply to other individuals or cases. Potential for researcher bias, as the researcher may
become too invested in the case.
8. Ethnographic (e.g., studying a cultural group's beliefs about mental illness): Strengths:
Provides a rich, contextual understanding of a culture or community. Can reveal culturally
specific beliefs and practices related to mental health. Weaknesses: Time-consuming and
resource-intensive. Requires skilled researchers with cultural sensitivity and awareness.
Potential for researcher bias, as the researcher's own cultural background may influence
interpretations.
Conceptualization and Tool Construction
• Survey (e.g., measuring anxiety): Define the specific type of anxiety to be measured (e.g.,
trait anxiety, state anxiety). Choose a validated anxiety scale (e.g., State-Trait Anxiety
Inventory). Ensure the survey is clear, concise, and easy to understand. Pilot test the survey
to identify any problems with wording or format.
• Interview (e.g., exploring experiences of trauma): Develop an interview guide with open-
ended questions about the traumatic event, its impact on the individual, and their coping
mechanisms. Train interviewers on how to conduct sensitive interviews and establish rapport
with participants.

• Observation (e.g., observing social interactions in children with autism): Develop a

structured observation form that specifies the behaviors to be observed (e.g., eye contact,

Page 4 of 7
 social initiation, repetitive behaviors). Train observers to ensure consistency in their
observations.
• Focus Group Discussion (e.g., exploring attitudes towards mental health stigma):
Develop a discussion guide with open-ended questions about mental health, stigma, and help-
seeking behavior. Recruit participants from diverse backgrounds and ensure a safe and
respectful environment for discussion.
Data Management and Data Analysis (Psychology Examples)
• Survey: Enter data into statistical software (e.g., SPSS, R). Clean and validate the data by
checking for errors and missing values. Use descriptive statistics (e.g., means, standard
deviations) to summarize the data. Use inferential statistics (e.g., t-tests, ANOVA) to test
hypotheses about relationships between variables.
• Interview/Focus Group Discussion: Transcribe audio or video recordings verbatim. Use
thematic analysis to identify recurring themes and patterns in the data. Code the data to
organize and categorize responses.
• Observation: Analyze observational data to identify patterns and trends in behavior.
Calculate frequencies and durations of specific behaviors.
• All Methods: Consider using qualitative data analysis software (e.g., NVivo, Atlas.ti) to
manage and analyze qualitative data.
Constructing Field Method Tools (Psychology Example)
Let's say you're researching the impact of mindfulness meditation on stress levels in college students.
• Survey:

o Demographics: Age, gender, year of study, major.

o Mindfulness:* Use a validated mindfulness scale (e.g., Five Facet Mindfulness
Questionnaire).
o Stress:* Use a validated stress scale (e.g., Perceived Stress Scale).
o Open-ended question: "What are your biggest stressors as a college student?"
• Interview Guide:

o "Can you describe your experience with stress in college?"

o "Have you ever tried mindfulness meditation or other stress-reduction techniques?"
o "If so, how has it impacted your stress levels?"
o "What are the challenges and benefits of practicing mindfulness meditation in
college?"
Remember to pilot test all your tools before using them in your research. This will help you identify
any potential problems and ensure that your data collection methods are reliable and valid.

Page 5 of 7
Activity 1: Survey Design for Measuring Anxiety in a Specific Context
• Objective: To design a survey measuring anxiety tailored to a specific psychological context.
• Materials: Whiteboard/flip chart, markers, sticky notes, sample anxiety scales (e.g., STAI,
BAI).
• Steps:

1. Choose a Context: Select a specific context where anxiety might be relevant. Examples: Test
anxiety, social anxiety in online interactions, anxiety related to climate change, health anxiety
related to a specific illness.
2. Define "Anxiety" in this Context: How does anxiety manifest specifically in this chosen
context? Brainstorm specific thoughts, feelings, and behaviors. Psychology Connection: This
emphasizes situational specificity in psychological measurement.

3. Review Existing Scales: Examine existing anxiety scales. Identify items relevant to your
chosen context and how they might need adaptation. Psychology Connection: Understanding
existing psychometric tools is crucial.
4. Generate New Items: Create new survey items specifically addressing the nuances of anxiety
in your chosen context. Use a mix of Likert scales, frequency scales, and perhaps a few open-
ended items for qualitative insights. Example (Climate Change Anxiety): "I feel overwhelmed
by the information available about climate change." (Strongly Disagree - Strongly Agree),
"How often do you discuss climate change with others?" (Never - Very Often).
5. Structure and Pilot Test: Organize the survey logically. Consider demographics, then move
to general anxiety items, then context-specific items. Discuss how you would pilot test this
survey. Psychology Connection: Pilot testing is essential for refining a survey's reliability and
validity.

Activity 2: Interview Guide for Exploring Coping Mechanisms

• Objective: To create an interview guide for exploring coping mechanisms related to a specific
stressor.
• Materials: Paper, and pens.
• Steps:
1. Choose a Stressor: Select a specific stressor relevant to psychological research. Examples:
Academic stress, job loss, chronic illness, relationship breakups, discrimination.
2. Identify Coping Dimensions: Brainstorm different dimensions of coping. Examples:
Problem-focused coping, emotion-focused coping, social support seeking, avoidance, and
meaning-making. Psychology Connection: Familiarity with coping theory is key.
3. Develop Open-Ended Questions: Craft open-ended interview questions for each coping
dimension, related to the chosen stressor. Example (Job Loss): "Can you describe the steps you
took to find a new job after losing your previous one?" (Problem-focused), "How did you
manage your emotions during this time?" (Emotion-focused).

Page 6 of 7
 4. Create Probes: Develop follow-up probes for each question. These should encourage deeper
exploration. Example: "You mentioned feeling overwhelmed. Can you tell me more about what
that felt like?"

5. Ethical Considerations: Discuss the ethical implications of interviewing about this specific
stressor. How will you ensure participant well-being and confidentiality? Psychology
Connection: Ethical considerations are paramount in research.
6. Practice and Refine: Practice conducting mock interviews. Refine the guide based on
practice and feedback.

Activity 3: Comparing Survey and Interview Approaches to Studying a Single

Phenomenon
• Objective: To understand the strengths and weaknesses of surveys vs. interviews for
studying a single psychological phenomenon.
• Materials: Whiteboard/flip chart, markers.

• Steps:
1. Choose a Phenomenon: Select a psychological phenomenon. Examples: The impact of social
media on self-esteem, the experience of flow state, and the development of resilience.
2. Survey Approach: Design a brief outline of how you would study this phenomenon using a
survey. What constructs would you measure? What types of questions would you ask? What
are the potential strengths and limitations of this approach?

3. Interview Approach: Design a brief outline of how you would study the same phenomenon
using interviews. What themes would you explore? What types of questions would you ask?
What are the potential strengths and limitations of this approach?
4. Comparison and Discussion: Compare and contrast the two approaches. When might a
survey be more appropriate? When might interviews be preferred? How do the methods
complement each other? Psychology Connection: This activity reinforces the importance of
methodological choices in research design.

Page 7 of 7