0% found this document useful (0 votes)
103 views

Lecture Notes Chapter 5 Data Collection Sampling and Data Analysis

This document discusses data collection methods in scientific research, including observation, interviews, questionnaires, tests, and document review. It notes that qualitative research often uses observations and interviews to gather contextual details, while quantitative research relies more on questionnaires, tests, and instruments. The document also discusses different scales of measurement for variables, including nominal, ordinal, interval, and ratio scales. It provides examples of how each scale is used and the types of statistical analysis applicable for each.

Uploaded by

Mitiku
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
103 views

Lecture Notes Chapter 5 Data Collection Sampling and Data Analysis

This document discusses data collection methods in scientific research, including observation, interviews, questionnaires, tests, and document review. It notes that qualitative research often uses observations and interviews to gather contextual details, while quantitative research relies more on questionnaires, tests, and instruments. The document also discusses different scales of measurement for variables, including nominal, ordinal, interval, and ratio scales. It provides examples of how each scale is used and the types of statistical analysis applicable for each.

Uploaded by

Mitiku
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 41

Scientific Research Methods Dr. Engr.

Bien Maunahan

CHAPTER 5

DATA COLLECTION, SAMPLING, AND DATA ANALYSIS

DATA COLLECTION

Data Collection methods

After determining the research design, the next step in the research process is to select
the methods of collecting data. These methods include:
• Observation
• Interviews
• Questionnaires
• Standardized tests
• Use of physical instruments
• Simulation
• Review of documents

Observations and interviews are widely used in qualitative research to collect


contextual details and probe more deeply into respondents’ perspectives, interpretations, and
experiences. Quantitative researchers tend to use questionnaires, standardized tests, physical
measuring instruments, and simulation—both types of research review existing documents
for qualitative or quantitative data.

Many studies use multiple or mixed methods to collect data by exploiting the strengths
and offsetting the weaknesses of each data collection method. In doing so, they expand the
scope of the research. For example, we may use standardized tests to assess students’
performance, followed by qualitative data on why students with similar backgrounds differ
substantially in their performance. Economists regularly use this strategy to supplement
quantitative data with illustrative qualitative examples.

Instead of combining the qualitative and quantitative data, some researchers transform
the qualitative data into quantitative data. For example, a researcher may use numeric codes
corresponding to the responses to open-ended questions in a structured questionnaire. This
strategy partially overcomes the possibility of unlimited responses to open-ended questions.

Before discussing these data collection methods, we must understand the scales from
which empirical measures for theoretical concepts are developed.

JU/JIT Construction Engineering and Management 1


Scientific Research Methods Dr. Engr. Bien Maunahan

SCALES MEASUREMENT

Scales are used for categorization, ranking, and assessing magnitudes (Table below). There
are two types of variables, namely:

• discrete variables that take integer values, such as 20 girls


• continuous variables that take any real number, such as 2.3 kg.

A nominal scale categorizes data, such as 0 for females and 1 for males. In transport
studies, the mode of transport to work is usually a categorical variable, such as 1 for a walk, 2
for a bicycle, 3 for a motorcycle, 4 for a bus, etc. We often use discrete variables to generate
count or frequency data, such as the number of boys and girls in a class.

Table Types of variables and scales


Types of variables Scales Use Example
Nominal Classification Gender
Discrete
Ordinal Ranking Rating
Interval Distance 2005-2010
Continuous
Ratio Ratio Weight

An ordinal scale provides ratings, for example, 4 = Very Important; 3 = Important; 2


= Not So Important and 1 = Not Important. Another common technique is to provide a
statement, and respondents tick their answers depending on whether they strongly agree,
agree, remain neutral, disagree, or strongly disagree with it. There is no hard and fast rule on
whether a 5-point, 7-point, or 10-point scale should be used so long as one pays attention to
the sensitivity of the responses. The difference between using odd and even numbers lies in
whether “Neutral” is an acceptable answer. Technically, ordinal scales cannot be averaged
because the intervals are unequal. However, if it can be reasoned that the intervals are
roughly equal, then averaging may be acceptable.

An interval scale consists of equal intervals that measure the relative distances
(differences) between points on the scale, such as IQ scores, temperature, or time. Ratios are
meaningless; a person with an IQ score of 160 is not twice as intelligent as one with a score
of 80. Similarly, the period 2005–2010 makes sense in calendar time, but not the ratio
2005/2010.

In a ratio scale, the ratios are meaningful. For example, a length of 3 m is twice as
long as 1.5 m, or 10 kg is twice as heavy as 5 kg.

Despite the differences in the interval and ratio scales, it is often not necessary to
distinguish them. Both scales use real numbers, and most statistics, such as the mean and
standard deviation, apply to them.

JU/JIT Construction Engineering and Management 2


Scientific Research Methods Dr. Engr. Bien Maunahan

How precisely we want to measure something depends on the purpose and cost. For
instance, we should measure a room’s temperature using a thermometer if this level of
accuracy is essential, rather than merely stating if it is “hot” or “cold.” The measurement
scale will also affect the type of statistical tests used. For instance, the mean and standard
deviation are meaningless on the nominal scale. If there are 20 boys and ten girls in the class,
the average (of 15) does not make sense.

Methods of Collecting Data

Observations

We may collect data by observing:

• Space or physical arrangements, such as the hierarchical arrangements of office


space
• The people, in terms of the number, composition, and behavioral patterns
• The goals, or what they are trying to accomplish
• Their actions
• The activities
• Traces of frequency of use of equipment or facilities
• Flows of people or traffic
• Processes
• Occurrences, such as an accident
• Sequence of events
• Feelings, such as whether people are happy, sad, or shocked.

The researcher must know what to observe. Most observers use a checklist to guide
their observations. They also try to take notes and make sketches as soon as practical and
supplement them with recording media. However, be sure to obtain permission to record or
film conversations and activities. If quick note-taking is impossible, it should be done at the
earliest opportunity.

Observer bias may occur for various reasons. For example, the observer may either
not understand the context or he did not receive adequate training. Any two observers may
also interpret the same event differently. To reduce observer bias and improve coverage, we
often use two or more observers to compare notes. In general, triangulation uses two or more
observers or methods to collect data.

JU/JIT Construction Engineering and Management 3


Scientific Research Methods Dr. Engr. Bien Maunahan

Interviews

Most qualitative researchers use interviews in their research because of the


opportunity to ask probing questions through conversations and open discussions. The
participants may represent the population, key informants such as leaders or experts, or form
a group. The interviews may be unstructured, semi-structured, or structured. Some interviews
require respondents to think aloud to determine how students solve problems in educational
research.

The interviewer does not wish to impose any prior framework in an unstructured
interview. For instance, in an interview with a project manager on how he was affected by
project failure, the interviewer may start with a question such as “how do you define project
failure,” The interview then proceeds based on the responses. Generally, the questions will
cover awareness of the issue, the adaptive responses, damage control, the consequences, etc.

A semi-structured interview based on a research framework is standard. The interview


has a list of questions, but the answers can be open-ended. Researchers can use open-ended
questions to probe more deeply into an issue like structured interviews.

A structured interview is highly standardized. Respondents answer the same set of


questions in the same order. These structured questions contain a limited set of possible
answers to ensure that aggregation and comparisons are possible between groups or across
different periods.

A focus group is a group interview comprising about five to ten respondents. The
researcher facilitates and moderates the collective discussion to explore ideas, share views, or
make recommendations on an issue. Its effectiveness will depend on the composition of the
participants, whether they are representative of the population, the skills of the moderator, the
ground rules, and the type of questions.

Beyond ten respondents, the focus group becomes a community meeting. Researchers
use public forums and hearings to gather ideas from a broader range of stakeholders. Such
meetings should be inclusive; they include all sections of the community. They should also
be participatory and not be dominated by specific stakeholders. Do not assume that all
stakeholders will be present for a public meeting.

Researchers may carry out the interviews face to face, particularly if probing
questions or visual aids are required, or over the telephone or Internet. Because the
researcher’s presence may affect the respondent’s readiness to provide information, the
interviewer should try to put the respondent at ease.

Other considerations in interviews include authorizations, informant access to key


respondents, timings, venues, seating arrangements, use of recorders (if permission is given),
note-taking, and training of interviewers.

JU/JIT Construction Engineering and Management 4


Scientific Research Methods Dr. Engr. Bien Maunahan

Questionnaires

However, a postal, email or web-based questionnaire does not involve an interview.

Most questionnaires contain highly structured questions together with a limited set of
answers. They usually have factual questions and ratings and occasional opinions and
reasons. An example is given below.

JU/JIT Construction Engineering and Management 5


Scientific Research Methods Dr. Engr. Bien Maunahan

Before finalizing the questionnaire, you should conduct a pretest using a small sample
of respondents to obtain feedback on the length, structure, sequencing, and content.
Generally, a questionnaire should not exceed five pages. It is advisable to adopt a simple
structure with proper sequencing without too many disruptive jumps from one section to
another. Finally, check the content for validity.

There are three types of validity, namely:

• Construct Validity: Ensures that questions in construction surveys or


assessments truly measure what they are supposed to measure (like safety
perceptions on a construction site).
• Internal Validity: Checks if observed changes or results in construction projects
are genuinely due to the factors being measured (such as a decrease in accidents
because of a new safety program).
• External Validity: Examines whether findings or improvements observed in
construction practices apply beyond the specific project or conditions studied (like
whether a new technique's benefits extend to different climate zones).

These validity concepts help ensure that the data collected, observations made, or changes
implemented are accurate, reliable, and applicable in understanding and improving aspects
across various settings or scenarios.

After the pre-test, the questionnaire is refined by checking validity, proper numbering,
rewording vague or offensive questions, including good options in a question, removing
duplicates and unimportant questions, and putting the more difficult or contentious questions
last rather than first.

Steps in Designing Questionnaires/interviews:

1. Content: Use the objectives and variables as a starting point


2. Formulating Question: Compose one or more questions to provide the information
needed for each variable. The question should be specific, measure one thing at a
time, and not be leading
3. Sequencing question
• Design the question to be informant friendly
• Follow a logical sequence
• Start with an exciting but non-controversial question
• Pose more sensitive questions as late as possible in the interview
4. Formatting the questionnaire
• Introductory page
• Heading and sub-heading
• Space for responses

JU/JIT Construction Engineering and Management 6


Scientific Research Methods Dr. Engr. Bien Maunahan

5. Translation
• There should be a translation in cases where the language is a problem
6. Ethical Considerations
• Obtaining informed consent before the study or the interview begins
• Ensuring the confidentiality of the data obtained
• Leaning enough about the culture of informants to ensure it is respected
during the data collection process
7. Pre-test: it refers to a small-scale trial of particular research components
• Data collection tools
➢ clarity of language, acceptability of questions, the accuracy
of the translation, the time needed to administer the
questionnaire, the need to pre-categorize some answers,
need for additional instructions
• Availability and willingness of respondents
• Sampling procedure
• Procedures for data processing and analysis

Two Question Rules

Bear in mind these rules when drafting your questionnaires

1. Keep it short using conversation language


2. Ask only one piece of information per question

Example: Good: What is the cause of building failure?

Not so good: What is the cause of building failure and its


probable solution?

Kinds of Questions

1. An open-ended question allows the respondent to freely express their


thoughts, opinions, or information without limitations or specific prompts.
2. A closed-ended question requires respondents to choose from predefined
options provided by the questioner when providing their answer

Closed questions are more common in questionnaires, and there is a range of ways of
providing the 'closeness' of the answer:

Yes/No Question

From these questions, it is clear that the answer should be a yes or no only.

JU/JIT Construction Engineering and Management 7


Scientific Research Methods Dr. Engr. Bien Maunahan

Multiple Choice Questions

In this type, there are two or more answers, and respondents are told either to
tick one or as many as they like

For example: Which of the following factors are more significant in the
poor performance of local engineers (tick as many as you like)?

o Budget/capital
o Skilled Manpower
o Gender
o Equipment
o Other Please Specify ___________

Rank Order Question

Respondents must put items in order: best to worst, most relevant to the least
essential, and others.

Rating Scale Question

The respondent will rate something (an experience, attitude, attribute, etc.)
along a continuum.

For example: If you are engaged in the construction industry, how


influential do you find these factors?

The Likert Scale

➢ It is named after the psychologist Rensis Likert and can be used in any
situation where belief or attitude is being measured
➢ You will be asked for agreement or disagreement with a statement you
provide.

JU/JIT Construction Engineering and Management 8


Scientific Research Methods Dr. Engr. Bien Maunahan

Questionnaire Online

Try to log in to www.surveymonkey.com for more helpful services in constructing


your questionnaires.

At the time of writing, it lets you construct your questionnaire free for up to
100 respondents and gives help on the construction of a questionnaire, with
24-hour online support.

If you need an alternative service that lets you survey the number of people,
you will probably find that your university subscribes to one. You can ask
your tutor or someone at the Computer Centre which one is used at yours.

Some suggestions for improving a questionnaire include:

Using simple words; if a technical word is necessary, provide a short explanation within the
question; similarly, provide a map if necessary
• Using fixed-alternative questions that are theoretically sound and not artificially
imposed, and state clearly if multiple answers to a question are possible
• Avoiding vague questions, such as what does “seldom” mean in terms of how
many times I watch movies? It is better to provide frequency counts, such as “On
average, how many movies do you watch in a month?”
• Using open-ended questions where many answers are possible, for example,
“What is your vision for downtown?”
• Avoiding questions that lead to particular answers, for example, “Should
unproductive speculators be taxed?”
• Avoiding double-barreled questions, for example, “Is your work easy and
challenging?” poses a dilemma if it is easy but not challenging
• Stating the units of measurement, for example, gross or net monthly income
• Asking in units that people remember, for example, monthly take-home pay rather
than the annual income
• Using ranges for sensitive issues, for example, income ranges
• De-sensitizing phrases, for example, “Many people surf the Internet for
pornographic sites. Have you done this before?” are less sensitive than “Have you
surfed the Internet for pornographic sites?”
• Avoiding hypothetical questions that tend to be poor predictors because there are
many considerations, for example, “Do you intend to buy this product?”
• Avoiding questions on competency, for example, “How do you rate yourself as a
computer user?” is prone to the prestige bias of overrating one’s competency
• Avoiding questions that have a social desirability bias, for example, “Do you
support this project to help the unfortunate children?”
• Furthermore, being aware of possible researcher bias because the way questions
are worded or asked may not reflect respondents' view of the way issues.

JU/JIT Construction Engineering and Management 9


Scientific Research Methods Dr. Engr. Bien Maunahan

Sometimes, we conduct an item analysis during the pre-test to determine if the responses to
an item (question) correlate well with the responses to other items.

For example, suppose we are interested in rating the services of a subway system
(based on a scale of 1 to 10), and the sections of the questionnaire include:
1. Respondent characteristics
2. Fares
3. Security and so on

The section on security has four items (questions), namely:


1. Adequacy of the guards
2. Adequacy of lighting
3. Adequacy of cameras
4. The alertness of the staff.

We correlate the scores for each item from the pre-test responses with the aggregate scores
for all other items. In the table below, item 3.4 may be correlated with the aggregate scores
for all other items.
Table: Item Analysis

Standardized Tests

Standardized tests are another way to collect data. They are commonly used in
psychological and educational research, such as in an experiment to test mental ability or the
effectiveness of a teaching method.

The challenges in designing standardized tests include ensuring that the content is
appropriate, sufficient time to complete the test and that the test is not too easy or difficult.
Standardization makes such tests less suitable for answering complex questions with no
simple solutions.

In education testing, it is possible to prepare by teaching to the test, meaning that


students learn to ace the test rather than learn the fundamental principles. What is not tested
will be devalued.

JU/JIT Construction Engineering and Management 10


Scientific Research Methods Dr. Engr. Bien Maunahan

These tests are used to quantify or assess particular traits, abilities, behaviors,
knowledge, or characteristics of individuals in a standardized and systematic way.
Administering a standardized test means giving everyone the same questions or tasks with
clear instructions, and making sure the test is fair and consistent for everyone taking it.

Use of Physical Instruments

Real instruments are widely used in the natural sciences to measure velocity,
acceleration, temperature, distance, mass, pressure, weight, volume, etc. The decision will
depend on cost, availability, accuracy, precision, ease of use, calibration requirements, and
reliability.

Simulation

A simulation model is a mathematical imitation of a real-world system. Researchers


use simulations to analyze uncertainty, generate statistical distributions, model processes,
generate forecasts, or model interactions among variables. It generates its data, which makes
simulation a method of data collection. For example, we may simulate the energy
performance using the design drawings and use the results to improve the design before the
construction stage.
Although simulation can handle models with many interacting variables, it may
degenerate into black-box modeling where the results are less specific. The user may not be
able to check the computations.

Review of Documents

We may also collect data from published documents such as:


• Internal organizational accounting records, sales data, maps, commercial
reports, and other miscellaneous records
• Academic journals, directories, magazines, newspapers, commercial
reports, reference books, dissertations, theses, encyclopedias, websites,
and books
• And private diaries, letters, memos, photographs, and films.

Permission is required to access these sources. Accuracy is important; if possible,


consult the source that often contains the actual words, intent, methodological details,
warnings, and standard errors that subsequent users do not report. It is also necessary to
verify the authenticity and credibility of the source.

JU/JIT Construction Engineering and Management 11


Scientific Research Methods Dr. Engr. Bien Maunahan

For instance, “official” sources may suppress statistics on worksite accidents or use
different methodologies or words to make the numbers or organization look good.

Data Collection

As we already know that after developing the research question(s), hypothesis (or
framework), research design, and methods of data collection, the next step in the research
process is the actual collection and processing of data. The processes are linked, and it is
impossible to develop each step independently of prior decisions.

Stages in the data collection process

1. Permission to proceed
➢ Obtaining consent from relevant authorities, individuals, and the community
in which the project is to be carried out
2. Data handling
➢ Coding number questionnaires/samples/measurement
➢ Identify the person responsible for storing data and the place where it will be
stored
3. Data Collection
➢ Logistics
➢ Who will collect data
➢ When and
➢ With what resources
➢ Quality Control
➢ Prepare a fieldwork manual
➢ Select and train your research assistants
➢ Supervise the collection
➢ Check for completeness and accuracy

The issues during data collection include:


• Access to respondents
• Management of research assistants
• Care and use of equipment
• Protocol for review of documents
• Note-taking
• Establishing the chain of evidence
• Enhancing reliability
• Tracking of progress

The issues are similar for all research designs, with minor variations between interpretive and
causal studies. These variations will be highlighted below.

JU/JIT Construction Engineering and Management 12


Scientific Research Methods Dr. Engr. Bien Maunahan

Access to Respondents

Researchers need to gain access to individuals and organizations to gather


information. It is the door to field research. However, this process of gaining is not well-
theorized or documented. The literature is sparse.

The gatekeepers control your access to the organization. They are likely to be a leader
or senior person in the organization. For example, in a school setting, the gatekeeper is the
principal. He will decide whether you can observe and interview school administrators,
teachers, and students. You need to address his concerns, such as:
• The purpose of the study
• Why the school has been selected
• What are you going to do with the result
• Will it disrupt classes
• How the school can benefit from participating

From the last bullet point, we can see that the best way to gain access is to show how the
other party can benefit from the study. For instance, you may want to share your research
findings with the school as an inducement. This means that the research problem is essential
to the school. For example, you may want to share whether a new technique for teaching
mathematics is effective.

Other ways of gaining access include:

• Formal introductions, usually by someone influential such as the chairperson of


the school council
• Informal introductions and networks, such as through a teacher or a friend
• Past links to the school, such as if you are an alumnus.

In a commercial setting, gaining access to workers presents a different set of


problems. One issue is the lack of trust between the researcher and the workers. For some
workers, the researcher may be a “spy” from management. Further, workers may have little
incentive to share sensitive views with outsiders.
In the case of questionnaire surveys, access to potential respondents is often through
an impersonal mailing list. The researcher has to consider the cost (for example, postal,
email, or web-based), geographical spread, timeliness, ease of obtaining permission, and the
likely response rate. The response rate depends on topics, quality of the questionnaire, the
currency of the mailing list, ease of reply, the possibility of rewards, and so on.
All forms of access have time limits. It cannot go on forever. For example, if you are
interviewing a senior manager, be clear upfront on the expected number of interviews and the
period. Do not assume that subsequent access to a respondent to clear up some issues is
automatic.

JU/JIT Construction Engineering and Management 13


Scientific Research Methods Dr. Engr. Bien Maunahan

Management of Research Assistants

The management of research assistants includes planning and budgeting, hiring,


training, supervising, scheduling the fieldwork, logistics, safety and health, quality control,
and mentoring.

In selecting interviewers, honesty, humility, possession of the relevant skills, a good


voice, a pleasant personality, a right attitude, and a liking for field conditions are pre-
requisites. Good command of specific languages is mandatory if not all respondents (for
example, tourists) speak the same language. Interviews can sometimes be frustrating, and
people with short fuses are unsuitable. It is uncertain whether biases may occur between paid
and unpaid field staff and between internal and external field assistants. Motivation and effort
are also affected by perceptions of the adequacy of payment.

Training should be provided to field staff members. Someone familiar with the
fundamental research, such as the principal investigator, should conduct the training. The
briefing includes the nature and purpose of the study and data collection procedures. They
should be trained on specific procedures to be followed when contingencies arise, such as:
• The respondent is not at home
• No one is answering the phone
• The call is directed to an answering machine
• Non-resident answers the call
• The line has been disconnected
• The selected respondent is unable to answer because of physical disability
• There is a language barrier
• The interview is incomplete
• The selected respondent refuses to be interviewed.

A demonstration interview is recommended, followed by a trial interview with each


field staff member. This provides a model for interviewers to follow and an opportunity to
correct mistakes. Interviewers may use probes to prompt respondents for their “best guess”
answers, but they must be mindful of possible bias in the responses. Training should also
cover ethical issues and expectations of integrity, such as truthful reporting, processing, and
analyses of field data, data protection, avoiding plagiarism, and not infringing copyright.
Scheduling, logistics, safety, and health will need to be considered so that the research
assistants work as a team, work is distributed correctly, and the timings and periods of site
visits are appropriate and coordinated. Be reasonable in the scheduling; interviewing many
people over a short period is not easy, and productivity may fall sharply if motivational
aspects are neglected. The researcher is responsible for providing proper clothing, equipment,
and safety procedures, such as how to deal with chemicals, radiation, and other hazards.
Finally, a research project allows the researcher to supervise and mentor research
assistants. They are not just “a pair of hands” to help you collect data. In turn, mentored
research assistants find the experience more satisfying and productive.

JU/JIT Construction Engineering and Management 14


Scientific Research Methods Dr. Engr. Bien Maunahan

Care and Use of Equipment

Check that equipment such as tape recorders, cameras, and other measuring devices
are calibrated and in good working order. Field equipment should be looked after to prevent
damage and, for safety reasons, ensure only qualified people handle the equipment. Leaving
them unattended invites theft and gives participants the impression of professional
irresponsibility.
For interviews, notebooks, instruction manuals, survey forms, and maps should be
handled appropriately.

Protocols for Review of Documents

Most research designs require the review of documents for qualitative and
quantitative data. There should be a protocol or checklist for reviewing such documents to
extract the data meaningfully and effectively.
The process begins with assessing the types of information required and the types of
documents to review. Some of the information may have been published elsewhere, or there
are alternate sources of information. For example, different government agencies may publish
information on construction statistics. As far as possible, the researcher should triangulate the
data from these sources to minimize errors.
Use sources when collecting documentary data to minimize transcription and
interpretation errors. Subsequent users may have reorganized the original data and essential
footnotes on how these collected data may have been omitted.

Note-taking

Large quantities of notes need to be managed as a database in many research designs.


Note-taking requires skill. Observers must be trained on what to observe and fill in
observation checklists, forms, and logbooks. Observations should be carried out
unobtrusively because subjects may react differently when an observer is busy tracking every
step. If the situation is fluid, leave nothing to memory by taking notes as soon as possible.
Use color pens to insert footnotes, personal opinions, and follow-up action. It is good to take
notes in stages, starting with sketchy notes to keep abreast of what is happening and fill in the
details when spare time is available.
As an observer, you may not be sure what is important. Hence, you should jot down
the events whenever possible. The perspective may change, and what was previously thought
unimportant may become significant.

JU/JIT Construction Engineering and Management 15


Scientific Research Methods Dr. Engr. Bien Maunahan

Establishing the Chain of Evidence

The notes will have to be organized to trace the chain of evidence. The notes and
evidence are usually arranged in temporal sequence or themes. Within each theme, there is
still the need to track material changes.
In legal terms, a “chain of evidence” is a series of sequential events that account for
the actions of a particular person in a specific legal case (for example, a criminal case) from
the beginning to the end. The reasoning should be tight for the conclusion to be defensible in
court. It is similar to the causal mechanism or process tracing and is widely used in forensic
science.

Enhancing Reliability

In interviews, the researcher typically lets the respondent express his views freely,
telling, or constructing his side of the story. Reliability can be enhanced by cross-checking
his opinions with other sources of evidence. For example, if a worker claims that he works
long hours, this may be checked with colleagues. Triangulation among observers and other
sources of information also minimizes observer bias.
The sources should be reliable and credible for documentary research, such as data
published by reputable researchers and organizations. Triangulation among data sources will
also improve reliability.

Tracking of Progress

For interpretive studies, tracking research progress is less of a problem once access
has been secured, and respondents continue to co-operate. This is not so for survey research,
where the response rate tends to be more uncertain.
Tracking research progress also involves field supervision to ensure that research
assistants follow reasonable field procedures and workloads. It is not unusual for supervisors
to verify a small portion of the interviews or questionnaires by re-interviewing or asking
respondents whether they have been interviewed.
Supervisors should collect survey forms regularly and edit them in the field for
legibility and completeness. Where problems occur, these issues are communicated to field
assistants, and additional training may be necessary. A reminder may be sent, and follow-ups
are made soon after the cut-off date.

JU/JIT Construction Engineering and Management 16


Scientific Research Methods Dr. Engr. Bien Maunahan

What is the DATA?

Data is a collection of facts, such as values or measurements.

It can be numbers, words, measurements, observations, or even just


descriptions.

Data can be qualitative or quantitative

➢ Qualitative data is descriptive information (it describes something)


➢ Quantitative data is numerical information (numbers)

Quantitative data can also be Discrete or Continuous:

➢ Discrete data can only take specific values (like whole numbers)
➢ Continuous data can take any value (within a range)

With your eyes and ears, you get data or information, and with this data, you can
answer your questions and support or not the claims you made at the beginning of your
research. When data are used to support a proposition in this way, they become evidence.

“Evidence is significant in research.”

Types of Data

1. Primary Data: Are those which are collected afresh and for the first time and happen
to be original
2. Secondary Data: Are those who have been collected

Collection of Primary Data:

1. There are several methods of collecting primary data, particularly in surveys and
descriptive research.
2. In descriptive research, we obtain primary data either through observation or through
direct communication with respondents in one form or another or through personal
interviews

JU/JIT Construction Engineering and Management 17


Scientific Research Methods Dr. Engr. Bien Maunahan

Collection of Secondary Data

1. These are already available, i.e., they refer to the data which have already been
collected and analyzed by someone else.
2. Secondary data may either be published or unpublished data. The researcher must be
meticulous in using secondary data because the data available may be sometimes
unsuitable

Precautions in Data Collection

1. The data must be relevant to the research problem.


2. The data should be complete in itself and also comprehensive.
3. The data should have a minimum measurement error.
4. The data should be such as these can be subjected to statistical treatment easily
5. The data should be collected through the actual procedure.
6. The data should be accurate and precise.
7. The data should be reliable and valid.
8. The data should be such that it can be presented and interpreted easily.
9. It should be collected through formal or standardized research tools.

SAMPLING, POPULATION, AND SAMPLE

Sampling is the selection of participants for research.

 Sampling is an essential technique for the research. The research work


cannot be undertaken without the use of sampling.
 The total population study is impossible, and it is also impracticable.
 The practical limitation: cost, time, and other factors usually operative in
the situation stand in the way of studying the total population.
 The concept of sampling has been introduced to make the research
findings economical and accurate.

Population refers to the group that the research wishes to conclude from

❖ The population is the entire group of interest that the researcher aims to study.
It could be people, objects, events, or any defined unit relevant to the research
question.
❖ It helps researchers determine the appropriate methods, sampling strategies,
and scope of their study, ensuring that the findings are relevant, reliable, and
applicable to the intended context or group.

JU/JIT Construction Engineering and Management 18


Scientific Research Methods Dr. Engr. Bien Maunahan

Defining of Populations:

➢ Target Population: A specific group or entire set of individuals, cases, objects, or


phenomena that a researcher aims to study and draw conclusions about

Example: Engineers can be considered the target population within the


context of a construction project or engineering-related study.

➢ Accessible Population: the subset of the target population

Example: Surveys on new technology specifically to civil engineering


aspects, the accessible population might be limited to civil engineers who
specialize in structural design, materials, or other relevant areas

Types of Populations:

➢ Finite Population: A population with a known and countable number of elements.


o Example: The company is simultaneously managing 10 construction projects
in a given timeframe, the population of these projects would be finite.
➢ Infinite or Theoretical Population: A population that is theoretically unlimited or
very large, making it impractical to observe or count all its elements.
o Example: The population of potential customers seeking home renovation
services in that city or region could be considered infinite

Samples:

It refers to the members of the population that have been chosen to take part in the
research

It is used to gather data, make inferences, and draw conclusions about the entire
population based on the characteristics of the selected subset

Example:

Scenario: A construction project manager wants to assess the satisfaction levels of clients
who have recently completed home renovation projects with their company. The manager
wishes to gather feedback to improve services and understand areas for enhancement

Population: The population in this scenario would consist of all clients who have recently
undergone home renovation projects with the construction company.

JU/JIT Construction Engineering and Management 19


Scientific Research Methods Dr. Engr. Bien Maunahan

Sample: Instead of surveying or gathering feedback from the entire population of clients
(which might be impractical or resource-intensive), the project manager might opt to take a
sample from this population

The term sample refers to the members of the population that have been chosen to take part in
the research. Sampling procedures must ensure that the sample is representative of the
population.
Representative Samples

Two techniques are used to ensure a representative sample:


1. Random Sampling
2. Stratified Sampling and Stratified Random Sampling

Random Sampling

A random sampling procedure in which every member of the population has


an equal chance of being selected
Example:
1. Picking a name out of a hat
2. Lotto
3. Closing your eyes and selecting a number to match that number
with student ID numbers

Random Sampling

JU/JIT Construction Engineering and Management 20


Scientific Research Methods Dr. Engr. Bien Maunahan

Stratified Sampling and Stratified Random Sampling:

➢ It is used when you wish to eliminate the effects of confounding variables


➢ The effects of a specific variable can be eliminated as a possible confounding
variable in an experiment
➢ The variable could be any personal attribute, such as age, years of education,
ethnicity, gender, IQ, etc.
➢ Involves six procedures:
➢ Identifying a property that we believe may interface with the effects of
the IV (independent variable) on the value of the DV (dependent
variable)
➢ Measuring that appropriately for each member of the population
➢ Dividing the population into particular strata (groups) based on the
value of that variable
➢ Deciding on the number of participants required for the experiment
➢ Selecting participants in the same proportions as exist in the population
to make up the sample (stratified sample)
➢ Selecting a random sample from each stratum in the same proportions
as exists in the population (stratified random sampling)

STRATIFIED SAMPLING

JU/JIT Construction Engineering and Management 21


Scientific Research Methods Dr. Engr. Bien Maunahan

Sampling Flow Chart

Advantages of Sampling Technique

➢ It has greater adaptability.


➢ It is an economical technique.
➢ It has higher precision and accuracy in the observation.
➢ It has a higher speed in conducting research work.
➢ It has enormous scope in the field of research.
➢ It reduces the cost of observation or data collection.

Characteristics of a Good Sample

➢ A good sample is representative of the population corresponding to its


properties. The population is known as the aggregate of specific properties,
and the sample is called the sub-aggregate of the universe.

➢ A good sample is also economical from an energy, time, and


money point of view.
➢ A good sample is comprehensive. This feature of a sample is
closely linked with true representativeness.
➢ A good sample maintains accuracy. It yields accurate estimates or
statistics and does not involve errors.
➢ A good sample is free from bias
➢ A good sample is an objective one, and it refers to objectivity in
selecting a procedure
➢ The subjects of the excellent sample are easily approachable.

JU/JIT Construction Engineering and Management 22


Scientific Research Methods Dr. Engr. Bien Maunahan

➢ The size of a good sample is such that it yields accurate results.


The probability of error can be estimated.
➢ A good sample makes the research work more feasible. A good
sample has the practicability for the research situation

Types of Sampling

1. Probability Sampling
➢ The sampling method gives the probability that our sample is representative of
the population.
2. Non-probability Sampling
➢ If there is no such idea of probability, the sampling method is known as non-
probability sampling.
➢ Non-probability is also known as non-parametric sampling, which is used for a
specific purpose

SAMPLING

Probability Non-
Sampling Probability
Sampling

Simple Systematic Stratified Cluster Multi Stage


random

Accidental Purposive Quota Judgement

Probability Sampling

Types of Probability Sampling

1. Simple Random Sampling


2. Systematic Sampling
3. Stratified Sampling
4. Multiple or Double Sampling
5. Multi-stage Sampling
6. Cluster Sampling

JU/JIT Construction Engineering and Management 23


Scientific Research Methods Dr. Engr. Bien Maunahan

Simple Random Sampling

➢ A simple random sample is one in which each element of the population has
an equal and independent chance of being included in the sample
➢ It is done by using several techniques as :
➢ Tossing a coin
➢ Throwing a dice
➢ Lottery method
➢ Blindfolded method
➢ By using a random table
Advantages

➢ It requires minimum knowledge of the population.


➢ It is free from subjectivity and free from personal error.
➢ It provides appropriate data for our purpose
Disadvantages

➢ The representativeness of a sample cannot be ensured;


➢ It does not use knowledge about the population.
➢ The accuracy of the finding depends upon the size of the sample.

Systematic Sampling

➢ Systematic sampling requires complete information about the population.


➢ Now we decide the size of the sample.
 Let sample size = n and population size = N

 Now, we select each N/nth individual from the list, and thus we have
the desired size of the sample, known as a systematic sample.

➢ Thus for this technique of sampling population should be arranged in any


systematic way

JU/JIT Construction Engineering and Management 24


Scientific Research Methods Dr. Engr. Bien Maunahan

Advantages

•A simple method of selecting a sample.


•It reduces the field cost.
•The sample may be comprehensive and representative of the population.
• Observations of the sample may be used for drawing conclusions and
generalizations.
Disadvantages

➢ This is not free from error since there is subjectivity due to other individuals'
different ways of the systematic list.
• The information of each individual is essential.
• There is a risk in concluding the observations of the sample

Stratified Sampling

• The researcher divides his population into strata based on some characteristics
and draws a predetermined number of units at random from each of these
smaller homogeneous groups (strata).

Types of Stratified Sampling

1. Disproportionate stratified sampling.


2. Proportionate stratified sampling.
3. Optimum allocation stratified sampling.

Advantages

• It is a good representative of the population.


• It is an objective method of sampling
Disadvantages

• It is challenging to decide the relevant criterion for stratification.


• Only one criterion can be used for stratification, but it generally seems more
than one criterion is relevant for stratification.
• It is a costly and time-consuming method.
• The selected sample may be represented concerning the used criterion but not
for the other.
• There is a risk of generalization.

JU/JIT Construction Engineering and Management 25


Scientific Research Methods Dr. Engr. Bien Maunahan

Cluster Sampling
• To select the whole group is known as a Cluster sampling.
• In Cluster sampling, the sample units contain groups of elements (clusters)
instead of individual members or items in the population.

Advantages
• It may be a good representative of the population.
• It is an easy and economical method.
• It is practicable and highly applicable to education.
Disadvantages
• Cluster sampling is not free from error.
• It is not comprehensive.

Multi-Stage Sampling
• This sample is more comprehensive and representative of the population.
• Primary sample units are inclusive groups, and secondary units are subgroups
within these ultimate units to be selected, which belong to one and only one
group.
• Stages of a population are usually available within a group or population,
whenever the researcher does stratification.
• Individuals are selected from different stages for constituting the multi-stage
sampling

JU/JIT Construction Engineering and Management 26


Scientific Research Methods Dr. Engr. Bien Maunahan

Multi-Stage Sampling

Advantages

• It is a good representative of the population


• Multi-stage sampling is an improvement over the earlier methods.
• It is an objective procedure of sampling

Disadvantages
• It is a challenging and complicated method of samplings.
• It involves errors when we consider the primary and secondary stages.
• It is, again, a subjective phenomenon.

Non – Probability Sampling

Characteristics of Non-probability Sampling

1. There is no idea of the population in non-probability sampling.


2. There is no probability of selecting any individual
3. The non-probability sample has free distribution.
4. The observations of the non-probability sample are not used for
generalization purposes.
5. There is no risk of concluding.

JU/JIT Construction Engineering and Management 27


Scientific Research Methods Dr. Engr. Bien Maunahan

Accidental Sampling

• The term incidental or accidental applied to those samples that are taken
because they are most frequently available,
• This refers to groups that are used as samples of a population because they are
readily available or because the researcher is unable to employ more
acceptable sampling Methods.

Advantages
• It is a straightforward method of sampling.
• It reduces the time, money, and energy

Disadvantages
• It is not representative of the population.
• It is not free from error

Judgment Sampling

• This involves the selection of a group from the population based on available
information thought
• It is to be representative of the total population.
• Generally, the investigator should take the judgment sample, so this sampling
is highly risky.

Advantages
• Knowledge of the investigator can be best used in this sampling technique.
• This technique of sampling is also economical.

Disadvantages
• This technique is objective.
• It is not free from error
• It includes uncontrolled variation
• Generalization is not possible

Purposive Sampling
• The sample is selected by some arbitrary method because it represents the total
population or is known to produce well-matched groups.
• The idea is to pick out the samples concerning some essential criteria for the
particular study.
• This method is appropriate when the study places particular emphasis on the
control of certain specific variables

JU/JIT Construction Engineering and Management 28


Scientific Research Methods Dr. Engr. Bien Maunahan

Kinds of Purposive Sampling

• Snowball Sampling- Begin by identifying someone who meets the criteria for
inclusion in your study. Then ask the respondent to recommend others whom
they may know who also meet the criteria
• Modal Sampling-Sampling the most frequent case, such as polls
• Expert Sampling- sample of persons with known or demonstrable experience
and expertise in some area
• Heterogeneity Sampling- when we want to include all opinions or views, and
we are not concerned about representing these views proportionately

Advantages
• Use of the best available knowledge concerning the sample subjects.
• Better control of significant variables.
• The sample group's data can be easily matched.
• Homogeneity of subjects used in the sample.

Disadvantages
• The reliability of the criterion is questionable.
• Knowledge of the population is essential.
• Errors in classifying sampling subjects.
• Inability to generalize the total population.

Quota Sampling
• This combined both judgment sampling and probability sampling.
• The population is classified into several categories: based on judgment,
assumption, or previous knowledge, the proportion of the population falling
into each category is decided. After that, a quota of cases to be drawn is fixed,
and the observer is allowed to sample as he likes.
• Quota sampling is very arbitrary and likely to figure in municipal surveys.

Advantages
• It is an improvement over judgment sampling.
• It is an easy sampling technique.
• It is most frequently used in social surveys.

Disadvantages
• It is not a representative sample.
• It is not free from error.
• It influences regional geographical and social factors.

JU/JIT Construction Engineering and Management 29


Scientific Research Methods Dr. Engr. Bien Maunahan

Sample Size

In addition to the purpose of the study and population size, the following three criteria
usually need to be specified to determine the appropriate sample size:

1. the level of precision,


2. the level of confidence or risk, and
3. the degree of variability in the attributes being measured

The Level of Precision


The level of precision is sometimes called sampling error, which is the range in which
the actual value of the population is estimated.
This range is often expressed in percentage points (e.g., ±5 percent). Thus, if a
researcher finds that 60% of engineers in the sample have experience in industries
with a precision rate of ±5%, they can conclude that between 55% and 65% of the
engineers in the population have the practice.

The Confidence Level


The confidence or risk level is based on ideas encompassed under the Central Limit
Theorem.
➢ Approximately 95% of the sample values are within two standard
deviations of the actual population value (e.g., mean) in a normal
distribution).
In other words, this means that if a 95% confidence level is selected,
➢ 95 out of 100 samples will have the actual population value within the
range of precision specified earlier.
 There is always a chance that the sample you obtain does not represent the true
population value
➢ This risk is reduced to 99% confidence levels and increased by 90%
(or lower).

JU/JIT Construction Engineering and Management 30


Scientific Research Methods Dr. Engr. Bien Maunahan

Degree of Variability

The third criterion, the degree of variability in the attributes, refers to the
distribution of characteristics in the population

The more heterogeneous a population, the larger the sample size required to
obtain a given level of precision. The less variable (more homogeneous) a
population, the smaller the sample size

 Note that a proportion of 50% indicates a higher level of variability


either 20% or 80%.
 This is because 20% and 80% indicate that a vast majority do not or
do, respectively, have the attribute of interest. Because a proportion of
0.5 means the maximum variability in a population, it is often used in
determining a more conservative sample size; that is, the sample size
may be larger than if the real variability of the population attribute was
used.

SAMPLE SIZE Formulas

You can find the following formulae (or variations thereof) in most statistics
textbooks, especially descriptive statistics dealing with probability.

The sample size for an infinite population, where the population is more significant than
50,000

𝑍 2 ∗ 𝑝 ∗ (1−𝑝)
SS = 𝐶2
SS = sample size
Z = Z value (1.96 for a 95 % confidence level)
P = percentage of population picking a choice, decimal
C =confidence interval in decimal (±0.04)

JU/JIT Construction Engineering and Management 31


Scientific Research Methods Dr. Engr. Bien Maunahan

A Z-values represents the probability that a sample will fall within a specific distribution.

The Z-values for confidence levels are:

1.645 = 90 percent confidence level


1.96 = 95 percent confidence level
2.576 = 99 percent confidence level

Sample size – finite population where the population is less than 50,000

𝑆𝑆
New SS = 𝑆𝑆−1
(1+ [ ])
𝑁
SS = sample size
N = population

Example
Find the sample size for a total student population in 5600. Use a 95% confidence
level, a population percentage of 60%, and a confidence interval of 4%

Sample Size

JU/JIT Construction Engineering and Management 32


Scientific Research Methods Dr. Engr. Bien Maunahan

In summary, use different criteria to determine the sample size. In qualitative


surveys, the aim should gather as many different views as possible. In
quantitative surveys, the spread and effect sizes come into play, together with
the cost or difficulties in accessing the potential respondents.

JU/JIT Construction Engineering and Management 33


Scientific Research Methods Dr. Engr. Bien Maunahan

Some References: Here are the publication years for the mentioned books on
sampling techniques and research methodology:

1. “Sampling Techniques" by William G. Cochran: This book was first published in


1977, and it remains a foundational text in sampling theory and methods. Several
editions have been released, so you might find newer editions with updates and
revisions.
2. "Sampling: Design and Analysis" by Sharon L. Lohr: The first edition of this
book was published in 1999. Subsequent editions might have been released with
updated content and additional material.
3. "Sampling Methods for Applied Research" by Richard A. Marafiote: This book
was published in 2003 and provides practical insights into various sampling methods
for applied research.
4. "Sampling: A Guide for Internal Auditors" by Dan M. Swanson: This book was
published in 2001 and focuses specifically on sampling techniques for internal
auditors.
5. "Sample Size Determination and Power" by Thomas P. Ryan: The publication
year for this book is 2013, offering insights into sample size determination, power
analysis, and related statistical methods.
6. "Sampling Methods in Forestry and Range Management" by Hailemariam
Temesgen and Chris Cieszewski: This book was published in 2008 and focuses on
sampling techniques within forestry and range management contexts.
7. "Research Design: Qualitative, Quantitative, and Mixed Methods Approaches"
by John W. Creswell and J. David Creswell: This book has multiple editions; the
latest edition (5th edition) was published in 2018 and covers a wide range of research
methodologies, including sampling considerations.

Please note that some of these books might have newer editions available with updated
content, so it could be beneficial to explore the latest editions for the most current
information and insights.

JU/JIT Construction Engineering and Management 34


Scientific Research Methods Dr. Engr. Bien Maunahan

Many books on sampling techniques and research methodology are available for purchase
or download in electronic formats. Several platforms offer digital versions of these books
for easy access. Here are some popular online platforms where you might find those books:

1. Amazon Kindle Store: Amazon offers a wide range of eBooks on research methods,
sampling techniques, and statistical analysis that can be purchased and downloaded to
Kindle devices or read using the Kindle app on various devices.
2. Google Books: Google Books provides access to a vast collection of books. While
not all books may be available for full download due to copyright restrictions, many
titles offer previews or limited pages for free and allow users to purchase digital
copies.
3. Project Gutenberg: This platform offers free access to a wide range of public
domain books. While it might not have the most recent publications, it can be a
resource for classic texts and older editions that are freely available for download.
4. Online Libraries and Academic Databases: Institutions, universities, and libraries
often provide access to electronic resources, including eBooks, through their online
libraries or academic databases. If you're affiliated with an academic institution, check
their library resources for available digital books on sampling and research
methodology.
5. Publisher Websites: Some publishers provide direct access to digital copies of their
books through their websites or partner platforms. Publishers often offer eBooks for
purchase or download in PDF or ePub formats.

Before downloading eBooks, consider checking multiple platforms to compare availability,


prices, and formats. Some platforms might offer free previews or limited access, while others
require purchasing or subscribing to access digital copies. Additionally, remember to respect
copyright laws and choose legitimate sources for downloading digital books.

Reading Assignment
 Review some of the formulas in determining the sample size out of the
population.
 Try looking for the book “Determining Sample Size” by Patrick Dattalo

JU/JIT Construction Engineering and Management 35


Scientific Research Methods Dr. Engr. Bien Maunahan

DATA PROCESSING

After data have been collected, the next step is to process them into information
suitable for analysis. The processing of qualitative data is part of data analysis rather than a
separate process. For quantitative data, processing is necessary to ensure the integrity of the
data.

The first stage of data processing is to edit the data for errors, contradictions,
inconsistencies, and omissions that have escaped preliminary field editing. Falsified data are
usually rejected. Suppose errors or missing data have been spotted. In that case, a decision
has to be made to discard the information, re-contact the respondent, use an average value
among similar respondents, interpolate from other discounts, or use subject matter knowledge
to guess an appropriate value. Care must be exercised in handling outliers because they do
not fit the theory. They may provide a refutation of the theory. Data obtained from published
documents may also require editing. They may contain biases such as arbitrary accounting
conventions and failure to consider quality change, price discounts, and reporting errors.
They may also contain misprints.

The second stage of data processing is transforming the data through conversion,
adjustment, or reconstruction. This may involve converting one currency to another,
converting monthly to annual income, deriving net from gross values, or rebasing a time
series to a new base year.

The third stage is to code the data by labeling, classifying, and organizing them for
subsequent analysis. Coding is generally straightforward for quantitative data, such as
developing the data table or matrix for regression or multivariate analyses using statistical
software. The researcher should avoid heaping, where too much data fall into a particular
category. If it occurs, reclassification is necessary.

For qualitative data, coding is the basis for analysis because respondents provide
open-ended answers to questions. The development of the storyline is fundamental in
qualitative studies, so it is not just a matter of labeling and classifying data.

The processing of data and further analysis may be broken up into three stages:

1. Data management,
2. Explanatory data analysis
3. Statistical analysis (testing and modeling)

JU/JIT Construction Engineering and Management 36


Scientific Research Methods Dr. Engr. Bien Maunahan

The process of analyzing data in research or any analytical project can be segmented into
three main stages:

1. Data management: This initial stage involves organizing, cleaning, and preparing the
raw data for analysis. It includes activities such as data collection, data entry, data
validation, and data cleaning to ensure accuracy and consistency. Data management
aims to transform raw data into a usable format that can be effectively analyzed.
Techniques like data coding, formatting, and structuring are part of this stage. The
goal is to create a dataset that is ready for further exploration and analysis.
2. Explanatory data analysis: Once the data is cleaned and organized, the next stage
involves exploring and understanding the characteristics, patterns, and relationships
within the dataset. Explanatory data analysis employs various statistical and
visualization techniques to describe the main features of the data, detect anomalies or
outliers, identify trends, and uncover insights. This stage focuses on summarizing the
data, examining distributions, relationships between variables, and gaining an initial
understanding of the dataset's key aspects. Visualizations like histograms, scatter
plots, and summary statistics (mean, median, standard deviation, etc.) are commonly
used in this phase.
3. Statistical analysis (Testing and Modeling): In this final stage, statistical methods,
tests, and models are applied to the prepared data to test hypotheses, make
predictions, or derive conclusions. This phase involves more advanced statistical
techniques such as hypothesis testing, regression analysis, machine learning
algorithms, or other modeling approaches depending on the nature of the research or
analysis goals. The aim is to draw meaningful conclusions, validate hypotheses, or
develop models that can predict or explain phenomena within the dataset.

These stages are interconnected and iterative; findings from one stage may lead to revisiting
the previous stages for further refinement or exploration. Each stage plays a crucial role in the
overall data analysis process, leading to a comprehensive understanding and interpretation of
the data to derive valuable insights and conclusions.

JU/JIT Construction Engineering and Management 37


Scientific Research Methods Dr. Engr. Bien Maunahan

DATA ANALYSIS

How to Analyze the Data?

The methods you use to analyze your data will depend on whether you have chosen to
conduct qualitative (words) or quantitative (numbers) research, and this choice will be
influenced by:
• personal preference
• methodological preference
• educational background

Stages of Data Processing

• Sorting data - Into groups of different study populations or comparison groups


• Quality control checks
 Check again for completeness and internal consistency
 Missing data
 Inconsistency - correct, return or exclude
• Data processing
 Categorizing the data
 Coding and data entry
 In a proposal-dummy table that contains all elements of a real table,
except that the cells are still empty
• Data analysis
 Frequency counts
 Cross-tabulations
 And others

How to Analyze Quantitative data?

 For quantitative data analysis, issues of validity and reliability are essential.
 The analysis of large-scale surveys is best done using statistical software, although
simple frequency counts can be undertaken manually.

1. Eyeballing - Eyeballing just means looking at your numbers to see what they
tell you:
1. What do they seem to say?
2. Are they going up or down?
3. Are they all around one point?
4. Are there any that seem not to fit with the others?

Sometimes: we should rely on our common sense as well as the statistics to


tell us what a range of numbers may be saying

JU/JIT Construction Engineering and Management 38


Scientific Research Methods Dr. Engr. Bien Maunahan

2. Presenting - Do remember your readers and that you:


1. need to make things intelligible for them, and
2. demonstrate to them that you can think intelligently about numbers and
how they can best be presented.
3. Tables and charts can do to present quantitative data. Choose the one
that best explains these numbers

The statistics described here are called descriptive statistics (because they
represent them), but there are others with different purposes.

If you use these statistics, you will probably need to use SPSS rather than Excel.
SPSS (Software Package used for Statistical Analysis)

Options for Analyzing Numeric Data

➢ Correlation: a statistical technique to determine how strongly two or more


variables are related.
➢ Cross-tabulations: obtaining an indication of the frequency of two
variables occurring simultaneously.
➢ Data and text mining: computer-driven automated techniques that run
through large amounts of text or data to find new patterns and information.
➢ Exploratory techniques: taking a ‘first look’ at a data set by summarizing
its main characteristics, often through visual methods.
➢ Frequency tables: arranging collected data values in ascending order of
magnitude and their corresponding frequencies to ensure a clearer picture
of a data set.
➢ Measures of central tendency: a summary measure that attempts to
describe a whole set of data with a single value representing the middle or
center of its distribution.
➢ Multivariate descriptive: providing simple summaries of (large amounts
of) information (or data) with two or more related variables.
➢ Non-parametric inferential: flexible data and do not follow a normal
distribution.
➢ Parametric inferential: carried out on data that follow specific parameters.
➢ In the case of experimental research, data are generated depending on the
compared parameters and the results of laboratory experiments

3. Explaining
1. The next thing to remember with numbers is that the numbers and the
statistics used to analyze them serve no function in themselves.
2. They help you analyze, but this analysis exists for you to explain,
discuss, and communicate your findings.
3. So, remember that when you present an analysis using numbers, you
will need to explain with words

JU/JIT Construction Engineering and Management 39


Scientific Research Methods Dr. Engr. Bien Maunahan

How to Analyze Qualitative Data?

 Qualitative data analysis is a very personal process.

Ask two researchers to analyze a transcript, and they will probably come up
with very different results.

 Types of qualitative data analysis:


➢ Coding Analysis
➢ Reflexivity Analysis
➢ Narrative Analysis
➢ Discourse Analysis
➢ Content analysis
➢ Thematic analysis
➢ Timeline

Coding Analysis - The raw data require some processing before the actual data analysis.
These may include making back-ups of original copies, indexing sources for easy reference
and retrieval, and transcribing audio recordings into texts to facilitate analysis. The coding
of texts consists of assigning words, phrases, symbols, or numbers to each category.

Reflexivity reduces researcher bias through continuous self-questioning, not taking anything
for granted — not even language. There is awareness of self-bias and recognition of multiple
views, explanations, and options. It is a crucial principle of qualitative research.

The narrative is a non-fiction storyline that guides the entire data analysis. It is an intelligible
story of human actions and the resulting events in the temporal order. The framework or
hypothesis provides the guideposts for the story. The researcher then proceeds to code the
data, knowing that the narrative may change as the researcher discovers new ideas and
evidence. Construction of coherent narratives of the changes occurring for an individual, a
community, a site or a program or policy

Discourse Analysis's purpose is to deconstruct texts to reveal how they create particular
views of “reality” and sustain life forms through such cognition and power relations.

Content analysis: reducing large amounts of unstructured textual content into manageable
data relevant to the research questions. Content analysis involves quantifying the contents of
written or digital texts, such as looking for the occurrences of particular words or images.

Thematic coding: recording or identifying passages of text or images linked by a common


theme or idea, allowing the indexation of text into categories.

Timelines: a list of critical events, ordered chronologically.

JU/JIT Construction Engineering and Management 40


Scientific Research Methods Dr. Engr. Bien Maunahan

Data analysis approaches for causal attribution.

 Counterfactual approaches
➢ Developing an estimate of what would have happened in the absence of the
program or policy implies using a control group or comparison group.
 Consistency of evidence with the causal relationship
➢ It identifies patterns that would be consistent with a causal relationship and
then seeks confirming and disconfirming evidence.
 Ruling out alternatives
➢ Identifying possible alternative causal explanations and then seeking
information to determine if these can be ruled out.

The ethical issue of data collection and analysis

 During the data collection stage, respondents were assured that all data were provided
confidentially and would be used exclusively for evaluation purposes
 During the focus group discussions, the names of the participants were not recorded,
nor were the sessions taped
 During the interviews, the interactions among the participants themselves as well as
between the participants and the evaluators were based on mutual respect and trust

The same evaluation also provides excellent examples of safeguards to ensure the
confidentiality of data:

 During data processing, no precise references were made to particular respondents or


statements made by respondents
 Data from the questionnaires were statistically processed, and the qualitative data
was reviewed as a whole in the absence of any personal information.

Scientific research requires the data by means


of some standardized research tools
or self-designed instruments.

A great variety of research tools are of


many kinds and employs a distinctive way of
describing and qualifying
the data

JU/JIT Construction Engineering and Management 41

You might also like