Chapter IV - Operationalization Process Edited
Chapter IV - Operationalization Process Edited
Learning Sequence/Input
Topic Outline
3. Research Design
4. Research Variables
5. Research Hypothesis
6. Measurement of Data
7. Research Proposal
• The conceptualization process ends with the preparation of a conceptual framework that is
obtained from the theoretical framework.
• The review of related literature, on the other hand, is the basis of the theoretical framework.
• The operationalization process takes off from conceptual framework. (The activities in the
operationalization process are shown in Figure 1.)
✓ In this process, the primary task is the preparation of the operational framework.
✓ The process extends up to the point when the researcher is ready to go on fieldwork
to gather data.
✓ Once the operational framework is done, the researcher can develop the research
design which serves as the basis of identifying the methods of measurement and
data-gathering.
✓ After the research design, the variables and the corresponding indicators are
identified and defined operationally, the data-gathering methods are determined,
and the research instruments are prepared.
✓ Finally, sampling plan is developed.
Developing the
Operational Framework Research Design
• Why – Purpose of Study
Research Variables and • Who – Unit of Analysis
Indicators • What – Point of Focus
• When – Time Dimension
•Identification
• Definition
• Measurement
Data Collection
• Data Gathering
Methods
• Instruments
• Sampling Plan
o In presenting the variables of the study, the operational framework usually shows the
variables that establish association or relationship such as cause and effect
relationship:
➢ independent variable is the cause. Its value is independent of the other
variables in the study.
• The operational framework may also be a schematic presentation of the areas covered in
the study. It may also show the phases or major stages to be undertaken in the research.
o The study and examines whether certain internal organizational factors (independent
variables) have relationship with the state of institutionality (dependent variables) of
small and medium enterprises (Figure 2).
Internal Variables
Institutionality
• Leadership style
• Production policies • Technical competence
• Market access • Normative
• Human resources commitment
• Financial Resources • Innovative thrust
• Environmental image
• Spread effects of
External Variables
activities
• Enabling linkage • Autonomy
• Functional linkage • Influence
• Normative linkage • Public acceptance
• Diffuse linkage
• An operational framework detailing the areas of study is shown in Figure 3. The study
focuses on three major areas concerning financial management as a system of good
governance. These areas are the system components, performance measurement, and
overarching goals.
• The operational framework showcasing the phases of the study is shown in Figure 4. The
study entails four phases: conducting an inventory of organizations or institutions,
interpreting the data gathered from the inventory, selection of the units of further studies,
and analysis of the unit of study.
• The operational definition of terms complements the operational framework through the
meaning of the variables, areas, phases or processes presented therein.
• Definition is one avenue that reduces the danger of confusion due to different meanings
that the readers may attribute to the concepts presented by the researcher.
• It gives meaning to a variable by spelling out what the researcher must do to measure it.
Example: Information seeking may be defined in terms of the
✓ number of hours spent listening to political radio programs;
✓ extent of reading a particular news story;
✓ number of media that a person exposes himself daily; or
✓ types of news stories to which the person would be exposed.
✓ It must have empirical referents: one must be able to count, measure, or gather
the information through the senses.
❖ One common mistake among researchers is the use of the nominal definition of
terms.
✓ This definition describes the meaning of the concept by using other concepts. It
specifies the observational strategy but it does not allow the process of
observation.
Research Design
• Research design is a scheme prepared to identify the different conditions necessary for the
measurement, collection, and analysis of data. It helps in determining the research
method(s) to be used.
• The research design is different from the research method, which refers to the data-
gathering techniques.
• A research design is not just a work plan that details what has to be done to complete the
study. The work plan, specifically with respect to the data collection and analysis will flow
from the research design.
• The research design should ensure that the evidence obtained will enable the researcher
to answer the research question unambiguously.
• Research design is a logical structure of the inquiry; that is, it deals with the logical problem
and not with the logistical problem. Thus, it is improper to treat research design as a mode
of data collection.
• In determining the research design, one must avoid committing
✓ reductionism
✓ ecological fallacy
✓ individualistic fallacy
Reductionism is an overly strict limitation on the kinds of concepts and variables to explain
a broad range of human behavior. Essentially, reductionism tends to deceive a researcher
into believing that certain particular units of analysis or variables are more relevant than
others.
✓ Examples:
o researchers with economics background may consider only economic
variables such as supply and demand
o sociologist may consider only sociological variables such as norms, values,
and roles
o accountants may consider only accounting variables such as profit, costs,
and revenues
Individualistic fallacy entails conclusions derived from general patterns of attitudes and
actions of people whom the researcher has previous knowledge or familiarity.
✓ For instance, if a researcher knows a rich businessman who has no formal
education, he/she might commit this fallacy if the conclusion flows from the
previous observation that education has no influence on the wealth of a person.
Obviously, the general pattern of higher education relating to higher income is not
far-fetched.
• In preparing the research design, the conditions to be considered include
a. purpose of the research
b. unit of analysis
c. point of focus
d. time dimension
Purposes of Research
• The purpose of a research answers the question of "why" the research is to be conducted.
✓ A research can have any or a combination of the following purposes:
o description
o explanation
o exploration
✓ While it is useful to distinguish the three purposes of research, it makes sense to
note that many studies have elements of all three.
A descriptive research is concerned with delineating the way things are -- the current state of
condition or existing manner of doing things.
o This type of study has two primary purposes:
1. to portray accurately the characteristics of a particular phenomenon
2. to determine the frequency with which the phenomenon occurs or associated
with something else.
o It concentrates on the accuracy and completeness by which the phenomenon is
depicted and revealed.
o The researcher should be able to determine the appropriate measurement and data-
gathering methods to ensure the right quality of descriptions.
In an explanatory research, the researcher would like to find out why certain things happen
or why people prefer to do certain things.
o This type of research deals with the use of variables to find out the relationships
between these variables which could explain why certain things happen.
o The ability of a research to explain commonly gives it the ability to predict. This
predictive power assumes the ability to establish cause-effect relationship.
In an exploratory research, the researcher examines a relatively new and unstudied subject
matter.
o Exploratory studies are typically done for three purposes:
1. to satisfy the researcher's curiosity and desire for better understanding
Unit of Analysis
• This part of the research design answers the question "who." It specifies the source of
data or the units of observations.
• The unit of analysis of a research can be one or a combination of the following:
1. individuals
2. groups
3. organizations
4. social artifacts
Individuals frequently serve as the unit of study. Understandably, social phenomena are
studied by examining and analyzing the individuals who are part of such phenomena.
✓ The individual, as a unit of analysis, may also be characterized in terms of their
membership in a social grouping.
✓ While the individuals serve as the unit of analysis, the write-up of analysis is not on
the individual level since any given individual's attitudes or behaviors are generally
of no interest to many researchers. Rather, the researcher is interested in the
attitudes and behaviors of an aggregate of individuals.
Groups that may be studied include the family, work group, position cluster, industry
sectors, geographical areas, or portion of an organizational hierarchy.
Organizations in business, professions, and society can also be the unit of analysis.
Examples:
✓ business organizations in the form of partnerships and corporations
✓ professional organizations
✓ churches
✓ socio civic organizations
✓ government agencies
✓ educational institutions
✓ non-profit organizations
Point of Focus
• The point of focus answers the question "what" that can be the (1) characteristics, (2)
orientations, and (3) actions.
Orientations are attitudes, beliefs, personality traits, prejudices, predispositions, and the
like.
o In the case of groups and organizations, orientations refer to their philosophies,
purposes, policies, regulations, processes, and procedures.
o Social interactions might have political or religious orientation, anti-labor or anti-
poverty orientations, and the like.
Actions are accounts of events or processes undertaken by the unit of analysis. Examples
are voting, bond buying, investing, holding strikes, engaging in credit transactions,
prosecution, product advertising, and the like.
Time Dimension
• This answers the question "when" to do the research. Time plays significant roles in the
design and conduct of research.
✓ First, it is a vital element in determining causal relationship between variables.
✓ Second, it is also a basis of making generalization in the findings of the study.
One can conduct a cross sectional or longitudinal research.
A trend study looks into the dynamics of a particular attribute of the population over
time.
A panel study measures the same sample of respondents at different points in time.
✓ Unlike trend studies, panel studies can reveal both net change and gross
change in the dependent variable.
✓ Panel studies can reveal shifting attitudes and patterns of behavior that
might go unnoticed with other research approaches.
✓ Depending on the purpose of the study researchers can use either:
o a continuous panel, consisting of members who report specific
attitudes or behavior patterns on a regular basis,
o an interval panel, whose members agree to complete a certain number
of measurement instruments only when the information is needed.
✓ In general, panel studies provide data suitable for sophisticated statistical
analysis and might enable researcher to predict cause-effect relationships.
1. Experimental design
2. Non-experimental design
Experimental design
• Experiment – hailed as the most powerful design for investigating relationships between
and among variables.
• It has become the most prestigious means of advancing scientific knowledge.
• An experiment typically implies a highly controlled situation wherein researcher tries to
make the predicted relationship occur.
• In an experiment, the researcher looks for a relationship. The researcher changes one
variable and measures the resulting behavior through measurement of another variable.
Then he/she sees if the manipulation changed the behavior so that the predicted
relationship is observed.
• In a social science experiment, the researcher actively tries to change the situation,
circumstance or experience of the participants. This process, called manipulation, leads to
a change in behavior of the participants that is measured.
• The basic idea underlying all experimental research is: try something and systematically
observe what happens. Changes are planned and deliberately manipulated in order to
study its effect(s) on one or more outcomes.
• Experiments are employed to test a causal hypothesis. The logic behind is: If the hypothesis
is correct, the researcher sees an influence or change in the behavior whenever he does
this or that to the participants.
• Generally, the experimenter is present on the scene when the data are collected so that
he/she could exercise considerable control over the experimental environment. This
control over the research process allows the experimenter to establish causation rather
than mere correlation. In fact, the establishment of causation is the usual goal of the
experiment.
1. There are at least two (but often more) conditions that are compared to assess the
effect(s) of a particular treatment.
2. There are usually two groups of subjects-an experimental group and a control or
comparison group, although it is also possible to conduct an experiment with only one
group by providing all treatments to the same subjects.
✓ The experimental group receives a treatment of some sort while the control group
receives no treatment or the comparison group receives a different treatment.
4. The effect of the manipulation of the independent variable on the dependent variable is
observed or measured.
✓ Random assignment should take place before the experiment begins. It allows the
researcher to form groups that are equivalent, right at the beginning of the study.
Thus, they differ only by change in any variable of interest.
✓ It is one of the reasons why experiments in general are more effective than other
types of research for assessing cause-and-effect relationships.
✓ Random assignment is also the main distinction between true experiments and
quasi-experiments.
Forms of true experimental designs that are commonly used in social research
1. Randomized Posttest Only Control Group Design. This involves two groups formed by
random assignment. One group receives the experimental treatment while the other does
not. Both groups are post-tested on the dependent variable. A diagram of this design is
shown in Figure 5.
R X1 Outcome
Random Workshops with Posttest Auditor
assignment of 25 sensitivity Morale
auditors to training Questionnaire
50 experimental
auditors Dependent
randomly Variable
selected
R X2 Outcome
Random Workshops that Posttest Auditor
assignment of 25 do not have Morale
auditors to sensitivity Questionnaire
experimental training
Figure 5. Randomized Posttest Only Control Group Design
2. Randomized Pretest-posttest Control Group Design. This differs from the first design
solely in the use of the pretest. Two groups of subjects are used, with both groups being
measured or observed twice. The first measurement serves as the pretest, the second as
the posttest. Random assignment is used to form the groups. The observations are
collected at the same time for both groups. The diagram for is shown in Figure 6.
R O X1 O
Random Pretest Auditor Treatment Posttest
assignment of Morale
Questionnaire Workshop with Auditor
25 auditors to
(Dependent Sensitivity Morale
experimental
Variable) Training Questionnaire
50 group
auditors Dependent
randomly Variable
selected
R O X2 O
Random Pretest Auditor Treatment Posttest
assignment of Morale
Questionnaire Workshop with Auditor
25 auditors to No Sensitivity Morale
(Dependent
experimental Training Questionnaire
Variable)
group group
Figure 6. Randomized Pretest-Posttest Only Control Group Design
3. Solomon Randomized Four Group Design. This involves random assignment of subjects to
four groups, with two of the groups being pretested and the other two not. One of the
pretested groups and one of the unpretested groups are exposed to the experimental
treatment. All four groups are then posttested. The diagram is shown in Figure 7.
R O X1 O
Random Pretest Auditor Treatment Posttest
assignment of 25 Morale Auditor Morale
auditors to Questionnaire Workshop with Questionnaire
experimental (Dependent Sensitivity (Dependent
group (Group 1) Variable) Training Variable)
R O X2 O
Random Pretest Auditor Treatment Posttest
assignment of 25 Morale Auditor Morale
auditors to Questionnaire Workshop with Questionnaire
100 control group (Dependent No Sensitivity (Dependent
auditors (Group 2) Variable) Training Variable)
randomly
selected then
divided into R X1 O
four groups Random Treatment Posttest
assignment of 25 Auditor Morale
auditors to Workshop with Questionnaire
experimental Sensitivity (Dependent
group (Group 3) Training Variable)
R X2 O
Random Treatment Pretest Auditor
assignment of 25 Morale
auditors to Workshop with Questionnaire
control group No Sensitivity (Dependent
(Group 4 Training Variable)
A quasi-experimental design follows the procedures of an experiment but does not randomly
assign participants or people to the treatment and comparison groups.
✓ It looks a bit like an experimental design but lacks the key ingredient of random
assignment.
✓ It is more easily implemented than the randomized one.
✓ lt appears to be inferior to randomized experiments.
✓ Groups are selected upon which a variable is tested, without any random pre-
selection processes.
o For instance, in performing this type of design in an audit staff training class, the
participants of the study can be selected arbitrarily through seating arrangement
or by alphabet division.
o This type of selection is convenient for it causes little disruption as possible.
Survey
• Survey is considered the best design available to researchers who are interested in
collecting original data for describing a population too large to observe directly.
• A survey may be used for descriptive, explanatory, and exploratory purposes. It can also
be used to show changes in the subject of study and make comparisons between certain
attributes.
• A survey is also an excellent vehicle for measuring attitudes, opinions, beliefs, knowledge,
and abilities. This is chiefly used in studies that have individual person as the unit of
analysis. Although this can be used also for groups or organizations, a survey necessitates
that some individual persons become respondents or informants.
• In a survey, the main pathway by which information is collected is by asking questions; the
answers to these questions constitute the data of the study.
✓ Survey research is used primarily in business to find out customer satisfaction with
respect to products and services strategies are enhanced, innovative measures are
formulated, and products are further developed.
✓ Survey has a broad appeal in social sciences including political science because it
reflects the attitudes, preferences, and opinion of the people from whom the society's
policy makers derive their mandates.
✓ Development projects also use survey to find out the level of acceptance of the people
and their relative capacity to adapt to the possible effects of development in the
place. To be considered as formal research, these survey designs should have the
required elements, systems and procedures that formal researches have.
Case Study
• The case study investigates trends and specific situations in many scientific disciplines.
Basically, a case study is an in-depth inquiry of a particular situation rather than a
sweeping statistical survey.
• It is also useful for testing whether scientific theories and models actually work in the real
world.
• It is used to narrow down a very broad field of research into one easily researchable topic.
✓ For instance, instead of conducting a survey of all manufacturing companies in a
geographical area, a thorough examination of selected companies that
manufacture animal feeds is done in the form of a case study. The results of the
study would be an extensive portrayal of the attributes, conditions, and actions
of the feed manufacturers.
• The advantage of the case study design is that the researcher can focus on specific and
interesting stories. Thus, the research is thorough. However, it requires that note-taking
should be meticulous and systematic.
• In the design of a case study, it is important to plan how the researcher is going to address
the study. Unlike a scientific report, there is no strict set of rules tor a case study. The
most important part is making sure that the study is focused and concise; otherwise, the
researcher will end up having to wade through a lot of irrelevant information.
• In a case study, the researcher takes a passive stance by being more of an observer than
an experimenter.
✓ The analysis of the case results tends to be more opinion-based than statistically
treated. The idea is for the researcher to collate data into a manageable form and
construct a narrative around them.
✓ In a multi-subject case, each subject must be treated individually but cross-case
conclusions can be drawn. There really is no right or wrong answer in a case
study.
Research Variables
• Variables are measured so that relationships between them can be identified and tested.
✓ This type of variable is capable of taking an ordered set of values within a certain
range.
o The values reflect at least a rank order such that a larger value of the
variable means more of the property in question than a smaller value.
Oftentimes, the quantitative variables use a scale.
✓ One categorical variable and one quantitative variable can also have relationship.
o Example:
a. the method of training the audit staff to write audit reports
(categorical) and the level of achievement of the staff in writing the
report
b. the nationality of consultants (categorical) and the percentage of
accomplishment of work targets;
c. the coaching approach used for new salesmen (categorical) with
their level of anxiety.
o Example:
✓ In measuring the relative effectiveness of teaching models (lecture, case study,
and group work) for new staff auditors, the active variables would be the
structure and contents of the models since they could vary and any model might
be tested on any population group. The contents, structure, and testability of a
model on a population group may also vary from researcher to researcher.
✓ On the other hand, the attribute variables include the characteristics of the new
staff auditors (such as their age, gender, religion, attitudes, and level of
motivation) since a researcher does not have any control over characteristics of
these new staff.
✓ Extraneous variables may influence the dependent variable but are not part of the
study. The four ways to control this type of variable are
1. to eliminate it as a variable
o The principle behind this is to eliminate the effect of a possible influential
independent variable on a dependent variable by choosing the subjects
so they are as homogenous as possible on that independent variable.
2. to apply randomization
o By randomization, the experimental groups can be considered equal in
all possible ways.
3. to build it right into the design as an independent variable
o In building the extraneous variable in the design, it can then be controlled
as an attribute variable. Thus, the research will yield additional
information about the effect of the variable on the dependent variable
and about its possible interaction with other independent variables.
4. to match subjects.
o In matching the subjects, the researcher splits a variable into two or more
parts (for example, high and low level) and then randomize within each
level.
• A causal relationship implies that the change in one variable causes change in another
variable.
✓ This relationship is expressed as "X causes Y, if…” In other words, there is a
relationship between X and Y.
✓ The relationship is asymmetrical so that a change in X results in a change in Y but not
vice versa.
✓ Further, this implies that a change in X results in change in Y regardless of the actions
of other factors.
• Causal relationship is expressed in terms of direction and strength.
✓ The direction of relationship can either be positive or negative.
o In a positive relationship, both variables vary in the same direction. That means
an increase in the value of one variable is accompanied by an increase in the value
of the second variable. It follows that a decrease in one variable is accompanied
by a decrease in the other variable.
o Negative relationship means that an increase in one variable is accompanied by
a decrease in other variable. Therefore, the direction tells whether the
relationship between variables is either positive or negative.
✓ The strength of relationship, also called magnitude, shows the extent to which the
variables co-vary positively or negatively. It is measured by correlation coefficient.
✓ In a correlation analysis, the scale/ level of measurement used is the interval or ratio.
The obtained correlation coefficient takes an absolute value between 0 and 1, where
0 denotes no correlation; +1 denotes perfect correlation between directly related
variables (positive correlation); and -1 denotes perfect correlation between inversely
related variables (negative correlation). The statisticians use the following ranges for
classification of results:
Research Hypothesis
• A hypothesis is testable when the analysis of data could possibly enable a researcher to
clearly support or refute certain proposition about the subject variables.
• In summary, a testable hypothesis should state relationship between variables and the
direction of said relationship. It does not use value judgment, meaning, the hypothesis
should not be judgmental.
o The potential for specifically potential violence generally varies strongly with the
potential for group violence.
o The magnitude of political violence varies strongly with the potential for political
violence.
3. Hypotheses on Bureaucracy. If the research question is "What is the effect of the
bureaucratic form of organization in a business entity?" the hypotheses can be as follows:
o The greater the centralization in organizations, the greater the volume of
production and vice versa.
o The greater the centralization, the greater the efficiency and vice versa.
o The greater the centralization, the greater the formalization and vice versa.
• Research questions can also be restated as hypothesis as shown in the following examples:
✓ Question: Will students who are taught accounting by a teacher of the same gender
like the subject more than students taught by a teacher of different gender?
o Hypothesis: Students who are taught accounting by a teacher of the Same gender
will like the subject more than the students who are taught by a teacher of
different gender.
✓ Question: Is the relationship between clients and auditors in audit firms that use
client-centered approach different from those using task-oriented approach?
o Hypothesis: Auditing firms that use a client-centered approach will have different
client-auditor relationship from those using task- oriented approach.
Measurement of Data
The characteristics and basis of empirical operation of the four levels of measurement are shown in
the following Table.
• A sound measurement has three basic characteristics: validity, reliability, and precision.
a. Validity is the extent to which
✓ the measuring instrument is actually measuring the concept in question, not some
other concepts;
✓ that the concept is being measured accurately.
✓ The instrument is valid if it tackles all the aspects of the concept, measuring exactly
what one wants to measure.
o For example if the researcher wants to measure intelligence level of a group of
employees, an intelligence test, not other type of test, is constructed.
b. Reliability is a matter of whether a particular technique, applied repeatedly to the same
object, would always yield the same result.
✓ The measurement is dependable. This implies that every time the researcher uses
the same instrument, it will yield the same answer.
✓ Reliability is also the quality of consistency that the instrument or procedure
demonstrates over a period of time.
• Common types of scales used in research are rating scales and ranking scales
✓ Rating scales can be dichotomous or have multiple choices.
o Dichotomous scale has two possible answers to a question.
o A scale with multiple choices has three or more possible answers.
✓ The other measurement scale is the Likert scale. This is used in statements wherein
the respondent shows the amount of agreement/disagreement as shown below:
Small airlines generally give better service than the large ones.
o Strongly o Disagree o Neither o Agree o Strongly
Disagree Agree nor Agree
Disagree
Philippine Airline is
✓ Importance scale is a scale that rates the importance of some attributes as shown
below:
✓ Attribute rating scale assesses some attributes from poor to excellence as shown as
below:
How interested are you in the following areas? Please tick as appropriate
Very Somewhat Neutral Somewhat Very
Interested Interested Interested Interested
1 2 3 4 5
Investment
Management
Alternative
Investments
Risk
Management
Financial
Modeling
Corporate
Finance
How often do you read each of the following?
Very Somewhat Neutral Somewhat Very
Interested Interested Interested Interested
1 2 3 4 5
Financial
newspapers
Financial
magazines
Financial
Journals
Which of the following do you consider as your problem in financing or availing the loan
facilities? Please rank those that affect your business.
Research Proposal
Chapter 1- Introduction
1. Background of the Study
2. Statement of the Problem
3. Objectives of the Study
4. Significance of the Study
5. Scope and Limitations of the Study
• The description of the research designs and methods in the research proposal is expressed in
future tense since they are meant for prospective implementation.
• When the data gathering is complete and the research report is written, this chapter on
research design and methods will be converted into past tense.
• Because of this conversion, the research proposal is, by nature, a tentative document.