Summary of RM in OM
Summary of RM in OM
Summary of RM in OM
Sharmaine Linker
Contents
Chapter 1 – Introduction of the book ......................................................................................... 3
Chapter 2 – Research in operations management ...................................................................... 3
2.1 Introduction ...................................................................................................................... 3
2.2 Research outputs and targets ............................................................................................ 3
2.3 Roles of the researcher ..................................................................................................... 3
2.4 The research process ........................................................................................................ 4
2.5 Research as contribution to knowledge ............................................................................ 4
2.6 What to research for academia and practice ..................................................................... 5
2.7 Research quality ............................................................................................................... 5
2.8 Assessing research quality and contribution .................................................................... 6
2.9 Getting published ............................................................................................................. 6
2.10 Research ethics and ethics for researchers ..................................................................... 6
3. The research process .............................................................................................................. 6
3.1 Contributing to knowledge ............................................................................................... 6
3.2 Choosing a research topic ................................................................................................ 7
3.3 Using literature to develop the research topic .................................................................. 7
3.4 Developing research question .......................................................................................... 8
3.5 Considerations in choosing a research approach .............................................................. 8
Chapter 4 – Surveys ................................................................................................................... 9
4.1 Introduction ...................................................................................................................... 9
4.2 The survey research process ............................................................................................. 9
4.3 What is needed prior to survey research design? ........................................................... 10
4.4 How a survey should be designed .................................................................................. 10
1
4.5 Pilot testing the questionnaire ........................................................................................ 11
4.6 Advancements in theory formalization and survey design ............................................ 12
4.7 Survey execution ............................................................................................................ 12
4.8 Data analysis and interpretation of results ..................................................................... 13
4.9 Information that should be included in articles .............................................................. 13
4.10 Ethical issues in survey research .................................................................................. 13
Chapter 5 – Case research ........................................................................................................ 13
5.1 Introduction .................................................................................................................... 13
5.2 When to use case research .............................................................................................. 13
5.3 The research framework, constructs and questions ........................................................ 14
5.4 Choosing cases ............................................................................................................... 14
5.5 Developing research instruments and protocols............................................................. 15
5.6 Conducting the field research ......................................................................................... 15
5.7 Reliability and validity in case research ......................................................................... 15
5.8 Data documentation and coding ..................................................................................... 15
5.9 Analysis .......................................................................................................................... 16
Chapter 9 – Modelling and simulation ..................................................................................... 16
9.1 Introduction .................................................................................................................... 16
9.2 Origins and development of model-based research in operations management ............ 16
9.3 Methodologies in quantitative modelling ....................................................................... 16
9.4 How to conduct quantitative research in operations management ................................. 17
2
Chapter 1 – Introduction of the book
Nothing special
The aim of research is the creation and development of knowledge and the output is
contribution to knowledge. Research may have different purposes: confirmation, falsification
and exploration. Confirmation is often done by confirming previous findings in other settings.
Falsification needs to identify the rejection of an earlier hypothesis or theory. Exploration
offers endless opportunities since there are always issues and problems from empirical
situations that have not been studied before.
3
2.4 The research process
1. Identification of a problem or issue to research
2. Literature review
3. Specifying the aim, objective, or purpose of the intended research
4. Determine specific research questions
5. Choice of research approach and methods
6. Development of a conceptual framework
7. Data collection
8. Analysing and interpreting the data
9. Synthesizing and concluding
10. Evaluating the research and suggesting further research
11. Reporting and communicating the research findings
At the base of research philosophy is a view of reality that reflects the researcher’s
understanding of what exists and what hence can be said to be, this is called ontology (called
the science of being). Just as there can be different realities, there can be different truths. The
study of reality ontology and the study of knowledge is called epistemology.
There must be good (justified) reasons for believing that something can be verified as
absolutely true regardless of the context, before it can be considered as knowledge.
Logic of argument
Components
Rules Observations Results
Argumentations
Deduction Induction Abduction
Rule Observation Result
↓ ↓ ↓
Observation Result Rule
↓ ↓ ↓
Result Rule Observation
4
Rule: concerns how the world is structured and functions
Observation: the database or the research material
There are different levels of knowledge. The first level is the data, this are those facts that can
be gathered and for which there are measures. When data are put into a system, we form
information. The information can be put in a context and used, and, as a result, add
experience. This enables an interpretation of the information, its applicability, effects and
other strengths and weaknesses. Knowledge is developed.
After deciding on the intended contribution, a more thorough literature review can be
performed. Then the researcher can start to find a way to achieve knowledge development and
plan a study, creating a methodology, analysing the methodology and creating an
empirical/theoretical foundation. The researcher can also plan how to set the contribution in
the research field context.
A researcher should forward a chain of evidence. A report is expected to start with a problem
discussion based on the relevant problem from practice and the theoretical formulation. A
problem definition should be developed. Next a thorough literature review should be given to
develop a picture of the relevant knowledge and gaps in the knowledge. Then the research
questions should be formulated (explorative, hypothesis generating/testing, or whatever). A
conceptual framework of what will be studied should be presented. The next section should be
about the methodology and thereafter the results can be presented. The last section should
contain a conclusion.
5
objects
- Reliability that the study is objective in the sense that other researchers
should reach the same conclusion in the same setting
Theories are not built, they are invented, they cannot be systematically constructed or deduced
from facts, but require inspiration and creativity. They cannot be proved, but only disproved
by findings that run counter to their predictions/explanations.
Other research products that could constitute valid contribution, but that should not be
confused with theory
- Proposition there is a relationship between propositions and hypotheses,
hypotheses require measures whereas propositions involve
concepts.
- Model is a way to operationalize theory for empirical testing
- Conceptual model sets out in broad terms the definition of the particular problem to
6
be solved and it specifies the variables that will be used to define
the nature of the problem.
- Taxonomy used to classify things according to their similarities
- Framework explain either graphically, or in narrative form, the main things
to be studied
7
- Interpreting and explaining research findings
- Discuss the research findings in relation to existing literature
Basic gap spotting modes Specific versions of basic gap spotting modes
Neglect spotting Looking for areas in existing literature that are overlooked or
under-researched or that lack empirical support
Confusion spotting Looking for competing explanations in existing literature
Application spotting Extending and complementing existing literature
8
Chapter 4 – Surveys
4.1 Introduction
Exploratory survey research takes place during the early stages of research on a phenomenon
when the objective is to gain preliminary insight into a topic, and provides the basis for more
in-depth survey research.
Confirmatory (or theory testing or explanatory) survey research takes place when knowledge
of a phenomenon has been articulated in a theoretical form using well-defined concepts,
models and propositions. Data collection is carried out with the specific aim of testing the
concepts developed in relation to the phenomenon, the linkages hypothesized among the
concepts and the validity boundaries of the model.
Holistic construal: this approach is neither rigidly deductive nor purely exploratory. Rather it
subsumes a process by which theories and hypotheses are tentatively formulated deductively,
tested on data and, later, reformulated and retested until a meaningful outcome emerges.
A survey is a suitable method when knowledge of the phenomenon under investigation is not
too underdeveloped, when generalization is an important intended contribution, when the
variables and the context can be detailed and when the empirical evidence sought concerns
‘how variables are related’, ‘where the relations hold’ and ‘to what extent a given relation is
present’.
Design
Pilot test
Collect data
Analyse data
Generate report
9
4.3 What is needed prior to survey research design?
1. Researcher should have a clear idea of what the problem is about and should discuss it
in depth
2. Researcher should map the problem in the existing literature in order to be cognizant
of what is already know and what is still unknown
3. Researcher should clarify the intended contribution of the research.
Exploratory survey research may pose several problems with regard to framing the research,
as little support is provided by the available literature. In contrast, theory-testing is based on
more established knowledge and, therefore, the focus of the researcher is easier to
communicate clearly.
The unit of analysis refers to the level of data aggregation during the subsequent analysis.
Defining the unit of analysis at a theoretical and empirical level is important to avoid the
cross-level inference problem and even the possibility that a reader might fail to understand
the level to which the research refers.
In developing operational definitions, the first problem is to translate the theoretical concepts
into observable and measurable elements. The list of observable elements in each construct
should be developed before writing the items/questions that constitute the measure.
When the operational definition has been developed, the researcher should test it for content
validity. The content validity of a construct measure can be defined as the degree to which a
measure’s items represent a proper sample of the theoretical context domain of a construct.
Evaluating the face validity of a measure can indirectly assess its content validity.
The sample
- Population refers to the entire group of people, firms, plants or things that the researcher
wishes to investigate
- An element is a single member of the population
- The population frame is a list of all the elements in the population from which the sample is
to be drawn
- A sample is a subset of the population it comprises some members selected from the
population
- A subject is a single member from the sample
- Sampling is the process of selecting a sufficient number of elements from the population so
that by studying the sample, and understanding the properties or the characteristics of the
sample subjects, the research will be able to generalize the properties or characteristics to the
population elements.
Sampling overcomes the difficulties of collecting data from the entire population, which can
be impossible or prohibitive in terms of time, costs and other human resources.
While content validity refers to the degree to which the meaning of a set of items represents
the domain of the concept under investigation, construct validity refers to the degree to which
scores obtained from using a set of items behave as expected. You can only have construct
validity if there is content validity.
When checking construct validity, first the construct unidimensionality has to be assessed. A
measure must satisfy two conditions in order to be unidimensional. First, an empirical
indicator must be significantly associated with an underlying latent variable. Second, it can be
associated with one and only the latent variable.
The second step in checking construct validity is assessing the convergent and discriminant
validity. Convergent validity refers to the degree to which multiple attempts to measure the
same concept are in agreement. Discriminant validity refers to the degree to which measures
of different concepts are distinct.
Control variables are extraneous, not directly connected with the main theory and hypothesis,
but presumably able to cofound with them. The idea behind control variables is that they
essentially remove the variation explained by a predictor variable that has some readily
identifiable alternative explanation.
12
When data is missing three strategies can be used
- Deletion
- Replacement based on estimation
- Mean based
- Regression based
- Model-based
- Hot-deck imputation
- Model-based strategy
Significance tests can be grouped into two classes: parametric and non-parametric. Parametric
tests are considered more powerful because their data are typically derived from interval and
ratio measurements whose likelihood model is known, except from some parameters. Non-
parametric tests are used with nominal and ordinal data.
13
- The case method lends itself to early, exploratory investigations where the variables
are still unknown and the phenomenon not at all understood
In inductive research, propositions or frameworks are the outcome of the analysis. Deductive
research starts with hypotheses that are then empirically tested. In abductive research, an
extant theory is identified and explored through an iterative process eventually leading to
propositions or frameworks and extension to existing theory.
When selecting cases it is also important to consider what are the parameters or factors that
define the population and are to be held constant across the sample. Controls rely on the
14
selection of the phenomena during the study’s experimental stage for their control. This
allows particular factors to be, in essence, ‘held constant’ while other are left free to vary as
they would naturally.
Reliability is the degree to which a measure is free from random error components. Validity is
the extent to which a measure only reflects the desired construct without contamination from
other systematically varying constructs.
A common format for the protocol is the funnel model. This start with broad and open-ended
questions first, and as the interview progresses, the questions become more specific and the
detailed questions come last.
Saturation occurs when the addition of respondent does not add any different insights or
theoretical advancement.
The chapter contains a very specific explanation of how to conduct field research, steps are
the same as in the assignment and in the slides.
15
5.9 Analysis
There are two steps in analysis: analysis of within-case data, and searching for cross-case
patterns.
To start the analysis of within-case data, it is useful to create an array or display with all the
data. The overall idea is to become intimately familiar with each case as a stand-alone entity,
and to allow the unique patterns of each case to emerge before you seek to generalize across
cases. Now, the researcher can start looking for explanation and causality. Two options are
suggested: using a case dynamics matrix or making predictions and then use the case to test
them. A third method is using the causal network.
When searching for cross-case patterns, also a display should be created first. An effective
analytical approach is then to pick a group or category and to search within groups for
similarities or differences.
This section explains how research in operations management has developed over the
years.
The first class of research, axiomatic research, is primarily driven by the model itself. The
primary concern of the researcher is to obtain solutions within the defined model and make
sure that these solutions provide insights into the structure of the problem as defined within
the model. Axiomatic research produces knowledge about the behaviour of certain variables
in the model, based on assumptions about the behaviour of other variables in the model.
Axiomatic research is most of the times prescriptive; prescriptive research is primarily
interested in developing policies, strategies and actions to improve over the results available
16
in the existing literature, to find an optimal solution for a newly defined problem or to
compare various strategies for addressing a specific problem.
The second class of research, empirical research, is primarily driven by empirical findings and
measurements. The primary concern of the researcher is to ensure that there is a model fit
between observations and actions in reality and the model made of that reality. This type of
research can be both prescriptive and descriptive. Descriptive empirical research is interested
in creating a model that adequately describes the causal relationships that may exist in reality,
which leads to understanding of the processes going on.
Axiomatic descriptive research start with a condensed description of the characteristics of the
operational process or the operational decision problem that is going to be studied. The
conceptual model description should use as much as possible concepts and terms that are
accepted as standards published in scientific literature.
The second phase in the research is the specification of the scientific model of the process or
problem. The scientific model must be presented in formal, mathematical term such that a
mathematical/numerical/simulation analysis or study can be performed. Analytical research
aimed at managerial insights does not try to provide the manager with a direct answer to his
question; instead, it construct an idealized model of the problem, ensuring that an answer for
the idealized problem can be found with the analytical methods and tools available.
At this point validity gets important, three ways to claim validity:
- Researcher may refer to scientifically accepted axiomatic descriptions of the system
studied that contain evident of the occurrence of the characteristics in real life
- Researcher may refer to published empirical research that shows the existence in real
life of the characteristics captured in the model
- Researcher may refer to earlier published empirical research that uses the same
modelling assumptions
Decision rule oriented research is more ambitious than managerial insight orientated research.
Its goals is to provide the manager with decision rules that, when applied, achieve optimal or
near optimal performance with respect to some criterion function. Results in this field are
more difficult to obtain and modelling assumptions are often less strict. In particular, the
17
results must be obtained for realistic large-scale models, or must be easily scalable to a
realistic size.
A Slightly different approach is taken when the result is obtain with computer simulation
instead of mathematical analysis. This model is used when the model/problem is too complex
for formal mathematical analysis. This type of research generally leads to lower scientific
results than research using mathematical analysis, but the scientific relevance of the
process/problem studies can be much higher.
The first step in simulation study is to build a (very rich) conceptual model. Secondly, a
justification of the research method has to be given since the contribution to the scientific
results is often low. Then a justification of the solution or hypotheses to be tested have to be
given, since no related proof can be generated. After these justifications, the model can be
developed. The next step is the set-up of the experimental design. One of the last steps is to
perform a statistical analysis of the results. The last step is the interpretation of the results.
Model-based empirical research is concerned with either testing the (construct) validity of the
scientific models used in quantitative theoretical research, or with testing the usability and
performance of the problem solutions obtained from quantitative theoretical research, in real
life operational processes.
The first step in model-based empirical research is the identification of the basic assumptions
regarding the operational process underlying the theoretical models or problems. The second
step is to identify the type of operational process and the type of decision problem regarding
this operational process to which the basic assumption are assumed to apply. The third step is
that operational, objective criteria must be developed for deciding whether or not a real-life
operational process belongs to the class of operational processes considered and for
identifying the decision system is the operational process that represents the decision problem
considered. The fourth step is to derive, from the basic assumptions, hypotheses regarding the
behaviour of the operational process. The fifth step is to develop an objective way to do
measurement or to make the observations. The sixth step consists of applying the
measurement and observation systems, collecting and documenting the resulting data. The
seventh step is the processing of the data. The last step is to interpret the results.
18