Research Methods in

Computer Science
Faculty of Computing
Bahir Dar Institute of Technology
Bahir Dar University

Faculty of Computing 2/17/2018

 Research Methodology &
Scientific Writing
(ITEC5021)

Faculty of Computing 2/17/2018

 Research Methods in Computing

Faculty of Computing 2/17/2018

 Research Methods in Computing
• Computing science deal with the theory, design, development,
and application of software and systems.
• It involves the study:
– of data & data structures & the algorithms to process these
structures;
– of principles of computer architecture-both hardware and
software;
– of problem-solving and design methodologies;
– of computer-related topics such as optimization and artificial
intelligence;
– of language design, structure, and translation technique.
• Principal areas of study in the field of Computing include artificial
intelligence, computer systems & networks, security, database
systems, human computer interaction, vision & graphics,
programming languages, software engineering & search engine.

Faculty of Computing 2/17/2018

 Why Research Methods Course?
• Most of the computing curriculum teaches you:
– how to be a good engineer (e.g., computer programming,
software engineering, and object-oriented design),
– how to think about problems abstractly (e.g., algorithms, data
structures, theory of network & data communication, and
automata theory),
– how computing can be applied to solve various problems (e.g.,
vision, speech and language processing, and transaction
processing systems), or
– how computer systems work (e.g., operating systems, compiler,
computer architecture, …).
• This course takes the view that computer programs are
complex systems that need to be studied by conducting
controlled experiments:
– to measure their performance; using accuracy, running time,
memory space requirement
Faculty of Computing 2/17/2018
 Problems encountered in Computing?
• Origins: Mathematics,
engineering, and Theory
commercial practice. Design
• Evolved into
– Theoretical, experimental Computing
& design (or user)
orientated aspects.
– It tries to balance and Experimentation
synthesize these aspects

• The problems that computer scientists and information

technologists encounter range
 from the abstract-- determining what problems can be solved with
computers and the complexity of the algorithms that solve them
 to the tangible – designing applications that perform well, that are easy to
use, and that uphold security measures.

Faculty of Computing 2/17/2018

 Flavours of Research in Computing
• Theoretical
– Develop new theories, principles
– Research Outputs: Theorems, Data structure, Algorithms,
Models and/or Analyses of existing research
• Engineering
– Develop better mechanisms to improve current practice
– Research Outputs: System architectures & prototypes, Code
libraries, Knowledge bases, and/or Hardware specifications
• Experimental
– Evaluate a theory/methods & Test programs/algorithms –
usually via implementation and lab tests
– Research Outputs:
• Experimental results in terms of performance measures
• Comparative analyses (of two or more systems, tools,
algorithms)
Faculty of Computing 2/17/2018
 Why research?
• Research allows you to learn something new, to improve your
problem-solving skills, to challenge yourself in new ways and
to pursue your interests.
– To learn to read and think critically.
– To face a challenge
– To solve a problem
– To get a degree
– To get intellectual joy
– To bring advancement of wealth of human knowledge
– To serve society
• by increasing standard of living in case of Science & Technology, and
• by showing right path to society in case of Social and Behavioral
Sciences

Faculty of Computing 2/17/2018

 Course Objective
• To provide a deep and systematic understanding
of the nature of computer science research.
• Undertake independent research
• Have an understanding of how established
techniques of research and enquiry are used to
extend, create and interpret knowledge in
Computer Science
• Locate and summarize scientific literature; and
understand and apply correct ways of referencing
to and citing from scientific literature
• of Computing
Faculty 2/17/2018
 Objective
• Produce a well developed research proposal,
• Select an appropriate methodology to conduct
the research,
• Understand various tasks required to carry out
the research,
• Find the resources needed to guide them
through the research process,
• And develop scientific research report.

Faculty of Computing 2/17/2018

 Outline
Chapter 1: Introduction and overview of the
research methods
Chapter 2: The research Process
Chapter 3: Literature Review
Chapter 4: Research Methodology and Design
Science in CS/IT/IS Research
Chapter 5: Research Ethics
Chapter 6: Citation and Referencing Style for
Research Report
Chapter 7: Presentation Skill
8 Open Research areas ion Computer Science
Faculty of Computing 2/17/2018
 Evaluation
• Review articles and presentation
• Research proposal development
• A short position paper to be submitted for ICAST
conference
• Final Exam

Faculty of Computing 2/17/2018

 References
1. Kothari C.R. (2004) Research methodology (Methods and Techniques), 2nd
ed., New Age International Publisher, 2004.
2. Oates B.J. (2005) Researching Information Systems and Computing, Sage
Publications, 2005
3. Zobel J. (2014) Writing for Computer Science - The art of effective
communication. 4th ed., Springer, 2004
4. John W. Creswell (2002) Research Design: Qualitative, Quantitative, and
Mixed Methods (Edition: 2nd), SAGE Publications, 2002
5. Leslie P. Willcocks, Chris Sauer, and Mary C. Lacity (2915)
Formulating Research Methods for Information Systems, Palgrave.
6. Berndtsson, M.; Jörgen Hansson, J.; Olsson, B. and Lundell, B.(2008). Thesis
Projects: A Guide for Students in Computer Science and Information
Systems (2nd ed)
7. Leedy, D. Paul and Ormrod E. Jeanne (2013). Practical research: planning and
design (10th ed)

Faculty of Computing 2/17/2018

 Introduction
• What research is & is not
• Scientific research
• Types of research

Faculty of Computing 2/17/2018

 What research is?
• Research is a voyage of discovery
– A method of critical thinking;
– A careful critical enquiry in seeking facts for principles
• An art of scientific investigation, which means
– Scientific & systematic search for pertinent information on a
specific topic
– Process of arriving at dependable solutions to problems through
the planned & systematic collection, analysis & interpretation of
data
• An activity caused by instinct of inquisitiveness and
curiosity to:
– gain fresh insight
– find answers to question
– acquire knowledge
Faculty of Computing 2/17/2018
 What research is?
• Research describes what or explains why
– It is a method for finding answers to questions or a strategy for
explanation

• A systematized effort to gain new knowledge; A

movement from the known to the unknown
– Search for (new) knowledge/facts through objective, systematic
and scientific method of finding solution to a problem

• The three major goals of research are defining the prevailing

situation, analyzing information, and reaching new
conclusions.
– The three main acts of doing research are searching for,
reviewing, and evaluating information.
Implicit question + Explicit answer + data to answer the
question
Faculty of Computing 2/17/2018
 What Research is not?
• Research isn’t information gathering:
– Gathering information from books, journal articles, conference
papers and/or the Internet isn’t research.
– Information gathering has no contribution to new knowledge.
• Research isn’t the transportation of facts:
– Merely transporting facts from one resource to another
doesn’t constitute research.
– No contribution to new knowledge although this might make
existing knowledge more accessible.

• Not synonymous with commonsense,

– but systematic, reproducible, objective (purposeful), relevant
activity having control over some factors

Faculty of Computing 2/17/2018

 Qualities of Good Research
• Research is:
– Empirical, because it is based on evidence or data
• It provides a basis for external validity to results (validation)
– Systematic, because it uses a method
• It rejects the use of guessing & intuition, but does not rule out
creative thinking
– Objective, because it is presumably conducted and interpreted by
the researcher without any bias
– Controlled – Variables are identified & controlled, wherever possible
– Logical - Guided by rules of logical reasoning & logical process of
induction & deduction
– Replicable – produce the same results if repeated exactly. So
replicability will help to verify and confirm the study
– Self Correcting - Built in mechanism & open to public scrutiny by
fellow professionals

Faculty of Computing 2/17/2018

 How to do Research?
• Research is all about addressing an issue or asking and
answering a question or solving a problem, so…
• Select topic: Identify an issue, question, or problem.
– Talk with people who want or need your study.
• Review literature: Find out what's already known about it.
– Talk with experts and/or read their reviews and the original
research on the topic.
• Develop research proposal: Plan, cost, and do your study
accordingly.
• Write research report and submit it for evaluation.
– Better still, do a good job on it and submit it for publication.
• Your work will benefit more people if you publish it.
Rule No. 1 in academia is publish or perish
Faculty of Computing 2/17/2018
 Is research the same as project?
• A project is where you apply the theories that
you've learned to practice, where as a research
goes a little beyond that.
– you apply existing theories (you’ve learned) but will
be coming up with new theories or concepts of your
own.
– you will have to experiment new scenario, interpret it
and come up with findings in your study.
– you cannot be certain of the result till you are done
with your research

Faculty of Computing 2/17/2018

 Research Methods: Scientific Method
• There are hundreds of Scientific fields & disciplines:
– Natural Sciences: Physical Science, Life Science, Computer and Information
sciences, Earth & Environmental sciences;
– Social Sciences: Education, Business, Economics, Geography, History, Linguistics,
Political science, Psychology, Sociology.
– Medical and health sciences, Agricultural sciences, etc.
• The fundamental governing principle they all share in common, that distinguishes a
science as a science is The Scientific Method.
• The Scientific Method can be defined as a sequence of steps for systematically
analyzing scientific questions. Such steps include;
– Researching previous studies and current data to pose Research Questions for
current study.
– Designing a Research “Protocol/Framework” to answer the research questions.
– Executing the research to create reproducible results.
• The scientific method is constantly applied to research, building on previous studies
to add new knowledge & discoveries to the incredible size & diversity of scientific
fields.

Faculty of Computing 2/17/2018

Definition of Science
• Science is an objective, logical , and systematic method of
analysis of phenomena, devised to permit the
accumulation of reliable knowledge

• SCIENCE vs. ART?

– Both Science & Art are about reasoning and
development. Both are also creative.
– Science is about fact. Art is about arguing meanings,
feelings, and contesting views.
– Science is about understanding the world, what’s in it,
what’s beyond it. Art is about searching within,
expanding the world, & determining perceptions.
– Science is about advancing, moving forward, discovery.
Art is about searching, moving in all directions,
discovery.
– Science is about discovering significance. Art is about
giving significance.

Faculty of Computing 2/17/2018

 Why scientific method in Research?
The scientific method employed
ensures:
• Purpose/objectives clearly defined in
common concepts
• Procedure enumerated to keep continuity
and replicability
• Carefully planned design leading to
objective results
• Complete frankness; flaws reported & their
effect estimated
• Adequate analysis & interpretation of data
with appropriate methods of analysis
• Carefully checked data for validity & reliability
Validity = the relationship between observed and true values.
Reliability = reproducibility of observed values.
• Conclusions confined to those justified by the data
Faculty of Computing 2/17/2018
 Scientific Method…

Characteristics of the Scientific Method

Elements of the
Objectivity Scientific Method
Systematic Analysis
Logical Interpretation of Results

Empirical Approach
Observations
Questions
Hypotheses
Basic Experiments
General Laws
Research
Scientific

Analysis
Method

Conclusion
Replication
Applied Information or
Research Ideas for alternative
Courses of action

Faculty of Computing 2/17/2018

Faculty of Computing 2/17/2018
 Types of Research
• There are different ways of classifying research.
• It should also be noted that there is no clear dividing line
between one method and the other.
• However, research can be classified in terms of:
 Goal of research,
 Specific objectives,
 Approaches of research,
 Designs,
 Type of data used in research, and
 Fields of study.

Faculty of Computing 2/17/2018

 Types of research…
• The goal of research is problem solving.
• The nature of the problem that the research
attempts to solve could be theoretical or
practical i.e. building a theory or solving
immediate practical problems.
• These two types of problems that the research
tries to solve leads to two broad classifications of
research:
1. Basic research, and
2. Applied research.
Faculty of Computing 2/17/2018
 Types of Research: Basic vs. Applied Research
• Basic research (usually refers to fundamental research, or
pure research)
– In basic research, the researcher is testing theory and ideas
without necessarily applying the results to practical problems
– It is concerned with generalizations & formulation of theory
– Knowledge for knowledge’s sake
• Applied research is also called field research, evaluation
research, or action research
– This type of research is conducted to find solution for
problems (often immediate problems), sometimes only within
one organization (hence its results are only applicable to that
organization)
– It is often used to influence policy and decision-making, and
– It is not rigorous/flexible in application of the conditions
Faculty of Computing 2/17/2018
Types of research: Basic/Pure Research
• Basic research (also called fundamental or pure
research) has as its primary objective the
advancement of knowledge and the theoretical
understanding of the relations among variables.
• It is basically concerned with the formulation of a
theory or a contribution to the existing body of
knowledge

Faculty of Computing 2/17/2018

 Basic Research…
• The major aims of basic research include:
– Obtaining and using empirical data to formulate, expand, or
evaluate theory; and
– Discovery of knowledge solely for the sake of knowledge.
• Hence, basic research may take any of the following forms:
– Discovery: where a totally new idea or explanation emerges
from empirical research which may revolutionize thinking on
that particular topic.
– Invention: where a new technique or method is created.
– Reflection: where an existing theory, technique or group of
ideas is re-examined possibly in a different organizational or
social context.

Faculty of Computing 2/17/2018

 Applied Research
• Applied research is designed to solve practical
problems of the modern world, rather than to
acquire knowledge
• One might say that the goal of the applied
scientist is to improve the human condition.
• It is undertaken to solve immediate practical
problem and the goal of adding to the scientific
knowledge is secondary.

Faculty of Computing 2/17/2018

 Applied Research….
• The purpose of applied research is about testing
theories, often generated by pure science, and
applying them to real situations, addressing
more than just abstract principles.

• Applied scientific research can be about finding

out the answer to a specific problem, such as ‘Is
global warming avoidable?’ or ‘Does a new type
of medicine really help the patients?’

Faculty of Computing 2/17/2018

Types of research: Conceptual vs. Empirical
• Conceptual research is that related to some abstract idea(s) or theory.
–It is generally used by philosophers/thinkers to develop new
concepts or to reinterpret existing ones.
–It relies on literature
• Empirical research relies on experience or involves observation alone,
often without due regard for theory. It is a data-based research, with
analyses coming up with conclusions, which can be verified by
observation or experiment.
–It can also be called “experimental research”; where the researcher
must: first formulate hypothesis or guess as to the probable results;
then collect facts (data) to prove/disprove hypothesis. Finally, by
setting up experimental designs, test & report experimental results.
• Empirical research is appropriate when proof is sought that certain
variables affect other variables in some way. Evidence gathered
through experiments or empirical studies is today considered to be
the most powerful support possible for a given hypothesis.
Faculty of Computing 2/17/2018
 Empirical Research Methods ..
• Controlled Experiments (including Quasi-
Experiments)
• Case Studies (both exploratory and confirmatory)
• Survey Research
• Ethnographies
• Action Research

Faculty of Computing 2/17/2018

 Empirical Investigations
• Common tasks
– Identify goals, questions and measures (metrics)
– Choosing research method(s)
– Planning, designing, and carry out investigations
– Data collection,
– Data Analysis
– Results
– Validity considerations
– Conclusions

Faculty of Computing 2/17/2018

 Types of Research: Quantitative vs. Qualitative
• Quantitative Research tends to deal with variables that have numeric values
– Measured & expressed in terms of quantity; Expression of a property or quantity in
numerical terms
– Quantitative research helps:
• Precise measurement; Knowing trends or changes overtime; Comparing trends
or individual organizations/units
– How far do you commute to work? How tall are you?

• Qualitative Research looks at variables which are binary (Yes/No), have non-
numeric values, or are free-form text
– Involves quality or kind; Helps in having insight into problems or cases
– What is your favorite football team? How could I improve this slide?

• Qualitative research methods are designed to help researchers understand

people & the social and cultural contexts within which they live.
– The goal of understanding a phenomenon from the point of view of the
participants and its particular social and institutional context is largely lost when
textual data are quantified.

Faculty of Computing 2/17/2018

 Differences between qualitative & quantitative
research
Qualitative research Quantitative research
Involves unstructured Involves experiments, surveys, testing,
interviews, observation, and and structured content analysis,
content analysis. interviews, and observation.
Subjective Objective
Inductive Deductive
Little structure High degree of structure
Little manipulation of subjects Some manipulation of subjects

Takes a great deal of time to May take little time to conduct

conduct
Little social distance between Much social distance between
researcher and subject researcher and subject
Faculty of Computing 2/17/2018
 The Nature of Qualitative and Quantitative Research
Strategies:
• Difference is the type of data you collect &
the tools you employ for data collection
and analysis.
• Specifically:
– The same data collection strategies can be
qualitative or quantitative
– Qualitative data can become quantitative
– Pure quantitative data cannot become
qualitative
– Often in research, it is good to use hybrid of
qualitative and quantitative in the same study

Faculty of Computing 2/17/2018

 Summary
• In this chapter we briefly addressed what a
research is or not, scientific methods and types
of research.

Faculty of Computing 2/17/2018

 Assignment
• Read the following articles:
– Hossein Hassani (2017). Research Methods in
Computer Science: The Challenges and Issues
– Wieringa and Heerkens (2006)
The methodological soundness of requirements
engineering papers: a conceptual framework and two
case studies. Requirements Eng (2006) 11: 295–307

Faculty of Computing 2/17/2018

 References
• Gordona Dodif-Crnkovic, “Scientific
Methods in Computer Science”
• Easterbrook et al: Selecting Empirical Methods
for Software Engineering Research
• Creswell: Research Design: Qualitative,
Quantitative, and Mixed Methods Approaches
• For SE folk - Kitchenham et al: Preliminary
guidelines for empirical research in software
engineering

Faculty of Computing 2/17/2018

Faculty of Computing 2/17/2018