Part - 2 - Research Design and Methodology
Part - 2 - Research Design and Methodology
Part - 2 - Research Design and Methodology
1
BDU: Bahir Dar Institute of Technology: Computing Faculty
Concepts of research design
• Design: is the core of all professional tasks; it is the principal mark t
hat distinguishes the professions from the sciences.
4 4
BDU: Bahir Dar Institute of Technology: Computing Faculty
Concepts of research design
Qualitative
• Qualitative research involves the use of qualitative data, such as i
nterviews, documents, and participant observation data, to unders
tand and explain social phenomena.
• Examples of qualitative methods are action research, case study research an
d ethnography.
Quantitative
Quantitative research methods were originally developed in the natural scien
ces to study natural phenomena.
5 5
BDU: Bahir Dar Institute of Technology: Computing Faculty
Concepts of research design
Quantitative
• Examples of quantitative methods now well accepted in the social sciences incl
ude survey methods, laboratory experiments, formal methods (e.g. econometric
s) and numerical methods such as mathematical modeling
• The most popular data collection techniques include: Questionnaire (survey ins
truments) , secondary data sources or archival data, objective measures or tests.
7
BDU: Bahir Dar Institute of Technology: Computing Faculty
Steps in preparing a research design
8
BDU: Bahir Dar Institute of Technology: Computing Faculty
Steps in research design
• Identify a need
• Problem solving • Research begins with a problem, however,
identifying this problem can actually be the
• Build:
hardest part of research.
• Model, Instantiate
• Evaluate • And, good research projects should:
• Address an important question.
• Verify, Validate
• original and significant
• Learn • Advance knowledge.
• Current, Emergent
• Theorize
• Conceptualize and generalize findings
• Research question
• Theory
• Data
10
BDU: Bahir Dar Institute of Technology: Computing Faculty
Major components and tasks of research design
• Research question
• Important
• Not too general
• Not too specific
• Just right
• Contribute to literature
• How to tell: Computer Sciences Citation Index
• Theory
• Definition: A general statement of a proposition that argues why e
vents occur as they do and/or predicts future outcomes as a functio
n of prior conditions
• Desirable qualities of theories
11
BDU: Bahir Dar Institute of Technology: Computing Faculty
Major components and tasks of research design
• Data
• Terms
• Cases
• Observations
• Variables
• Dependent variables
• Independent variables
• Units of analysis
12
BDU: Bahir Dar Institute of Technology: Computing Faculty
Formulation of research design
• Research design is a creative process and a guide line to the flow
of the whole research work,
13
BDU: Bahir Dar Institute of Technology: Computing Faculty
Directional vs. non directional formulation of
research design
• Directional formulation:
• Specifies the direction of the relationship between independent
and dependent variables,
• Non-directional hypothesis:
• Shows the existence of a relationship between variables but no
direction is specified,
• Deductive Vs inductive formulation Theory
Tentative
Theory hypothesis
Hypothesis Pattern
Observation Observation
Conformation
A schematic representation of
A schematic representation of
inductive formulation
deductive formulation
14
BDU: Bahir Dar Institute of Technology: Computing Faculty
Deduction Vs. Induction research formulation
• Deductive research formulation is:
• Carry out large scale literature review to gather enough theories or evidence
as premises,
• Use deductive logic to derive a set of hypotheses,
• Systematically gather data relevant to the hypothesis,
• Statistically test and interpret the data to see if they support the hypothesis.
• Building theory
• Start from the data, begin to detect patterns and regularities, for
mulate some tentative hypotheses, end up developing some gen
eral conclusions or theories
15
BDU: Bahir Dar Institute of Technology: Computing Faculty
Deduction Vs. Induction research formulation
16
BDU: Bahir Dar Institute of Technology: Computing Faculty
Qualities of a Workable research design
• The quality of good research design results requires:
• A careful design of the research methodology,
17
BDU: Bahir Dar Institute of Technology: Computing Faculty
Qualities of a Workable research design
(Hypothesis);
• Care should be taken to ensure that the results are valid and re
liable.
• Validity • Reliability
• Main question: Is the relationshi • 3 main questions:
p between two variables causal? • Will the measures yield the
• Threats to validity: same results on other occasions?
• History
• Testing • Will similar observations be
• Instrumentation reached by other observers?
• Maturation
• Ambiguity over causal directi • Is there transparency in how
on sense was made of the raw data?
18
BDU: Bahir Dar Institute of Technology: Computing Faculty
Feasibility of research design
• Good research design:
• The availability and meanings of information,
• The objective and the nature of the problem to be studied,
• The availability of time and other resources for the research work.
19
BDU: Bahir Dar Institute of Technology: Computing Faculty
Classification of research design
Cross-sectional Study
Descriptive/dia Causal Design
Longitudinal Study gnosis Design
Experiment
20
BDU: Bahir Dar Institute of Technology: Computing Faculty
Exploratory of research design
• Exploratory research design
• Identifying potential causes of a problem, and establishing priorities or dire
ction for a research program
• Clarifying concepts, and Assisting new product development
Pilot study
Exploratory
Research
• undertaken with the aim of clarifying ambiguous problems (under the aim of
determining the characteristics of a population or phenomenon)
• general problems usually known but not sufficiently understood
• the purpose is to get more information, not to uncover specific courses of
action (subsequent research)
• High degree of precision or accuracy required
21
BDU: Bahir Dar Institute of Technology: Computing Faculty
Exploratory research design
• Exploratory research design (ERD): fundamental research design
• Purpose of ERD: is that of formulating a problem from precise investigation or developing
hypothesis from an operational point of view,
• Focused on discovering new ideas and/or in sight,
• Exploratory study must have flexibility in design to provide opportunity for
considering different aspects of a problem under study,
22
BDU: Bahir Dar Institute of Technology: Computing Faculty
Exploratory research design
• Explanatory studies focus on casual relationships and
• Have at least two variables
• Is used to prove or disprove whether there is a causal relationship
between two variables.
• Can be expressed as a prediction or an expected future outcome.
• Is logically linked to a research question or theory.
• Hypothesis are used to state the relationship between two
variables and may be stated as
• Null hypotheses (no relationship between two variables).
• Nondirectional hypotheses (we don’t know or won’t speculate abo
ut the direction of the relationship between two variables).
• Directional hypotheses. We state the direction of the relationship
between two variables.
23
BDU: Bahir Dar Institute of Technology: Computing Faculty
Exploratory research design
• Relationships specify:
• How the value of one variable changes in relation to another.
• May be either positive, negative, or the two variables may not have any
relationship to one another.
• Are not necessarily correlations. The type of relationship or association
among variables is determined by the level of measurement of each of
the two variables.
• Example:
Negative Positive Negative
1 4 1 1 1 4
2 3 2 2 2 1
3 2 3 3 3 2
4 1 4 4 4 3
24
BDU: Bahir Dar Institute of Technology: Computing Faculty
Descriptive and diagnostic research design
• The studies concerned with specific predictions, with a narrations
of facts and characteristics concerning individual, group, and
examples of descriptive studies,
• Can specify one or more variables (we don’t know enough to specify the
direction of the relationship among the variables).
• We use a research question rather than a hypothesis.
• Diagnosis study determine the frequency with which something
occurs or its association with something else.
• It focus on:
• Formulating the objectives and design the methods of data collection,
• Selecting samples and collecting data, then processing and analyzing the data,
• Accomplish the research work and reporting the findings.
25
BDU: Bahir Dar Institute of Technology: Computing Faculty
Experimental research design
• Experimental research design: hypothesis testing RD
• The study of tests the hypothesis of casual relationships between variables,
• It requires procedures that not only reduce bias and increase reliability but
will permit drawing of inference about causality,
• It has three basic principles:
• Principles of replication: The experiment should be repeated more than
once to ensure that each treatment is applied in many experimental units inst
ead of one,
• By doing so the statistical accuracy is increased.
• Principle of randomization: Provides protection against the effect of th
e extraneous factors in an experiment,
• The experiment in such a way that the variation caused by extraneous factors
can all be combined under the general heading of chance.
• Principles of local control: The known sources of variability is made to the
experiment.
26
BDU: Bahir Dar Institute of Technology: Computing Faculty
Focuses of research design
• The major focus of research design
Research
objectives
Research
questions
Research
project
27
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research design consideration
• Design consideration in terms of
• Research strategies (survey, case study, action research, and others ....see
more research methodology).
• Choices, and
• time horizons
28
BDU: Bahir Dar Institute of Technology: Computing Faculty
Design research process
Metrics, Analysis
How to Knowledge
Knowledge
Disciplinary
Inference
Knowledge
Identify Prob Define Objec Design & De Demonstration Evaluation Communica-
Theory
lem & Motiv tives of a Sol velopment Find Suitable co tion
ate ution ntext Observe How E
ffective, efficien Scholarly Publi
Define Problem What would a B Artifact Use Artifact to Solv t cations
Show Importan etter Artifact A e problem
ce/ supported b ccomplish? Iterate Back to Professional
y lit. design Publications
Process Iterations
29
BDU: Bahir Dar Institute of Technology: Computing Faculty
Design research process
knowledge
+ operation and goal knowledge
flows
circumscription
process
steps
Awareness of
Suggestion Development Evaluation Conclusion
problem
Logical
formalism
abduction deduction
30
BDU: Bahir Dar Institute of Technology: Computing Faculty
Sc/Eng research design output
constructs
better theories
emergent theory about models
embedded phenomena
abstraction models
abstraction methods
knowledge as constructs
operational principles
better theories
abstraction
31
BDU: Bahir Dar Institute of Technology: Computing Faculty
Phenomena of research methodologies
• What is research methodology? How it is important?
Problem Discovery
Problem Definition
(Statement of research problem)
Survey (Interview, Questionnaire)
Selection of Experiment (Laboratory, Field)
basic research Secondary Data Study
method Observation
33
BDU: Bahir Dar Institute of Technology: Computing Faculty
The flow of research process
• Based on the defined or survey research issues the research workflow
34
BDU: Bahir Dar Institute of Technology: Computing Faculty
The methodology of research process
• Case study:
• Intensive evaluation of small sample of entitles such as groups, o
rganizations, or systems
• Purpose: explanation, description, hypothesis generation
• Multiple means of data collection
• No controls of experimental phenomena
• Field study:
• An ex post facto method of evaluating organizational systems
• Purpose: Description, hypothesis generation or hypothesis testing
• Data Collection: questionnaires, interviews
• No experimental variables are manipulated
• Field experiment
35
BDU: Bahir Dar Institute of Technology: Computing Faculty
The methodology of research process
• Field experiment
• Experimental manipulation of one or more independent variables while
confounding variables are controlled
• Purpose: To observe the effect of the independent variable(s) in a natur
al setting, typically evaluated by hypothesis testing
• Many types of data collection possible
• Lab experiment
• Research takes place in a researcher-created setting with researcher ma
nipulation of independent variable(s) and a high degree of control
• Purpose: Hypothesis testing
• Many types of data collection possible
• Conceptual or narrative
• Who is causing the problem? • What will happen if this problem • Where does this problem occur?
• Who says this is a problem? is not solved? • Where does this problem have a
• Who are impacted by this pro • What are the symptoms? n impact?
blem? • What are the impacts? • Etc.
• Etc. • Etc.
37
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• A problem becomes known when we observes a discrepancy between
the way things are and the way things ought to be. Problems can be identified
through:
• Comparative/benchmarking studies
• Performance reporting -assessment of current performance against goals
and objectives
• Complaints
• Surveys
• Etc.
38
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• Feasibility Study: Here is a new idea, is it possible?
• Is it possible to solve a specific kind of problem … effectively ?
• computer science perspective (Turing test, …)
• engineering perspective (build efficiently; fast — small)
• economic perspective (cost effective; profitable)
• Proof by construction
• build a prototype
• often by applying on a “CASE”
• Conclusions
• primarily qualitative; "lessons learned“,
• quantitative: - economic perspective: cost – benefit,
• engineering perspective: speed - memory footprint
39
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• Guidelines to pick and formulate an important and useful research
problem
• Looking around you
• In many disciplines, questions that need answers – phenomena that need explan
ation - are everywhere.
• Concentrate on smaller problems – continually ask questions about what you he
ar and see.
• Why does such–and–such happen? What makes such–and–such tick? (The reas
ons for somebody’s behavior)
40
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• Attending professional conferences
• Many researchers have great success finding new research projects at national a
nd regional conferences.
• Learn “what is hot and what is not” in their field
• As an example:
• Sentiment analysis
• M-systems , Security, privacy in wireless communication
• Big data,
• Method tailoring (in software development)
• Novice researchers can make contacts with experts in their field, ask questions,
share ideas, exchange e-mail addresses with more experienced and knowledgea
ble individuals
42
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• The fish model
43
BDU: Bahir Dar Institute of Technology: Computing Faculty
Tools and techniques to defining research problems
• Basic techniques to define the cause:
• Force Field Analysis – Visually show forces that impact your proble
m or issue
• Process Mapping – Maps the “as is” flow of activities that make up a
process – look for excessive handoffs, redundancies, and other root
causes of inefficiencies
44
BDU: Bahir Dar Institute of Technology: Computing Faculty
Stating the research problem
• The heart of any research project is the problem.
• Such questions can help focus your efforts toward achieving your ult
imate purpose for gathering data: to resolve the problem.
• Researchers get off to a strong start when they begin with an unmista
kably clear statement of the problem.
45
BDU: Bahir Dar Institute of Technology: Computing Faculty
Formulating the research problem
• The task of formulating or defining a research problem is a step of greatest
importance in the entire research process,
• It determine the data to be collected,
• It determines the characteristic of the data which are relevant,
• It determines the choice of techniques to be used,
• It determines the form of the final report,
46
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research Questions and hypothesis
• Research question(s) are a technique of evaluation of a research problem
• Is the problem in line with my goal, expectations, and the expectation of
others,
• Will the solution of the problem advance knowledge?
• What is the value of potential outcomes? Who are the beneficiaries?
• Do I possess or can I acquire the necessary skills, abilities and background kno
wledge to study the problem?
• Will data be accessible?
• Do I have access to the necessary resources (time, money, tools, equipment, lab
oratory, etc.) to conduct the investigation?
• In cases where we don’t have a hypothesis, a problem statement should also
end with a research question
• Putting a the problem in a question form so that it guides the research process.
• How many RQ: You may have 3-5
47
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research Questions and hypothesis
• Farming the key questions
How many users w
Key Question #1A-a ill be…..?
The service is large.
Service interest
Hypothesis #1A Key Question #1A-b
Issue #1 How many are larg
Hypothesis #1B Key Question #1A-c e enough to take
on the client's busi
ness?
Web design project Cost Effectiveness?
Hypothesis #2A
Problem Issue #2 What questions need to be
answered to prove/disprove
Hypothesis #2B the hypothesis?
48
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research Questions and hypothesis
• In order to answer the key questions and validate the hypotheses, coll
ection of factual information is necessary
• First critical steps are to identify what information, i.e. data elements,
is required and develop a data collection approach/ technique
49
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research Questions and hypothesis
• Number of subscribe
How much efficient companies, individua
Key Question #1A-a
#1A a and effective to acc ls
ommodate all inqui • Gain from its service
ry? for …… years
Issue #1
Hypothesis #1A Key Question #1A-b
#1A b • Etc.
Hypothesis #1B
50
BDU: Bahir Dar Institute of Technology: Computing Faculty
Research Questions and hypothesis
• The aim is to determine what the relationship is between one thing (an
independent variable) and another (dependent variable);
51
BDU: Bahir Dar Institute of Technology: Computing Faculty
Formulation of the hypothesis
Definition:
• Hypothesis is a tentative explanation for an observation that can be tested (i.e.
proved or disproved) by further investigation
Importance:
• Start at the end - Figuring out the solution to the problem, i.e. "hypothesizing",
before you start will help build a roadmap for approaching the problem
Basic Concepts:
• Hypotheses can be expressed as possible root causes of the problem
• Breaking down the problem into key drivers (root causes) can help formulate
hypotheses
52
BDU: Bahir Dar Institute of Technology: Computing Faculty
Developing objective and specific objectives
• Statements that indicate what a researcher intends to accomplish in
a more specific term,
• Objective and or specific objectives need to be:
• The objectives must propose to do things as per the capability of the design of
the study,
53
BDU: Bahir Dar Institute of Technology: Computing Faculty
54
BDU: Bahir Dar Institute of Technology: Computing Faculty