Chapter 3 Research Design
Chapter 3 Research Design
Chapter 3 Research Design
RESEARCH DESIGN
1
Learning Objectives
2
…..Learning Objectives
3
3.1. Decision Making in Planning Research
Strategies and Tactics
• Decision making is the process of resolving a
problem or choosing among alternative
opportunities.
• The key to decision making is to recognize the
nature of the problem/opportunity, to identify
how much information is available, and to
recognize what information is needed.
• Every business problem or decision-making
situation can be classified on a continuum
ranging from complete certainty to absolute
ambiguity. 4
continued
Certainty
• The decision maker knows the exact nature of the
business problem or opportunity.
Uncertainty
• Uncertainty means that decision makers grasp the
general nature of the objectives they wish to
achieve, but the information about alternatives is
incomplete.
• Predictions about the forces that will shape future
events are educated guesses.
• Effective decision makers recognize potential value
in spending additional time gathering information to
clarify the nature of the decision.
5
continued
Ambiguity
• Ambiguity means that the nature of the
problem to be solved is unclear.
6
Important Concepts
7
Dependent and Independent variables:
8
Extraneous variable:
Independent variables that are not related to the
purpose of the study, but may affect the dependent
variable are termed as extraneous variables.
Control:
• ‘Control’ is used when we design the study minimizing
the effects of extraneous independent variables
• Used to minimize the influence or effect of extraneous
variables(s)
• the term ‘control’ is used to refer to restrain
experimental conditions.
Confounded relationship:
• When the dependent variable is not free from the
influence of extraneous variable(s), the relationship
between the dependent and independent variables is
said to be confounded by an extraneous variable(s).
9
Experimental and non-experimental hypothesis-testing
research:
• When the purpose of research is to test a
research hypothesis, it is termed as
hypothesis-testing research.
• It can be of the experimental design or of the
non-experimental design.
• Research in which the independent variable is
manipulated is termed ‘experimental
hypothesis-testing research’ and
• A research in which an independent variable
is not manipulated is called ‘non-
experimental hypothesis-testing research’.
10
Experimental and control groups:
Representativeness:
• refers to the question of whether the characteristics
of a
• sample drawn properly represents the characteristics
of the population from which the sample is selected
and about which a conclusion is to be made.
11
Validity
• refers to the problem of whether the data
collected is reflects the true picture of what is
being studied.
Reliability:
• refers to the dependability of the research findings
that they can be
• repeated either by the researcher or by other
researchers using similar research methods or
procedures.
12
Causation and Correlation
13
Causation and Correlation
• Correlation does not necessarily show cause
and effect relationship between variables or
occurrences.
15
Research design: meaning continued
Research design is the plan and structure of
investigation so conceived as to obtain answers to
research questions. The plan is the overall scheme
or program of the research. It includes an outline of
what the Investigator will do from writing
hypotheses and their operational implications to the
'final analysis of data. A structure is the framework,
organization, or configuration of . . . the relations
among variables of a study. A research design
expresses both the structure of the research
problem and the plan of investigation used to obtain
empirical evidence on relations of the problem."
16
Basic points in the definitions
17
Problem Discovery Problem Selection of
and Definition discovery exploratory research
technique
Sampling
Selection of
exploratory research
technique Probability Nonprobability
Secondary
Experience Pilot Case Collection of
(historical) Data
survey study study data
data Gathering
(fieldwork)
Data
Editing and
Problem definition Processing
coding
(statement of and
Analysis data
research objectives)
Data
Selection of Analysis
Research Design basic research
method Conclusions
Interpretation
and Report
of
findings
Experiment Survey
Secondary
Laboratory Field Interview Questionnaire Observation
Data Study Report
18
CLASSIFICATION OF RESEARCH DESIGNS
The degree to which the research problem has
been crystallized (exploratory or formal).
The method of data collection (observational or
survey).
The power of the researcher to affect the variables
under study (experimental and the ex-post facto).
The purpose of the study (descriptive or causal).
The time dimension (cross-sectional or
longitudinal).
The topical scope-breadth and depth-of the study
(a case or statistical study).
The research environment (field experimentation,
laboratory experimentation, simulation).
19
Basic Questions -
Basic Research Design
• What types of questions need to be answered?
• Are descriptive or causal findings required?
• What is the source of the data?
• Can objective answers be obtained by asking
people?
• How quickly is the information needed?
• How should survey questions be worded?
• How should experimental manipulations be
made?
20
3.5. Basic Research Designs
• 3.5.1. Survey Research
• 3.5.2. Observational Research
• 3.5.3. Experimental Research
• 3.5.4. Case Study Research
• 3.6. Sampling
21
3.5.1. Survey Research
22
3.5.1.1. Census versus Survey
Activity 3.1
Which do you think is more appropriate? Survey or
census? Why”
___________________________________________
___________________________________________
________________________________________
23
Census versus Survey
• Census involves collecting all the necessary
data from the whole population under study
to make the conclusion about the population.
• Census often suffers from the following
drawbacks.
• It is cumbersome
• It is time consuming
• It is costly
• It may be less accurate because of
administrative problems
24
Survey is a research technique in which
information is gathered from a sample of
respondents using verbal or written questioning
25
Benefits of Surveys
• Quick
• Inexpensive
• Efficient
• Accurate
• Flexible
Limitations of Surveys
• Poor Design
• Improper Execution
26
Classification of Surveys
C L A S S IF Y IN G
SURVEY
RESEARCH
M E TH O D S
M E TH O D S TR U C TU R E D TE M P O R A L
OF A N D D IS Q U IS E D C L A S S IF IC A TIO N S
C O M M U N IC A TIO N Q U E S TIO N S
27
Types of Surveys – Temporal Classification
Cross sectional surveys
• Data are collected at one point in time from a
sample selected to describe some larger
population at that time.
Longitudinal Surveys
• Surveys of respondents are made at different
points in time
• allows analysis continuity and changes over
time.
28
Longitudinal Survey
• Tracking study - compare trends and identify
changes
– consumer satisfaction
29
Trend studies
• A given general population may be sampled and
studied at different points in time while the specific
population and the persons studied are different in
each survey
30
Cohort studies
• Collects data from the same specific
population each time data are collected
although the sample respondents studied may
be different.
• Uses the same specific population to measure
changes at another time
Panel studies
• Involves collecting data from the same sample
of individual respondents over time.
31
Limitations of panel studies
• High attrition
• Switching of respondents
• Lack of willingness to respond
• Lack of appropriate memory
• Time consuming and
• Difficult to effectively administer
32
Choosing the appropriate longitudinal
design
Trend studies -- Longer duration
Cohort studies -- Medium duration
Panel Studies -- Short duration
33
• Surveys are more accurate than census results
because census may require large number of
skilled staff, more time, and more money would
make census very difficult to ensure accuracy.
34
3.5.1.2. Errors in Survey Research
35
36
37
38
Deliberate
Falsification
Interviewer
Bias
39
40
Random Sampling Error
• A statistical fluctuation that occurs because of
change variation in the elements selected for the
sample
42
Respondent Error
• A classification of sample bias resulting from
some respondent action or inaction
• Nonresponse bias
• Response bias
43
Nonresponse Error
• The statistical differences between a survey
that includes only those who responded all, a
survey that also includes those who failed to
respond
• Nonrespondents –
– people who refuse to cooperate
– Not-at-homes
– Self-selection bias
• Over-represents extreme positions
• Under-represents indifference
44
Response Bias
• A bias that occurs when respondents tend to answer
questions with a certain slant that consciously or
unconsciously misrepresents the truth
Deliberate Falsification
• occasionally some people deliberately give false
answers.
• A response bias may occur when people
misrepresent answers in order to appear intelligent,
to conceal personal information, to avoid
embarrassment, and so on.
45
Unconscious Misrepresentation
• Even when a respondent is consciously trying
to be truthful and cooperative, response bias
can arise from question format, question
content, or some other stimulus
• Respondents who misunderstand the
question may unconsciously provide a biased
answer.
• A bias may also occur when a respondent has
not thought about the question "sprung" on
him or her by an interviewer.
46
Response bias
• Five types
– acquiescence bias,
– extremity bias,
– interviewer bias,
– auspices bias, and
– social desirability bias.
47
Acquiescence Bias
• The general tendency to agree or disagree
with all or most questions is particularly
prominent in research on new products, new
programs, or ideas previously unfamiliar to
the respondents.
48
Extremity Bias
49
Interviewer Bias
• A response bias that occurs because the
presence of the interviewer influences
answers.
• Occurs because of interplay between
interviewer and respondent.
50
Auspices Bias
• Bias in the responses of subjects caused by
the respondents being influenced by the
organization conducting the study.
53
3.5.2. OBSERVATION METHODS
When Is Observation Scientific?
• Scientific observation is the systematic process of
recording the behavioral patterns of people, objects,
and occurrences without asking respondents.
54
Observation becomes a tool for scientific
inquiry when it:
• Serves a formulated research purpose
• Is planned systematically
• Is recorded systematically and related to
more general propositions rather than
being represented as reflecting a set of
interesting curiosities
• Is subject to checks or controls on validity
and reliability
55
What Can Be Observed?
Phenomena Example
58
Categories of Observation
59
• Human observation is commonly used when the
situation or behavior to be recorded is not easily
predictable in advance of the research.
60
Observation of Human Behavior
Benefits
• Communication with respondent is not
necessary
• Data without distortions due to self-report
(e.g.: without social desirability) bias
• No need to rely on respondents memory
• Nonverbal behavior data may be obtained
61
Observation of Human Behavior
Benefits
• Certain data may be obtained more quickly
• Environmental conditions may be recorded
• May be combined with survey to provide
supplemental evidence
62
Observation of Human Behavior
Limitations
• Cognitive phenomena cannot be observed
• Interpretation of data may be a problem
• Not all activity can be recorded
• Only short periods can be observed
• Observer bias possible
• Possible invasion of privacy
63
3.5.3. Basic Issues of Experimental Design
64
• The experimenter has some degree of control over the
independent variable.
• The variable is independent because its value can be
manipulated by the experimenter to whatever he or she
wishes it to be.
• one variable (the independent variable) is manipulated
and its effect on another variable (the dependent
variable) is measured, while all other variables that may
confound such a relationship are eliminated or
controlled.
• The experimenter either creates an artificial situation or
deliberately manipulates a situation.
65
Manipulation of Independent
Variable
• Classificatory Vs. continuous variables
• Experimental and control groups
• Treatment levels
• More than one independent variable
66
Dependent Variable
• Its value is expected to be dependent
on the experimenter’s manipulation
• Criterion or standard by which the
results are judged
• Selection
– e.g... sales volume, awareness, recall,
• Measurement
67
Experimental Errors
68
Controlling Extraneous Variables
• Elimination of extraneous variables
• Constancy of conditions
• Random assignment
69
Field versus
Laboratory Experiments
70
Field Versus Laboratory Experimentation
• A research experiment can be conducted in a natural
setting (field experiment) or in an artificial setting,
one contrived for a specific purpose (laboratory
experiment).
71
Laboratory Experiment Field Experiment
72
Basic versus Factorial Experimental Designs
Basic experimental designs
• a single independent variable is manipulated
to observe its effect on a single dependent
variable.
74
3.5.4. Case Study Research
• detailed and intensive analysis of one case
• e.g. a specific person, event, organization or
community
• often involves qualitative research
• case is the focus of interest in its own right -
location/setting just provides a background
• types of case: critical, unique, extreme, revelatory,
exemplifying
• e.g. Holdaway (1982, 1983): ethnography of
occupational culture in a particular police force
75
3.6.1. Sampling Designs & Sampling Procedures
Sampling Terminologies
• Sample
• Population or universe
• Population element
• Census
76
Sample
• Subset of a larger population
Population
• Any complete group
– People
– Sales territories
– Stores
77
Census
• Investigation of all individual elements that
make up a population
78
Stages in the Define the target population
Selection
of a Sample Select a sampling frame
Plan procedure
for selecting sampling units
Conduct fieldwork
79
Target Population
• Relevant population
• Operationally define
Sampling Frame
• A list of elements from which the sample may be
drawn
• Working population
• Mailing lists - data base marketers
• Sampling frame error
80
Sampling Units
• Group selected for the sample
• Primary Sampling Units (PSU)
• Secondary Sampling Units
• Tertiary Sampling Units
Random Sampling Error
• The difference between the sample results and the
result of a census conducted using identical
procedures
• Statistical fluctuation due to chance variations
81
Systematic Errors
• Non-sampling errors
• Unrepresentative sample results
• Not due to chance
• Due to study design or imperfections in
execution
82
Errors Associated with Sampling
83
Two Major Categories of Sampling
• Probability sampling
• Known, nonzero probability for every element
• Nonprobability sampling
• Probability of selecting any particular member
is unknown
84
Nonprobability sampling designs
– Convenience sampling
– Quota sampling
– Purposive/Judgment sampling
– Snowball sampling
Probability Sampling Designs
– Simple random sampling
– Stratified random sampling
– Systematic sampling
– Cluster sampling
85
Convenience Sampling
86
Judgment Sampling
• Also called purposive sampling
• An experienced individual selects the sample
based on his or her judgment about some
appropriate characteristics required of the
sample member
87
Quota Sampling
• Ensures that the various subgroups in a
population are represented on pertinent
sample characteristics
• To the exact extent that the investigators
desire
• It should not be confused with stratified
sampling.
88
Snowball Sampling
• A variety of procedures
• Initial respondents are selected by probability
methods
• Additional respondents are obtained from
information provided by the initial
respondents
89
Simple Random Sampling
• A sampling procedure that ensures that each
element in the population will have an equal
chance of being included in the sample
90
Systematic Sampling
• A simple process
• Every nth name from the list will be drawn
91
Stratified Sampling
• Probability sample
• Subsamples are drawn within different strata
• Each stratum is more or less equal on some
characteristic
• Do not confuse with quota sample
92
Cluster Sampling
• The purpose of cluster sampling is to sample
economically while retaining the
characteristics of a probability sample.
• The primary sampling unit is no longer the
individual element in the population
• The primary sampling unit is a larger cluster of
elements located in proximity to one another
93
Examples of Clusters
94
What is the Appropriate Sample Design?
• Degree of accuracy
• Resources
• Time
• Advanced knowledge of the population
• National versus local
• Need for statistical analysis
95
3.6.2. Determining the sample Size
Sample size is influenced by:
96
SAMPLE SIZE CRITERIA
The three criteria to determine the appropriate
sample size:
97
i) The Level of Precision
• sometimes called sampling error, is the range
in which the true value of the population is
estimated to be.
• This range is often expressed in percentage
points, (e.g., ±5 percent)
98
ii) The Confidence Level
• The confidence or risk level is based on ideas
encompassed under the Central Limit Theorem
• when a population is repeatedly sampled, the
average value of the attribute obtained by those
samples is equal to the true population value
• Furthermore, the values obtained by these
samples are distributed normally about the true
value, with some samples having a higher value
and some obtaining a lower score than the true
population value
99
confidence level …..
100
confidence level
101
iii) Degree Of Variability
• The degree of variability in the attributes
being measured refers to the distribution of
attributes in the population
• The more heterogeneous a population, the
larger the sample size required to obtain a
given level of precision and vice versa
• Because a proportion of 0.50 indicates the
maximum variability in a population, it is often
used in determining a more conservative
sample size,
102
Approaches/strategies to determine the sample size
103
i) Using A Census For Small Populations
• Using the entire population as a sample.
although cost considerations make this
impossible for large populations
ii) Using A Sample Size Of A Similar Study
• you may run the risk of repeating errors that were
made in determining the sample size for another
study.
iii) Using Published Tables
• Show actually obtained data
• Assume normal distribution
104
iv) Using Formulas To Calculate A Sample Size
Further Reading
Sample Size Determination Formulas
105
Sampling in Practice
• Exercice
106
3.7. Ethical Issues in Business Research
What is Ethics?
• Ethics is a state of good or bad
• Ethics Vs Rules and Regulations
• Rules are formal and ethics is societal law
• Research demands ethical behavior from its
participants.
• The goal of ethics in research is to ensure that
no one is harmed or suffers adverse
consequences from research activities.
107
Research Ethics Continued
• Ethical questions are philosophical questions that are based on
the perceptions of a society.
• Societal norms are codes of behavior adopted by a group,
suggesting what a member of a group ought to do under given
circumstances.
• Ethics bridges the gap between laws and actual practices.
• In research ethical issues are concerns of the three major
stakeholders:
– the researcher or investigator
– the subject or respondent, and
– the sponsor or client or financier
• Therefore ethical issues in business research are explained by the
interaction of the rights and obligations of these three
stakeholders.
108
109
Rights and Obligations of the Respondent
Obligation:
• to provide truthful information.
Rights:
i) Privacy
• Collecting and giving out of personal information of
respondents without their knowledge can be a
serious violation
• This involves the subject’s freedom to choose
whether or not to comply with the investigator’s
request.
• Field interviewers indicate their legitimacy by
– passing out business cards,
– wearing nametags, or
– identifying the name of their company.
110
Rights continued
ii) Deception/The right not to be deceived
• Deception occurs when the respondent is told only a
portion of the truth or when the truth is fully
compromised.
• Some suggest two reasons to legitimate deception:
– to prevent biasing the respondents prior to the
survey and
– to protect the confidentiality of a third party (e.g.,
the client).
• However
a) The benefits to be gained by deception should be
balanced against the risks to the respondents.
b) Once the research is completed, the subjects who
were deceived should be “debriefed.”
111
Rights continued
112
Rights continued
113
Rights and Obligations of the Researcher
• A code of ethics may also be developed by
professional associations.
• Code of ethics is a statement of principles and
operating procedures for ethical practice.
• Points that deserve attention in the efforts of the
researcher in relation to ethics.
i) The purpose of Research is Research
• The purpose should be explained clearly
• The researcher should not misrepresent
himself/herself for the sake of getting admission or
information.
• Research should not be politicized for any purpose.
114
Research ethics continued
ii) Objectivity
• Researchers must not intentionally try to prove a
particular point for political purposes.
• The researcher should not try to select only those
data that are consistent with his/her personal
intentions or prior hypothesis.
iii) Misrepresentation of Research
• To analyze the data honestly and to report correctly
the actual data collection methods.
iv) Protecting the Right to Confidentiality of both
Subjects and Clients
• The privacy and anonymity of the respondents are
preserved.
• Both parties also expect objective and accurate
report from the researcher.
115
Research ethics continued
116
ii) An Open Relationship with Researchers
• The obligation to encourage the researcher to seek
out the truth objectively.
• This requires a full and open statement of
– the problem,
– explication of time and money constraints, and
– any other insights that may help the supplier,
iii) An Open Relationship with Interested Parties
• Conclusions should be based on the data.
• Violation of this principle may refer to justifying a
self-serving, political position that is not warranted
from the data poses serious ethical questions.
117
iv) Commitment to Research
• This involves requesting research proposals
when there is a low probability that the
research will be conducted.
• Researchers believe that the client has the
obligation to be serious about considering a
project before soliciting proposals.
v)Pseudo-Pilot Studies
• Tell the researcher that it is a pilot study and
that if a good job is performed during the pilot
study stages there will be an additional major
contract down the line.
118
vi) Right to Quality Research
119