5 Questionnaire Design
5 Questionnaire Design
5 Questionnaire Design
CENTER
J and S Building, 104 Kalayaan Avenue, Diliman, Quezon
City
Introduction to
Questionnaire Design
Prepared by:
Josefina V. Almeda
Professor and College Secretary
School of Statistics
University of the Philippines, Diliman
August 2009
Questionnaire
Types of Questionnaire
Structured
Unstructured
Open-Ended Questions
Closed-Ended Questions
Types of Questions
Open ended :response categories are not specified;
the respondents are free to answer as
they please
Example:
We would like to get your opinion regarding the
effectiveness of the project in your barangay.
a. What do you think are the strengths of the
project? Why did you say so?
b. How do you think can the project still be
improved to meet its objective?
Types of Questions
Closed - ended respondent selects one or more of the
specific categories provided by the researcher or the
question is asked as an open question and the interviewer
allocates the answer to the appropriate code category.
Example:
Do you practice family planning?
__ Yes
__ No
If YES, what methods did you use?
__ Condom
__
Pills
__ Ligation
__
IUD
__ Injectables
__
Natural
__ Others, specify ____________________
Statistical Research and Training Center
10
11
12
13
____________________________________
_____________________________________
14
15
16
Presuming questions
Do you think the Clean Air Act is being implemented
properly by local authorities?
Improvement:
_____________________________________
____________________________________
17
18
Unrealistic questions
What brand of perfume do you think you will be
using three years from now?
Improvement:
__________________________________________
_
__________________________________________
Statistical Research and Training Center
19
Incomplete/non-exhaustive listing
Did you learn about the brand from TV, radio, newspaper, or
friends?
Improvement:
____________________________________________
____________________________________________
20
Biased Wording
Do you think that decent, low-cost funerals are
sensible?
Improvement:
__________________________________________
_
_________________________________________
Statistical Research and Training Center
21
Leading questions
The majority of physicians in the Philippines feel
that smoking is harmful; do you agree?
Improvement:__________________________________
______________________________________
Statistical Research and Training Center
22
23
Examples of Pitfalls in Question Construction
Dangling Alternatives
_______________________________________
24
25
Hypothetical Questions
If you are the president of the Philippines, would you push
through with the Charter Change?
Improvement:
_______________________________________________
_______________________________________
26
Vague questions
How often do you wash your hair?
Very often
Often
Not too often
Never
Imrovement: ______________________________________
__________________________________________
Statistical Research and Training Center
27
WORD
acquaint
assist
consider
initiate
major
materialize
purchase
sufficient
terminate
28
SIMPLER WORD
inform, tell
help
think
begin, start
important, chief, main, principal
come about, happen, occur
buy
enough
end
Exercise:
29
30
31
32
33
34
Number of Categories
There is no optimal number of categories.
5 to 6 categories are commonly used
Odd or Even Number of Categories
If odd, usually the middle category is the neutral position.
If even, there will be no neutral category. Thus, the
respondent is forced to take a position.
35
36
10
37
Rank-Order Scale
This involves having the respondent rank various objects with respect to
the attitude in question.
This is actually a forced scale.
It is possible that respondent actually dislikes all of the objects they were
asked to rank according to a favorable characteristic. This attitude is not
captured by the scale.
Example: The following are some of the problems faced by the local
government. Please rank them in terms of importance, from 1 (most
important) to 5 (least important).
_____
_____
_____
_____
_____
Statistical Research and Training Center
Pollution
Garbage
Traffic
Drug Addiction
Crime
Training Course on Basic Statistics for Research
August 24 - 28, 2009
38
Checklist Question
provides more than two alternatives from which the respondent can
choose as many responses that apply to them.
Example: What kind of ball sports do you like to play?
basketball
volleyball
football
tennis
baseball
water polo
others, pls. specify _____________
Question Order
39
40
Funnel Approach
Uses a general-to-specific question flow.
Work Approach
Requires that difficult to answer questions are placed deep
inside the questionnaire.
Sections Approach
Arranges the questionnaire into sections or topic category
divisions that are dictated by the objectives of the study
41
Quintamensional Design
This 5-question approach was developed by George Gallup to
cover the most essential features of an opinion:
Open-ended question on awareness/knowledge of the issue
Open-ended question on the attitudes toward the issue
Closed-ended question on attitude towards specific issues
Open-ended question on reason behind attitude
Closed-ended question on the intensity of attitudes
42
43
44
Example of an Introduction
45
The Pretest
46
Types of Pretest
47
Participating Pretest
Respondents are told that this is a practice run, and are asked
to explain their reactions and answers.
This allows for a very detailed probe on certain questions such
as:
What did the whole question mean to you?
What did the (term) make you think of?
Undeclared Pretest
The respondent is not told that this is a questionnaire under
construction, and the interviewer plays it straight.
48
49
WORKSHOP
50
Data Coding
51
52
53
TYPES OF CODES
54
Listing codes
Bracket codes
Scale codes
Series codes
System codes
Statistical Research and Training Center
LISTING CODES
55
Example:
56
BRACKET CODES
57
Example:
58
SCALE CODES
59
Example:
60
1. Two-point scale
Q:
"How do you rate the overall performance of this
administration?"
1
2
__________________
Low
High
Ans: "Inspite of the economic crisis, the performance of
this administration is above my expectation."
Code: ______
Statistical Research and Training Center
Example:
61
2. Three-point scale
(a) This scale has a middle or neutral position
Q:
"Do you get along well with your supervisor?"
1
2
3
__________________________________
YES
YES IN SOME WAYS,
NO
NO TO OTHERS
Ans: "Sometimes."
Code: _______
Statistical Research and Training Center
Example:
62
3. Four-point scale
(a) This scale has no middle or neutral position.
Q:
"How sure are you about the outcome of the
election in your province?"
1
2
3
4
__________________________________
Certain Fairly
Fairly
Uncertain
certain
uncertain
Ans: "I have no idea."
Code: _______
Statistical Research and Training Center
63
Example:
4. Five-point scale
(a) We use a five-point intensity to code responses with
degree of feeling.
Q:
"How satisfied are you with your present job?"
1
2 3
4
5
_____________________________________________
VerySatisfied
Satisfied
Neutral
Dissatisfied
Dissatisfied
Very
Series Codes
64
65
66
21
22
23
SYSTEM CODES
67
Example:
68
Example:
69
Example:
70
CODING OF NO RESPONSE
71
Types of No Response:
A.
No Opinion
B.
Don't Know
C.
Refuse to answer
D.
Not applicable
E.
Missing (in general)
NO RESPONSE
72
A. NO OPINION
NO OPINION should be coded NO or given a code
number directly following the other categories.
Example:
Did you find Mr.______adequate in helping you solve
your problems?
________Yes
________No
Answer: No Comment.
We could give Yes a code (1); No a code (0) and a No
Opinion/No Comment a code (2).
Statistical Research and Training Center
NO RESPONSE
73
B. DON'T KNOW
NO RESPONSE
74
Example:
How much did you and your household spend on
transportation this past month ?
_____(1)
less than P200
_____(2)
P200 to less than P500
_____(3)
P500 to less than P1000
_____(4)
P1000 to less than P2000
_____(5)
more than P2000
_____(6)
don't know
NO RESPONSE
75
C. REFUSES TO ANSWER
We sometimes, unfortunately, encounter not-so
receptive respondents who do not like to readily
volunteer their responses.
NO RESPONSE
76
Example:
How much was your family income this past month ?
Answer: refuses to answer
Code: _______
NO RESPONSE
77
D.NOT APPLICABLE
Some responses to our questions may be dependent
upon answers to previous questions or to some
attributes of our respondents. So that if the attribute is
not present, the question becomes irrelevant.
In cases like these, we code it as NA; or as '9',or '99' or
even '99999', again depending on the number of
columns allotted to our variable.
NO RESPONSE
78
Example :
Do you own a farm ? _____Yes
_____No
What is the land area of your farm ? _____(hectares)
Code: ________
NO RESPONSE
79
E.MISSING
refers to responses which were not recorded for various
reasons, which could not be verified. Hence, we assign
to it a special "missing" value symbols.
Following are some characters which are recognized
automatically as missing values by three major
statistical software packages:
BMDP:
blank
SAS :
blank
SPSS :
blank
Statistical Research and Training Center
80
81
Q:
What type of TV shows do you watch ? (Please check your
answers )
[ ] action
[ ] drama
[ ] game
[ ] sport
[ ] none
[ ] Pls. specify __________________
A:
Code: _____________
Statistical Research and Training Center
82
Code
1 watched
0 did not watch
1 watched
0 did not watch
1 watched
0 did not watch
1 watched
0 did not watch
2 does not watch
83
Quality Control
84
Training of Encoders
Encoders should be trained and supervised
Procedures to be used in coding and entering data
should be reviewed in sequence and in detail.
Encoders should be provided with codebooks
Quality Control
85
Range Checking
This checks the variable values against predefined
maximum and minimum bounds.
This is often done to catch spurious values or keyboard
entry errors.
Cleaning rules can be formulated as logical expressions
making various assertions about the data.
Quality Control
86
Quality Control
87
WORKSHOP
88
89
Example
Respondent Identification Variables
Variable
Name
Variable Label
Code Response
ID
ID Number
Brgy
Barangay
1 Ibayo
2 Labac
Type
Type of Barangay
1 Urban
2 Rural
Resp
Age Classification
1 Adult
2 Youth
Intervr
Name of Interviewer
Encode as is
Encode as is
90
Example
Demographics. Personal Information
Variable Label
Variable
Name
A1
A2
A3
A01Name
A02Sex
Name
Sex
1 Lalaki
2 Babae
Age
A03Age
Civil Status
A4
Code Response
A04CS
1 Single
2 Married
3 Separated
4 Widowed
5 Others
Training Course on Basic Statistics for Research
August 24 - 28, 2009