Operational Research
Operational Research
Operational Research
March 2019
1
Table of Contents
Table of Contents..................................................................................................2
Background.........................................................................................................11
Acknowledgment................................................................................................12
Introduction.........................................................................................................14
Module Overview...............................................................................................14
Target Audience..................................................................................................14
Organization of the Module................................................................................14
Instructions for Use.............................................................................................16
Preparation with Handouts and Worksheets.......................................................16
Using Students Manual When Teaching.............................................................16
Abbreviations......................................................................................................18
Session 1: Basic Statistical Concepts..................................................................20
Session 2: Basic Biostatistics Data.....................................................................27
Session 3: Data Presentation...............................................................................34
Session 4: Establishing Trends in Health Care...................................................45
Session 5: Basic Concept of Research................................................................55
Session 6:Classification of Research..................................................................61
Session 7: Procedures for Conducting Operational Research............................72
Session 8: Identification of Research Problem..................................................79
Session 9: Analysis and Statement of the Problem.............................................96
Session 10: Literature Review in Research......................................................106
Session 11: Research Objectives and Questions...............................................114
Session 12: Review of Study Types/Designs....................................................125
Session 13: Research Sampling........................................................................129
Session 14: Determining Sample Size..............................................................141
Session 15: Research Ethics.............................................................................147
Session 16: Developing Research Tools...........................................................153
Session 17: Pre-Testing the Research Tools.....................................................194
Session 18: Data Collection Plan......................................................................203
Session 19: Research Budget............................................................................215
Session 20: Data Collection..............................................................................224
Session 21: Data Collection - Field Work Activities........................................233
Session 22: Data Processing.............................................................................236
Session 23: Data Analysis.................................................................................244
Session 24: Research Report Writing...............................................................259
Session 25: Methods for Dissemination of Research Findings........................273
2
3
Background
There is currently an ever increasing demand for pharmaceutical personnel in Tanzania.
This is due to expanding investment in public and private pharmaceutical sector. Shortage of
trained pharmaceutical human resource contributes to poor quality of pharmaceutical
services and low access to medicines in the country (GIZ, 2012).
The Pharmacy Council formed a Steering committee that conducted a stakeholders workshop
from18th to 22ndAugust 2014 in Morogoro to initiate the implementation of the project.
Key activities in the implementation of this project included carrying out situational analysis,
curriculum review and harmonization, development of training manual/facilitators guide,
development of assessment plan, training of trainers and supportive supervision.
After the curricula were reviewed and harmonized, the process of developing standardized
training materials was started in August 2015 through Writers Workshop (WW) approach.
The approach included two workshops (of two weeks each) for developing draft documents
and a one-week workshop for reviewing, editing and formatting the sessions of the modules.
The goals of Writers Workshops were to build capacity of tutors in the development of
training materials and to develop high-quality, standardized teaching materials.
The training package for pharmacy cadres includes a Facilitator Guide, Assessment plan and
Practicum. There are 12 modules for NTA level 6 making 12 Facilitator guides and one
Practicum guide.
4
Acknowledgment
The development of standardized training materials of a competence-based curriculum for
pharmaceutical sciences has been accomplished through involvement of different
stakeholders.
Special thanks go to the Pharmacy Council for spearheading the harmonization of training
materials in the pharmacy after noticing that training institutions in Tanzania were using
different curricula and train their students differently.
I would also like to extend my gratitude to Christian Social Service Commission (CSSC) for
their tireless efforts to mobilize funds from development partners (German Ministry of Industry
and action medeor). It is through the implementation of the Multi-Actors Partnership (MAP)
project, CSSC has been able to provide the financial and technical support needed during the
development of this training material.
Many thanks go to the Centre for Educational Development in Health Arusha (CEDHA)
experts on health material development and training who coordinated the development of
these module sessions particularly Ms. Diana H. Gamuya for her commitment in coordinating
and facilitating the planning and development to its completion.
Particular acknowledgements are sent to Mr. Dickson Mtalitinya and Members from the
secretariat of National Council for Technical Education (NACTE) for facilitating and
providing their expertise to the success of this work.
It will be unfair if I will not recognize the efforts and contributions of all CEDHA supportive
staff that made this process a success; accountant, secretary, drivers and printers
Finally, I very much appreciate the contributions of the tutors and content experts
representing PTIs, hospitals, and other health training institutions. Their participation in
meetings and workshops, and their input in the development of this training
manual/facilitators guide have been invaluable.
5
Mr. Wensaa Muro KSP
Mr. John Mmassy CSSC
Ms. Emily Mwakibolwa Pharmacy Council
Mr. Samwel M. Zakayo Pharmacy Council
Mr. Godfrey Komba NACTE
Mr. Samweli Mdallingwa NACTE
Mr. Daniel Muhochi CEDHA
Dr. Byera Shwekerela CEDHA
Dr. Johannes Lukumay CEDHA
Dr. Mwandu Jiyenze CEDHA
Dr. Peter Sala CEDHA
Mr. Stephano Kiberiti CEDHA
Mr. Amani Phillip HKMU
Mr. John M. Bitoro CUHAS
Mr. Omary Mejjah CUHAS
Mr. Karol Marwa CUHAS
Mr. Raphael Matinde CUHAS
Mr. Rajabu I. Amiri MUHAS
Mr. Peter Njalale MUHAS
Ms. Tumaini H. Lyombe MUHAS
Ms. Dilisi J. Makawia KSP
Mr. Richard P. Mmassy KSP
Mr. Nemes Uisso RAS-KLM
Mr. Gaspar Baltazary RuCU
Mr. Goodluck Mdugi RuCU
Mr. Godfrey A. Pharaoh SIBS
Mr. Joel M.Selestine SIBS
Mr. Jimmy M. Mulee SIBS
Mr. Evalist Shileki DECOHAS
Mr. Eliabu Mshashi KIUT
6
Introduction
Module Overview
This module content is a guide for tutors of Pharmaceutical schools for training of students.
The session contents are based on sub-enabling outcomes and their related tasks of the
curriculum for Basic Technician Course in Pharmaceutical Sciences. The module sub-
enabling outcomes and their related tasks are as indicated in the in the Basic Technician
Certificate in Pharmaceutical Sciences (NTA Level 6) Curriculum
Target Audience
This module is intended for use primarily by tutors of pharmaceutical schools. The module s
sessions give guidance on the time, activities and provide information on how to teach the
session. The sessions include different activities which focus on increasing students
knowledge, skills and attitudes.
The module consists of twenty five (25) sessions; each session is divided into several parts as
indicated below:
7
students to study material on their own and to refer to them after the session. Sometimes,
a handout will have questions or an exercise for the participants including the answers to
the questions.
Tutors are expected to use the module as a guide to train students in the classroom and
skills laboratory
The contents of the modules are the basis for teaching and learning dispensing.
Use the session contents as a guide
The tutors are therefore advised to read each session and the relevant handouts and
worksheets as preparation before facilitating the session
Tutors need to prepare all the resources, as indicated in the resource section or any other
item, for an effective teaching and learning process
Plan a schedule (timetable) of the training activities
Facilitators are expected to be innovative to make the teaching and learning process
effective
Read the sessions before facilitation; make sure you understand the contents in order to
clarify points during facilitation
Time allocated is estimated, but you are advised to follow the time as much as possible,
and adjust as needed
Use session activities and exercises suggested in the sessions as a guide
Always involve students in their own learning. When students are involved, they learn
more effectively
Facilitators are encouraged to use real life examples to make learning more realistic
Make use of appropriate reference materials and teaching resources available locally
Go through the session and identify handouts and worksheets needed for the session
Reproduce pages of these handouts and worksheets for student use while teaching the
session. This will enable students to refer to handouts and worksheets during the session
in the class. You can reproduce enough copies for students or for sharing
Give clear instructions to students on the student activity in order for the students to
follow the instructions of the activity
Refer students to the specific page in the student manual as instructed in the facilitator
guide
The student manual is a document which has the same content as the facilitator guide,
which excludes facilitator instructions and answers for exercises.
8
The student manual is for assisting students to learn effectively and acts as a reference
document during and after teaching the session
Some of the activities included in facilitator guide are in the student manual without
facilitator instructions
9
Abbreviations
CA Continuous Assessment
EM Essential medicine
10
OTC Over the counter
RA Regulatory authority
11
Session 1: Basic Statistical Concepts
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define common terms used in biostatistics
Explain the importance of different measures in statistics
Explain the application of statistics in data analysis
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD computer
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 5 minutes Presentation Introduction, Learning Tasks
12
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
Other terms:
Statistics can be defined in two forms:
o First statistics as a noun means a descriptive measure computed from data of a
sample i.e. numerical statement - information that is available in numbers). Examples
of this include:
Hospital data on the number of admissions for some condition in a period
How much drug (e.g. Amoxicillin capsules) is distributed to health units -
hospitals, health centres and dispensaries
This first part of the subject is usually referred to as descriptive statistics
o Secondly statistics as a discipline is a field of study concerned with:
Collecting, organizing and summarizing and analysis of data in a systematic way.
Drawing of inferences about a population on the basis of only a part of the
population targeted.
This second part, which, provides objective means of drawing conclusions,
constitutes inferential statistics
Population
o A collection of entities.
o A statistical population means the largest collection of entities in which we have an
interest.
o Example we may be interested in looking at how may health facilities are given
Amoxil in district X?
Sample
o Part of a population.
o Example number of health centres given Amoxil capsules.
Central tendency
13
o Measures of central tendency provide a summary measure that attempts to describe
data with a single value that represents the middle or centre of its distribution.
o There are three main measures of central tendency:
the mean,
median and
mode
Median (Mdn):
The midpoint or number in a distribution having 50% of the scores above it and 50% of
the scores below it.
The median of a data set is the value that is at the middle of a data set arranged from
smallest to largest
If there are an odd number of scores, the median is the middle score.
Mode (Mo):
The number that occurs most frequently in a distribution of scores or numbers
The mode is the most common observation of a data set, or the value in the data set that
occurs most frequently.
Quartile
A measure of statistical dispersion which divides a frequency distribution into equal
groups each containing the same fraction of the total population
The first quartile (designated Q1 ) is the lower and cuts off the lowest 25% of data (the
25th percentile)
The second quartile (Q2 ), or the median, cuts the data set in half (the 50th percentile)
The third quartile (Q3 ) cuts off highest 25% of data, or the lowest 75% (the 75th
percentile)
Variations
Range (Ra): The difference between the highest and lowest scores in a distribution; a
measure of variability.
Standard deviation (SD): The most stable measure of variability, it takes into account
each and every score in a normal distribution. This descriptive statistic assesses how far
individual scores vary in standard unit lengths from its midpoint of 0. For all normal
distributions, 95% of the area is within 1.96 standard deviations of the mean.
14
Variance (SD2): A measure of the dispersion of a set of data points around their mean
value. It is a mathematical expectation of the average squared deviations from the mean.
15
The importance of different measures in statistics is to give one value for the distribution
and this value represents the entire distribution, to know what is normal or 'average' for a
set of data and variations from normal.
16
References
Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C.(1997). Lecture notes in
Biostatistics, manual of biostatistics: Dar es Salaam, Tanzania: Muhimbili University
College of Health Sciences
Rao, J. S., & Richard, J. (2002). An introduction to bostatistics-a manual for students in
health sciences (3rd Ed); New Delhi: Circus
17
Session 2: Basic Biostatistics Data
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define data
Mention characteristics of data
Explain sources of data
Describe types of data
Explain the quality of data
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD Computer
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
10 minutes Brainstorm
2 Definition of Data
Presentation
25 minutes
3 Presentation Characteristic of Data
25 minutes Buzzing
4 Sources of Data
Presentation
15 minutes Buzzing
5 Types of Data
Presentation
30 minutes Presentation
6 The Quality of Data
7 05 minutes Presentation Key Points
18
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
19
o Sentinel surveillance
This is a system in which data is collected routinely from selected health facilities or
communities. It is very useful in obtaining specific morbidity data in a more detailed
form, particularly endemic diseases and those under special control programmes,
with an improved accuracy compared with routine data collection system
o Surveys
A survey is very useful for evaluation because it can be done in a shorter time and
obtains a lot of detailed representative data. Surveys have the advantage of providing
timely and relevant information. Often surveys are done in the community, and hence
become more representative of the real situation than data obtained from health
facilities e.g. Demographic and health survey
o Scientific research
Research findings are usually of very high quality and can be useful in medium and
long term planning of health services. Comparatively, researches are more focused on
the subject matter than other sources of information
o External sources
o Data are collected by individual research workers or by other organizations through
sample surveys or experiments, keeping in view the objectives of the study in your
environment
20
STEP 6: The Quality of Data (30 minutes)
Data quality refers to the condition of a set of values of qualitative or quantitative variables.
Data is considered of high quality if it is fit for intended uses in operations, decision
making and planning.
Seven characteristics of quality data
o Timeliness: For data to become useful for decision-making it must reach the
manager at the appropriate time. Data on drug stock-outs and overstock should
reach the management before the meeting to make decisions on the type and
amount of drugs to procure for the next month.
o Accuracy: Data collected should be accurate enough for the manager to have
confidence in using it. However, despite the need for a high level of accuracy, it
should be borne in mind that any effort to increase the level of accuracy will be
met with an increase in the cost of collecting and processing that data. However,
the level of accuracy required in the day-to-day decision-making and planning is
not as stringent as may be required in scientific research.
o Simplicity: The process of data collection and analyses should therefore be fairly
simplified and only the necessary data should be collected on a daily 3basis.
It4667uj4y8i4nvshould always be borne in mind that the majority of lower level
health wordker have had no training in statistics.
D
o Accessibility: Information emanating from the data should be accessible to
managers at all levels to facilitate decision making, and stored properly for easy
retrieval. It should reach the manager in a timely manner, depending on the type
of decisions made.
21
STEP 7: Key Points (5 minutes)
Data is defined as the raw information from which statistics are created
They are two types of statistical data: Primary Data and Secondary Data
Quality data is considered to be timely available, accurate, complete, appropriate,
comprehensive, simple, accessible and userfriendly
STEP 8: Evaluation (5 minutes)
What is data?
What are characteristics of data?
What are the sources of data?
What are the qualities of good data?
22
References
Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. &Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press, United
Kingdom
Polit, D. F and Beck, C. T (2004) Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences.third edition, New delhi, Circus: Asoke k ghosh.
Rosner B: Fundamental of Biostatistics, 4th edition, Duxbury Press, 1995.
23
Session 3: Data Presentation
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define data presentation
Describe methods of data presentation
Explain the use of data presentation methods
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
15 minutes Brainstorming
2 Definition of Data Presentation
Presentation
40 minutes
3 Presentation Methods of Data Presentation
35 minutes Presentation
4 Use of Data Presentation Methods
Buzzing
5 10 minutes Presentation Key Points
24
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
25
students
Male 34
Female 27
Total 61
Percentages
o Is number of units in the sample with a certain characteristics divided by total of
units in the sample multiplied by 100
o May also be called Relative frequencies
26
o Standardizes the data and make it easier to compare with similar data obtained in
another sample of different size or origin
o E.g. weight of 17 pharmaceutical students at KCMC school of Pharmacy on
enrolment
31-40 12 26.7
41-50 17 37.8
51-60 11 24.4
61-70 5 11.1
Total 45 100
Bar charts
o Is simplest and most effective means of illustrating qualitative data
o Bars can either be horizontal or vertical
o The bars are not connected
e.g.57 Adolescents from Kaloleni streets in Arusha were asked the following
question: How often have you used cannabis for the past one year? This was
closed question with the following possible answers
28
o Frequently (more than 5 times),Occasionally ( 3 to 5 times), rarely (1 to 2 times)
and never
Frequently 7 12.2
Occasionally 9 15.8
Rarely 10 17.5
Never 31 54.4
Total 57 100
Pie charts
o Provides quick view of data presented in different form.
o Used in qualitative number with few categories to avoid congestion
29
Histograms
o Numerical data are often presented in histograms
o Are similar to bar charts however the difference is that in histogram the bars are
connected(as long as there is no gap between the data where as in bar charts the
bars are not connected as the different categories are distinct entitles)
Line graphs
o Useful for numerical data if you want to show Trend over time
o It is easy to show two or more distribution in one graph as long as difference
between lines are easy to distinguish e.g. age distribution between males and
females
STEP 4: Use of Data Presentation Methods (35 minutes)
Conditions in which the following methods of data presentation are used
Frequency distributions
o Frequency distributions are used for both qualitative and quantitative data.
o A frequency distribution of data can be shown in a table or graph.
o Some common methods of showing frequency
distributions include frequency tables, histograms or bar charts.
o A frequency table is a simple way to display the number of occurrences of a
particular value or characteristic.
o Statistical hypothesis testing is founded on the assessment of differences and
similarities between frequency distributions
30
o In Cross tabulation
o In Cumulative frequency
Percentages
o Useful in expressing the relative frequency of survey responses
o In Comparison of groups
o As a fraction
o In advertisement, e.g. shops advertise discounts on products. These discounts are
percentages
Proportions
o A proportion is simply a statement that two ratios are equal.
o Uses cross products to find a missing term in a proportion
o Used when administering medication
Birth Rate - The number of live births per 1000 population over a period of one
year
Death Rate - The number of deaths per 1000 population over a period of one
year
Infant Mortality Rate (IMR) - The number of deaths of infants under one year
deaths of age per 1000 live births over a period of one year
31
Incidence Rate - The number of new cases per population over a specific
period of time (usually a year)
Prevalence Rate - The number of existing cases per population over a specific
period of time (usually a year)
32
References
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press, United
Kingdom
Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notes in
Biostatistics, manual of biostatistics, Muhimbili University College of Health Sciences, Dar es
Salaam. (2000) Designing and Conducting Health Systems Research Projects
33
Session 4: Establishing Trends in Health Care
Total Session Time: 120 minutes+ 120 minutes assignment
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
List tables and graphs used to determine trend
Generate tables and graphs
Interpret tables and graphs
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
34
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
Table
A table is a drawing having columns and rows that facilitate representation of large amount
of data in an attractive easy to read and organized manner.
Steps to make a table
o Name your table write a title of the table at the top of the paper
o Decide how many rows and columns you need
o Insert/draw a table using the computer
o Label your columns and rows
o Record the data you have in the columns and rows
35
o When making cross-tabulations, check that the column and row counts correspond
to the frequency counts for each variable.
o Also check that the grand total in the table corresponds to the number of subjects in
the sample.
Example of a table
Doctors Pharmacists
Line graph
o A line graph is a diagram that shows a line joining several points, or a line that shows
the relationship between the points.
o A line graph can be taken as xy plane, where there will be an independent variable
and a dependent variable
o It specifies how the two variables are related to each other and vary with respect to
one another.
o Mostly, the independent variable is taken on the x-axis while the dependent variable
on the y-axis.
36
F. 11 54
Step 2: Draw and label the scale on the vertical and horizontal axis
Step 3: List the each item and locate the points on the graph
Step 4: Connect the points with line segments
You can see a line plotted through two points say A and B on the following
graph
The data given on table above has been summarized in the form of a line graph as
follows:
Line graph have one or more lines plotted on the graph. They are very useful for showing
change over time
Bar Graph
o Bar graph is drawn on an x-y graph and it has labeled horizontal or vertical bars that
show different values.
• The size, length and color of the bars represent different values.
• Bar graph is very useful for non-continuous data and it helps in comparing or
contrasting the size of the different categories of the data provided
• Lets take an example of the bar diagram and compare the pass percentage of a
school 90%, 100% and 60% during the year 2000, 2001 and 2002 respectively
37
Frequency Polygon
o The frequency polygon has most of the properties of a histogram, with an
extra feature
o Here the mid-point of each class of the x-axis is marked
o Then the midpoints and the frequencies are taken as the plotting point
o These points are connected using line segments
o We also complete the graph, that is, it's closed by joining to the x-axis.
o Frequency polygon gives a less accurate representation of the distribution,
than a histogram, as it represents the frequency of each class by a single point
not by the whole class interval
o Lets consider a data table and lets try to draw frequency polygon of it
Draw a graph by using data given below:
38
10-20 15 3
20-30 25 6
30-40 35 4
40-50 45 2
Histogram
o Histogram is the most accurate graph that represents a frequency distribution
o In the histogram the scores are spread uniformly over the entire class interval
o The class intervals are plotted on the x-axis and the frequencies on the y-axis
o Each interval is represented by a separate rectangle
39
o To plot this take the class limits on the x-axis and the frequency on the y-axis.
o On the x-axis, the scale can be 10 units whereas on the y-axis the scale can be 1
unit.
STEP 4: Interpretation of Tables and Graphs (30 minutes)
Frequency distribution
o A frequency shows the number of times that data with particular characteristics
occur in a data set.
o The distribution tells how many or what proportion of the group has each value or
a range of values out of all possible values
Bar chart
o the frequency of each group is represented by the length of the corresponding bar
o the height of the bar over a period represents the figure for the corresponding
period
Histogram
o read erected rectangles over class interval representing the frequencies of the class
interval
o the frequency distributions of each grouped data by areas (height and width), e.g.
the frequency distribution of patients presenting with a certain condition in a given
period, with the patient grouped into 5-years block
Pie chart
o compare individual category with the total
40
o depicts each category as a slice of pie with the size of each slice varying according
to its proportion of the whole pie
Frequency polygon
o see variations in increase and decrease over time or seasons
41
References
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press, United
Kingdom
Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C.(1997). Lecture notesin
Biostatistics, manual of biostatistics, Muhimbili University College of Health Sciences, Dar es
Salaam
Rao, J. S., & Richard, J. (2002). An introduction to bostatistics-a manual for students in
helthsciences.third edition, New delhi, Circus: Asoke k ghosh.
Sundars, M., Lewis, P and Thornhill, A (2007). Research Methods for Business Students,
Harlow, Prentice Hall.
42
Session 5: Basic Concept of Research
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define research
Outline the importance of research in pharmaceutical services
Explain the application of research concepts in pharmaceutical services
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1. 05 minutes Presentation Introduction, Learning Tasks
43
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
44
STEP 4: Application of Research Concepts in Pharmaceutical Services (50
minutes)
Application of Research Concepts in Pharmaceutical services
o Focuses on examining how and why people access pharmacy services, how
much care costs, and what happens to patients as a result of this care.
o Health policy and governance
o Quality assurance and safety
o Medicine access and rational use
o Quality, safety & standards (e.g. vaccines and biological)
o Strengthening the services they provide through:
- Building the evidence base for developing and commissioning new
services
- Improving patient care
- Contributing to the knowledge base within health service research more
widely
- Gaining both professionally and personally in the process
45
Areas in pharmaceutical services that need research: may include health policy and
governance, quality assurance and safety, rational use of drugs
46
References
Moser CA, Kalton G (1989, 2nd ed.) Survey Methods in Social Investigation. Hants, UK:
Gower Publishing Company. (In particular Chapters 10-13)
Patton MQ (1990, 2nd ed.) Qualitative Evaluation and Research Methods. Newbury Park,
USA: Sage Publications. (In particular Chapters 17-29)
Stewart A (2001). Basic Statistics and epidemiology, A practical guide, Radcliffe Medical
Press, United Kingdom
The Netherlands Health Systems Research Projects, Vol. 2 Part I. IDRC, Ottawa
47
Session 6: Classification of Research
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Identify classes of research
Describe study designs for classes of research identified
Explain the uses and limitations of each study design
Identify the most appropriate study design for the research proposal you are
developing
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
48
SESSION CONTENTS
STEP1 Presentation of Session Title and Learning Tasks (5 minutes):
READ or ASK students to read the learning tasks and clarify
49
o Exploratory studies only aim to explore the research area and they do not
attempt to offer final and conclusive answers to research questions.
o Conclusive studies, on the contrary, aim to provide final and conclusive
answers to research questions.
o Quantitative or qualitative
Limitations
o Costly: Operation Research (OR) is very costly.
o Not realistic: Operation Research experts make very complex models for solving
problems. These models may not be realistic
o Complex: Operation Research is a complex concept
50
Quantitative research
Uses
o . Provides statistical, mathematical, or numerical results
o Tends to analyze phenomena in terms of trends and frequencies
o Quantitative research is based on the measurement of quantity or amount.
o It is applicable to phenomena that can be expressed in terms of quantity.
o Quantitative research is inquiry into an identified problem, based on testing a
theory, measured with numbers, and analyzed using statistical techniques.
o The goal of quantitative methods is to determine whether the predictive
generalizations of a theory hold true.
Limitations
o Research quality is heavily dependent on the individual skills of the researcher
o More easily influenced by the researcher's personal biases and idiosyncrasies.
o Rigor is more difficult to maintain, assess, and demonstrate
Qualitative research
Uses
Limitations
51
o No result verification in qualitative research
Exploratory studies
Uses
o It is a small-scale study of relatively short duration, which is carried out when
little is known about a situation or a problem.
o It may include description as well as comparison.
o Used for Small scale studies
o Gathers information about unfamiliar phenomenon
o Results give insight to a problem before a large scale study is designed
Limitations
o Interpretation of findings is judgemental
o Uses small samples which may not be representative
Descriptive studies
Uses
o involves describing the characteristics of a particular situation, event or case
o Can be carried out on a small or large scale
o Small scale, descriptive case studies
o provide quite useful insight into a problem
o Less expensive
o describe in-depth the characteristics of one or a limited number of cases e.g.
patient; village
Analytical
Uses
o An analytical study attempts to establish causes or risk factors for certain
problems.
o Is done by comparing two or more groups some of which have or develop the
problem and some of which have not
o Describe phenomena, and
o Analyze relationship between phenomena and other variables
(determinants/association
Limitations
o Only describe phenomena: e.g. Person, Place, Time
o No analysis of determinants/association e.g. Cross-sectional descriptive
52
o Low response rate
Analytical studies
Cross-sectional studies
Uses
o Quick and cheap
o Can reveal various exposures, as first step in investigating the cause
o Repeated measures can depict( represent) trend
o Data useful in assessing health care needs
Limitation
o Not possible to determine if the exposure preceded the outcome
Uses
Limitations
o Not possible to determine if the exposure preceded the outcome (temporal
relationship)
53
Case-control studies
In a case-control study the investigator compares one group among whom the
problem that he wishes to investigate is present (e.g. adverse drug reactions) and
another group called a control or comparison group, where the problem is absent,
in order to find out what factors have contributed to the problem
Uses
o Useful for generating/ test hypothesis
o Cheap and quick
o Makes use of comparison (control group)
o Can study more than one risk factor
o Useful for rare disease or long latent period
Limitations
o Data on exposure might be inaccurate and biased
o Difficult to make precise selection of control group
o Retrospective cannot separate cause and effect
o Cannot be used for rare exposure
o You cannot calculate incidence (you do not know when disease occurred
Cohort studies
• In a cohort study, a group of individuals that is exposed to a risk factor
(study group) is compared to a group of individuals not exposed to the risk
factor (control group)
• Aim at determining risk factors for diseases/outcome
• At the start identify two groups
o With exposure to a risk factor (exposed)
o Without exposure (no-n exposed)
o Both groups have not developed the disease/outcome at the start
o Follow over time
o At the end, analyses disease/outcome occurrence in both groups
and compare
Limitations
54
o Needs to get complete and accurate information about exposure
and outcome for all individuals
o Time consuming, expensive
o Inefficient in evaluating rare diseases
o Loss of follow up affect validity of results
STEP 4: Appropriate Study Type for the Research Proposal (20 minutes)
Depending on the existing state of knowledge about a problem that is being studied, different
types of questions may be asked which require different study designs. Some examples are
given in the following matrix.
55
knowledge about cause(s) particular experimental studies
to develop and assess an intervention/strategy
intervention which would (e.g., treating with a
prevent, control or solve particular drug; being
the problem. exposed to a certain type
of health education)
Which of two alternate
strategies gives better
results? Which strategy
is most cost-effective?
Source: Varkevisser et al: Designing and Conducting Health Systems Research Projects, Vol. 2 Part I.
Depending on the existing state of knowledge about a problem that is being studied,
different types of questions may be asked which require different study designs
56
References
Patton MQ (1990, 2nd ed.) Qualitative Evaluation and Research Methods. Newbury Park,
USA: Sage Publications. (In particular Chapters 17-29)
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Ranjit K (205). Research methodology step by step guide for beginners, 2nd edition,
Singapore, pearson education
57
Session 7: Procedures for Conducting Operational
Research
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Outline the major characteristics of research
Identify essential guidelines in conducting operational reseach
Describe procedural steps for conducting operational research
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1. 05 minutes Presentation Introduction, Learning Tasks
Presentation Major characteristics of research
2. 15 minutes
Brain storming
Presentation Essential guidelines for conducting operational
3.
30 minutes Buzzing research
60 minutes Presentation Procedural steps for conducting operational
4. Group research
discussion
5. 05 minutes Presentation Key Points
6. 05 minutes Presentation Evaluation
58
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
ASK students if they have any questions before continuing
59
It should be cost-effective operational research should focus, to a large extent, on
low-cost studies that can be undertaken by management and service personnel in the
course of daily activities.
Results should be presented in formats most useful for administrators, decision-
makers and the community.
Evaluation of the research undertaken should concentrate on its ability to influence
policy, improve services and ultimately lead to better health
-
Step 3; Formulate Objectives
Step 4; Develop research methodology
60
o variables
o types of study
o data collection techniques
o sampling
o plan for data collection
o plan for data processing and analysis
o ethical consideration
o pretest/pilot study
Step 5: Prepare the work plan
Step 6: Identification of resources required and preparation of a budget
Step 7: Plan for project administration and utilization of results
Step 8 Collect data in the field (implement the proposal)
Step 9: Analyze collected data and interpret results
Step 10: Prepare and present a final report of the research findings, including
recommendations
Step 11: Prepare plan of action for implementation of recommendations
Writing Introduction to Research Proposal
This is written when all sections of the proposal have been completed. The introduction leads
the reader from a general subject area to a particular topic of inquiry.
It establishes the scope, context, and significance of the research being conducted by
summarizing current understanding and background information about the topic, stating
the purpose of the work in the form of the research problem supported by:
o a hypothesis or a set of questions,
o explaining briefly the methodological approach used to examine the research
problem,
o highlighting the potential outcomes your study can reveal, and
o outlining the remaining structure and organization of the paper
Think of the introduction as a mental road map that must answer for the reader these four
questions:
o What was I studying?
61
o What did we know about this topic before I did this study?
o How will this study advance new knowledge or new ways of understanding?
o First, ensure that you summarize prior studies about the topic in a manner that lays a
foundation for understanding the research problem
o Second, explain how your study specifically addresses gaps in the literature,
insufficient consideration of the topic, or other deficiency in the literature
o third, note the broader theoretical, empirical, and/or policy contributions and
implications of your research
62
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press, United
Kingdom
Patton MQ (1990, 2nd ed.) Qualitative Evaluation and Research Methods. Newbury Park,
USA: Sage Publications. (In particular Chapters 17-29)
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
63
Session 8: Identification of Research Problem
Total Session Time: 120 minutes+ 420 minutes assignment
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define research problem
Identify research problems
Outline conditions for a problem to be researchable
Explain criteria for selecting a research topic
Explain how to prioritize topic for research
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 8.1: Research Problem Identification
Handout 8.2: Examples of Research and Non-Research Problems
Handout 8.3: Prioritizing Health Problems for Operational Research
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Definition of reseach problem
2 05 minutes
Brainstorming
Presentation Identification of research problem
3 30 minutes
Buzzing
Presentation Conditions for a problem to be researchable
4 10 minutes
Presentation Criteria for selecting a research problem
5 55 minutes
Small group discussion
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
05 minutes Assignment: Identification and selection of
8 Presentation
problem for research proposal
64
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
65
STEP 4: Conditions for a problem to be researchable (10 minutes)
Whether a problem situation requires research depends on three conditions:
There should be a perceived difference or discrepancy between what exists and the
ideal or planned situation
The reason(s) for this difference should be unclear (so that it makes sense to develop
research questions)
There should be more than one possible answer to a question or more than one
solution to the problem.
66
2 = Relevant
3 = Very relevant
Avoidance of duplication
Feasibility of study
o Can the study be done with the available resources?
67
o Consider human, material, financial, time
After carefully assessing and scoring the topics based on the criteria, select one with
the highest score.
68
STEP 5: Evaluation (5 minutes)
What are criteria for selecting health-related problems?
What is a group consensus technique used to set priorities for research?
69
Handout 8.1: Research Problem Identification
Problem Identification
o Finding a problem is not difficult, but identifying one for the purpose of research is
not always easy.
o Identifying a problem situation is the first essential step in designing a research
proposal, but it must then be followed by a process of problem definition.
o The research problem identified must be defined in terms of its occurrence, intensity,
distribution, and other measures for which data are already available.
o The aim is to determine all that is currently known about the problem and the reason
it exists.
o All research is set in motion by the existence of a problem.
o A problem is a perceived difficulty, a feeling of discomfort about the way things are,
or a discrepancy between what someone believes should be the situation and what the
situation is in reality.
o While problems are the initiating force behind research, not all problems require
research.
o A potential research situation arises when three conditions exist:
A perceived discrepancy exists between what is and what should be.
A question exists about why there is a discrepancy.
At least two possible and plausible answers exist to the question.
• If there is only one possible and plausible answer to the question about the
discrepancy, then a research situation does not exist.
Problem Justification
o After the problem is identified, it is necessary next to justify the importance of the
problem. Research often is expensive and time consuming.
o Find out why the problem you wish to study is important.
Ask yourself the following questions: Can you justify your selection of the research
problem? Can you convince others that the problem is important?
70
What to Do: Justifying the Selection of a Research Problem
o In justifying the importance of a research problem, it is helpful to ask yourself a series
of questions and then try to answer each of them.
Is the problem you wish to study a current and timely one?
Does the problem exist now? How widespread is the problem? Are many areas
and many people affected by the problem?
Does the problem affect key populations, such as youth, people living with
HIV/AIDS (PLHA), mothers, or children?
Does the problem relate to ongoing program activities?
Does the problem relate to broad social, economic, and health issues, such as
unemployment, income distribution, poverty, the status of women, or education?
Who else is concerned about the problem? Are top government officials
concerned? Are medical doctors or other professionals concerned?
o Review your answers to these questions, and arrange them into one or two paragraphs
that justify the importance of the research problem.
o Start by discussing the broad issues that justify the problem and then begin to focus
on the more specific issues related to a particular population group or geographical
setting.
Sample Research Problem Justification
o Over time, millions of HIV-infected people in Africa and elsewhere in the world are
developing HIV-related illnesses. In most African countries, hospitals, clinics, and
other formal health care institutions simply cannot cope with the large numbers of
people in need of physical care and social and psychological support.
o In some hospitals, well over half of the beds are already occupied by AIDS patients.
In some countries the figure is as high as 70 percent of all hospital beds. This is a
problem of great concern to health care planners, as well as to the Ministry of
Finance, which simply does not have the resources to build new facilities or train
large numbers of new providers.
o The problem of providing care and support for PLHA is particularly challenging in
rural areas because there are relatively few health facilities or adequately trained
providers available. In this situation, an alternative is to provide care, support, and
treatment in the homes of those with AIDS. How to do this in a cost-effective manner
while simultaneously providing high-quality services is a challenge.
71
o New models of delivering care and support services in rural areas need to be
developed and tested to improve the quality of life for PLHA.
o Without effective new approaches, large numbers of people with AIDS will suffer
physical and psychological pain that might otherwise be avoided or at least lessened.
Comments on the Sample Justification:
o The first paragraph establishes the dimensions of the problem. The large number of
people with AIDS cannot be adequately treated or supported by the formal health care
system, which is already overwhelmed in many countries.
o The second paragraph notes that the problem is particularly acute in rural areas, where
health facilities and providers are relatively few in number. An alternative is to
provide services to PLHA in their homes. The important question is how to do this.
o The paragraph ends by saying that without the development of new approaches to
care and support, large numbers of PLHA will needlessly suffer.
72
Handout 8.2: Examples of Research and Non-Research Problems
73
- Nonetheless, there may very well be a need to conduct research on the question of
why the supply logistics system is incapable of providing medication during the
rainy season, when it is known that roads and bridges are frequently damaged.
Problem Situation
o A recent provincial study revealed great differences among villages in the
prevalence of HIV-positive persons. Despite the fact that all villages receive the
same level of health education and services from the Ministry of Health, some
villages have an HIV prevalence rate as high as 32 percent among adults from 15
to 49 years old, while other villages have a rate as low as 6 percent.
o Discrepancy
In a relatively small geographic area, you would expect that all villages should
have approximately the same sero-prevalence rate but, in fact, there is great
variation among villages.
o Problem Question
Which factors are responsible for the geographic variation in HIV prevalence
among villages?
o Possible Answers
- Villages differ in their socioeconomic environments, and these differences influence
the context within which HIV is transmitted.
- Some are stable agricultural villages, while some are mobile fishing communities.
- Some villages are located on major roads and have easy access to market towns;
others are more remote with very difficult access to market centers. Some villages
- have schools, health clinics, electricity, and a good water supply, while others do not
74
have these advantages.
- These and many other social, economic, and cultural differences affect the context
within which sexual relations take place and HIV is transmitted.
- Villages differ in individual and institutional support for HIV/AIDS prevention, care,
and support programs.
- In some villages, influential local leaders strongly support sexual behavior change and
condom distribution programs.
- In other villages, people are resistant to these programs, and there is substantial
stigma and discrimination associated with HIV/AIDS.
- In some villages, there are very active anti-AIDS clubs for youth, strong PLHA
organizations, and effective orphan care NGOs.
- In other villages these institutions are absent. These differences in individual
commitment to and institutional support for HIV/AIDS programs affect the sexual
behavior of individuals, the use of condoms, the level of stigma and discrimination,
and the transmission of HIV.
o While the problem situation presented above is fairly clear, the possible and plausible
reasons for the problem are complex. Several of these reasons have been described, but it
is very likely there are many more.
o In situations such as this one, the researcher must devote considerable time and attention
to identifying and clearly defining the problem situation before any potential solutions to
the problem can be tested experimentally through a longitudinal operations research
study.
o The aim of clearly identifying and defining a problem situation is to focus the research on
the most important aspects of a problem that can be changed through a program
intervention.
75
Handout 8.3: Prioritizing Health Problems for Operational Research
Relevance
o The topic you choose should be a priority problem.
o Questions to be asked include:
- How large or widespread is the problem?
- Who is affected?
- How severe is the problem?
o If you do not consider a topic relevant, it is not worthwhile to continue rating it. In
that case you should drop it from your list.
o Try to think of serious health problems that affect a great number of people or of the
most serious problems that are faced by clinicians in the area of your work.
o Also, consider the question of who perceives the problem as important. Health
managers, health staff and community members may each look at the same problem
from different perspectives.
o Community members, for example, may give a higher priority to economic concerns
than to certain public health problems.
o To ensure full participation of all parties concerned, it is advisable to define the
problem in such a way that all have an interest in solving it. Even within villages,
opinions may differ on how important a problem is.
o It is therefore obligatory to discuss the problem with community leaders, as well as
peripheral villagers, males as well as females, rich and poor, exploring their
perceptions of the problem.
Avoidance of Duplication
o Before you decide to carry out a study, it is important that you find out whether the
suggested topic has been investigated before, either within the proposed study area or
in another area with similar conditions.
76
o If the topic has been researched, the results should be reviewed to explore whether
major questions that deserve further investigation remain unanswered. If not, another
topic should be chosen.
o Also, consider carefully whether you can find answers to the problem in already
available, unpublished information or just by using your common sense. If so, you
should drop the topic from your list.
o Under certain circumstances, however, you may feel that a study is required to show
that the government's policy needs adjustment. If so, you should make an extra effort
to involve the policy-makers concerned at an early stage, in order to limit the chances
for confrontation later.
Feasibility
o Look at the complexity of the problem and the resources you will require to carry out
your study and time required for intervention. Thought should be given first to
manpower, time, equipment and money that are locally available.
o In situations where the local resources necessary to carry out the processes are not
sufficient, you might consider resources available at the national level. Finally,
explore the possibility of obtaining technical and financial assistance from external
sources.
Applicability of Possible Results/Recommendations
o Is it likely that the recommendations from the study will be applied? This will depend
not only on the management capability within the team and the blessing of the
77
authorities but also on the availability of resources for implementing the
recommendations.
o Likewise, the opinion of the potential clients and of responsible staff will influence
the implementation of recommendations.
Ethical Acceptability
o We should always consider the possibility that we may inflict harm on others while
carrying out research or any intervention.
o Therefore, consider important ethical issues such as:
- How Cultural sensitivity must be given careful consideration.
- Informed consent be obtained from the research subjects.
- Will the condition of the subjects be taken into account? For example, if
individuals are identified during the study who require treatment, will this
treatment be given?
- What if such treatment interferes with your study results?
• Will the results be shared with those who are being studied?
• Will the results be helpful in improving the lives or health of those studied?
Scales for rating research topics
These criteria can be measured by the following rating scales:
o Relevance
1. = Not relevant
2. = Relevant
3. = Very relevant
o Avoidance of duplication
1. = Sufficient information already available
2. = Some information available but major issues not covered
78
o Political Acceptability
1. = Topic not acceptable to high level policymakers
2. = Topic more or less acceptable
3. = Topic fully acceptable
o Feasibility
1. = Study not feasible, considering available resources
2. = Study feasible, considering available resources
3. = Study very feasible, considering available resources
o Applicability
1. = No chance of recommendations being implemented
2. = Some chance of recommendations being implemented
3. = Good chance of recommendations being implemented
o Ethical acceptability
1. = Major ethical problems
2. = Minor ethical problems
3. = No ethical problems
79
Session 9: Analysis and Statement of the Problem
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Identify factors contributed to the problem.
Clarify the relationship between the problem and contributing factors.
Decide on the scope and focus of the research
Formulate the problem statement
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 9.1: Formulating the Problem Statement
Handout 9.2: Sample Problem Analysis Diagram
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Factors Contributed to the Problem.
2 30 minutes
Group discussion
Presentation Relationship Between the Problem and
3 15 minutes Contributing Factors.
Brainstorming
80
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Assignment
SESSION CONTENTS
STEP1: Presentation of Session Title and Learning Tasks (5 minutes)
READ or ASK students to read the learning tasks and clarify
81
o Extend the problem analysis diagram further by identifying additional factors that
could have contributed to or aggravated the problem.
o It may be possible to identify several generations of predisposing factors, by
asking but why
Organise related factors together into larger categories and develop final draft
diagram. For example
o Many researchers group contributing factors into four main categories:
Socio-cultural factors
Economic factors
Service-related factors
Disease-related factors
82
An analysis of the major factors that may influence the problem and a discussion of
why certain factors need more investigation if the problem is to be fully understood.
A brief description of any solutions to the problem that have been tried in the past, how
well they have worked, and why further research is needed (justification for your study).
A description of the type of information expected to result from the project and how this
information will be used to help solve the problem.
If necessary, a short list of definitions of crucial concepts used in the statement of the
problem.
Writing the statement of the problem
List the major points plan to include in the problem statement and rearrange them, if
necessary, before preparing the written text for the problem statement.
Use available reports to help specify their problem, and to search for information they do
not have. Part of the literature review, if not all, may be included in the statement of the
problem.
Preparation of the written problem statement can be done in small groups or individually,
The description of relevant socio-economic, cultural and health characteristics of the
country and/or district in which the study takes place can be best done at the end, after a
thorough description of the problem, to avoid irrelevant background data. It will be placed
at the beginning of the problem statement.
83
ASK each student to work on the following Assignment
Write the statement of the problem you have identified for a research proposal
84
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors)(2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
85
Handout 9.1: Formulating the Problem Statement
Importance of a Well-Defined Problem
o A poorly defined research problem leads to confusion.
o A well-defined research problem statement leads to:
Statement of research objectives
Hypotheses
Definition of key variables
Selection of a methodology for measuring the variables
Foundation for the further development of the research proposal
Ease in finding find information and reports of similar studies from which your
own study design can benefit
Systematic justification for undertaking the proposed research, and what the
researcher he/she hope to achieve with the study results
This is important to highlight when you present your project to community
members, health staff, relevant ministries and donor agencies who need to support
your study or give their consent.
Statement of the Problem Includes:
o Identification, definition, and justification of the research problem
o One of the most important first tasks of research is to identify and clearly define the
problem you wish to study.
o If you are uncertain about the research problem or if you are not clear in your own
mind about what you want to study, others who read your proposal will also be
uncertain.
o Problem Identification and definition
o While it is always possible to guess why a problem exists, guesses are often wrong
and usually do not provide a firm basis for designing a research study.
o A far better way to define a problem situation is to review relevant literature, examine
current service statistics, seek educated opinions from persons concerned about the
problem, and obtain probable reasons for the problem from social, economic, or
health theory.
86
o Follow this general procedure when identifying and defining a problem situation:
Start with a simple statement of the problem situation.
Add details as you review the literature, review theoretical concepts, and
investigate the problem in greater depth.
Simplify the focus by identifying the most important aspects of the problem that
are researchable.
Make a first attempt at identifying the problem situation by using the following format:
o Problem Situation: Write a small, simple paragraph that identifies the problem.
o Discrepancy: State the discrepancy between what is and what should be.
o Problem Question: Write down the central problem question.
o Possible Answers: Write two or more plausible answers to the problem question.
From the available research literature, health and behavioral theory, current service
statistics, educated opinions and other sources of information, try to add details to the
problem situation you have just identified.
Look for theoretical concepts and operational variables that you may have missed. List
these concepts and variables on a piece of paper as you come across them. Try to answer
the following questions:
o What are the incidence and prevalence of the problem?
o Which geographic areas are affected by the problem? Which population groups are
affected by the problem?
o What are the findings of other research studies?
o What has been done to overcome the problem in the past?
o How successful were past efforts to overcome the problem?
o What seem to be major unanswered questions about the problem?
With the information you have collected from a literature review and other sources,
rewrite your statement identifying and defining the problem. Use the format described
above:
o Problem Situation, Discrepancy, Problem Question, and Possible Answers
o Add details that help to define the problem, but organize the information. Try to
establish the boundaries of the problem.
o Focus your attention on the most important, researchable aspects of the problem.
Have one or more colleagues read your final statement identifying and defining the
problem situation. If they are unclear about the problem situation or cannot describe the
87
discrepancy between what is and what should be, then go back to the beginning and start
all over again.
Figure below shows the initial problem diagram on Irrational drug use
88
Session 10: Literature Review in Research
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Describe the reasons for reviewing available literature
Identify the resources that are available for carrying out such a review
Prepare index cards for summarization of important information obtained from literature
Prepare a review of literature pertaining to research topic
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
Presentation
2 15 minutes Reasons for Reviewing Available Literature
Buzzing
Presentation Identification of Resources that are Available
3 10 minutes
Brainstorming for Carrying out Literature Review.
89
SESSION CONTENTS
90
Sources could be at different levels of administrative system
o Community level, district and regional levels and provincial level
o National levels e.g. national libraries, Ministries of Health, central statistics, etc.
o International levels UNICEF, WHO, USAID, etc.; including computerized search
for international literature
91
Sources of Information at Various Levels of Administrative System
92
STEP 4: Summarizing Important Information Obtained from Index Cards
(55 minutes)
93
o All facts mentioned need a source, except some general and well known statements.
o For the description of the selected problem, use all available raw or published
literature.
o Literature from other countries or regions may be used to illustrate your point.
If these sources are many, you may have a separate section on international
literature.
o More complex studies using theoretical models should have a separate section
discussing these models, which could come after the section of statement of the
problem.
o When drafting the background section or the statement of the problem, usually do not
describe sources one by one. Instead, write a coherent discussion in your own words,
using all relevant literature linked to each other.
o It is possible to cite several sources for one statement. Reference all the literature
referred to in your review.
o At the end of your paper, list your references in order, using the format described
above.
o In research proposals, the references come before the annexes.
o Select one style of references (such as Vancouver, Harvard, etc.) and use it
consistently for citations and reference lists in your proposal.
Bias in Literature
o Bias: A distortion of the available information in such a way that it reflects opinions
or conclusions which do not represent the real situation.
o Understanding the various types of bias helps to be critical of the existing literature.
o If you have reservations about certain references or if you find conflicting opinions in
the literature, then discuss these openly and critically. Such a critical attitude may
help you to avoid biases in your study.
o Common types of bias in literature include:
Playing down controversies and differences in one's own study results.
Restricting references to those that support the point of view of the author.
Drawing far reaching conclusions from preliminary or shaky research results or
making sweeping generalizations from just one case or small study.
94
STEP 5: Review of Literature Pertaining to Research Topic (20 minutes)
Review of literature pertaining to research topic avoiding the following:
Plagiarism (pretending information is yours) is defined as:
o An object (language, words, text, diagram, graphs, ideas)
o which has been taken from a source (books, journals, internet, not just text)
o by an agent (person, student, academician)
o without adequate acknowledgement of sources
o with or without intention to deceive
Bias in literature review
o Suppressing/omitting controversies/ conflicting opinion or differences
o Using author supportive references only
o Over concluding/ generalisation from inadequate data - one case or small study or
poor design
Such types of bias may have serious ethical implication (may affect peoples health; take
researcher to court)
STEP 6: Key Points (05 minutes)
Literature review or search is a systematic and thorough search of all types of published
literature in order to identify as many items as possible that are relevant to a particular
topic
Resources that are available for carrying out such a review are people, publications,
unpublished information, supervisors and fellow students
Review and write literature for the problem of your research proposal
95
ALLOCATE time for students to do the assignments and submit
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
96
Session 11: Research Objectives and Questions
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define general and specific objectives
Outline the characteristics of research objectives
State the difference between general and specific objectives
Prepare research objectives in an appropriate format for the project you are developing
Develop research questions appropriate for the study
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 11.1: Broad and Specific Objectives
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
10 minutes Presentation
2 Definition of General and Specific Objectives
Brainstorming
10 minutes Presentation
3 Characteristics of Research Objectives
Brainstorming
Presentation
4 20 minutes The Difference Between General and Specific
Buzzing Objectives
35 minutes Presentation
5 Preparation of Research Objectives
Lecture discussion
97
SESSION CONTENTS
Specific objectives
o Explain the broad objective in specific
o Should systematically address:
The various aspects of the problem
Key factors that are assumed to influence or cause the problem.
They should specify what you will do in your study, where and for what purpose.
98
Usually focuses on quantifying or specifying the problem
Hypothesis
o Statement/a specific prediction about the nature and expected direction of
the relationship between two or more variables that permit empirical testing.
Why should research objectives be developed?
o To clarify and focus your intentions /focus the study (narrowing it down to
essentials).
o To have a basis for measuring your achievements at the end of the study.
o To avoid the collection of data which are not strictly necessary for understanding
and solving the problem you have identified.
o To organize the study in clearly defined parts or phases.
o To facilitate the development of your research methodology and orient the
collection, analysis, interpretation and utilization of data.
General objectives are broad and long-term while specific objectives are short term
and narrow in focus
The general objective is met through accomplishing each of the specific objectives.
Specific objectives is to specify what really you want to concentrate with or what you
want to do, show the main point you are focusing to
101
o Are clearly phrased in operational terms, specifying exactly what you are going to do,
where, and for what purpose;
o Are realistic considering local conditions; and
o Use action verbs that are specific enough to be evaluated
Examples of action verbs are: to determine, to compare, to verify, to calculate, to
describe, and to establish
Avoid the use of vague non-action verbs such as: to appreciate, to understand, or
to study
o It is not necessary to develop an objective for every single contributing factor
It's absolutely essential to develop a research questions that you're interested in or care
about in order to focus your research
For example,
Researching a broad topic such as "business management" is difficult since there
may be hundreds of sources on all aspects of business management.
On the other hand, a focused question such as "What are the pros and cons of
Japanese management style?" is easier to research and can be covered more fully
and in more depth.
How do you develop a usable research question?
o Choose an appropriate topic or issue for your research, one that actually can be
researched
o Then list all of the questions that you'd like answered yourself.
o Choose the best question, one that is neither too broad nor too narrow.
o Sometimes the number of sources you find will help you discover whether your
research question is too broad, too narrow, or okay?
o If you know a lot about the topic, you can develop a research question based on your
own knowledge. If you feel you don't know much about the topic, think again.
o It's a good idea to evaluate your research question and to ask for feedback on your
research question.
102
o Once you complete your list, review your questions in order to choose a usable one
that is neither too broad nor too narrow.
o In this case, the best research question is "three"
Question "one" is too narrow, since it can be answered with a simple statistic
Question "two" is too broad; it implies that the researcher will cover many tactics
for reducing the problem of irrational drug use that could be used throughout the
country
Question "three," on the other hand, is focused enough to research in some depth
Formulate broad and specific research objectives, hypothesis and questions for the
your research proposal
103
ALLOCATE time for students to do the assignments and submit
104
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
First Example
A study into the cost and quality of home-based care for HIV/AIDS patients and their
communities in Tanzania, was developed. It had its general
objective:
o To explore to what extent Community Home-Based Care (CHBC) projects in
Tanzania provide adequate, affordable and sustainable care of good quality to people
with HIV/AIDS, and to identify ways in which these services can be improved.
106
Session 12: Review of Study Types/Designs
Total Session Time: 120 minutes
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Describe the study types most used in research
Explain uses and limitation of each study type most used in research
Describe how the study design can influence the validity and reliability of the study result
Identify the most appropriate study design for research proposal being developed
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
107
SESSION CONTENTS
STEP 3: Uses and Limitation of Each Study Type Most Used in Research
(10 minutes)
Reliability: means that someone else using the same method in the same circumstances
should be able to obtain the same findings (your findings are repeatable).
o Reliability (repeatability) refers to the possibility to replicate (repeat) the observations
and is related to the precision of the instrument used for scientific observations.
o Validity refers to the soundness of the observations and to the accurateness of the data
collected by the research method/instrument.
108
STEP 6: Key Points (5 minutes)
A descriptive study involves describing the characteristics of a particular situation, event
or case
An analytical study attempts to establish causes or risk factors for certain problems
Any study designs used, should give valid and reliable findings
ASK each student to select an appropriate study type/design for a research proposal being
developed
109
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Stewart A (2001). Basic Statistics and epidemiology, A practical guide, Radcliffe Medical
Press, United Kingdom
110
Session 13: Research Sampling
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define the common terms used in sampling
Identify the population(s) to be studied
Describe common methods of sampling
Explain reasons for sampling
Describe source of bias in sampling that should be avoided
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 13.1: Types of sampling methods and when to use it
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
111
SESSION CONTENTS
112
STEP 3: Identifying the Population (s) to be Studied (20 minutes)
Study population
o Collective of study units for which the values of the varieties of interest could
possibly be determined.
o In identifying the population(s) to be studied we must consider the following questions:
What is the group of people (STUDY POPULATION) we are interested in from
which we want to draw a sample?
How many people do we need in our sample?
How will these people be selected?
Sample is a ubset of study population selected to participate in the research
when whole study population cannot be reached
o The study population has to be clearly defined (for example, according to age, sex, and
residence.) Otherwise we cannot do the sampling
o Each study population consists of STUDY UNITS. The way we define our study
population and our study unit depends on the problem we want to investigate and on the
objectives of the study
Representativeness
o If researchers want to draw conclusions which are valid for the whole study
population, which requires a quantitative study design, they should take care to draw a
sample in such a way that it is representative of that population.
o A representative sample has all the important characteristics of the population from
which it is drawn
113
Figure 1: Relationhip between population and sample
STEP 4: Common Methods of Sampling (35 minutes)
The common methods of sampling are:
Two types of sampling probability and non probability
o Non probability
o Probability (random sampling)
114
o Make or search for an existing numbered list of all the units in the population
from which you want to draw a sample (sampling frame).
o Decide on the size of the sample.
o Select required number of sampling units, using a lottery method.
For example, a systematic sample is to be selected from 1200 students of a school. The
sample size selected is 100. The sampling fraction is:
100 (= sample size) = 1
1200 (= study population) 12
The sampling interval is therefore 12.
The number of the first student to be included in the sample is chosen randomly
Stratified Sampling
o If it is important that the sample includes representative study units of small groups
with specific characteristics, then sampling frame must be divided into groups, or
strata, according to these characteristics.
o For example, residents from urban and rural areas, or different religious or ethnic
group
o Random or systematic samples of a pre-determined size will have to be obtained from
each group (stratum).
115
Cluster Sampling
o The selection of groups of study units (clusters) instead of the selection of study units
individually.
o Clusters are often geographic units (e.g. districts, villages) or organizational units (e.g.
clinics, training groups).
Multi-Stage Sampling
o A multi-stage sampling procedure is carried out in phases and it usually involves
more than one sampling method. Example selecting one region out of 26 then select 4
councils out of 7 in the selected region. In the 4 selected councils, the researcher
selects 3 wards out of 8 then two villages are selected from the 3 wards. The selection
method in each stage could be random or systematic.
116
Sampling Methods for Qualitative Data (Non probability)
Non probability sampling is:
o Unequal chance of being included in the sample (non random)
o It is asampling process in which the samples are selected for specific purpose with
a predetermined basis for of selection
o Purposeful sampling strategies for qualitative studies
o Extreme case sampling
o Maximum variation sampling
o Homogeneous sampling
o Critical case sampling
o Snowball or chain sampling
Sample size: Number of subjects selected to represent a given study population
o Sample Size in Qualitative Studies
There are no fixed rules for sample size in qualitative research.
The size of the sample depends on what you try to find out, and from what
different informants or perspectives
o If you want to explore how you can involve mothers in your HC catchment area
you try to find that out. For example:
effectively in early detection and treatment of pneumonia, you might decide to
conduct some FGDs to assess mothers knowledge, attitudes and practices with
respect to antimalarials.
You could start with two FGDs among lowly educated mothers and two among
mothers with more education (who usually are of higher socio-economic status).
o If research objective is more complex e.g., attitudes of males and females towards
family planning, and has policy implications for a larger area, your sample will be
bigger. You might start with four FGDs, two among males and two among females,
subdivided according to socio-economic status.
In exploratory studies, the sample size is therefore estimated beforehand as precisely as
possible, but not determined.
117
Tips for Determining Sample Size
o The desirable sample size depends on the expected variation in the data (of the most
important variables).
o The more varied the data are the larger the sample size needed to attain the desired
level of accuracy.
The desirable sample size also depends on the number of cells in the cross tabulations.
A rough guideline is to have at least 5 to 10 study units per cell. For example:
o After conducting FGDs and in-depth interviews in the study on attitudes of men and
women towards family planning you might decide to conduct a bigger survey.
o If the exploratory study revealed that age and education appear to be important factors
determining FP use, compare FP use in groups with different levels of education and
of different ages.
o If you split each of these variables up in three categories, and you select four
categories of informants (male users/ spouses of female users; female users; male
non-users, female non-users) you would have 12 cells in each table. In order to obtain
5-10 answers per cell you would require 60-120 informants in each research area.
The eventual sample size is usually a compromise between what is desirable and what is
feasible.
118
o Sampling remains the only choice when a test involves the destruction of the item
under study
o Sampling usually enables to estimate the sampling errors and, thus, assists in
obtaining information concerning some characteristic of the population
119
Ways to Reduce the Possibility of Bias
o Data collection tools (including written introductions for the interviewers to use with
potential respondents) should be pre-tested. If necessary, adjustments should be made
to ensure better co-operation.
o If non-response is due to absence of the subjects, follow-up of non-respondents may
be considered.
o If non-response is due to refusal to co-operate, an extra, separate study of non-
respondents may be considered in order to identify to what extent they differ from
respondents.
o Another strategy is to include additional people in the sample, so that non-respondents
who were absent during data collection can be replaced. This can only be justified if
their absence was very unlikely to be related to the topic being studied.
o The bigger the non-response rate, the more necessary it becomes to take remedial
action.
o It is important in any study to mention the non-response rate and to honestly discuss
whether and how the non-response might have influenced the results.
ASK each student to select to identify population to be studied and the sampling technique
for a research proposal being developed
120
REFER students to recommended reference
121
References
Rao, J. S., & Richard, J. (2002). An introduction to bostatistics-a manual for students in
helthsciences.third edition, New delhi, Circus: Asoke k ghosh.
Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C (1997). Lecture notes in
Biostatistics, manual of biostatistics, Muhimbili University College of Health Sciences, Dar es
Salaam
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Stewart A (2001). Basic Statistics and epidemiology, A practical guide, Radcliffe Medical
Press, United Kingdom
122
Handout 13.1: Types of sampling and when to use it
123
Session 14: Determining Sample Size
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
List the issues to consider when deciding on sample size
Calculate the sample size (desirable)
Determine the sample size(s) most appropriate for the research design (feasible)
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 15 minutes Issues to Consider when Deciding on Sample Size
Buzzing
50 minutes Presentation
3 Calculation of the Sample Size (Desirable)
Brainstorming
5 Key Points
05 minutes Presentation
6 05 minutes Presentation Evaluation
7 05 minutes Presentation Assignment
124
SESSION CONTENTS
o The desirable sample size also depends on the number of cells we will have in the
cross-tabulations which we need to analyze the results.
A rough guideline is to have at least 5 to 10 study units per cell
125
o How big can be calculated. Still, the desirable sample size cannot always be
achieved for lack of resources such as time, manpower and money.
This constraint applies to quantitative as well as qualitative studies
Therefore the eventual sample size is usually a compromise between what is
desirable and what is feasible
o Sample size calculations
The following steps should be taken:
Estimate how big the proportion might be (say 80%)
Choose the margin of error you will allow in the estimate of the proportion (say
+ 10%). This means that, if in the survey indeed 80% of the children are found
to be vaccinated, this proportion will probably be between 70 and 90% in the
whole study population from which the sample was drawn.
Choose the precision with which you want to be confident that the vaccination
coverage in the whole population is indeed between 70 and 90%. You can never
be 100% sure. Do you want to be 95% sure? Or 99%?
o Formulae
N = z2PQ
d2
N = Minimum sample size
Z = Constant, Standard normal deviate (1.96 for 95% Confidence level)
P = Population proportion with characteristic of interest
Q=1P
d = Acceptable Margin of error
126
determining the size of sample for large samples result in increasing the cost of
sampling estimates
o Depends on expected variation in the data: the more varied the data are, the larger the
sample size one would need to attain the same level of accuracy
o Depends on the number of cells one will have in the cross-tabulations required to
analyze the result
A rough guideline is to have at least 20-30 study units per cell
o Eventual sample size is a compromise between desirable and feasible
o Nature of study: If items are to be intensively and continuously studied, the sample
should be small. For a general survey the size of the sample should be large, but a
small sample is considered appropriate in technical surveys.
o Type of sampling: Sampling technique plays an important part in determining the size
of the sample. A small random sample is appropriate to be much superior to a larger
but badly selected
.
STEP 5: Key Points (5 minutes)
There are no fixed rules for sample size in qualitative research.
Eventual sample size is a compromise between desirable and feasible
127
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
128
Session 15: Research Ethics
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define research ethics
Identify areas of research requiring ethical clearance
Describe procedure for research ethical clearance
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
129
SESSION CONTENTS
130
o data collection process.
If sensitive questions are asked, for example, about family planning or sexual
practices, or about opinions of patients on the health services provided, it is advisable
to omit names and addresses from the questionnaires.
o Inform participants that they are free to withdraw from the study at any point
131
o Protocols for Clinical trials to be conducted in Tanzania are reviewed by another
specialized sub-committee, Clinical Trials Sub-Committee.
This sub-committee has nine members, and meets monthly and reports to the
NatHREC.
o Clinical trials are required to also obtain a Clinical Trials Certificate from Tanzania
Food and Drug Authority (www.tfda.or.tz) before the commencement of the study.
Application procedures
o Applicants for research clearance are required to submit application form, Curriculum
vitae, Research proposal and three passport size photographs preferably two month
before commencement of research.
o Permits are given for a period of one year and can be renewed for similar period
provided satisfactory progress reports for the previous periods are received by
COSTECH.
o If and when these formalities have been satisfactorily completed (which may take
several months) applicant will receive a formal written offer of a research clearance.
o Applicant should not make any irreversible preparations to leave for Tanzania unless
and until he/she receives this offer letter.
o Soon after obtaining a research permit, the researcher will be required to proceed to
the Immigration Department and apply for class C residence permit.
132
Activity: Take Home Assignment (5 minutes)
133
References
National Institute of Medical Research (2014) 2ND Edition. Standard Operating Procedures
for the National Health Research Ethics Committee, Dar es Salaam, Tanzania
http://www.nimr.or.tz/wp-content/uploads/2018/11/SOPS-2014-KEY-NatHREAC-SOPs-
Final-17th-June-2014.pdf
Mashalla, Y.J.S., Shija, J.K., Kitua, A.Y., Mwaikambo, E., Kohi, Y.M., Ndossi, G.D.,
Malecela, M., Mboera, L.E.G. (2009) Second edition. Guidelines of Ethics for Health
Research in Tanzania, Tanzania National Health Research Forum, Dar es Salaam, Tanzania
134
Session 16: Developing Research Tools
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
List common research tools
Identify appropriate data-collection techniques
Prepare data-collection tools
Conduct out an interview
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 16.1: Overview of data collection techniques
Handout 16.2: Advantages and disadvantages of various data collection tools
Handout 16.3: Focus Group Discussion (FGD)
Handout 16.4:Functions of FGD Facilitator
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Common Research Tools
2 10 minutes
Buzzing
3 10 minutes Presentation Identification of Data-Collection Techniques
4 45 minutes Presentation Preparation for Data-Collection Tools
35 minutes Presentation Conducting an Interview
5
Brainstorming
6 05 minutes Presentation Key points
7 05 minutes Presentation Evaluation
135
8 05 minutes Presentation Assignment
SESSION CONTENTS
136
respondents own words.
o Open questions are useful for obtaining in-depth information on
Facts with which the researcher is not very familiar.
Opinions, attitudes and suggestions of informants, or Sensitive issues.
137
2. Elected at a community meeting..........................................................
3. Nominated by community leaders.........................................................
4. Nominated by the health staff...............................................................
5. Other (specify): ........................................................................................................
In this case the first four categories of answers are known, but there may be
other possibilities.
Therefore there is a category other where other answers can be recorded.
During the analysis, these responses can still be further categorized.
o For open-ended questions, more than one answer is usually allowed.
138
These questions, when used, will always be followed by other questions asking for
elaboration on reasons and conditions for use or non-use of the practice.
Closed Questions
o Closed questions have a list of possible options or answers from which the
respondents must choose.
o Closed questions are most commonly used for background variables such as age,
marital status or education, in case of age and education take the exact values and
categorize them during data analysis.
For example:
What is your opinion on the following statement: (Circle one response).
Women who are pregnant do not use antimalarial
Strongly agree
Agree
Not sure/no opinion
Disagree
Strongly disagree
Used if one is only interested in certain aspects of an issue and does not want to waste
time obtaining more information than one needs.
For example:
A researcher who is only interested in the sources of protein in a family diet
may ask:
Did you eat any of the following foods yesterday? (Circle yes if at least one item in
each set of items is eaten.)
139
o Comparing responses of different groups, or of the same group over time, becomes
easier
Risks of Closed Questions
o In case of illiterate respondents, the interviewer may be tempted to read the list of
possible answers in the given sequence, thereby influencing the choice of response
and introducing bias.
o Take objectives and variables as a starting point.
o Decide what questions will be needed to measure or (in the case of qualitative studies)
to define your variables and reach your objectives.
o Formulate one or more questions that will provide the information needed for each
variable.
o Check whether each question measures one thing at a time.
o Avoid leading questions.
A question is leading if it suggests a certain answer.
For example: Do you think that people have to give bribes at hospital X to be seen
by a doctor? Hardly leaves room for no or for other options.
A better question would be: Have you recently visited hospital X?
This would be followed by a series of other probing questions such as:
• By whom were you seen?
• What were the complaints?
o Ask sensitive questions in a socially acceptable way.
Questions relating to abortion, sexual practices of adolescents, or AIDS and
mental illness in the family are usually sensitive.
o Sequencing the questions: design your interview schedule or questionnaire to be
informant friendly.
The sequence of questions must be logical for the informant and allow, as much as
possible, for a natural conversation, even in more structured interviews.
Formatting the questionnaire: When you finalize your questionnaire, be sure that:
o A separate, introductory page is attached to each questionnaire, explaining the
purpose of the study, requesting the informants consent to be interviewed and
assuring confidentiality of the data obtained.
o Each questionnaire has a heading and space to insert the number, date and location of
the interview, and, if required, the name of the informant.
140
o Layout is such that questions belonging together appear together visually.
o If the questionnaire is long, use subheadings for groups of questions.
o Sufficient space is provided for answers to open-ended questions, categories such as
other and for comments on pre-categorized questions.
o Boxes for pre-categorized answers are placed in a consistent manner (e.g., on the right
half of the page).
Translation
o If interviews will be conducted in one or more local languages, the questionnaire
should be translated in order to standardize the way questions will be asked.
o After having it translated you should have it retranslated into the original language by
a different person.
o Compare the two versions for differences and make decisions concerning the final
o phrasing of difficult concepts.
Self-Administered (Written) Questionnaires
o All steps discussed above apply to written questionnaires as well as to
guides/questionnaires used in interviews.
o Self-administered questionnaires are most commonly used in large-scale surveys
using predominantly pre-categorized answers among literate study populations.
o In exploratory studies which require intensive interaction with informants in order to
gain better insight in an issue,
o Written questionnaires may sometimes be useful in small-scale studies on sensitive
topics.
They are usually combined with other tools e.g. FGD on sensitive issues like sexual
behavior.
Checklists
o Checklists can be used to systematically observe human behavior or the condition of
specific equipment (e.g. fridge, expiring dates of medicines, or completeness of
records).
o Observations can be relatively open or can be predetermined comparisons of reality
against fixed standards.
o The objectives of the study determine the content of a checklist.
141
o A checklist includes all the items or points that must be considered during an
observation in the field, or when extracting data from existing records.
142
Unpublished reports and publications in archives and libraries or in offices,
Newspapers and published case histories
Advantages of Reviewing Documents
o It is inexpensive, because data is already there
o It Permits examination of trends over the past
Limitations of Reviewing Documents
o Data are not always easily accessible
o Ethical issues concerning confidentiality may arise
o Information may be inaccurate or incomplete
Observation Technique
o Observation is a technique that involves systematically selecting, watching and
recording behavior and characteristics of living beings, objects or phenomena
o Observation of human behavior is a much-used data collection technique
o It can be undertaken in different ways:
Participant observation: The observer takes part in the situation he or she
observes
For example, a doctor hospitalized with a broken hip, who now observes
hospital procedures from within.
o Non-participant observation: The observer watches the situation, openly or concealed,
but does not participate.
o Observation becomes a scientific tool and method of data collection for the
researcher, when:
It serves a formulated research purpose.
Is systematically planned and recorded.
Is subjected to checks and controls on validity and reliability
Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done
o The information relates to what is currently happening
o Not complicated by either past behavior or future intentions or attitudes.
o Independent of respondents willingness to respond and hence less demanding on
active cooperation on the part of the respondents
143
o Suitable in studies which deal with subjects who are not capable of giving verbal
reports of their feelings for one reason or the other
Interviewing Technique
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group
o Requires a person known as the interviewer asking questions in a face-to-face contact
to the interviewee or through other means of communication like telephone
o Answers to the questions posed during an interview can be recorded by writing them
down (either during the interview itself or immediately after the interview) or by tape-
recording the responses, or by a combination of both
144
o People with certain high level positions like officials or executives may not be easily
approachable under this method and to that extent the data may prove inadequate
o Creating effective rapport with the interviewee may be a difficult
o Some subjects may demand incentives during data collection process
o There may be a language barrier between an interviewer and interviewee
Pre-Requisites and Basic Tenets of Interviewing
o Interviewers should be carefully selected and trained
o They must possess technical competence (interviewing and interpersonal skills)
o They should be able to create an atmosphere of trust and confidence
Written Questionnaires
o A written questionnaire (also referred to as self-administered questionnaire) is a data
collection method in which written questions are presented that are to be answered by
the respondents in written form. The questions can be either open-ended or closed
(with pre categorized answers).
o A written questionnaire can be administered in different ways, such as by:
Sending questionnaires by mail with clear instructions on how to answer the
questions
and asking for mailed responses;
Gathering all or part of the respondents in one place at one time, giving oral or
written instructions, and letting the respondents fill out the questionnaires; or
Hand-delivering questionnaires to respondents and collecting them later
Advantages of Questionnaires
o Low cost when study is large
o Free from interviewer bias
o Respondents have adequate time to give out their answers
o Respondents, who are not easily approachable, can be reached
o Used in large studies
o Permits anonymity and may result in more honest responses.
Limitations of Questionnaires
o Low rate of return of the duly filled in questionnaires
o Bias due to non-response is undetermined
o Used only when respondents are educated and cooperating
145
o Control over questionnaire may be lost
o Not flexible once the questionnaire has been dispatched out
o Ambiguous replies or omissions creating difficult in interpretation
o Slowest method of all when mailing is used
Focus Group Discussions (FGD)
o FGD allows a group of 6 - 12 informants to freely discuss a certain subject with the
guidance of a facilitator or reporter during which group members talk freely and
spontaneously about a certain topic.
o Characteristics and Uses of Focus Group Discussions
A FGD is a qualitative method.
A FGD aims to be more than a question-answer interaction.
The idea is that group members discuss the topic among themselves, with
guidance from the facilitator.
o FGD techniques can be used to:
Focus research and develop relevant research hypotheses by exploring in greater
depth the problem to be investigated and its possible causes.
Formulate appropriate questions for more structured, larger scale surveys.
Develop appropriate messages for health education programmes and later evaluate
the messages for clarity
Explore controversial topics. For example: Sexual behavior is a controversial
topic in the sense that males and females judge sexual relations and sexuality
often from very different perspectives.
o Advantages of FGD
The researcher can interact with the participants, pose, follow up questions or ask
questions that probe more deeply.
Results can be easier to understand than complicated statistical data.
The researcher can get information from non-verbal responses such as facial
expressions or body language.
Information is provided more quickly than if people were interviewed separately.
Limitations of FGD
o The small sample size means the groups might not be a good representation of the
larger population
o Group discussions can be difficult to steer and control, so time can be lost to
irrelevant topics
146
o Respondents can feel peer pressure to give similar answers to the moderators
questions
o The moderators skills in phrasing questions along with setting can affect responses
and skew results
Summary of Data collection Techniques and Tools
Data Collection Techniques Tools
Using available information Checklist, data compilation forms
Observing Eyes and other senses, pen/paper, watch,
scales, microscope
Administering written question
questionnaire Questionnaire
Focus Group Discussion (FGD) FGD Guide
147
The informant may mistrust the intention of the interview and avoid certain
questions or give misleading answers.
For example: in a survey on alcoholism you ask school children:
Does your father sometimes get drunk? Many will probably deny that he does,
even if it is true
o Such bias can be reduced by:
Adequately introducing the purpose of the study to informants.
Phrasing questions on sensitive issues in a positive way.
Taking sufficient time for the interview and by assuring informants that the data
collected will be confidential.
o Information bias
Sometimes the information itself has weaknesses.
Medical records may have many blanks or be unreadable. This tells something
about the quality of the data and has to be recorded.
• For example, in a compliance of TB drugs study the percentage of non compliant
patient with an incomplete or missing address should be calculated.
o Another common information bias is due to gaps in peoples memory this is called
memory or recall bias.
For example: A mother may not remember all details of her childs last diarrhoea
episode and of the treatment she gave two or three months afterwards.
For such common diseases it is advisable to limit the period of recall, asking, for
example, Has your child had diarrhoea over the past two weeks?
148
o Ascertain whether all required information is going to be obtained by
questioning only or not
o How much is known about the problem being investigated. Familiar?
Unfamiliar?
This determines whether closed/open questions should be used.
o The number of subjects to be studied.
This determines how much of open/closed questions to be used
Open-ended (free response) questions: respondents are not given options to
choose ; they answer in their own words
Closed questions (fixed alternatives): respondents are given alternative answers to
choose from
Requirements of the research questions
o Should measure the variable under study
o Should be ones to which respondents are expected to know the answers
o Should be clear and unambiguous
o phrased in simple language; avoid technical terms
o Contain one idea only
o Should not be offensive
o Should not suggest an answer (leading)
Steps in designing tools (questionnaire):
o first step: Deciding on the content
Refer to the study objectives and variables
Think of the question(s) needed to measure the variable
o Second step: Formulating the questions
Formulate one (or more) question (s) that will provide the required
information
Make sure that the questions satisfies the requirements discussed earlier
o Third step: Sequencing the questions
Arrange them in a logical sequence to allow a natural discussion
(consumer friendly)
Begin with non-sensitive questions and pose the sensitive ones later
o Fourth step: Formatting the questionnaire
Questionnaires normally have two major sections
149
Introductory section. This precedes the questions and have the
following contents
• Heading
• Serial number
• Date of interview
• Place of interview
• Name of interviewer
• Name/code of respondents
o Questions section. This bears the questions and the following should
be ensured
Related questions should appear together
There is sufficient space for respondents to fill in their responses to
open-ended questions
The boxes for pre-categorized responses are placed in consistent
manner
There are reserved boxes for computer coding for computer aided data
analysis
Formatting should ensure that the questionnaire is user friendly
o Fifth step: Translation
Translation of the questionnaire into language familiar to all
respondents should be done if the original version is in a different
language.
o Sixth step: Pretesting
Before embarking on actual data collection it is important to check
whether the questionnaire gathers the information expected and
whether both the interviewer and interviewee feel at ease with it.
Data compilation forms
150
o A checklist is a tool for identifying the presence or absence of conceptual
knowledge, skills, or behaviors
o Developing a checklist involves the following steps
Step 1: Review the learning outcome and associated criteria for success
o State the level of success required for the checklist to be considered
completed, In most cases, all items must be checked
o Decide on the response such as Yes or No, or simply have a box to be
checked once the item has been completed
Step 2: From a procedure, process, or task description list, pick those items that
are required for a good performance or product
o Itemize task descriptions in one column and
o Provide a space beside each item in a second column to check off the
completion of the task
o Group similar items or order them sequentiallykeep as short as possible
o Highlight critical steps, checkpoints, or indicators of success
Step 4: Write clear instructions for the observer
Step 5: Review the task descriptions for details and clarity
Step 6: Format the checklist
Step 7: Ask for feedback from other instructors before using it with learners
o Checklists are used for identifying whether key tasks in a procedure, process,
or activity have been done in complete and in a systematic manner.
151
Enough information should be given to raise the interest of informants
and to enable them to judge whether they would like to participate or
not.
Consent has to be obtained before the interview
o Second: Interviewers should try to blend in the environment. In order to
do so:
Clothing of interviewers should be culturally acceptable and as simple
as possible
Sitting arrangements for interviewer(s) and informant(s) should
preferably be at the same height
Gender relations have to be respected.
an interviewer should show interest in what the informant says, be at
ease (never in a hurry); Make the informant feel at ease
The environment should also be supportive of the interview situation.
Anything which disturbs (noise, other people listening, a formal
surrounding) should if possible be avoided
Tape recording may be an enabling or a disturbing environmental
factor in the interview
Informants should be asked for their consent before use
o Third: The interviewers tasks
• The interviewer has a number of other tasks:
Posing questions
Evaluating answers and probing for elaboration or more precision in
case of a superficial or invalid answer
Noting down answers
Leading the discussion, but at the same time encouraging the informant
to give spontaneous information relevant to the topic by letting him/her
talk
Keeping control over the interview
At the end, the interviewer should summarize the interview
after-interview' discussions and questions should always be recorded,
like all spontaneous information, because discussions can shed light on
152
complicated, not yet fully clear issues from many preceding
interviews.
o Fourth: Training the research team/assistants
• Research assistants should be taught basic interview techniques, such
as:
Asking questions in a neutral manner
Not showing by words or expression what answers one expects
Not showing agreement, disagreement or surprise
Recording answers to open questions precisely as they are provided,
without sifting or interpreting them
STEP 6: Key Points (5 minutes)
Common research tools are interview guides, questionnaires , collecting forms and
checklists
Common data collection techniques include; interview, self administration of
questionnaire, FGD , review of information available and Observation
Questionnaires and interview schedules are used to collect information for
quantitative research
An interviewer needs to have the skills of turning an informant into a partner
153
STEP 8: Assignment (5 minutes)
Activity: Take Home Assignment (05 minutes)
Prepare your data-collection tools (instruments), taking care that you cover all
important variables. Refer to the matrix with data collection techniques and
responsible tools
Take care that you have an optimal mix between open-ended and pre-categorised
questions.
Discuss the possibilities for bias, which may occur when using the data-collection tools.
Try to avoid bias as much as possible.
154
References
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
Empire State College (2018). Questions or feedback about ESC's Online Writing Center
https://www.esc.edu/online-writing-center/resources/research/research-paper-steps/
developing-questions/
155
Handout 16.1: Overview of Data Collection Techniques
Data collection techniques refer to a variety of methods which are used to gather
information for the study.
Data collection techniques allow to systematically collect information about the objects of
study (people, objects, phenomena) and about the settings in which they occur.
In the collection of data we have to be systematic.
If data are collected haphazardly then it will be difficult to answer research questions
in a conclusive way.
Common Data Collection Techniques in Use
o Reviewing documents
o Observing/observation
o Interviewing (face-to-face)
o Administering written questionnaires
o Focus group discussions
Reviewing Documents
o Documents to be reviewed can be obtained from dispensary, health center, and
hospital records.
For example, analysis of the information routinely collected by health facilities
can be very useful for identifying problems such as flows of drug supply or
increases in the incidence of certain diseases.
o Other sources of data may be Health Information Management System, census,
unpublished reports and publications in archives and libraries or in offices,newspapers
and published case histories
Limitations of Reviewing Documents
o Data are not always easily accessible.
o Ethical issues concerning confidentiality may arise.
o Information may be inaccurate or incomplete.
Observation Technique
o Observation is a technique that involves systematically selecting, watching and
recording behavior and characteristics of living beings, objects or phenomena.
o Observation of human behavior is a much-used data collection technique.
156
It can be undertaken in different ways:
Participant observation: The observer takes part in the situation he or she
observes.
• For example, a doctor hospitalized with a broken hip, who now observes
hospital procedures from within.
o Non-participant observation: The observer watches the situation, openly or concealed,
but does not participate.
Observation becomes a scientific tool and method of data collection for the researcher,
when:
o It serves a formulated research purpose.
o Is systematically planned and recorded.
o Is subjected to checks and controls on validity and reliability.
Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done.
o The information relates to what is currently happening.
o Not complicated by either past behavior or future intentions or attitudes.
o Independent of respondents willingness to respond and hence less demanding on
active cooperation on the part of the respondents.
o Suitable in studies which deal with subjects who are not capable of giving verbal
reports of their feelings for one reason or the other.
Limitations of Observation Method
o It is an expensive method
o Information provided by this method is very limited
o Sometimes unforeseen events may interfere with the observational task
o Some subjects are rarely accessible to direct observation
o If subjects know that they are being observed, they may change their behaviour
Interviewing Technique
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group.
o Requires a person known as the interviewer asking questions in a face-to-face contact
to the interviewee or through other means of communication like telephone.
Limitations of Reviewing Documents
157
o Data are not always easily accessible.
o Ethical issues concerning confidentiality may arise.
o Information may be inaccurate or incomplete.
Observation Technique
o Observation is a technique that involves systematically selecting, watching and
recording behavior and characteristics of living beings, objects or phenomena.
o Observation of human behavior is a much-used data collection technique.
o It can be undertaken in different ways:
Participant observation: The observer takes part in the situation he or she
observes.
• For example, a doctor hospitalized with a broken hip, who now observes
hospital procedures from within.
o Non-participant observation: The observer watches the situation, openly or
concealed, but does not participate.
Observation becomes a scientific tool and method of data collection for the researcher,
when:
o It serves a formulated research purpose.
o Is systematically planned and recorded.
o Is subjected to checks and controls on validity and reliability.
Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done.
o The information relates to what is currently happening.
o Not complicated by either past behavior or future intentions or attitudes.
o Independent of respondents willingness to respond and hence less demanding on
active cooperation on the part of the respondents.
o Suitable in studies which deal with subjects who are not capable of giving verbal
reports of their feelings for one reason or the other.
Limitations of Observation Method
o It is an expensive method
o Information provided by this method is very limited
o Sometimes unforeseen events may interfere with the observational task
o Some subjects are rarely accessible to direct observation
158
o If subjects know that they are being observed, they may change their behavior
Interviewing Technique
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group.
o Requires a person known as the interviewer asking questions in a face-to-face contact
to the interviewee or through other means of communication like telephone.
o Answers to the questions posed during an interview can be recorded by writing them
down (either during the interview itself or immediately after the interview) or by tape-
recording the responses, or by a combination of both.
Advantages of the Interview Method
o Detailed information can be obtained.
o Interviewer could overcome resistance of the respondent, if any.
o Provides flexibility to the interviewer to restructure, clarify, or add probe questions.
o Observation can also be applied during interview.
o Is suitable for use with both literates and illiterates.
o Has higher response rate than written questionnaires.
o The interviewer can collect supplementary information about the respondent s
personal characteristics and environment.
Limitations of Interview
o It is very expensive and time consuming especially when the sample is large.
o Chances of Interviewer as well as interviewees bias are high.
o People with certain high level positions like officials or executives may not be easily.
approachable under this method and to that extent the data may prove inadequate.
o Creating effective rapport with the interviewee may be a difficult.
o Some subjects may demand incentives during data collection process.
o There may be a language barrier between an interviewer and interviewee.
Pre-Requisites and Basic Tenets of Interviewing
o Interviewers should be carefully selected and trained
o They must possess technical competence (interviewing and interpersonal skills)
o They should be able to create an atmosphere of trust and confidence
Written Questionnaires
o A written questionnaire (also referred to as self-administered questionnaire) is a data
159
o collection method in which written questions are presented that are to be answered by
the respondents in written form. The questions can be either open-ended or closed
(with pre categorized answers).
o A written questionnaire can be administered in different ways, such as by:
Sending questionnaires by mail with clear instructions on how to answer the
questions and asking for mailed responses;
Gathering all or part of the respondents in one place at one time, giving oral or
written instructions, and letting the respondents fill out the questionnaires; or
Hand-delivering questionnaires to respondents and collecting them later.
Advantages of Questionnaires
o Low cost when study is large
o Free from interviewer bias
o Respondents have adequate time to give out their answers
o Respondents, who are not easily approachable, can be reached
o Used in large studies
o Permits anonymity and may result in more honest responses.
Limitations of Questionnaires
o Low rate of return of the duly filled in questionnaires
o Bias due to non-response is undetermined
o Used only when respondents are educated and cooperating
o Control over questionnaire may be lost
o Not flexible once the questionnaire has been dispatched out
o Ambiguous replies or omissions creating difficult in interpretation
o Slowest method of all when mailing is used
Focus Group Discussions (FGD)
o FGD allows a group of 6 - 12 informants to freely discuss a certain subject with the
guidance of a facilitator or reporter during which group members talk freely and
spontaneously about a certain topic.
Characteristics and Uses of Focus Group Discussions
o A FGD is a qualitative method.
o A FGD aims to be more than a question-answer interaction.
160
o The idea is that group members discuss the topic among themselves, with guidance
from the facilitator.
o FGD techniques can be used to:
Focus research and develop relevant research hypotheses by exploring in greater
depth the problem to be investigated and its possible causes.
Formulate appropriate questions for more structured, larger scale surveys.
Help understand and solve unexpected problems in interventions.
Develop appropriate messages for health education programmes and later evaluate
the messages for clarity.
Explore controversial topics. For example: Sexual behavior is a controversial
topic in the sense that males and females judge sexual relations and sexuality
often from very different perspectives.
Advantages of FGD
o The researcher can interact with the participants, pose, follow up questions or ask
questions that probe more deeply.
o Results can be easier to understand than complicated statistical data.
o The researcher can get information from non-verbal responses such as facial
expressions or body language.
o Information is provided more quickly than if people were interviewed separately.
Limitations of FGD
o The small sample size means the groups might not be a good representation of the
larger population
o Group discussions can be difficult to steer and control, so time can be lost to
irrelevant topics
o Respondents can feel peer pressure to give similar answers to the moderators
questions
o The moderators skills in phrasing questions along with setting can affect responses
and skew results
161
o Analysis of the information routinely collected by health facilities can be very useful
for identifying problems in certain interventions or in flows of drug supply, or for
identifying increases in the incidence of certain diseases.
o Analysis of health information system data, census data, unpublished reports and
publications in archives and libraries or in offices at the various levels of health and
health-related services, this may be a study in itself. Usually, however, it forms part of
a study in which other data collection techniques are also used.
o The use of key informants is another important technique to gain access to available
information. Key informants could be knowledgeable community leaders or health
staff at various levels and one or two informative members of the target group (e.g.,
adolescents on their sexual behavior). They can be involved in various stages of the
research, from the statement of the problem to analysis of the data and development
of recommendations.
o Other sources of available data are newspapers and published case histories, e.g.,
patients suffering from serious diseases, or their relatives, telling their experiences
and how they cope.
o The advantage of using existing data is that: Collection is inexpensive. However, it is
sometimes difficult to gain access to the records or reports required, and the data may
not always be complete and precise enough, or too disorganized.
Note:
In order to retrieve the data from available sources, the researcher will have to design
an instrument such as a checklist or compilation sheet.
In designing such instruments, it is important to inspect the layout of the source
documents from which the data is to be extracted.
For health information system (HIS) data, for example, the data compilation sheet
should be designed in such a way that the items of data can be transferred in the order
in which the items appear in the source document. This will save time and reduce
error.
Interviewing
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group. Answers to the questions posed during
an interview can be recorded by writing them down (either during the interview itself
162
or immediately after the interview) or by tape-recording the responses, or by a
combination of both.
o Interviews can be conducted with varying degrees of flexibility. The two extremes,
high and low degree of flexibility, are described below:
High degree of flexibility:
• For example: When studying sensitive issues such as teenage pregnancy and
abortions, the investigator may use a list of topics rather than fixed questions.
• These may, e.g., include how teenagers started sexual intercourse, the
responsibilities girls and their partners take to prevent pregnancy (if at all),
and the actions they take in the event of unwanted pregnancies.
• The investigator should have an additional list of topics ready when the
respondent falls silent, (e.g., when asked about abortion methods used, who
made the decision and who paid).
• The sequence of topics should be determined by the flow of discussion. It is
often possible to come back to a topic discussed earlier in a later stage of the
interview.
• The unstructured or loosely structured method of asking questions can be used
for interviewing individuals as well as groups of key informants.
• A flexible method of interviewing is useful if a researcher has as yet little
understanding of the problem or situation he is investigating, or if the topic is
sensitive. It is frequently applied in exploratory studies.
• The instrument used may be called an interview guide or interview schedule.*
• Low degree of flexibility:
o Less flexible methods of interviewing are useful when the researcher is
relatively knowledgeable about expected answers or when the number of
respondents being interviewed is relatively large.
o Then questionnaires may be used with a fixed list of questions in a
standard sequence, which have mainly fixed or pre-categorized answers.
o For example: After a number of observations on the (hygienic) behavior of
women drawing water at a well and some key informant interviews on the
use and maintenance of the wells, one may conduct a larger survey on
water use and satisfaction with the quantity and quality of the water.
Administering Written Questionnaires
163
o A written questionnaire (also referred to as self-administered questionnaire) is
a data
collection tool in which written questions are presented that are to be answered by the
respondents in written form. A written questionnaire can be administered in different
ways, such as by:
o Sending questionnaires by mail with clear instructions on how to answer the questions
and asking for mailed responses;
o Gathering all or part of the respondents in one place at one time, giving oral or written
instructions, and letting the respondents fill out the questionnaires; or hand-delivering
questionnaires to respondents and collecting them later.
o The questions can be either open-ended or closed (with pre-categorized answers).
Projective Techniques
o When a researcher uses projective techniques, she/he asks an informant to react to
some kind of visual or verbal stimulus. For example:
An informant may be provided with a rough outline of the body and be asked to draw
her or his perception of the conception or onset of an illness.
Another example of a projective technique is the presentation of a hypothetical
question or an incomplete sentence or case/study to an informant (story with a gap).
o A researcher may ask the informant to complete in writing sentences such as:
If I were to discover that my neighbor had TB, I would ...;
If my wife were to propose that I use condoms, I would...
Or (s) he may ask the informant: Suppose your child suffered from diarrhea, what
would you do?
o Such techniques can easily be combined with semi-structured interviews or written
questionnaires. They are also very useful in FGDs to get peoples opinion on sensitive
issues.
o Mapping and Scaling
Mapping is a valuable technique for visually displaying relationships and
resources.
In a water supply project for example:
• Mapping is invaluable. It can be used to present the placement of wells,
164
distance of the homes from the wells, other water systems, etc. It gives
researchers a good overview of the physical situation and may help to
highlight relationships hitherto unrecognized.
• Mapping a community is also very useful and often indispensable as a pre-
stage to sampling.
• Scaling is a technique that allows researchers through their respondents to
categorize certain variables that they would not be able to rank themselves.
• For example, they may ask their informant(s) to bring certain types of herbal
medicine and ask them to arrange these into piles according to their
usefulness. The informants would then be asked to explain the logic of their
ranking.
Mapping and scaling may be used as participatory techniques in rapid appraisals
or situation analyses. Rapid appraisal techniques and participatory research are
approaches often used in health systems research.
165
Handout 16.2: Advantages and disadvantages of using various data
collection tools
Table for advantages and disadvantages of using various data collection tools
166
Corlien, Pathmanathan, & Brownlee. (2003).
167
For example: Sexual behavior is a controversial topic in the sense that males and
females judge sexual relations and sexuality often from very different perspectives.
Sexual education has to take this difference into account.
Through FGDs, first with females, then with males, and then with a mixed group to
confront both sexes with the different outcomes of the separate discussions (listed on
flip charts) it becomes easier to bring these differences in the open. Especially for
teenagers, who may have many stereotypes about the other sex or be reluctant to
discuss the topic openly (particularly girls), such a multi-stage approach is useful.
Strengths and Limitations of FDG
o Implementation of FGDs is an iterative process; each focus group discussion builds
on the previous one, with a slightly elaborated or better-focused set of themes for
discussion.
o Provided the groups have been well chosen, in terms of composition and number (see
o below), FGDs can be a powerful research tool which provides valuable spontaneous
information in a short period of time and at relatively low cost.
o FGD should not be used for quantitative purposes, such as the testing of hypotheses or
the generalization of findings for larger areas, which would require more elaborate
surveys.
o However, FGDs can profitably complement such surveys or other, qualitative
techniques.
o Depending on the topic, it may be risky to use FGDs as a single tool.
o In group discussions, people tend to centre their opinions on the most common ones,
on social norms. In reality, opinions and behavior may be more diverse. Therefore it
is advisable to combine FGDs with at least some key informant and in-depth
interviews.
o Explicitly soliciting other views during FGDs should be routine as well.
o In case of very sensitive topics, such as sexual behavior or coping with HIV/AIDS,
FGDs may also have their limitations, as group members may hesitate to air their
feelings and experiences freely.
o One possible remedy is the selection of students who do not know each other (e.g.,
selection of children from different schools in FGDs about adolescent sexual
behavior), while assuring absolute confidentiality.
168
o It may also help to alternate the FGD with other methods, for example, to precede it
by a self developed role play on sexual behavior, or to administer a written
questionnaire immediately after the FGD with open questions on sexual behavior in
which the students can anonymously state all their questions and problems. This
worked in Tanzania and Nepal.
How to Conduct a Focus Group Discussion
o Determine the purpose
A FGD can be regarded as a mini-study. It therefore requires one or two clear
objectives.
These objectives will guide the research team in the formulation of discussion
questions.
o Situation analysis
Any FGD requires good knowledge of local conditions. Communities are seldom
or never homogeneous. There are always differences between community
members, for example in education, political power, gender, economic status and
ethnic group.
These differences will be reflected in their perceptions of the problems they suffer
from and possible solutions.
A researcher must be aware of these differences, otherwise (s)he may miss
important groups of students or obtain a hotchpotch of information.
Similarly, she/she must know which key persons or organizations could be good
entry points for the selection of students in the FGDs (e.g.: womens groups,
parent associations, youth clubs, etc.).
For example: In an intervention study on sexual health among out-of-school youth
in an urban area, the researcher first planned some interviews with key informants.
He selected the leaders of a political youth club and of a Christian youth club and
some teachers, with whom he thoroughly discussed his research topic.
• Through them he came in contact with youth of different backgrounds. He let
each of the three groups, separated into boys and girls, draw maps of the town
and asked them to mark places which they thought riskful in terms of sexual
behavior (easy contacts, unprotected sex).
• The drawings formed a good basis for further FGDs but also helped him to
identify wider networks of adolescents at risk who had to be included in the
169
study.
170
o One should serve as recorder.
o The facilitator should preferably be as close as possible to the students in their
characteristics (same sex, roughly same age).
171
Handout 16.4: Function of Focus Group Facilitator
172
When dealing with a dominant participant, avoiding eye contact or turning
slightly away to discourage the person from speaking, or thanking the
person and changing the subject.
When dealing with a reluctant participant, using the person s name,
requesting his/her opinion, making more frequent eye contact to encourage
his/her participation is important.
o Deal correctly with sensitive issues.
o If you notice that the discussion stops when dealing with a sensitive topic, you could
o ask students (if literate) to anonymously write down their responses or opinions on the
topic.
o Alternatively, you could summarize for the group some of the opinions from previous
focus group discussions, focusing on one or two major contrasting opinions.
o Still another strategy is to form sub-groups, and to get a member of the sub-group to
summarize and present the opinions of their sub-group members after which the
whole group can still discuss these opinions.
o Build rapport, empathize
o Observe non-verbal communication.
o Ask yourself, What are they saying? What does it mean to them?
o Be aware of your own tone of voice, facial expressions, body language, and those of the
students.
o Avoid being placed in the role of expert
o When asked for your ideas or views by a respondent, remember that you are not there
o to educate or inform.
o Direct the questions back to the group by saying: What do you think, What would
you do?
o Set aside time, if necessary, after the session to give students the information they
have asked for.
o Do not try to comment on everything that is being said.
o Dont feel you have to say something during every pause in the discussion.
o Wait a little and see what happens.
o Control the rhythm of the meeting, but in an unobtrusive way
o Listen carefully, and move the discussion from topic to topic. Subtly control the time
173
allocated to various topics so as to maintain interest.
o If students spontaneously jump from one topic to another, let the discussion continue
for a while since useful additional information may surface; then summarize the
points brought up and reorient the discussion.
o Take time at the end of the meeting to summarize, check for agreement and thank the
Students
o Summarize the main issues brought up, check whether all agree and ask for additional
comments.
o Thank the students and let them know that their ideas have been a valuable
contribution and will be used for planning the proposed research, intervention, or
health education materials.
o Listen for additional comments and spontaneous discussions which occur after the
meeting has been closed.
Functions of the Recorder
o The recorder should keep a record of the content of the discussion as well as
emotional reactions and important aspects of group interaction.
o Assessment of the emotional tone of the meeting and the group process will enable
you to judge the validity of the information collected during the FGD.
o Items to be recorded include:
Date, time, place
Names and characteristics of students
General description of the group dynamics (level of participation, presence of a
dominant participant, level of interest)
Opinions of students, recorded as much as possible in their own words, especially
for key statements
Emotional aspects (e.g., reluctance, strong feelings attached to certain opinions)
Vocabulary used - particularly in FGDs that are intended to assist in developing
questionnaires or health education materials
Spontaneous relevant discussions during breaks or after the meeting has been
closed
o It is highly recommended that a tape-recorder be used to assist in capturing
information. Even if a tape-recorder is used, notes should be taken as well, in case the
machine malfunctions and so that information will be available immediately after the
174
session for discussion.
Duration
o A focus group session typically lasts up to an hour and a half.
o Generally the first session with a particular type of group is longer than the following
ones because all of the information is new.
o Thereafter, if all the groups have a similar opinion on particular
topics, the facilitator may be able to move the discussion along more quickly to other
topics which still elicit new points of view.
175
Session 17: Pre-Testing the Research Tools
Total Session Time: 60 minutes + 240 minutes assignment
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define pretest and pilot study
Outline reasons for pretest
Describe the components of a pre-test
Plan and carry out pre-test of research components
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 17.1: Summary of points to assess during a pre-test or pilot study
SESSION OVERVIEW
Activity/
Step Time Content
Method
05 Introduction, Learning Tasks
1. Presentation
minutes
05 Presentation Definition of pretest and pilot study
2.
minutes Brainstorming
Presentation Reasons for pretesting
10
3. Lecture
minutes
discussion
15 Presentation
4. Components of a Pre-Test and Pilot Study
minutes Buzzing
10 Presentation
5. Planning and Carrying out Pre-Test of
minutes Buzzing Research Components
05
6. Presentation Key Points
minutes
05
7. Presentation Evaluation
minutes
8. 05 Presentation Assignment
176
minutes
SESSION CONTENTS
Enables, if necessary, to revise the methods and logistics of data collection before
starting the actual field works.
Pre-testing is simpler and less time-consuming and costly than conducting an entire
pilot study.
177
o STEP 4:Components of Pre-Testing (15 minutes)
178
o team work
Procedures for data processing and analysis
work plan and budget for research activities
It is highly recommended that you analyse the data collected during the pre-test right
away
Identify what aspects of the study you would like to pre-test in your research area and
why, with whom, when and where.
Summarize this information in one or two paragraphs in your research proposal.
180
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
181
Handout 17.1: Summary of points to assess during a pre-test or pilot study
Acceptability of questions
Acceptable
2. The data-collection tools Not Suggestions
acceptable
Accuracy of translation
Pre-categorising of questions
182
3. Sampling procedures Acceptable Not Suggestions
acceptable
Team dynamics
Accuracy of interpretation
Appropriateness of statistical
procedures
183
6. Schedule for research activities Acceptable Not Suggestions
acceptable
supervision
administration
analysis of data
Sequence of activities
184
Session 18: Data Collection Plan
Total Session Time: 120 minutes + 240 minutes assignment
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Describe problems that may arise during data collection and how they may be solved.
Prepare a plan for data collection for the developed research proposal
Determine the various tasks of the staff needed for research
Prepare a work schedule (GANTT chart)
Draw a work schedule(GANTT chart)
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
Handout 18.1: Example of a GANTT
Handout 18.2: Example of a work schedule
185
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 15 minutes Typical Problems that May Arise During Data
Buzzing Collection and Solutions.
8 Evaluation
SESSION CONTENTS
186
o Training research assistant
o Pretest instrument
o Adequate supervision of data collection
o Revise method to check quality of data
o Prior anticipation of problems that might occur and prepare plan to overcome them
187
o The Health Research Unit in the Ministry of Health or the institution organizing the
course may assist in obtaining permission from the national level.
Stage 2: Data Collection
o During data collection consider:
Logistics: who will collect what, when and with what resources
Quality control (data must be reliable and valid)
o When allocating tasks for data collection, it is recommended that first list type of data
required.
o Identify who could best implement each of the tasks.
If it is clear earlier that your research team will not be able to carry out the entire
study by itself
Plan to look for research assistants to assist in relatively simple but time-
consuming tasks.
Consider the following:
Time for Data Collection
o Think about how long will it take to collect data for each component of the Study?
The time required to reach the study area(s)
The time required locating the study units (persons, groups, records), search for
specific informants (e.g., users or defaulters of a specific service)
It might take more time to locate informants than to interview them; consider the
number of visits required per study unit.
o Calculate the number of interviews that can be carried out per person per day (e.g. 4)
o Calculate the number of days needed to carry out the interviews. For example:
You need to do 200 interviews
o Your research team of 5 people can do 5 x 4 = 20 interviews per day
o You will need 200:20 = 10 days for the interviews
Calculate the time needed for the other parts of the study, (for example, 10 days)
Determine how much time you can devote to the study.
o Since the research team usually consists of very busy people, it is unlikely that team
members can spend more than 30 working days on the entire study:
o 5 days for preparation (including pre-testing and finalizing questionnaires)
o 20 days actual field work
o 5 days data processing + preliminary analysis
188
Think of when should the data be collected? The type of data to be collected and the
demands of the project will determine the actual time needed for the data collection
Consider:
o Availability of research team members and research assistants
o The appropriate season(s) to conduct the field work (if the problem is season-related
or if data collection would be difficult during certain periods)
o Accessibility and availability of the sampled population
o Public holidays and vacation periods
Stage 3: Data Handling
o Develop a clear procedure for handling and storing data
o Number questionnaires and other research tools. Decide if this should be done at the
time of the interview or at the time the questionnaires are stored.
o Each tool used will get its own numbers starting from 1. If some data sets are linked,
e.g., you interview leprosy patients as well as their relatives and neighbors to analyze
their interaction and possible stigma from different perspectives, better link the
numbers.
o Identify the person responsible for storing data and the place where it will be stored.
o Decide how data should be stored.
o Record forms should be kept in the sequence in which they have been numbered. In
what sequence should data be collected?
o Other isues to consider during data collection
In general, it is advisable to start with analysis of data that is already available.
data to be drawn from different sources but in one locality should be collected at
the same time.
It is extremely important that the data collected are of good quality (reliable and
valid)..
Possible sources of data distortion (bias) that should try to prevent, include:
o Deviations from the sampling procedures set out in the proposal.
o Variability or bias in observations or measurements made because:
Subject changes his/her behavior
Use of unstandardized weighing scales or inaccurate or no guidelines for
interviewing.
189
Variation in researchers observations (observer variability) in what they
observe or measure.
_ Variations in criteria for measurement or for categorizing answers;
changed them during the study.
Measures to ensure good quality of data
Prepare a field work manual for the research team as a whole, including:
Guidelines on sampling procedures and what to do if respondents are not available
or to co-operate.
A clear explanation of the purpose and procedures of the study which should be
used to introduce each interview
Instruction sheets on how to ask certain questions and how to record
STEP 4: Determination of Various Tasks of the Staff Needed for Research
(25 minutes)
When allocating tasks for data collection, it is recommended that you first list them.
Then you may identify who could best implement each of the tasks as example given
in the following matrix.
190
o Number all tasks.
o Make revisions, if required
o Preparing a work schedule (Gantt chart)
o Step 1: Consider:
The time required to reach the study area(s);
The time required to locate the study units (persons, groups, records);
• If you have to search for specific informants (e.g., users or defaulters of a
specific service) it might take more time to locate informants than to interview
them.)
The number of visits required per study unit.
• For some studies it may be necessary to visit informants a number of times,
for example, follow-up of pregnant mothers or malnourished children
Time needed for follow-up of non-respondents should also be considered.
o Step 2: Calculate the number of interviews that can be carried out per person per day
(e.g., 4)
o Step 3: Calculate the number of days needed to carry out the interviews.
For example:
you need to do 200 interviews
your research team of 5 people each can do 4 interviews per day
you will need how many days for the interviews
o Step 4: Calculate the time needed for the other parts of the study, (for example, 10 days)
o Step 5: Determine how much time you can devote to the study. It is unlikely that team
members can spend more than 30 working days on the entire study
5 days for preparation (including pre-testing and finalizing questionnaires)
20 days actual field work
5 days data processing and preliminary analysis
191
It shows all of the tasks that need to be done, the amount of time each task is
expected to take, the time frames in which individual tasks are to be completed,
and the relationship between various tasks.
This way, everything gets done on schedule, and you never waste time waiting
for a task to be completed that should have been done already.
192
DIVIDE students in groups or individuals
193
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
194
Handout 18.1: Example of a GANTT
195
196
Handout 18.2: Example of a Work Schedule
197
Session 19: Research Budget
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Identify the important points to be considered when starting to plan for data collection
Determine what resources are available and needed to carry out the research
Describe the activities of the research
Cost the research activities, materials and supplies required
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Objectives
Identification of Important Points to be
Presentation
2 15 minutes Considered when Starting to Plan for Data
Buzzing
Collection
Presentation Determination of Resources Available and
3
10 minutes Brainstorming Needed to Carry Out the Research
4 25 minutes Presentation Activities of the Research
50 minutes Presentation Costing the Research Activities, Materials and
5
Group discussion Supplies Required
6 05 minutes Presentation Key Points
198
SESSION CONTENTS
ASK students to pair up and buzz on the following question for 2 minutes:
What are the important points to be considered when starting to plan for data collection
ALLOW few pairs to respond and let other pairs to add on points not mentioned
The most important points to be considered when starting to plan for data collection:
o It should be simple, realistic, and easily understood by those directly involved.
o It should cover the preparatory and the implementation phases of the project, as well
as data analysis, reporting, dissemination and utilization of results.
o The activities covered should include training, technical or research tasks;
administrative, secretarial and other support tasks.
o The realities of local customs (local holidays, festivals) and working hours should be
considered, when preparing the work plan.
o Also seasonal changes and their effect on travel, work habits, and on the topic you are
studying (such as incidence of disease or nutritional status), should be kept in mind as
the schedule is planned.
STEP 3: Determination of Resources Available and Needed to Carry Out
the Research (10 minutes)
Base on the work plan
199
Specify for each activity in the work plan, what resources and inputs are required
For each resource determine unit cost and ,number of units to get the total cost
What research activities, materials and supplies required in the study need to be
budgeted?
200
WRITE their responses on flipchart or board
201
o Do not underestimate the time needed to complete project tasks in the real world.
o Include a 5% emergency fund if you fear that you might have budgeted for the
activities
rather conservatively.
If inclusion of a contingency fund is not allowed, an alternative is to slightly over-
budget in major categories.
Budget Justification
o It is not sufficient to present a budget without explanation.
o The budget justification follows the budget as an explanatory note justifying briefly,
in the context of the proposal, why the various items in the budget are required.
o Give clear explanations concerning why items that may seem questionable or that are
particularly costly are needed and discuss how complicated expenses have been
calculated.
If a strong budget justification has been prepared then, it is less likely that
essential items will be cut during proposal review.
How to Reduce Budgets
o Explore whether other health-related institutions are willing to temporarily assign or
second personnel to the project.
o When possible, use local rather than outside personnel. If consultants are needed at
the
beginning, train local personnel as soon as possible to take over their work.
o Explore the use of students or community volunteers, where appropriate.
o Plan for strict control of project expenditures, such as those for vehicle use, supplies.
The budget justification follows the budget as an explanatory note justifying briefly,
in the
context of the proposal, why the various items in the budget are required.
o Give clear explanations concerning why items that may seem questionable or that are
particularly costly are needed and discuss how complicated expenses have been
calculated.
If a strong budget justification has been prepared then, it is less likely that
essential items will be cut during proposal review.
202
Example of a field budget : Costs involved in fieldwork
Category Unit Cost Multiplying Cost
(Tsh) Factors (Tsh)
ALLOWANCES
a. Researchers (5)
b. Research assistants (5)
c. Secretary (1)
d. Drivers (2)
e. Facilitator (1)
Evaluation pilot study
Subtotal (I)
Transport Costs
Subtotal (II)
Supplies
Subtotal (III)
Total (I+II+III)
5% Contingency
Grand Total
The type of budget format to be used may vary depending upon whether the budget will
be supported by your own organization or submitted to the Ministry of Health or a donor
organization.
o Most donor organizations have their own special project forms, which include a
budget format (budget format)
o Keep in mind the tendency to underestimate the time needed to complete project tasks
in the real world
o If the budget is for a period longer than a year, build in allowances for inflation before
the project begins and in subsequent years by increasing costs by a set percentage
(budget preparation)
o It is not sufficient to present a budget without explanation (Budget justification)
203
o When possible, use local rather than outside personnel to reduce cost
Obtaining funding for projects
o To conduct research, it is usually necessary to obtain funding for the research
project. In addition to preparing a good research proposal, the following strategies
are useful for researchers who need to obtain their own funding:
o Familiarize yourself with the policies and priorities of funding agencies. Such
policies and priorities may be:
o Identify the procedures, deadlines and formats that are relevant to each agency.
o Obtain written approval and support from relevant local and national health
authorities and submit this together with your proposal.
o If you are a beginning researcher, associate yourself with an established researcher.
Host agencies scrutinize the credibility of the researcher to whom funds are
allocated. Such credibility is based on previous projects that have been successfully
completed.
o Build up your own list of successfully completed projects (i.e., your own reports,
publications, etc.).
204
STEP 8: Assignment (5 minutes)
205
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
206
Session 20: Data Collection
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Review previous data-collection techniques
State the uses and limitations of different data collection methods
Mention issues to consider in selecting data collection methods
List advantages of using a combination of different data collection techniques
Explain difference between data collection methods and tools
Identify various sources of bias in data collection and ways of preventing
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 10 minutes Various Data-Collection Techniques
Buzzing
Presentation
3 Group The Uses and Limitations of Different Data Collection
35 minutes discussion Methods
207
7 Presentation Sources of Bias in Data Collection and Ways of
15 minutes Preventing
8 05 minutes Presentation Key Points
9 05 minutes Presentation Evaluation
SESSION CONTENTS
STEP 3: Uses and Limitations of Different Data Collection Methods (35 minutes)
Use of available information
o Means: Looking into records and extracting information
o Advantages
Cheaper since information is already there
Doesn't depend on respondents willingness to respond
Allow observation of trend
o Disadvantages
May be difficult to access the data
Information may be incomplete or imprecise
Ethical concerns regarding confidentiality may arise
Observation
o Means: Watching and recording, no talking with respondent
o advantages
208
Gives information of what is currently happening
Doesn't depend on respondents willingness to respond
Disadvantages
Observer may notice only what interests him/her (bias)
Presence of observer may influence behaviour of respondent
Ethical concerns regarding confidentiality may arise
Interview
o Means: Asking a respondent questions orally
o Advantages
Can be used for illiterates
Allows clarification of questions
Higher response rate
o Disadvantages
Expensive (time, human resources)
Presence of interviewer may influence response
Administering a questionnaire
o Means: giving respondents written questions (questionnaire) so that they read the
questions themselves and provide answers
o Advantages
Quick and cheap, no many research assistants needed
Allows anonymity, hence more honest responses
o disadvantages
Require literate respondents
Response rate could be low
Questions may be misunderstood by respondents
Some respondents may choose responses simply because they saw it there,
otherwise they wouldn't have thought of it
209
Findings are more believable
Relatively cheaper
o Disadvantage
Discussion could base on irrelevant issues
Minority opinion may not be expressed
Difficult to analyse the data
Require highly trained moderator
In-depth interview
o Means: A person to person conversation in order to gain insight into people's
thoughts, feelings, and behaviour on important issues
o Advantages
Collects large amount of data quickly
Allows clarification of issues
o Disadvantages
Needs skilled interviewer
Data difficult to analyse
Views could be subjective
210
o Focus group discussions.
o Participant observations are also called qualitative research techniques.
o They produce qualitative data that is often recorded in narrative form.
STEP 6: Difference Between Data Collection Methods and Tools (25 minutes)
Data collection instruments and tools are things that are used in collecting
information.
o Example of instrument: Data compilation form, interview guide, etc.
o Example of tool: Pen, weighing scale
Different techniques need different instruments and tools
211
Observation Checklist Eye, pen
Interview Interview schedule, guide Ears, pen, recorder
STEP 7: Sources of Bias in Data Collection and Ways of Preventing (15 Minutes)
Sources of bias:
o Defective instruments or tools
o Interviewers and observers different data collectors eliciting different information
o Effect of the interview respondents mistrust the interview intention, thus dodge the
questions
o Information bias incomplete record, respondents being unable to recall
Ways to Reduce the Possibility of Bias:
o Data collection tools (including written introductions for the interviewers to use with
potential respondents) should be pre-tested. If necessary, adjustments should be made
to ensure better co-operation.
o If non-response is due to absence of the subjects, follow-up of non-respondents may
be considered.
o If non-response is due to refusal to co-operate, an extra, separate study of non-
respondents may be considered in order to identify to what extent they differ from
respondents.
o Another strategy is to include additional people in the sample, so that non-respondents
who were absent during data collection can be replaced. This can only be justified if
their absence was very unlikely to be related to the topic being studied.
o The bigger the non-response rate, the more necessary it becomes to take remedial
action.
o It is important in any study to mention the non-response rate and to honestly discuss
whether and how the non-response might have influenced the results.
STEP 8: Key Points (5 minutes)
212
Data collection methods include; use of available information, observation, interview
administering questionnaires , focus group discussion, in-depth interview
Sources of bias in data collection may arise from tools, interviewer and information
recorded
Data collection instruments and tools are things that are used in collecting
information
213
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985); Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Ranjit K (205); Research methodology step by step guide for begginers, 2nd edition,
Singapore, pearson education
Polit, D. F and Beck, C. T (2004) Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
214
Session 21: Data Collection - Field Work Activities
Total Session Time: 480 minutes
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Identify activities to be done before data collection
Collect data
Process data while in the field
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1. 05 minutes Presentation Introduction, Learning Tasks
Presentation
2. 15 minutes Activities to be done before data collection
Buzzing
Presentation
3. 20 minutes Lecture Data collection
discussion
Presentation
4. Data processing
10 minutes Brainstorming
5. 05 minutes Presentation Key Points
6. 05 minutes Presentation Evaluation
7. 05 minutes Presentation Field wok data collection
SESSION CONTENTS
215
STEP 2: Activities to be Done before Data Collection
Briefing managers, health service personnel and community members concerned
Identifying and obtaining resources for the study
Reviewing availability of subjects and information
Organizing logistics for data collection
Preparing field work manuals (if necessary)
Training of research team members, including assistants
Conducting the pre-test in the research location, with preliminary data analysis and
revision of data-collection tools (if was not done)
1. Editing/cleaning,
2. Categorising and coding,
3. Summarising data on data master sheets, or
4. If a computer is used, writing instructions to the computer analyst concerning data
input and analysis.
216
STEP 6: Evaluation
What are the important preparations one will do before embarking in data collection?
217
Session 22: Data Processing
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Categorize the data
Code the data
Summarize the data in data master sheets
Compile the data manually without master sheets
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 20 minutes Group Categorizing the Data
discussion
20 minutes Presentation
3 Coding the Data
Brainstorming
30 minutes
4 Presentation Summarizing the Data in Data Master Sheets
35 minutes
5 Presentation Compiling the Data Manually without Master Sheets
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
218
SESSION CONTENTS
219
with the person who conducted the interview and to correct the answer.
If the inconsistency is less clearly a mistake in recording, it may be possible (in a small
scale study) to return to the respondent and ask for clarification.
If it is not possible to correct information that is clearly inconsistent, consider excluding
this particular part of the data from further processing and analysis as it will affect the
validity of the study.
If a certain question produces unclear answers throughout, the whole question should be
excluded from further analysis. (Normally, however, you would discover such a problem
during the pre-test and change the wording of the question.)
The Questions to be answered before Processing
o Have the data been sorted appropriately?
o Have questionnaires been numbered?
o Major categories of informants distinguished?
o Have quality checks been performed? For completeness and consistency of
information?
o Has all qualitative data been categorized as far as possible?
Data Processing Quantitative Data
o Decide on the method for processing and analyzing data from questionnaires
Manually, using data master sheets or manual compilation of the questionnaires
By computer, for example, using micro-computer and existing software or self-
written programmes for data analysis
Data processing in both cases involves
o Categorizing/classifying the data
o Coding
o Summarizing the data in data master sheets, manual compilation without master
o sheets, or data entry and verification by computer
Categorizing/Classifying Data
o Decisions have to be made concerning how to categorize responses.
o Categorical variables that are investigated through closed questions or observation,
the categories are decided earlier.
220
o In interviews the answers to open-ended questions, the answers can be pre-
categorized to a certain extent, depending on the knowledge of possible answers that
may be given.
• Answers that are difficult or impossible to categorize may be put in a separate
residual category called others, but this category should not contain more than
5% of the answers obtained.
For numerical variables, the data are often better collected without any pre-categorization.
If you do not exactly know the range and the dispersion of the different values of these
variables when you collect your sample (e.g., home-clinic distance for out-patients, or
income), decisions concerning how to categorize and code the data at the time you
develop your tools may be premature.
If you notice during data analysis that your categories had been wrongly chosen you
cannot reclassify the data anymore.
STEP 3: Coding the Data (20 minutes)
Coding
o If the data will be entered in a computer for subsequent processing and analysis, it is
essential to develop a coding system.
o For computer analysis, each category of a variable can be coded with a letter, group of
letters or word, or be given a number.
For example, the answer yes may be coded as Y or 1; no as N or 2 and no
response or unknown as 'Ú' or 9.
o The codes should be entered on the questionnaires (or checklists) themselves.
o When finalising your questionnaire, for each question you should insert a box for the
code in the right margin of the page.
o These boxes should not be used by the interviewer. They are only filled in afterwards
during data processing.
o Take care that you have as many boxes as the number of digits in each code.
o If analysis is done by hand using data master sheets, it is useful to code your data as
well
o Coding conventions
o Common responses should have the same code in each question, as this minimizes
mistakes by coders.
o For example
221
Yes (or positive response) code - Y or 1
No response/unknown code - U or 9
Codes for open-ended questions (in questionnaires) can be done only after examining a
sample of (say 20) questionnaires.
o You may group similar types of responses into single categories, so as to limit their
number to at most 6 or 7.
o If there are too many categories it is difficult to analyse the data.
Remember that the personnel responsible for computer analysis should be consulted very
early in the study
1 Y 4 PS N 1 3
2 Y 9 SS N 4 NA
3 N NA NA NA 5 NA
4 U PS Y 0 2
In any small scale study processed by hand in which groups will be compared, a
different master sheet should be made for each of those groups, e.g., good and poor
compliers to treatment.
As gender is an important cross-cutting theme, it is usually also advisable to subdivide
males and females within each of the groups that are being compared
222
STEP 5: Compiling the Data Manually without Master Sheets (35 Minutes)
When the sample is small (say less than 30) and the collected data is limited, it might be
more efficient to do the compilation manually
Certain procedures will help to ensure accuracy and speed.
o If only one person is doing the compilation use manual sorting.
o If a team of 2 persons work together use either manual sorting or tally counting.
Manual sorting can be used only if data on each subject is on a different sheet of paper/
entered in a separate questionnaire.
In manual sorting the basic procedure is to:
o Take one question at a time, for example, use of health facility,
o Sort the questionnaires into different piles representing the various responses to the
question, e.g., hospital/ health centre/ traditional practitioners) and
o Count the number in each pile.
To do tally counting the basic procedure is:
o One member of the compiling team reads out the information while the other records
it in the form of a tally (e.g., III representing 3 subjects)
o Tally count for no more than two variables at one time (e.g., sex plus type of facility
used)
o After tally counting, add the tallies and record the number of subjects in each group.
Then doing either manual or tally counting, check the total number of subjects/responses
in each question to make sure that there has been no omission or double count
It should be noted that hand tallying is often used in combination with master sheet
analysis when the relationship between two or three variables needs to be established, or
details analyzed
223
STEP 7: Evaluation (5 minutes)
How are the data categorised?
How are the data coded?
How are the data Summarised?
224
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
225
Session 23: Data Analysis
Learning Tasks
By the end of this session students are expected to be able to:
Describe data in terms of frequency distribution, percentages and proportion
Use figures to present data.
Explain the difference between mean, mode and median
Calculate the frequencies, percentages, proportion, ratios, rates means, medians,
modes for major variables.
Identify variables that are necessary for analysis of the collected data
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
226
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Description of Data in Terms of Frequency
2 15 minutes
Brainstorming Distribution, Percentages and Proportion
10 minutes
3 Presentation Using Figures to Present Data.
20minutes Presentation
4 Group Difference Between Mean, Mode and Median
discussion
20 minutes
Calculation of the Frequencies, Percentages,
5 Presentation Proportion, Ratios, Rates Means, Medians, Modes for
Major Variables.
40 minutes
6 Presentation Identification of Variables that are Necessary for
Analysis of the Collected Data
7 05 minutes Presentation Key Points
8 05 minutes Presentation Evaluation
SESSION CONTENTS
227
Smokers 51
Non-smokers 93
Total 144
• If numbers are large enough it is better to calculate the frequency distribution in
percentages (relative frequencies):
o 51/144 x 100 = 35% are smokers and 93/144 x 100 = 65% non-smokers.
o This makes it easier to compare groups than when only absolute numbers are
given. In other words, percentages standardize the data.
It is usually necessary to summarize the data from numerical variables by dividing them
into categories. This process may include the following steps:
o Inspect all the figures: What is their range? (The range is the difference between the
largest and the smallest measurement.)
o Divide the range into three to five categories. You can either aim at having a
reasonable number in each category (e.g. 0-2 km, 3-4 km, 5-9 km, 10+ km for home-
clinic distance) or you can define the categories in such a way that they are each equal
in size (e.g., 20-29 years, 30-39 years, 40-49 years, etc.)
o Construct a table indicating how data are grouped and count the number of
observations in each group.
o Categorical data
Bar charts
Pie charts
Bar charts
o Is simplest and most effective means of illustrating qualitative data
o Bars can either be horizontal or vertical
o Eg.57 Adolescents from Kaloleni streets in Arusha were asked the following question:
How often have you used cannabis for the past one year? This was closed question
with the following possible answers
228
o Frequently(more than 5 times),Occasionally ( 3 to 5 times), rarely (1 to 2 times)and
never
Categories Number Percentage
Frequently 7 12.2
Occasionally 9 15.8
Rarely 10 17.5
Never 31 54.4
Total 57 100
Pie charts
o Provides quick view of data presented in different form.
o Used in qualitative number with few categories to avoid congestion
229
Histograms
o Numerical data are often presented in histograms
o Which are similar to bar charts important difference is that in histogram the
bars are connected(as long as there is no gap between the data where as in bar
charts are not connected as the different categories are distinct entitles)
Line graphs
o Particularly useful for numerical data if you want to show Trend over time
o It is easy to show two or more distribution in one graph as long as difference
between lines are easy to distinguish e.g. age distribution between males and
females
STEP 4: The Difference Between Mean, Mode and Median (30 minutes)
Mean
o The mean of a data set is also known as the average value. It is calculated by dividing
the sum of all values in a data set by the number of values.
o So in a data set of 1, 2, 2, 3, 4, 5, we would calculate the mean by adding the values
(1+2+2+3+4+5) and dividing by the total number of values (6). Our mean then is
17/5, which equals 3.4
Mode
o The mode is the most common observation of a data set, or the value in the data set
that occurs most frequently.
o The example of the mode in: 1, 2, 2, 3, 4, 5, is 2
o The mode is an appropriate measure to use with categorical data
230
Median
o The median of a data set is the value that is at the middle of a data set arranged from
smallest to largest.
o In the data set 1, 2, 3, 4, 5, the median is 3.
o In a data set with an even number of observations, the median is calculated by
dividing the sum of the two middle values by two. So in: 1, 2, 2, 3, 4, 5, the median is
(2+3)/2, which equals 2.5.
o The median is appropriate to use with ordinal variables, and with interval variables
with a skewed distribution
Male 34
Female 27
Total 61
231
Count number of measurement(wt. of nurses) in each group:
31-40 II (34, 38)
41-50 IIIIII (42, 43, 45, 45, 45, 47)
51-60 IIIIII (51, 53, 53, 54, 54, 56)
61-70 III (61, 62, 62)
Add up and check totals.
31-40 12 26.7
41-50 17 37.8
51-60 11 24.4
61-70 5 11.1
Total 45 100
232
o Dont know' is special category that should not counted as missing data.
o Should not be used if total is less than 30, as one unit makes a big difference in terms
of percentage
Proportions
o Sometimes relative frequency are expressed in proportion instead of percentages
o Definition: proportion is numerical expression that compares one party of study units
to the whole.
o Can be expressed in fraction or decimal
Numerator is part of denominator
• E.g. Calculate proportion of modules studied in first semester
Ratio
o It is numerical expression that indicates relationship in quantity or amount or size
between two or more parts.
Numerator is not part of denominator
Example: Ratio of module studied in first semester to module to be studied in
second semester
Rates
o Is quantity or amount or degree of event or disease measured over specified period of
time.
o E.g. Birth rate = number of live birth per 1000 population over period of one year
233
Gender Female
Occupation Lecturer
Race Chinese
Social Class Low
Economic class High
234
Number of children (e.g. 1,2)
Categorical Variables
o Some variables may be expressed in categories. For example, the variable sex has two
distinct categories, male and female.
Figure: Example of categorical variable
Variable Categories
Colour Red, blue, green, yellow
Main type of staple food Maize, rice, millet, cassava
Types of drugs Antibiotics, anti inflammatory
235
Factors Rephrased as Variables
o Most of what we call factors are variables which have negative values.
o Contributing factors in negative phrase are such as lack of knowledge.
Example:
Factor Variables
Long waiting time Waiting time
Absence of drugs Availability of drugs
Lack of supervision Frequency of supervision
o Quantitative variables:
Variables which have definitive quantitative values (age in years- 24 year or 4 years
or weight or height) and can be manipulated according to the rules of mathematics.
Ordinal variables: Variables which do not have numerical values but can be graded
(e.g. level of education as primary school, advanced diploma and bachelor degree or
quality of services as poor, average, good).
Nominal qualitative variables or attributes (do not belong to either of the above)
examples are marital status-married, single, divorced or gender as male or female.
For a selected research problem, you may find that you are interested on many
variables, but to make a research manageable, pick few of them and leave others.
236
o A confounding variable may either strengthen or weaken the apparent relationship
between the problem and a possible cause.
In order to give a true picture of cause and effect, possible confounding variables must be
considered, either at planning stage or while doing data analysis.
For example:
237
o A relationship is shown between compliance with antimalaria treatment and
severe malaria in under-five children. However,mothers education may be related
to compliance with the treament and severe malaria.
o Mothers education is a potential confounding variable. In order to give a true picture
of the relationship between compliance with the treament and severe malaria in under
five children, the influence of mothers education should be controlled.
o This could either be done in the research design, e.g., by selecting only mothers with a
specific level of education, or it can be taken into account in the analysis of the
findings. Then the relation between compilance with antimalaria and severe malaria
would be analyzed separately for mothers with different levels of education.
Background Variables
o Related to a number of independent variables, so they influence the problem
indirectly
o In almost every study, background variables appear, such as
238
Age, sex, educational level, socio-economic status, marital status and religion.
Only background variables important to the study should be measured.
Background variables are notorious confounders.
239
References
Rao, J. S., & Richard, J. (2002). An introduction to bostatistics-a manual for students in
helthsciences.third edition, New delhi, Circus: Asoke k ghosh.
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
240
Session 24: Research Report Writing
Total Session Time: 120 minutes + 240 minutes assignment
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
List the main components of a research report
Make an outline of research report
Write drafts of report in stages
Check the final draft of report for completeness
Draft recommendations for action based on research findings
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation The Main Components of a Research Report
2 15 minutes
Brainstorming
40 minutes Presentation An Outline of Research Report.
3 Group
discussion
4 30 minutes Presentation Drafts of Report in Stages.
241
SESSION CONTENTS
The research report outline should contain the following components in the following
order :
o Title and Cover Page
o Summary of Study Design, Findings and Recommendations
o Acknowledgements
o Table of Contents
o List of tables, figures (optional)
o List of abbreviations (optional)
o Introduction (statement of the problem in its local context, including
relevantliterature)
o Objectives
o Methodology
o Research Findings
o Discussion
o Conclusions and Recommendations
o References
242
o Annexes (data collection tools; tables)
Note: When assigning page numbers to the report, components bullet number 1-6 use small
Roman Numerals (For example: i, ii, iii, iv, v ).
Introduction (Component number 7), is Page 1 of the actual report.
The findings, discussion of findings, conclusions and recommendations will form the
most substantial part of the report, which has to be written from scratch.
It is strongly advised that start with the findings, discussion and conclusions.
Write each component in stages as follows:
o Create an outline
o Write Introduction
o Write the Objectives
o Write the Methodology
o Write your Findings
o Discuss your Findings
o Write conclusions and recommendations
o References
o Annex
o Summary
o Acknowledgement
o Table of contents
o Title and Cover page
ALLOW few groups to present and the rest to add points not mentioned
243
CLARIFY and SUMMARIZE by using the following contents
An outline of a research report:
o Cover page
The cover page should contain the
Title
The names of the authors with their titles and positions,
The institution that is publishing the report, (e.g., Research Unit, Ministry of
Health) and
The month and year of publication.
The title in line with the broad objectives
o Abstract/Summary
The summary should be written only after the first or even the second draft of the
report has been completed. It should contain:
A very brief description of the problem (WHY this study was needed)
The main objectives (WHAT has been studied)
The place of study (WHERE)
The type of study and methods used (HOW)
Major findings and conclusions, followed by
The major (or all) recommendations
The summary will be the first part of the study that will be read.
o Acknowledgements
It is good practice to thank those who supported you technically or financially
in the design and implementation of your study.
Also your employer who has allowed you to invest time in the study and the
respondents may be acknowledged.
Acknowledgements are usually placed right after the title page or at the end of
the report, before the references
o Table of contents
It provides the reader a quick overview of the major sections of your report,
with page references
List of tables, figures
List of abbreviations (optional)
244
The table of contents and lists of tables, figures, abbreviations should be
prepared last
o Chapter 1: Introduction
Contains
Background information
Statement of the problem
Literature review collected during the implementation of the study
o Chapter 2: Objectives
The general and specific objectives should be included as stated in the proposal.
You can adjust them slightly for style and sequence.
If you have not been able to meet some of the objectives state them in the
methodology section and in the discussion of the findings.
o Chapter 3: Methodology
Should be described in detail and include a description of:
The study type
The study population(s), sampling method(s) and the size of the sample(s)
Major study variables
Data-collection techniques and tools used for the different study populations
Ethical consideration
o Chapter 4: Research findings
The systematic presentation of research findings in relation to the research objectives
is the crucial part of a report.
The description of findings should offer a good combination or triangulation of data
from qualitative and quantitative components of the study
There are two different ways in presentation of findings:
An integrated presentation of all data by objective
• As you listed all data by objective this should be easy.
• These integrated presentations will be a compilation of tables, graphs,
narrative interpretation and illustrative quotes from in-depth interviews
or FGDs
245
• Analyze the data by instrument and integrate the findings only in the
discussion.
• Separate analysis is indicated for objectives that are covered by distinct
study populations using specific instruments
• The list of data by objective will help you to decide how to organise
the presentation of data.
• When all data have been analysed, a detailed OUTLINE has to be
made for the presentation of the findings. This will help the decision-
making on how to organize the data
o Chapter 5: Discussion
The findings can now be discussed by
Objective or by cluster of related variables or themes,
The discussion should also include findings from other related studies that support
or contradict your own
o Chapter 6: Conclusions and Recommendations
They should follow logically from the discussion of the findings
Conclusions should be short
It should follow the sequence in which the findings have been presented.
The recommendations should be summarized according to the groups towards
which they are directed (specific), e.g. Policy-makers, managers, communities,
students etc.
o References
APA
o Annexes or Appendices
They should contain any additional information needed to enable professionals to follow
your research procedures and data analysis.
Examples :
Tables referred to in the text but not included in order to keep the report short;
Lists of hospitals, districts, villages etc. That participated in the study
Questionnaires or check lists used for data collection.
246
positions, the institution that is publishing the report, (e.g. Pharmacy Council of the
MOH Tanzania), the month and year of publication.
o The title could consist of a challenging statement or question, followed by an
informative subtitle covering the content of the study and indicating the area where
the study was implemented.
Summary
o The summary should be written only after the first or even the second draft of the
report has been completed.
o It should contain:
A very brief description of the problem (why this study was needed)
The main objectives (what has been studied)
The place of study (where)
The type of study and methods used (how)
Major findings and conclusions, followed by
The major (or all) recommendations
The summary will be the first (and for busy health decision makers most likely the only)
part of your study that will be read.
Several drafts have to be made, each discussed by the research team as a whole.
o If you collaborated with various groups during the drafting and implementation of the
research proposal, then consider writing different summaries for each of these groups.
o For example, you may prepare different summaries
For policy makers and health managers
For health staff of lower levels
For community members
For the public at large (newspaper, TV)
o In a later stage you may write articles in scientific journals
Acknowledgements
o Thank those who supported technically or financially in the design and
implementation of your study.
o Acknowledgements are usually placed right after the title page or at the end of the
report, before the references.
Table of Contents
o A table of contents is essential
247
o It provides the reader a quick overview of the major sections of your report, with page
references, so that she/he can go through the report in a different order or skip certain
sections.
List of Tables, Figures
o If there are many tables or figures, then they may be listed in a table of contents type
of format with page numbers.
List of Abbreviations (optional)
o If abbreviations or acronyms are used in the report, these should be stated in full in
the text the first time they are mentioned
o If there are many, then they should be listed in alphabetical order as well
o The list can be placed before the first chapter of the report.
o The table of contents and lists of tables, figures, abbreviations should be prepared last
o A t this time include the page numbers of all chapters and sub-sections in the table of
contents.
Finalize the numbering of figures and tables and include all abbreviations.
Chapter 1: Introduction
o Should contain relevant (environmental/ administrative/ economic/ social)
background data about the country, the health status of the population, and health
service data which are related to the problem that has been studied.
o The statement of the problem should follow
o Relevant literature collected during the implementation of the study.
o It should contain a paragraph on what you hope to achieve with the results of the
study.
Chapter 2: Objectives
o The general and specific objectives should be included as stated in the proposal.
o If you have not been able to meet some of the objectives this should be stated in the
methodology section and in the discussion of the findings.
o The objectives form the HEART of your study. They determined the methodology
you chose and will determine how you structure the reporting of your findings.
Chapter 3: Methodology
o The methodology you followed for the collection of your data should be described in
detail. This section should include a description of:
248
The study type;
Major study themes or variables (a more detailed list of variables on which data was
collected may be annexed);
The study population(s), sampling method(s) and the size of the sample(s);
Data-collection techniques used for the different study populations; how the data was
collected and by whom;
Procedures used for data analysis, including statistical tests (if applicable)
4.1 Description of the sample: (e.g., location, age, marital status, education,
social
economic status, of mothers; age and sex of children weight/measured by
research area).
4.2 Extent and seasonal variation of malnutrition in district X
4.3 Possible causes of malnutrition
4.3.1 Limited availability of food
4.3.2 Non-optimal utilization of available food
4.3.3 High prevalence of communicable diseases
4.3.4 Limited access to Reproductive and Child Health (RCH) and weaknesses
in RCH/nutrition services
249
o The system of numbering is flexible and can be extended according to need with
further headings or subheadings.
o The outline for the chapter on findings will predictably be the most elaborated.
o The first section under findings is usually a description of the study population.
o If different study populations have been studied, then provide a short description of
each group before presenting the data pertaining to these informants.
o Depending on the study design, provide more information on the problem studied
(size, distribution, characteristics).
o In an analytic study, the degree to which different independent variables influence the
problem has be discussed.
o Tables and figures in the text need numbers and clear titles.
o Include only those tables and figures that present main findings and need more
elaborate discussion in the text.
o The first draft of your findings is never final.
o Therefore you might concentrate primarily on content rather than on style.
o Nevertheless, it is advisable to structure the text from the beginning in paragraph
.
Chapter 5: Discussion
o The findings can be discussed by objective or by cluster of related variables or
themes, which should lead to conclusions and possible recommendations.
o The discussion may include findings from other related studies that support or
contradict your own.
250
Policy-makers
Health and health-related managers at district or lower level
Health and health-related staff who could implement the activities
Potential clients
The community at large
o Remember that action-oriented groups are most interested in this section.
o In making recommendations, use not only the findings of the study, but also
supportive information from other sources.
o The recommendations should take into consideration the local characteristics of the
health system, constraints, feasibility and usefulness of the proposed solutions.
o They should be discussed with all concerned before they are finalized.
o If the recommendations are short (roughly one page), include them all in the summary
and omit them as a separate section in Chapter 6 in order to avoid repetition.
References
o The references in your text can be numbered in the sequence in which they appear in
the report and then listed in this order in the list of references (Vancouver system).
o Another possibility is the Harvard system of listing in brackets the authors name(s) in
the text followed by the date of the publication and page number, for example:
Annexes or Appendices
o The annexes should contain any additional information needed to enable professionals
to follow your research procedures and data analysis.
o Information that would be useful to special categories of readers but is not of interest
to the average reader can be included in annexes.
o Examples of information that can be presented in annexes are:
Tables referred to in the text but not included in order to keep the report short;
lists of hospitals, districts, villages etc. that participated in the study;
Questionnaires or check lists used for data collection.
Revising and Finalizing the Text
o When a first draft of the findings, discussion and conclusions has been completed, all
working group members should read it critically and make comments.
o The following questions should be kept in mind when reading the draft
Have all important findings been included?
Do the conclusions follow logically from the findings?
251
If some of the findings contradict each other, has this been discussed and explained, if
possible?
Have weaknesses in the methodology, if any, been revealed?
Are there any overlaps in the draft that have to be removed?
Is it possible to condense the content?
In general a text gains by shortening. Some parts less relevant for action may be
included in the annex
Check if descriptive paragraphs may be shortened and introduced or finished
by a concluding sentence.
Do data in the text agree with data in the tables?
Are all tables consistent (with the same number of informants per variable), are they
numbered in sequence, and do they have clear titles and headings?
Is the sequence of paragraphs and subsections logical and coherent?
Is there a smooth connection between successive paragraphs and sections?
Is the phrasing of findings and conclusions precise and clear?
For a final check on readability you might skim through the pages and read the first
sentences of each paragraph. If this gives a clear impression of the organization and
results of the study, then one may conclude that you did the best you could.
252
Checking whether the format has been followed
Revising and finalizing the text
o When a first draft of the findings, discussion and conclusions has been completed, all
working group members and facilitators should read it critically and make comments.
o The following questions should be kept in mind when reading the draft:
Have all important findings been included?
Do the conclusions follow logically from the findings?
Have weaknesses in the methodology, if any, been revealed?
Are there any overlaps in the draft that have to be removed?
Is it possible to condense the content?.
Do data in the text agree with data in the tables and figures? Are all tables and
figures consistent (with the same number of informants per variable), are they
numbered in sequence, and do they have clear titles and headings?
Is the sequence of paragraphs and subsections logical and coherent? Is there a
smooth connection between successive paragraphs and sections? Is the phrasing of
findings and conclusions precise and clear?
STEP 6: Drafting Recommendations for Operational Research Findings
(10 Minutes)
Recommendations
o They should follow logically from the discussion of the findings
o It should follow the sequence in which the findings have been presented.
o The recommendations should be summarised according to the groups towards which
they are directed (specific), e.g.
Policy-makers, managers, communities, students etc.
253
What is an outline of a research report?
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,
Anthropology of health and health care, third revised edition,, Het Spinhuis Publishers, The
Netherlands
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
254
Session 25: Methods for Dissemination of Research
Findings
Prerequisites
None
Learning Tasks
By the end of this session students are expected to be able to:
Define dissemination of research findings
List various dissemination channel and tools
Describe dissemination strategy of research finings
List dissemination content of research findings
Resources Needed
Flip charts, marker pens, and masking tape
Black/white board and chalk/whiteboard markers
Computer and LCD
SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 10 minutes Definition of Dissemination of Research Findings
Buzzing
40 minutes Presentation
3 Group Dissemination Channel and Tools
discussion
35 minutes
4 Presentation Dissemination Strategy of Research Findings
10 minutes
5 Presentation Dissemination Content of Research Findings
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
255
SESSION CONTENTS
ASK students to pair up and buzz on the following question for 2 minutes:
What is dissemination of research findings?
ALLOW few pairs to respond and let other pairs to add on points not mentioned
ALLOW few groups to present and the rest to add points not mentioned
256
The following are dissemination channels
o Community meetings
o Interpersonal communication
o Local events
o Web sites
o Email messages
o Project team conference/meetings
o Policy briefs
o Dissemination workshops
o Technical reports
o Scientific seminars
o Mass media
o Scientific publication
o Communication of research findings
Some of the channels and their instruments are shown as follows:
257
o Personal briefings
Personal briefings would have to be organized between research team members
and the Ministry of Health Community Development Gender Elderly And
Children
o Mass media
When action is planned, one should also think of the mass media as information
channel:
Newspapers,
Radio,
TV,
Posters.
These are effective in disseminating information to a wide range of audiences
Mass media and interpersonal channels may fruitfully complement each other
o Identify key contact persons in each news organization, including reporters who cover the
area of your research,
Approach them through a letter to the news editor including relevant information
about your study
o Existing summaries of the study may be used
o Articles in research journals
o Presentation of research results to interested students and staff
To present results from research at research days to a selected group of health
managers and health researchers
258
in your own local area, as well as others.
o Research team and program should benefit from the results, as they have developed
the proposal to help solve one of their own priority problems.
Strategies to Ensure the Results of the Study will be Used
o Involve relevant authorities, staff and community members in the selection of the
topic and in the definition of your problem.
o List two or three major recommendations you expect to obtain from the study
o Identify who should be involved in their implementation.
o Distinguish between two categories of people who should be involved.
Those who authorize you to implement the recommendations.
Partners in the implementation process.
Identify which communication channels already exist which can be used to discuss and
disseminate results.
Channels for discussing and disseminating results may include
o Provincial or district development team meetings.
o Provincial or district health team meetings.
o Supervisory visits to health facilities involved, staff meetings.
o Mobile clinics or other health activities carried out in villages included in the study,
monthly meetings of village health workers when they collect drugs, meetings of
village health committees.
Determine what written materials should be prepared to keep relevant parties informed.
They may include:
o A one to two page summary of the project proposal that includes details on expected
results to distribute when you introduce the project to policy makers and staff
concerned.
o An introductory statement to use with interview guides and questionnaires, explaining
to informants the purpose and procedures of the study, as well as expected results.
A progress report of four to five pages, including preliminary findings and
recommendations, should be prepared for presentation of the data analysis and report
writing workshop.
o Used to inform authorities that will be crucial to utilization of project results.
To obtain feedback from decision makers and target groups in the community, you will
259
need a different summary, concentrating in simple words on the findings and preliminary
recommendations that directly concern them.
Make sure that summaries of your findings and preliminary recommendations are adapted
to the level of understanding and interests of different audiences
o This will increase their motivation to provide thorough feedback and to participate in
the implementation of the final recommendations collectively agreed up on.
Determine whether additional actions should be taken or mechanisms developed to
discuss the study results with all parties concerned and obtain their input, approval and
co-operation for the implementation of the recommendations
Key Steps
Develop and use a systematic dissemination and communication strategy for reaching
different audiences of potential users.
Present the research results to all stakeholders and obtain feedback on findings and
recommendations.
Develop a plan of action to promote the implementation of the recommendations that
resulted from the study.
STEP 5: Dissemination Contents of Research Findings (10 minutes)
Technical issues
Societal issues
Ethical issues
Personnel/organizational issues
Kothari C.R (1985). Research Methodology Methods and techniques, 2nd edition, Wiley
Eastern Limited New Delhi
Polit, D. F and Beck, C. T (2004). Nursing Research Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia
262