Fact Sheet - Data Quality Assurance - Fs-06-08

Data Quality Assurance
Strategies for improving public health M&E capabilities

At MEASURE Evaluation, we believe that improved
analysis and use of data lead to better health program
decision-making and, ultimately, improved health out-
comes. MEASURE Evaluation has developed innova-
tive tools for strengthening the monitoring and evalua-
tion (M&E) of public health interventions.
National public health programs and donor-funded

projects are working together to achieve ambitious
goals for the care and treatment of patients with HIV/
AIDS, tuberculosis, or malaria, and the prevention of
new infections. Resources for these vital programs are
finite, and must be managed wisely. Consequently,
funding has been increasingly tied to performance, and
program managers must show effectiveness to warrant level Indicators. The tool focuses primarily on two da-
continued investment. The quality of data generated ta-quality issues intrinsic to PEPFAR’s monitoring and
by monitoring and evaluation systems is imperative if evaluation needs: the “upstream” and “downstream”
program effectiveness is to be evaluated accurately. framework for target setting and results reporting; and
However, many national programs and implementing concerns involving double-counting of data.
partners are new to reporting results, and need effec-
tive tools for assuring the quality of their data. Data Quality Audit (DQA) Tool and Routine Data
Quality Assessment (RDQA) Tool — The MEASURE
To address the need for good quality data for pub- Evaluation data quality portfolio includes auditing
lic health programs, MEASURE Evaluation and col- tools (DQA) designed for use by independent audit
laborating partners have developed a suite of tools teams, and self-assessment tools (RDQA) that facilitate
for strengthening M&E systems, and assessing and capacity building and other flexible uses.
enhancing data quality. These data quality assurance
tools and methods enable programs and projects to The data quality tools have both qualitative and
evaluate the quality of data for selected priority indi- quantitative assessment components, which enable a
cators and identify problem areas to target for system holistic review of data quality and the strengths and
strengthening activities. weaknesses of the information system. The DQA in-
cludes a guide, Data Quality Audit Tool: Guidelines
Data Quality Assurance Tool for Program-Level for Implementation, and a series of indicator-specific
Indicators — This tool addresses the essential param- data verification templates in Microsoft Excel tailored
eters of data quality assurance needed within the U.S. for specific diseases, such as HIV/AIDS, tuberculosis,
President’s Emergency Plan for AIDS Relief (PEPFAR) or malaria. The Global Fund for AIDS, Tuberculosis
system of results reporting. It provides an overview of and Malaria uses the DQA as part of its performance
the data quality assurance tools for PEPFAR program- based funding mechanism and is available in English,
MEASURE Evaluation is funded by the U.S. Agency for International Development through Cooperative Agreement
GHA-A-00-08-00003-00 and is implemented by the Carolina Population Center, University of North Carolina at Chapel
Hill, in partnership with Futures Group International, ICF Macro, John Snow, Inc., Management Sciences for Health, and
Tulane University. FS-06-08 (9/10/09).
Figure 1. Framework
Framework for Improving
for Improving DataData Quality
Quality
INDICATOR
SYSTEMS APPROACH AUDITING APPROACH
APPROACH
Is the Program/Project M&P plan Are appropriate data management

complete and measurable? systems in place?
Are data management systems in What are the Data Quality challenges
place to ensure data quality? in collecting specific indicator data
Are good data reporting systems in Is reported data accurate and valid?
place?
CAPACITY BUILDING FOR M&E

CREATING DEMAND FOR QUALITY DATA AND FACILITATING INFORMATION USE
Impoving data quality requires attention to the systems that produce the data and dimensions of the indicators that may be subject to data
quality challenges (such as double counting of individuals served and incorrectly counting those served directly and indirectly through
program interventions). Furthermore, data quality audits can help periodically assess the accuracy, reliability, comprehensiveness, timeliness,
and integrity of information reported through programs.
French and Spanish. The DQA was developed collab- national stakeholders’ workshop. MESST helps iden-
oratively with the global fund, World Health Organiza- tify strengths and weaknesses in an M&E system and
tion (WHO), the Joint United Nations Programme on facilitates the development of a system-strengthening
HIV/AIDS (UNAIDS), and PEPFAR. work plan. Since 2007, MESST has been part of the
global fund’s performance-based funding mechanism
The RDQA is designed as a capacity-building and and is a prerequisite for mid-term funding evaluations.
self-assessment version of the DQA tool. The RDQA The global fund and PEPFAR collaborated with MEA-
enables national programs or donor-funded projects SURE Evaluation to develop this tool. MEASURE Evalu-
to evaluate their own data quality, improve the per- ation has also helped develop an enhanced version
formance of reporting, and prepare for data quality of MESST for UNAIDS, designed specifically for HIV/
audits. The RDQA facilitates the identification of prob- AIDS programs: 12 component M&E System Strength-
lem areas and the creation of M&E system strengthen- ening Assessment Tool.
ing action plans. The RDQA includes the Routine Data
Quality Assessment: Guidelines for Implementation These tools are available from the MEASURE Evalua-
and its Microsoft Excel template, a checklist and auto- tion Web site at:
mated dashboard to assist in interpreting assessment www.cpc.unc.edu/measure/tools/monitoring-evalua-
results. The RDQA is also available in French and Por- tion-systems/data-quality-assurance-tools
tuguese. Collaborating with MEASURE Evaluation in
developing the RDQA were the Office of the Global For more Information
AIDS Coordinator, PEPFAR, the global fund, and the David Boone
WHO. david_boone@jsi.com
MEASURE Evaluation
Monitoring and Evaluation Systems Strengthen- Carolina Population Center
ing Tool — The Monitoring and Evaluation Systems University of North Carolina at Chapel Hill
Strengthening Tool (MESST) is designed to evaluate 206 W. Franklin St., CB 8120
the components of an M&E system (e.g., an over- Chapel Hill, NC 27516
all M&E plan, data management capacity, and data 919-966-7482
reporting streams) through a facilitator-moderated www.cpc.edu/measure

Fact Sheet - Data Quality Assurance - Fs-06-08

Uploaded by

Copyright:

Available Formats

Fact Sheet - Data Quality Assurance - Fs-06-08

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Fact Sheet - Data Quality Assurance - Fs-06-08

Uploaded by

Copyright:

Available Formats

Data Quality Assurance

Strategies for improving public health M&E capabilities

National public health programs and donor-funded

Is the Program/Project M&P plan Are appropriate data management

CAPACITY BUILDING FOR M&E

You might also like