Participatory Monitoring and Evaluation: A Process To Support Governance and Empowerment at The Local Level
Participatory Monitoring and Evaluation: A Process To Support Governance and Empowerment at The Local Level
Participatory Monitoring and Evaluation: A Process To Support Governance and Empowerment at The Local Level
evaluation:
a process to support governance and
empowerment at the local level
A guidance paper
Thea Hilhorst
Irene Guijt
June 2006
PARTICIPATORY MONITORING AND EVALUATION: A PROCESS TO SUPPORT
GOVERNANCE AND EMPOWERMENT AT THE LOCAL LEVEL
A guidance paper
Thea Hilhorst
KIT (Royal Tropical Institute), Amsterdam, The Netherlands. E-mail : t.hilhorst@kit.nl
Irene Guijt
Learning by Design, Randwijk, The Netherlands. E-mail: iguijt@learningbydesign.org
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Table of contents
1 INTRODUCTION............................................................................................................................ 1
5/Dev/06.091/TH
July 2006, 558 129
i
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
BOXES
BOX 10. CSO USING CONVENTIONAL M&E TO IMPROVE SERVICE DELIVERY ......................... 25
BOX 13. JOINT MONITORING PUBLIC HEALTH AT THE LOCAL GOVERNMENT LEVEL........... 29
ii
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Acknowledgements
Thanks to Aditi Sen, CDD anchor at the WB, for providing timely support and
information. We are grateful to Jean Delion, Dan Murphy, Aditi Sen, Haddy Jatou Sey
and Mark Woodward for thoughtful comments received on earlier drafts. Colleagues from
KIT, notably Gerard Baltissen and Wim van Campen provided important feedback and
information.
iii
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
ACRONYMS
iv
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
1 Introduction
The ‘local level’ in this paper refers to primary beneficiaries in two contexts. One is the
lowest sub-national governance level where elected local government and ‘frontline’
service providers engage with citizens and their organizations. These formal, territorial
units may refer to a region, a district, a rural or an urban municipality, implying great
variation in area, population density, economic development, available capacities and
infrastructure - all of which have implications for the potential and practice of PM&E.
The second context that these guidelines address is communities that lack an
administrative or legal status but are nonetheless the focus of much human activity and
development work. This may include villages, hamlets, urban neighbourhoods, nomadic
camps and other types of human settlements. Some World Bank financed projects, such as
those promoting Community Driven Development (CDD) 1 , target this level for supporting
investments in basic infrastructure, economic development and capacity building of
community-based organizations.
This guidance paper starts with an introduction to PM&E in Chapter 2 and outlines a
framework for assessing governance at the local level and the role of decentralization in
Chapter 3. Chapter 4 explores the potential benefits of PM&E for local governance, for
key actors (local government, service providers and civil society organizations), and for
multi-stakeholder processes. The fifth chapter sets out operational guidelines for
1
CDD is often embodied in the next generation of social fund programs. A key difference is that
decision-making about resource allocation is made by local communities and not social fund staff.
1
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
introducing and embedding PM&E into World Bank activities and is illustrated with
examples from practice.
2
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
This chapter starts by defining PM&E and its core principles. It then discusses the range
of purposes that PM&E can fulfil in practice, also noting a series of common pitfalls. The
chapter proceeds by highlighting the recent shift in M&E practice from a largely
accountability-oriented mechanism to focusing on its contribution to learning for
improved actions. A specific consideration rounds off this chapter: that of tracking change
in contexts of uncertainty.
Monitoring and evaluation is about assessing actual change against stated objectives, and
making a judgement whether development efforts and investments were worthwhile or
‘cost-effective’ 4 . Therefore, M&E systems are generally constructed to provide
information for reporting on achievements in order to fulfil accountability responsibilities.
This has led to M&E being largely associated with a controlling and accountability
function. Increasingly, however, there is recognition that M&E systems may also
contribute to strategic management and learning lessons; and to feeding experiences into
policy processes.
Social accountability is defined by the World Bank as an approach that relies on civic
engagement in public affairs. PM&E differs from social accountability as it is applied to
interventions within the realm of control of primary stakeholders. Therefore they are in a
position to act upon findings. The PM&E process may also help to clarify rights and
2
Waglé and Shah, 2003
3
Citizenship involves the claiming of rights, which is not possible for all people, such as refugees. Not
all residents are citizens in an active sense, although they might be legally considered as such, because
they are unfamiliar with their rights and therefore do not pursue them.
4
IFAD, 2002
3
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
responsibilities and, where needed, formulate demands towards other actors and articulate
these in the appropriate fora for dialogue and decision-making. PM&E becomes linked to
social accountability.
- Supporting strategic management – providing the information for and facilitating the
processes required to set and adjust goals, objectives and strategies towards improving
quality and performance;
- Knowledge generation and sharing – generating new insights that contribute to the
established knowledge base in a given field. This includes documenting lessons learned
for sharing and feeding into policy reforms that can further enhance performance;
The special focus of this guidance paper is Participatory M&E. PM&E is defined here as a
process where primary stakeholders – those who are affected by the intervention being
examined – are active participants, take the lead in tracking and making sense of progress
towards achievement of self-selected or jointly agreed results at the local level, and
drawing actionable conclusions. The effectiveness (and sustainability) of such a process
requires that it be embedded in a strong commitment towards corrective action by
communities, project management and other stakeholders in a position to act.
5
Guijt and Gaventa, 1998
4
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
as linking monitoring to action. The PM&E process is build around agreeing on expected
results and milestones, defining how to track progress, collecting required data,
undertaking joint analysis and decide on actions. Capacity building, collaborative learning
and empowerment result from working together in this cycle of analysis and action.
5
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Participatory diagnosis, priority setting, and planning have become an accepted ethic and are
practiced in hundreds of Northern and Southern development initiatives. However,
‘participation’ should also address implementation, monitoring and evaluation. There is a
rapidly growing interest in ensuring wider participation, and since the mid 1990s, the term
‘participatory M&E’ (PM&E) has received increasing attention 6 .
PM&E is being asked to fulfil a wide range of purposes for different stakeholders - some
for citizens, some for service providers, some for government agencies and some for
projects, programs or partnerships. Alongside the range of purposes that are possible to
6
Action for Social Advancement, 2005; Estrella et al., 2000; IIED, 1998; Shah et al., 1993; Woodhill
and Robins, 1998; Toledano et al., 2002. The World Bank published its first technical paper on PM&E
in 1993 (Narayan, 1993).
6
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
pursue with more participatory forms of M&E is its growth as a generic term 7 and about
which there is no common understanding. This makes it imperative to be clear about what
is being pursued with PM&E. Is the focus of PM&E mostly on monitoring (tracking and
feedback)? Is it on evaluation (valuing and performance review)? Or is it more on
‘strengthening and deepening participation’ (shared learning, joint decision-making,
mutual respect, co-ownership, democratisation and empowerment) 8 ?
Initially, for example, the emphasis lay with making prevailing (conventional) M&E
systems more participatory (putting the ‘P’ in M&E). This has generated initiatives that
focused on involving primary stakeholders in determining objectives and indicators,
developing locally feasible data collection methods and seeking ways in which analysis
could be community-based. Much of this experimentation occurred at village level.
Examples include the tracking of progress by farmers of their agroforestry activities,
community groups assessing the impact of anti-poverty programs in the USA, or self-
monitoring of leadership capacity-building 9 .
Recent years have seen a diversifying of contexts in which the ideas of PM&E have been
applied and, therefore, of methodological innovation. Examples are an explicit integration
of M&E into participatory processes and locally managed interventions (putting M&E in
the ‘P’); and using PM&E to strengthen adaptive management and organizational learning
(see next sections).
It is important not to assume that different purposes can automatically be achieved within
a single approach or process. Each purpose has different requirements in terms of
capacities, information systems, resources and minimal conditions for success. Expecting
several or even all purposes to be equally well fulfilled within a short time frame may
prove overly optimistic and lead to disillusion (see Chapter 5 on ‘Operational
Guidelines’).
7
Other terms used to describe PM&E practice are: Participatory monitoring; Participatory evaluation;
Participatory assessment, monitoring and evaluation; Participatory impact monitoring; Process
monitoring; Self-monitoring/self evaluation; Auto-evaluation; Stakeholder based evaluation/assessment;
Empowerment evaluation; Community monitoring; community-based monitoring and evaluation;
community driven M&E (in World Bank documents); Citizen monitoring; Participatory planning,
monitoring and evaluation; Transformative participatory evaluation
8
Estrella et al., 2000
9
Estrella et al., 2000; Gaventa et al., 1998; Guijt and Gaventa, 1998, Action Aid, 2005; Yanggen et al.,
2004
7
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
For PM&E to be effective, choices have to be made regarding initial and longer-term
objectives in order to build a feasible and inspiring process that can evolve towards
fulfilling multiple purposes. Thus, the following four aspects have to be clarified 10 :
Required time frame – Should efforts be invested in establishing longer term monitoring
mechanisms or is a shorter tracking initiative sufficient?
Related type of decision-making. Who or what does the information need to influence, and
therefore into what decision-making space should the information be fed? What different
priorities, processes and calendar of activities govern these spaces that need to be
understood if information is to inform decisions?
Degree of participation of stakeholders. Who is essential to have involved and why
(ownership of analysis, their perspectives, resulting decisions, etc)? What would their role
ideally be? What support do they need for their participation to be meaningful and not
window dressing?
Depth of analysis and degree of rigour. To achieve the purpose with those identified as key
stakeholders, what degree of rigour and depth of analysis should be aimed for? To
‘empower’ citizens to monitor local service providers may require less scientifically
rigorous data than seeking clarity about precise water quality management strategies.
Combined pressures to improve the quality and adequacy of performance, while working
more efficiently and effectively, are encouraging also agencies and projects to ask the
10
Guijt (ed.), 2006
11
Guijt (ed.), 2006; IFAD, 2002 see Annex D for many ideas
8
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
question of how they can learn better to improve their work – not just account for it. The
core questions shift from what has happened to why has there been success or failure and
so what are the practical and strategic implications 12 (see Box 3). One example of
learning-focused M&E is provided by a guide that was developed specifically for CDD
projects 13 .
Learning-focused M&E and PM&E become synonymous, when the aim is to make
interventions more demand responsive, inclusive, empowerment-oriented and sustainable
by bringing voices of broader stakeholder groups systematically into discussions on
strategies and performance.
12
Woodhill, 2006
13
Action for Social Advancement, 2005
9
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
For programs, projects and partnerships working under these uncertain and dynamic
circumstances, this constitutes continual adaptation – incorporating new stakeholders and
adjusting the roles of existing partners, modifying processes, refocusing priorities,
strategies and practices, and so forth. Conscious attention is needed to signs that herald the
need for such adjustments and that help indicate what shape changes must take. This
awareness has stimulated greater appreciation for an adaptive management approach in
which information generated through monitoring is used for refining implementation
strategies and even goals, as circumstances require. Monitoring and implementation are
intertwined and mutually reinforcing
14
Woodhill, 2006 forthcoming
15
IFAD, 2002;Woodhill, 2006; see also Crawford et al., 2004 on embedding PM&E in an Education
Sector Support Program
10
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
PM&E can focus on the prevalence of certain resources, harvesting methodologies, quality of
social interactions between users, etc. Monitoring efforts may be comprehensive,
encompassing all issues within a forest area or very specific, such as beekeeping or a specific
(over-exploited) grass type. In some cases, all groups involved choose to develop a single
common framework for observing the effectiveness of their plans and the unexpected
outcomes. In other situations, each sub-group identifies its own monitoring priorities.
Case studies on experiences with PM&E in collaborative forest management report various
benefits:
- Improved understanding of the resource, the institutional environment, and of visions and
management options of the various stakeholders involved;
- Increased capacity and willingness to question previously accepted technical and institutional
norms;
- More informed decision-making;
- Shifting perception of monitoring as a form of policing towards monitoring as mutually
beneficial for management;
- Improved quality of partnership interactions and communication;
- Increased equity regarding voice and flow of benefits;
- Improved conflict management;
- Enhanced sustainability by using less harmful forest resource management practices.
16
Ghimire and Pimbert, 1997;Gunderson and Holling, 1995; Hinchcliffe et al., 1999; Jiggins and
Röling, 2000; Lee, 1999; McDougall et al., 2006; Roe and Eeten, 1999
11
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
This chapter starts with an analysis of the decentralization process and implications for
local governance. It then moves on to identifying four characteristics that determine the
quality of governance. These serve as a framework for integrating PM&E into local
governance initiatives. The chapter ends with a section on stakeholders that play a role in
PM&E: citizens and their organizations; local government and service providers.
Increasingly, the World Bank and other development institutions are supporting
decentralization initiatives that give greater powers to sub-national governments. This is
partly rooted in a critique of central planning and a belief in the advantages of local
competition and information exchange for improving service delivery. Other reasons are
related to the potential of decentralisations to strengthen democratisation and enhance the
transparency of public sector performance 18 .
Whether decentralised public policy becomes more meaningful for poor and marginalized
people depends on a number of issues. These include features of local power structures
17
White and Smoke, 2005; Manor, 1999
18
Campos and Hellman, 2005
12
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
(style of local leadership, legacy of authoritarian rule, the working of political parties,
openness and accountability of local political processes); the presence of articulate and
effective citizen organizations and private sector; and good information flows. In highly
stratified societies, it is possible that without accompanying measures devolution provokes
even more exclusion or elite capture. Equity is also undermined in situations where
discriminatory perceptions on participation and engagement are no longer kept in check
by statutory rights. 19
Decentralisation changes the context of participation and local governance, and therefore
also influences PM&E processes. It may open new avenues for institutionalising PM&E
and sustaining community level interventions, by strengthening functional relations
between local government and communities. Local government may become an anchor
for the institutionalisation of improved governance practices 20 . Therefore, assisting local
governments to strengthen local governance and to welcome citizen participation warrants
consideration.
The focus and structure of the PM&E process will depend on which aspects of local
governance are considered particularly pertinent to address in the project or program.
Below follows a short description of the four features of what constitutes ‘quality’ in
governance, and the types of questions that could be examined in more detail.
19
Alatas et al., 2003;Beal, 2005;Bonfiglioli, 2003;Devas and Grant, 2003;Oluwu, 2003; White and
Smoke, 2005;Wong and Guggenheim, 2005;World Bank, 2004
20
Reviews on CDD programs also indicate that integrating with local government is important for long-
term sustainability and the ability to scale up (McLean et al., 2005; OED, 2004; McDonald Stewart and
Muça, 2003
21
Asian Development Bank, 1999; DFID, 2001;European Commission, 2001; Kaufmann et al., 1999
13
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Other essential features of the exercise of power are accountability, transparency and
openness. Strengthening accountability mechanisms is increasingly perceived as an
important strategy towards improving local governance and addressing inadequate
performance and service delivery from public and private actors or programs and projects.
Particularly, interest in interventions that increase transparency and exact accountability
from public sector actors and elected representatives is growing as ‘holding delegated
authority accountable is integral to the idea of government subject to popular control’ 22 .
22
Goetz and Jenkins, 2005 p.2
14
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
those working in these structures to understand and see biases and exclusionary
mechanisms, as well as their willingness to address these.
Smooth partnerships are essential for efficiency, to avoid duplication and prevent gaps.
However, this is easier said than done. In a multi-stakeholder setting, being clear on
responsibilities and quality standards, sharing information, undertaking joint analysis, and
honouring agreements is often a challenge. These new configurations also raise questions
with respect to horizontal coordination, connecting effectively with other (vertical) levels,
and accountability.
23
Campos and Hellman, 2005; World Bank, 2004; Goetz and Jenkins, 2005
15
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Projects and service providers that are using PM&E for assessing the efficiency and
effectiveness of service delivery, require a relatively simple process of seeking feedback
on service delivery from users. This is based on jointly agreed criteria of what constitutes
16
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
‘a good service’ and a shared analysis about areas for further improvement. Many
examples exist of using PM&E to improve performance, ranging from a focus on
community-based M&E methodologies to more sophisticated forms of data collection.
One methodology that is often used is the community scorecard (see Box 5). Community
score cards are generally considered as a tool for advancing social accountability. When
the findings have a very immediate practical value for primary stakeholders and who are
also in a position to act upon findings, than community score cards are relevant also for
contributing to a PM&E process.
A PM&E process may facilitate local resource mobilisation. By becoming better informed
on resources and expenditures, it will be clearer to citizens what is actually available and
what is lacking. This may increase their preparedness to contribute from own resources-
money, time, support etc.- to an intervention that is regarded as worthwhile. PM&E
processes have also stimulated more active engagement of future users in thinking through
a proposed investment. They contributed with insights and suggestions on how to make
improvements, such as on quality and efficiency. Moreover, the costs of small-scale
infrastructure investments may be considerably less when managed locally than when
delivered by public agencies, even with the latter being in a position to obtain economies
of scale through central procurement. Besides, transferring micro-project management to
communities relieves the implementing organization from being obliged to administer and
oversee a large number of small projects 24 .
24
Wong and Guggenheim, 2005; McDonald Stewart and Muça, 2003
17
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
PM&E can contribute to the supply side and the demand side of accountability. Improving
the supply side of accountability means focusing attention on the correct application of
administrative rules and procedures, respect for auditing requirements, and whether
performance is according to the standards (see Box 7). A PM&E process that focuses
more on the demand side seeks to build citizens and communities influence on decision-
making and implementation in an informed, direct and constructive manner (see for
example Box 6 and 13).
25
Chambers et al., 2003; Malena et al., 2004
26
Crawford et al., 2004; Picard and Goulden, 2005
18
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Many examples of PM&E processes that deal with accountability and transparency, focus
on budget allocation, procurement and expenditure management (see Box 7). The guiding
questions are whether the (scarce) resources are used prudently, targeted to the right
sectors and the intended groups, and if resources flow there in the stipulated amounts.
Satisfactory community or CSO involvement in overseeing budgets may also reduce
rumours on corruption, which undermine trust in projects and local government. The
effectiveness of such a process increases when authorities and other stakeholders
acknowledge communities’ rights to question how decisions are taken and implemented,
as well as to track performance and propose suggestions for improvement.
19
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
(see Box 7). These experiences can contribute significantly to the strengthening of local
governance, once the ad-hoc committees set up around micro projects use their acquired
knowledge and skills to monitor other forms of (public) expenditure. These projects
contribute to building a culture of accountability from the bottom up when they
systematically build capacities around expenditure management and link these to feedback
and communication strategies to share findings.
20
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
The principle of majoritarianism, for example, may preclude support for the demands of
the poorest groups 27 . Community level planning processes may overlook the needs of
marginalized groups. Issues such as addressing violence against women, assistance to
widows or female headed households, or responding to the health needs of a specific
groups, often do not survive a participatory but competitive community level planning
process.
Secondly, by going through a PM&E process communities and other stakeholders become
more aware of how equitably the benefits from and burdens for services and goods are
shared within the community and where key problems and gaps lie. PM&E can help to
assess whether there are in-built biases that lead implementation mechanisms to
automatically bypass certain social groups.
Other obstacles to more equitable outcomes may result from a limited capacity or
willingness (due to social codes of conduct) of marginalized groups to organize
themselves in ways that enable active engagement with (more) formal systems. They may
be less well informed, with information reaching them only through other people, such as
community leaders or relatives, and they may have also less time to spare to participate.
27
Hickey and Bracking, 2005
21
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
These features affect a PM&E process. These groups often have also less experience in
dealing with projects, engaging in processes of discussion and negotiation, or may lack the
confidence to speak up (if allowed at all to be present). Special activities towards capacity
building and organizational strengthening of marginalized groups may have to be included
in project design (see Chapter 5).
The ultimate effectiveness of these interactions depends on whether findings are fed into
the decision-making process. This requires establishing and strengthening the formal and
informal ‘spaces’ for dialogue and exchange, for fostering coordination and encouraging
the implementation of agreements for corrective action. To function, participants should
22
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
demonstrate willingness to share insights, listen, negotiate and seek consensus about
conclusions.
To keep their legitimacy and hence effectiveness, these partnerships need to address also
their internal accountability systems and maintain feed-back relations with their
constituency. Finally, it is important that these fora contribute to the strengthening of
prevailing structures of democracy, as ultimately, these remain the spaces where political
choices will have to be made.
The Albania Development Fund (ADF) has set up a pilot involving Consulting and
Monitoring Groups (CMGs) at the village and local government levels. The emphasis is on
promoting dialogue and partnership and not control. The long-term goal is to build robust
PM&E mechanisms into local government development planning procedures. These groups
advise on sub-project identification, implementation and monitoring. They receive support
from a PM&E group, established to develop and propose indicators, data collection techniques
(e.g., community score cards) and feedback mechanisms to the CMGs. Inclusion of more
marginal groups, such as women, youth, senior citizens, and ethnic group members, is
promoted by using targeted focus groups, adapted feed-back channels (using festivals instead
of meetings), and making certain that the composition of CMGs is representative. Replication
is expected through the demonstration effect and learning by doing.
ADF expects that this range of PM&E related activities will improve the overall performance
of the program. Activities will reflect real needs, and enhance ownership of project
interventions. Moreover, early warning of problems allows for timely intervention and
adjustments. ADF also anticipates gaining a deeper understanding and learning lessons that
are important for future program design. It is further hoped that a more credible partnership
between local governments and citizens will emerge.
23
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
and across sectors 28 . Intermediary CSOs and NGOs can play a role in expanding the space
for meaningful citizen participation, as well as building the capacity of CSOs to
participate effectively.
Citizens organizations can use M&E to track performance of service providers and
resource use (budget, procurement procedures, quality control etc.). A form of citizen
engagement that is receiving more momentum at the local level is that of a citizens’ audit,
a form of social accountability. The aim is to reduce diversion of public funds for private
gains or patronage, by monitoring actual implementation of policy and spending and
generating extra pressure towards prudent and appropriate use of public resources (see
box 9).
In Uganda there are three levels of local government: community, sub-county and District.
The Uganda Debt Network (UDN) is supporting community-based monitoring (CBMES) by
providing training to grassroots people in poverty and public expenditure monitoring,
grassroots advocacy and lobbying. A CBMES starts with a local community that tracks the
performance of government agencies by obtaining information about their outputs over a
certain period of time and comparing this with the publicly declared outputs of those agencies.
For example, they try to assess how much of the funding budgeted for schools and clinics
actually reached the sub-county, which is used to prepare sub-county reports. The reports are
then brought together into a District-level report with support from UDN and then used in
District level dialogues with heads of departments and local politicians. Video-recordings of
these local dialogues are also made and then used for advocacy purposes at the national level,
as showing what people are saying is far more convincing than written reports. Some local
monitoring committees are now actively involved in Uganda’s anti-corruption campaign and
invited to national events.
Source: www.undn.or.ug
28
Manor et al., 1999; Reuben, 2003
24
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Civil society organizations in Bangalore, India, have used the citizen report card process
(CRC) to put pressure on public service providers to improve performance and responsiveness
through civil society advocacy and extensive media coverage. A CRC starts from the notion
that users know best the quality and reliability of service providers, as well as direct and
indirect costs for accessing that service. The methodology is inspired by consumer opinion
polls used by the private sector. Data collection is standardized for a series of pre-fixed
indicators (which did involve citizen consultation). Rigorous procedures are used in order to
avoid that the validity of the data presented is questioned, but this requires sufficient resources
and capacity to collect and analyse data. The resulting citizen report card is presented and
discussed in public, such as in fora established by local governments. In Bangalore, the CRC
was successful, as it has contributed to improving the quality of services, promoted a better
client-orientation by service providers and improved horizontal relationships between service
providers and civil society organizations. In addition, participating organizations became more
aware of issues that influence the performance of service providers and some now also seek to
track budget allocations and expenditures.
Source : Ravindra, 2004; Waglé et al., 2004
The route towards effective local government that is responsive to all citizens and is
accountable for its actions is both promising and challenging. Promoting participation by
citizens and their organizations has been shown to be critical, as is a respect for and
adherence to accountability as an obligation of office bearers. To enhance legitimacy and
performance, local governments can use a PM&E process as a self-assessment tool (see
next Box 11). Some CSOs and NGOs also use PM&E for self-assessment. For example,
25
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Action Aid’s work on self-assessment of its finance and human resource development
functions is an innovative organizational application 29 .
In principle, citizens influence policy directions and resource allocation by electing their
preferred representatives. However, elections are ‘at best, blunt instruments of
accountability’ 30 . There is much dissatisfaction with the record of elected representatives
in local development planning; with channelling citizens concerns into decision-making
processes; and representing the interests of less powerful groups. Such disappointments
may result in a low credibility of elected representatives, which undermines the legitimacy
of local governments and trust in democratisation processes in general.
Engaging citizen in public affairs beyond elections has become a worldwide concern. It is
spurring the search for mechanisms that allow for direct citizen participation in local
government priority setting, implementation and monitoring. New initiatives are emerging
in a number of countries, in which PM&E process play an important role. Many of these
29
Action Aid, 2005
30
Mehta 2001 in Goetz and Jenkins, 2005 p. 18; Ackerman, 2005
26
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
initiatives emerge in urban environments 31 . One of the most widely publicised examples is
participatory budgeting process in Porto Alègre, Brazil (see 12). This example is
interesting as it also illustrates how several qualities of local governance are addressed in
one integrated participatory planning and M&E process.
Participatory budgeting started in 1989. Conditions that favoured its emergence were an
ineffective municipal government, new, incoming political leaders willing to experiment with
decentralisation, and the presence of strong and active civil society organizations. PB goes
beyond micro-projects as it influences a substantial part of the resources available to the
municipality and affects long-term investment choices. It produces results within one year,
which was crucial for the PB process to take off and still motivate citizens’ interest and
commitment to engage. Every year, over tens of thousands of people participate of whom most
belong to the poorer strata of society and have no history of active involvement in public
affairs 33 . The participation of women and young people is strong and has increased over time.
The process is organized around the municipal budget cycle and involves a multi-tiered
system of consultation around local, regional and thematic meetings. Since the start,
procedures, ways of working, and state-civil society stakeholder relations have all evolved
profoundly in order to build trust and improve the efficiency and transparency of this form of
deliberative democracy. The aim is to make the process as democratic and transparent as
possible, but also capable of coming to a decision. During the PB consultation, citizens
negotiate directly with local government representatives (both political and technical) on the
allocation of public resources for investments. Government representatives listen to citizen
demands, explain government priorities and defend government actions. The resulting
proposals guide the municipal government in actual decision-making for investments in
31
Gaventa, 2002; Gaventa and Valderrama, 1999; Goetz and Jenkins, 2005; IIED, 2004; Pieterse, 2000;
Waglé and Shah, 2003
32
See for example Baiocchi, 2005; Cabannes, 2004;Gret and Sintomer, 2005; Koonings,
2004;Schneider and Goldfrank, 2002;Waglé and Shah, 2003
33
This amounts to between 1.5 and 6% of the adult population depending on whether micro-level
meetings are included (Gret and Sintomer, 2005).
27
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
infrastructure works and basic social services. Neighbourhood delegates monitor the
implementation of the budget during the fiscal year.
Source: Baiocchi, 2005;Cabannes, 2004;Gret and Sintomer, 2005; Waglé and Shah, 2003
In the health sector, the promotion of user committees took off following the so-called
Bamako initiative of 1987 on primary health care. Within the education sector, it has
become common practice to establish parent/pupil committees. Projects on water supply
normally work through community associations that take responsibility for maintenance.
These community associations may have a formal status, which allows them to handle
resources and implement projects. Service providers may be legally obliged to invite these
CSOs to fora where sector specific priority setting, decision-making and implementation
of programs in their communities is discussed. Where local government is in place, these
may become part of specialised commission or committees (e.g., on public health, waste
management, education, market management).
The effectiveness of these sector specific CSOs is chequered, however. Problems result
from an unclear mandate, limited representativeness, and insufficient access to
information and capacity, but also inadequate awareness of local people’s expectations
and needs. Often, accountability to end-users is receiving too limited attention and some
34
Manor argues, however, that Donors’ support for these user committees is undermining efforts to
strengthen local government performance and accountability (Manor 2006).
28
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Box 13. Joint monitoring public health at the local government level
In Mali, community health associations (Associations de Santé Communautaire) were
established during the 1990s. They are on the management board of local clinics and many run
successful cost-recovery systems for medicines. Some of these associations are becoming key
actors in partnerships evolving around public health at the local government level (in rural
areas). They are becoming a bridge between the Ministry of Health and the local Council.
Activities that brought the partnership to life were sharing of information on health policy and
planning procedures, as well as the mandate of local government for public health. They have
also undertaken joint analyses of progress indicators on priority issues for the Councils. Data
collected by the existing health system monitoring system are used (with support of a
facilitator). Benchmarks are indicated using a traffic light system. Progress of the selected
indicators is visualised and then jointly assessed. When problems are detected, a discussion on
possible causes and ways forward takes place. Even illiterate councillors and members of
associations found it easy to read graphs, for example, on attendance rates for pre-natal care of
pregnant women, and noticed that these were dropping. When discussing possible causes, the
initial suggestion was to sensitise women. More in-depth discussions revealed that men often
discourage women from visiting the clinic for check-ups, and that they too have to be reached.
Source: Hilhorst et al., 2005; Field visit January 2006.
29
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
The previous chapter showed that governance at the local level can be strengthened by
integrating a PM&E process in the program design. Undertaking a PM&E process can be an
important source of learning and capacity building, contributing to empowerment.
The process provides communities and primary stakeholders with methodologies and tools
for agreeing on priorities, tracking progress, analysing data and developing a joint
understanding. This analysis leads to the identification of opportunities and bottlenecks, and
may be used to improve performance for activities within their realm of control.
Community level PM&E focusing on public expenditure management, for example, can
become an important source for building capacities that will have wider governance
implications. Engagement in PM&E processes builds skills, capacity and confidence within
the community on issues such as how to elaborate a budget, how to monitor a plan or
expenditures, and how to deal with procurement and contractors. This experience may
foster the emergence of a local mentality that backs regular scrutiny of financial
management, within CBO, farmer organizations, local government, service providers, etc.,
thus enhancing transparency and efficiency.
The PM&E process may also help to clarify rights and responsibilities and, where needed,
formulate demands towards implementation agencies, local governments or service
providers. For PM&E to have an impact beyond the community, it has to be integrated into
ongoing project and program activities. The combination of generating local insights and
linking these to the appropriate fora for decision-making will improve the performance of
local interventions. Functional feed-back and communication loops will make programs and
projects more demand-led and enhance their ability to adjust to unexpected developments or
changing circumstances.
At a more aggregated level where diverse stakeholders interact to decide on local development,
PM&E processes can provide content and purpose to these exchanges and negotiations. PM&E
in a multi-stakeholder setting creates space for different actors to meet and interact -
diverging and converging as they express their needs, priorities, aspirations and respective
expectations. Working together through a PM&E learning cycle can enhance mutual
understanding, creating the basis for dialogue and constructive working relationships.
PM&E contributes also to openness, transparency and accountability between citizens and
committees, implementing agency, service providers, etc. While dealing with diversity and
divergence presents specific challenges for PM&E, it also holds interesting potential for
30
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
transformative relations in local governance. It is here that the frontier lies for furthering the
practice of PM&E.
This chapter provides suggestions for integrating PM&E into programs and projects that work
with large numbers of communities and micro-projects. For communities and organizations of
primary stakeholders, working through a PM&E process should not demand significant extra
resources or time.
If communities or primary stakeholders have little influence on the intervention that will be
implemented in their midst, starting a PM&E process with them is not a good idea. Under
these circumstances, other strategies may be more effective for strengthening local
governance, such as building information and communication flows, and creating space for
dialogue (see box 14, even although in this case communities do have some control over
micro-projects). Also, other ‘social accountability’ types of activities may be required to
work towards more local control over interventions.
Some of the major lessons that emerge from this project are:
31
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
The principles behind these methods and tools are generally straightforward, but resources
for adapting them to suit the particular circumstances of a specific program need to be
integrated into planned activities. PM&E processes taking place at community level need to
link up with such multi-stakeholder fora, because some findings can only be addressed at a
more aggregated level. And although experiences with sustaining quality over the long-
35
See for example Toledano et al., 2002
36
Samen et al, 2006; Wong, 2005
32
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
term, and establishing effective and continuous information feed-back loops and dialogue
with other fora, including the implementing agencies, are emerging, this is an area that still
needs work.
In addition, an inquiry into the scope for adjustments and adaptation within existing
regulations is needed. Administrative and legal regulations may be so rigid that projects,
local government or service providers are essentially paralysed in terms of innovation and
actors cannot make meaningful changes without a long and complex process of bureaucratic
manoeuvring. This substantially raises the cost of incorporating the lessons learned and
acting upon the recommendations from the learning process.
33
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
and primary stakeholders (see Box 15). It is critical to be clear in project design about the
purpose(s) that PM&E is supposed to fulfil, alongside conventional M&E processes and
management information systems.
PM&E serves, in the first place, the internal needs of primary stakeholders. In contrast to
conventional M&E, a PM&E system prioritizes downward and/or horizontal
accountability towards users/ citizens, communities and other primary stakeholders. This
is the reason why its focus may vary across micro-projects or communities. A considerable
part of the detailed information and insights generated though a PM&E process at the
community level will probably not enter a program’s M&E system. Most of these findings
concern the actions of primary beneficiaries and their organizations, and they have to decide
on corrective action when required. Since these actions are likely to improve the results of
interventions at the local level, the PM&E process is therefore of great importance for the
program as a whole, but less so for the M&E system itself.
The information needs of each stakeholder to carry out its responsibilities within the
agreed program of activities should guide the design of these information systems. The
‘need to know’ rather than ‘nice to know’ principle is paramount, avoiding duplication of
data collections or the circulation of large amounts of data that are hardly used but take
considerable time to record.
Key information brokers are community facilitators who should be asked to report
essential PM&E findings in writing or at meetings. Where possible, communities should
also be asked to produce reports for which a format may be proposed. Occasions to
discuss findings of PM&E processes include regular project meetings, review meetings,
supervision visits and mid-term reviews. Within projects and programs, feed-back from
PM&E should be a fixed item on the agenda of these scheduled meetings.
37
IFAD, 2002
34
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
In conventional M&E, standardized criteria tend to be used. These are often formulated
externally, but criteria identified in consultation with stakeholders can be added.
Standardization facilitates benchmarking and comparison across projects, programs and
organizations. Procedures for collecting information may be stipulated in the project
design, in particular for financial auditing. The contribution of PM&E to conventional
M&E depends on whether the collection of data on pre-fixed performance assessment
indicators is included and recorded in a systematic and appropriate way. Information
generated through conventional M&E tends to be used mostly for upward and internal
accountability.
In a World Bank-supported natural resource management program in Niger, the focus of the
PM&E program was on building capacity in communities for recording data in a systematic
way and depict results on wall posters. This way of tracking progress improved the quality of
community discussions, made it possible to present data to other organizations and use these
in conventional M&E.
In contrast, an education sector support program in Malawi decided to abandon the technical
vocabulary of M&E. Progress was discussed in terms that made sense to all stakeholders, such
as ‘what works well and what went wrong’ and using the ‘significant change’ methodology to
track progress. The intention was to achieve better program results and not to generate data
that can be used in a conventional M&E system.
38
This chapter builds on the guidebook for ‘integrating learning in the monitoring and evaluation of
CDD projects of the World Bank’ (Action for Social Advancement, 2005)
35
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
However, in cases where PM&E has not been mainstreamed into the project design, it
ends up being retrofitted into a preceding design. It is still critical to ensure that the
PM&E process is perceived as integral to implementation and to success, with findings
feeding into decision-making. PM&E components therefore need to be connected with
other project components, systems and procedures.
36
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
The budget 39 for the PM&E process should include resources for the following activities:
developing the PM&E approach; capacity building; costs for implementation; community
and discussion fora facilitation; information and feed-back mechanisms; internal learning;
documenting experience; and provisions for scaling up and institutionalization (see section
5.8). Most resources for the PM&E process are required in the start-up phase when the
approach has to be designed and tested, and facilitators have to be trained and coached.
External consultants may be needed to support the design and training of trainers.
A clear plan of action for capacity-building support on PM&E should be part of project
design, strengthening the ability of marginal groups to participate, and helping to establish
an environment and attitude open to dialogue, reflection and learning within and among
organizations. The implementing agency’s experience of working with communities and
using participatory approaches and organizational learning will affect the requirements for
external assistance and capacity building (see Box 16).
Capacity building and training may be needed on issues related to the PM&E process,
such as the identification of core information needs; the formulation of relevant and
feasible indicators; the concept of benchmarking; data collection methods; analysis
processes; and how to use findings for reflection and identification of actions.
Strengthening facilitation and communication skills for community level processes and
multi-stakeholder fora is also required. More basic support to the organizational
strengthening of participating civil society organizations, particularly for those of more
vulnerable groups, may have to be included.
Capacity building activities may have to be included in the project design to support the
emergence of a more favourable environment for participation and for learning within the
organization. This is particularly important in contexts that are less open to dissent and a
frank exchange of ideas.
But over time, the PM&E process has to become self-sustaining at the local level. Local
people have to be trained in facilitation and even advocacy skills, in order to be able to
convince appropriate fora that certain constraints are beyond their powers to change. This
evolution should be part of the capacity building plan.
39
Experience with integrating PM&E in CDD or other World Bank programs is still too recent to give
clear guidelines on budget requirements
37
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
capacity building plan (see Box 16). Social and institutional self-assessments are useful in
this regard, but specially commissioned studies may be required too. Issues that can be
addressed are: the political context within which PM&E will be operating; local
experience with participation and civic engagement; exclusionary mechanisms; the
prevailing attitude of office bearers towards openness and transparency; the presence of
fora and spaces to discuss findings; current practice with information exchange, feed-back
and dialogue; experience with participatory approaches, learning and critical reflection.
The results of these assessments and studies should be reviewed with respect to the
implications for project design. Not everything can be known in advance, but this should
not stop a program from getting started. It does underline, however, the importance of an
adaptive and flexible management style.
- Large, monolithic government departments that have limited experience of working with
communities, and have neither the inclination nor the skills to implement learning-based
concepts and techniques;
- Organizations that have some interest in community interaction, but need considerable
handholding support to operationalize learning-based M&E concepts and derive maximum
utility from them;
- Organizations that have a culture of working with communities and are familiar with
participatory approaches.
In all three situations, guidance is needed for setting up a PM&E process. Moreover, in the
first two situations considerable capacity building and handholding support may be required
on participatory approaches and how to work with primary stakeholders on an equal footing.
PM&E usually represents a methodological and social innovation for the implementing
agency. The implementing agency may not have sufficiently experienced people to
38
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
develop the approach and the input of experienced consultants may be required. The social
and institutional self-assessments and other commissioned studies, mentioned in section
5.2, may contain information on social and political relations that are useful for
developing the PM&E approach.
However, working only with consultants may undermine local ownership and
commitment. Ideally, a ‘PM&E management unit’ is set up to lead the development of
the PM&E process approach in consultation with key stakeholders. This unit includes staff
from the implementing agency, consultants and resource persons from experienced CSOs,
for example. The members of this unit should understand the principles of PM&E and
how it is built into the overall project design. They may assist the implementing agency to
keep the PME&E process within the scope of project aims, strategy and available
resources. It is advisable that a program staff member be responsible for overseeing the
PM&E program; organize training, coaching and quality control; keep an eye on feed-
back loops and information flows; and lead the documenting of experience.
39
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Steps for which methodologies need to be fleshed out during the development of the
PM&E approach are (see also Figure1). :
Building commitment and engagement at the community level;
Deciding on who participates and how this will evolve;
PM&E process
o Jointly establishing goals and expectations;
o Tracking progress and information collection,
o Joint analysis, sharing results and identifying action points
Communication and feed-back systems to community; to program, other
stakeholders and fora
Figure 1. Schema of sequence of steps in a PM&E processes (Guijt and Gaventa, 1998)
We would like to highlight the issue of data analysis, as this is often not integrated well
into PM&E design. For information to be significant and useful, it needs analysis and
mutual sense making. This feeds into a joint process of observation, reflection, planning,
action, and feedback that follow each other cyclically and are interdependent. In many
early experiences, the ‘participatory’ aspect was limited to involving local people or CSOs
in indicator identification and data collection. Little attention was paid to the importance
of investing in effective reflection processes. However, as much attention is needed in
40
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Another pitfall that emerged from early experiences with participatory monitoring is the
risk of a process that is disconnected from fora of decision-making and therefore unable
to contribute to improvement and change 40 . Convincingly and credibly presenting the
findings of PM&E in an appropriate format at different levels within the project and at
other fora so as to contribute to improved performance, is another important but
challenging step. It ensures that findings, which address issues beyond the realm of
control of communities, are linked to a program’s MIS and feed into the relevant decision
making fora.
At this stage, clarity is needed about existing platforms and multi-stakeholder fora where
coordination and decision-making takes place, about their functionality and constraints,
etc. Equally important is the identification of existing mechanisms for sharing
information, communication and feedback, and for dialogue and mutual learning within
communities and organizations. It is worthwhile to invest effort into identifying when data
will come together, what types of events these will be, who will be present and what
methods will be needed to make sense of the data and come to concluding insights that
can serve to guide decisions.
The project design will have set out the pace and approach for spreading the PM&E
process to other communities. The route of getting started by a next round of communities
may be facilitated when a demonstration effect is generated by the results produced by the
first (pilot) communities. Promoting information sharing and exchange visits between
experienced and new communities may also be of help. Other activities that can be
undertaken to promote the spread of the PM&E process are the organization of special
dissemination events, publicity, and the sharing of results within networks, and with other
organizations and sectors.
Both the overall project design and the set-up for the PM&E approach should explicitly
aim to fully involve marginal and vulnerable groups in priority setting and ensure that
40
Guijt (ed.), 2006
41
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
these are being served in decision-making. Ensuring equity in designing and implementing
PM&E process implies that some questions need to be asked continuously. Who is
participating? Who joined later and who left? How effective are feedback mechanisms
between participants and their ‘constituencies’? What is the influence of various groups on
the decisions that have been made?
Bias at the level of the implementing agency and other stakeholders, among facilitators
and within communities will reduce the participation of more vulnerable and marginal
groups. Such biases and other exclusionary mechanisms need to be identified and put on
the agenda, so that actions will be taken to promote equity of outcomes. Community
facilitators play an important role in ensuring that the PM&E process remains inclusive.
Focussed capacity building may be needed to make community facilitators aware of
differences in power and influence, existing biases to participation and why these matter,
and provide them with methodologies for addressing these issues. Ensuring that outcomes
will be equitable may require special ‘affirmative action’ for marginalized groups to
amplify their voice (separate focus groups, quotas in decision making structures, budget
allocations). Moreover, capacity building may be required to strengthen these groups’
ability to organize and participate effectively.
If principles of equitable service delivery are openly agreed to, this makes it easier to put
equity on the agenda of forums at the local level. A useful approach may be to compare
equity situations within and across communities and municipalities, as part of a strategy
for standardizing the quality of service delivery and governance. Gender responsive
budgeting is another example (see Box 17 below).
Where analysis reveals structural and poorly perceived biases at the community or
organizational level that affect the equity of service provision, the input of third parties
may be required to help to put any identified problems on the agenda, broker discussions
with community members, and support the implementing agency in taking institutional-
level actions to promote equity of program outcomes.
42
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
In addition, they should be provided with a good, realistic introduction and clear
information on the overall project (components, conditions, and terms). Access to
complete project information provides people with a sound basis to voice their concerns
and needs, which can be incorporated into project activities Moreover, wide public
dissemination helps to place control in the hands of communities and mitigates risks of
manipulation by other actors 41 . Once the program has begun, it remains important to
ensure that communities stay informed, receive feed-back on progress at other levels, and
that engagements are respected and empty promises avoided (see Box 18).
41
Action for Social Advancement, 2005
43
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
Allocating adequate time is absolutely central to the success of PM&E. A potential risk
comes from the desire for quick results from the implementing agency or other actors. The
more pressure that a ministry - or donor - puts on a project for rapid achievement of
intended objectives, the less inclined staff will be to stop, reflect, and shift direction and
modify plans 42 . As PM&E is a negotiated process within communities and between
stakeholders who will usually be new to methodological issues and will need to take on
new roles and modes of interaction, sufficient time should be allocated to develop, adapt
and implement an agreed process. The information and consultation part of the process,
for example, should be given sufficient time, to allow for building interest in what the
project is all about and the PM&E process itself, and confidence in the intentions of the
implementing agency. The intention is to work towards a relation of confidence and trust
between project, facilitators and communities.
Lapses in information and communication between a project and primary stakeholders may
undermine the relations, decreasing a community’s initial interest and willingness in
participation. Investing in local infrastructure is often a key activity in CDD and sector support
programs. There is a risk that the construction activities and the community participation side
of such a program move along separate paths. This may lead to a lack of understanding, clarity
and transparency in relation to the actual construction that will take place at the local level.
Steps taken in an education support program in Malawi to overcome these problems included
setting up a system of joint coordination and communication to keep all stakeholders abreast
of developments; jointly developing a written agreement that details communication
mechanisms between all stakeholders, including the contractors; inserting requirements for
communication in contracts; and developing a documentation and picture presentation of the
construction process and the various stages for communities and ensuring that all stakeholders
be fully aware of what is included and what not.
42
Guijt et al., 2005
44
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
To conclude, openness and transparency over project activities, budgets, procurement, and
expenditures will not suit everybody as muddy waters provide opportunities for some. It is
also possible that empowerment of marginalized groups may be perceived as threatening
by other groups. The PM&E management unit and facilitators should be aware -and
prepared- for the fact that a successful PM&E process might generate opposition and
resistance along the road.
Those engaged in the PM&E process should apply the key principles to their own practice
in collaboration with all actors involved. Jointly, they have to set criteria for success for
the PM&E process, determine how to take stock of progress, and when to meet to analyse
and discuss findings. Setting up a well-defined approach to tracking and documenting
progress is particularly important in those situations in which PM&E is still considered an
experimental approach or key stakeholders seek more evidence of its value.
This analysis will generate a shared agreement on the successes and downsides of the
PM&E process (or stakeholder-specific insights where agreement is not possible). It will
further generate clear lessons for key stakeholder groups about what they can do
differently and better and may also produce greater clarity for the implementing agency
and others about minimal conditions for success, requirements, costs and other key
features of a good PM&E process.
These monitoring exercises may also produce materials that can be used for informing
senior management and policy makers (see 5.1). Documenting experience and drawing
lessons on the PM&E process is important also for guiding replication, up-scaling and
institutionalization.
45
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
PM&E processes will be more effective when supported and complemented by other
government actions and support programs. In-country alignment between initiatives and
programs in support of local government, sector support programs and community driven
43
Wong and Guggenheim, 2005
46
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
44
Helling et al., 2005; KIT and World Bank, 2006
47
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
6 Conclusions
This guidance paper demonstrated how a participatory monitoring and evaluation (PM&E)
process can enhance local governance and participation in World Bank-supported projects
and programs. PM&E as discussed in this guidance paper serves above all the internal
needs of communities and other primary stakeholders, contributing to their empowerment.
PM&E is not constructed as an instrument for ‘control’ but focuses on improving the
quality and direction of joint development initiatives and local governance.
PM&E contributes to adaptive management approaches and better overall results when
effective communication and feedback loops are in place with management information
systems of programs and agencies. In so doing, PM&E becomes an effective mechanism
for embedding participatory, demand-led development, building a practice of dialogue and
accountability between communities and agencies, and instilling an attitude that values
learning from experience. Transparency and accountability of programs is improved
through the systematic sharing of information and clarity about the basis of decisions.
Moreover, these third parties may gain access to views, findings and data for operational
and strategic planning that cannot be obtained through MIS or conventional M&E.
A word of caution is needed at this point. Interest in PM&E has spawned a wide range of
expectations about what it can deliver. It is important not to assume that PM&E can
deliver results when basic conditions are not met, such as the ability of primary
stakeholders to act upon findings. Expecting all purposes to be equally well fulfilled
within a short time frame may well lead to disappointments and an abandoning of the
entire PM&E effort. Moreover, for a PM&E process to deliver in programs, an
organizational culture that rewards innovation, openness and transparency (even about
failure) is required. Therefore, engaging in PM&E processes should be done selectively.
PM&E processes are integrated in regular program activities. The process becomes self-
sustaining when communities are in a position to use the approach and act upon findings
without external support and are capable of articulating their proposals for improvements
in external fora. Sustainability requires further that local authorities and service providers
acknowledge and value these processes. PM&E processes will be more effective when
48
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
49
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
50
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
DFID. 2001. Making government work for poor people, building state capability. London.
Strategies for achieving the international development targets.
ECANET. 2005. Participatory monitoring and evaluation focused on local development
planning and subproject identification- proceedings of a workshop. Vlore, Albania,
ECANET- Network of Social investment funds from the Europe and Central Asia region.
Estrella,M, J with Blauert, D Campilan, J Gaventa, J Gonsalves, I Guijt, D Johnson, R
Ricafort, 2000, Learning from Change: Issues and experiences in participatory monitoring
and evaluation, London, Intermediate Technology Publishers and International
Development Research Centre.
European Commission. 2001. White Paper on European Governance. Brussels.
Gaventa,J. 2002. Towards Participatory Local Governance: Six propositions for
discussion. Sussex, Institute for Development Studies.
Gaventa,J, V Creed, J Morrisey, 1998, Scaling Up: Participatory Monitoring and
Evaluation of a Federal Empowerment Program, in E Whitmore (ed), Understanding and
Practising Participatory Evaluation: San Francisco, Jossey Bass Publishers.
Gaventa,J, C Valderrama. 1999. Participation, Citizenship and Local Governance.
Brighton, Institute of Development Studies. Background note prepared for workshop on
Strengthening participation in Local Governance, June 21-24.
Ghimire,KB, M P Pimbert, 1997, Social Change and Conservation: An Overview of
Issues and Concepts, in KB Ghimire and MP Pimbert (eds), Social Change and
Conservation: London, Earthscan Publications.
Goetz,AM, R Jenkins, 2005, Reinventing accountability - making democracy work for
human development, Hampshire and New York, Palgrave Macmillan.
Gret,M, Y Sintomer, 2005, Porto Alegre- l'espoir d'une autre démocratie, Paris, Editions la
découverte.
Guijt (ed.),I, 2006, Triggering adaptation in Adaptive Collaborative Management -
Learning through collaborative monitoring, CIFOR-in press.
Guijt,I, J Berdegue, G Escobar, E Ramirez, J Keitaanranta. 2005. Institutionalizing
Learning in Rural Poverty Alleviation Initiatives. Santiago, Chile, RIMISP.
Guijt,I, J Gaventa. 1998. Participatory Monitoring and Evaluation: Learning from Change.
Brighton, IDS. IDS Policy Briefing 12.
Guijt,I, J Woodhill. 2004. Lessons Learned' as the Experiential Knowledge Base in
Development Organizations: Critical Reflections. Paper presented at the European
Evaluation Society Sixth International Conference, Berlin 2004 Theme: Putting
Knowledge Management to Work.
Gunderson,LH, C S Holling, 1995, Barriers and Bridges to the Renewal of Ecosystems
and Institutions, New York, Columbia University Press.
Helling,L, R Serrano, D Warren. 2005. Linking community empowerment, decentralized
governance, and public service provision through a local development framework. World
Bank.
Hickey,S, S Bracking. 2005. Exploring the politics of chronic poverty: from
representation to a politics of justice. World development 33[6], 851-865.
51
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
52
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
NIPFP - National Institute of Public Finance and Policy, UNIFEM, with European
Commission, IDRC. 2004. Local level gender responsive budgeting- international export
group meeting report. New Delhi.
OED - Operations Evaluation Department. 2004. The effectiveness of World Bank support
for Community -Based and -Driven Development. Washington D.C, World Bank.
Oluwu,D. 2003. Local institutional and political structures and processes: recent
experience in Africa. Public Administration and Development Volume 23, Issue 1, 31-52.
Picard,M, J Goulden. 2005. Principles into practice: learning from innovative rights-
based programs. Care International.
Pieterse,E, 2000, Participatory urban governance - practical approaches, regional trends
and UMP experiences, Nairobi, United Nations Centre for Human Settlements (Habitat).
Ravindra,A. 2004. An assessment of the impact of Bangalore citizen report cards on the
performance of public agencies. no. 12. Washington, D.C., Operation Evaluation
department, World Bank. Evaluation Capacity Development (ECD) working paper series.
Reuben,W. 2003. The role of civic engagement and social accountability in the
governance equation. No. 75. Washington, D.C., World Bank. Social development notes.
Reuben,W, B Arévalo. 2005. Participation, social accountability and transparency
mechanisms in development policy loans in Latin America 2000-2003. no. 74.
Washington, D.C., World Bank. En breve.
Roe, E, M v Eeten. 1999. Threshold-based Resource Management: the Framework, Case
Study and Application, and Their Implications. Berkeley, University of California,
Rockefeller Foundation.
Salmen, L, M Bela, A-J Naude, J Delion. 2006. Report cards as a tool for empowering
communities in the fight against HIV/AIDS in Cameroon: a work in progress. Social
development notes 102. World Bank, Washington
Schneider,A, B Goldfrank. 2002. Budgets and ballots in Brazil : participatory budgeting
from the city to the state. Brighton, Institute of Development Studies, University of
Sussex.
Sey, Haddy Jatou, Sen, Aditi and Diachok, Myrtle (forthcoming). Social Accountability in
Community Driven Development. Summary analysis and case studies (draft version
04/18/2006
Shah,P, G Hardway, R Ambastha. 1993. Gujarat, India: Participatory Monitoring. How
Farmers, Extension Volunteers, and NGO Staff Work Together in Village-level Soil and
Water Conservation Program. Rural Extension Bulletin 1[April], 34-37.
Singh,J, P Shah. 2003. Community score card process- a short note on the general
methodology for implementation. Social development department, World Bank.
Toldano,J, W Sajous, A B Mayor, W Tarou, M Bakuzakundi, H Neighbor, B Ryan, M A Sani.
Sleeping on our mats; an introductory guide to community-based monitoring and evaluation.
2002. Washington, Community-Based Monitoring and Evaluation Team, Africa region, The
World bank.
Waglé,S, P Shah. 2003. Participation in public expenditure systems. note no. 69.
Washington, D.C., World Bank. Social development notes.
Waglé,S, J Singh, P Shah. 2004. Citizen report card surveys- a note on the concept and
methodology. Note no. 91. Washington D.C., World Bank. Social development notes-
participation & civic engagement.
53
USING PARTICIPATORY MONITORING AND EVALUATION TO STRENGTHEN LOCAL GOVERNANCE
White,R, P Smoke, 2005, East Asia decentralizes, in World Bank (ed), East Asia
Decentralizes: Making Local Government Work: Washington D.C., p. 1-23.
Wong,S, S Guggenheim, 2005, Community Driven Development: Decentralization's
Accountability Challenge, in World Bank (ed), East Asia Decentralizes: Making Local
Government Work: Washington D.C., p. 253-263.
Woodhill,J, 2006, M&E as learning: Rethinking the dominant paradigm, in World
Association Of Soil And Water Conservation (ed), Monitoring and Evaluation of Soil
Conservation and Watershed Development.
Woodhill,J, L Robins. 1998. Participatory Evaluation for Landcare and Catchment
Groups: A Guide for Facilitators. Australia, Greening Australia.
World Bank, 2004, World Development Report 2004: making services work for poor
people, Wasington D.C, World Bank.
Yanggen,D, D C Cole, C Crissman, S Sherwood. 2004. Pesticide Use in Commercial
Potato Production: Reflections on Research and Intervention Efforts towards Greater
Ecosystems Health in Northern Ecuador. EcoHealth 1, 72-83.
54