Of The Civil Society Education Fund Programme 2013-2015: Terms of Reference For An INDEPENDENT EVALUATION
Of The Civil Society Education Fund Programme 2013-2015: Terms of Reference For An INDEPENDENT EVALUATION
Of The Civil Society Education Fund Programme 2013-2015: Terms of Reference For An INDEPENDENT EVALUATION
1. Introduction: The Civil Society Education Fund and the Global Campaign for
Education
The Civil Society Education Fund (CSEF) is a unique global programme that supports civil
society engagement in education sector policy, planning and monitoring, through the
collaboration of national, regional and international civil society partners. The programme is
founded on a shared understanding among key stakeholders that strong, broad-based and
locally-driven civil society participation in education sector planning and policy development,
monitoring of implementation and budgets, and promoting awareness and engagement of
citizens in national education debates is crucial to delivering on Education for All (EFA) and
other national education goals.
The CSEF was initiated and is managed by the Global Campaign for Education (GCE) in close
collaboration with regional partners (Arab Campaign for Education for All - ACEA, Africa
Network Campaign for Education For All - ANCEFA, the Asia South Pacific Association for
Basic and Adult Education - ASPBAE, the Latin American Campaign for the Right to Education
- CLADE, ActionAid Americas, Education International Asia Pacific and Oxfam GB West
Africa).
The CSEF 2013-2015 phase is funded by the Global Partnership for Education (GPE) through
a grant of US$ 14.5m, and UNESCO fulfils the role of Supervising Entity and hence holds
overall accountability to the GPE for the CSEF grant. In keeping with the planned phased
programme approach, the 2013-2015 phase of the programme commenced in April 2013 with
a three-months planning period, implementation from July 2013 and, following an agreed nocost extension period, national coalition activities will be implemented until the end of March
20151.
A previous phase of CSEF (2009-2012) was implemented by the Global Campaign for Education and
partners, and funded through the Fast Track Initiative Education Program Development Fund (FTI
EPDF). During 2012, bridge funding for continuation of CSEF activities was provided by AusAid, while
the initial phase of CSEF was evaluated, and a further funding proposal for the present programme
cycle was prepared. The evaluation report for the initial phase is available for review (see section 10
for a list of relevant documents).
2 Of the 54 countries, 28 are in the Africa region, 15 in Asia Pacific, five in Latin America and the
Caribbean, and six in the Middle East and Eastern Europe.
CSEF 2013-2015 Evaluation Terms of Reference / Final 151114
P a g e |1
Through this support, the CSEF aims to build stronger, more consistent and more effective
civil society engagement in education sector processes, with the following four programme
objectives:
1. Policy participation: Formal civil society participation in education sector policy and
review processes and engagement with policy-makers and parliamentarians is
strengthened and better recognised;
2. Public awareness and coalition-building: National education coalitions are actively
strengthening grassroots capacity to access and participate in education sector
debates, through building awareness, knowledge, skills and opening opportunities to
participate;
3. Quality research, monitoring and analysis: Civil society research and analysis
effectively contributes to national government plans, policies, financing and practices
that better achieve the right to quality education for all and the six EFA goals, and;
4. Cross-country learning and networks for change: The CSEF programme builds the
quality and impact of civil society engagement in the education sector through
promoting partnerships, strengthening South-South collaboration, sharing learning,
and facilitating impact on global processes.
It should be noted that in addition to the above, each of the coalitions have defined national
level expected results that contribute to the global programme objectives and expected results.
3.2
Provide evidence of the impact of our work to support further access to funding and
other forms of programme buy-in and support.
3.3
Be both summative and formative, with a strong emphasis on drawing together lessons
and recommendations to inform improvements and structural changes for a future CSEF
2015-2018. Thus, whilst being an end of programme summative evaluation, the drawn
out lessons learnt, considerations and recommendations will inform future CSEF
programme practice in a formative manner.
GCE is therefore seeking applications from suitably qualified and experienced consultants,
consulting firms, or a consortium of consultants to form the evaluation team.
4. Scope of Work
4.1 Scope
To undertake a comprehensive and robust evaluation of the Civil Society Education Fund
(CSEF) programme and its results encompassing the period of the approved CSEF 20132015 programme and therefore to cover the period from 27th April 2013 to the 31st of March
2015.
The evaluation should:
4.1.1
Identify the extent to which the CSEF programme as a whole has achieved its
objectives and learning goals;
4.1.2
With reference to the programme logic / theory of change, assess whether and how
the programme has contributed to and/or brought about the intended (or unintended)
results and whether this is contributing (or has contributed) to the desired impact (or
other unintended impacts);
4.1.3
Assess the extent to which the CSEF partners and stakeholders have learned from
programme experiences, and shared and used that learning;
4.1.4
Measure the CSEF programmes impact on the role and influence of National
Education Coalitions in national education policy processes and in the GPE country
level processes where applicable;
4.1.5
Assess capacity in terms of human resources of the CSEF programme, as well as the
synergy and collaboration achieved with and between the partners of the CSEF
programme;
4.1.6
4.1.7
4.1.8
4.1.9
4.2.1
4.2.2
Relevance, value addition and impact of the programme on the capacity of national
coalitions, including an assessment of the appropriateness of funding levels;
4.2.3
4.2.4
4.2.5
Exploring the sustainability of the programme results and outcomes and the extent
to which these are pointing towards long-term impact;
In addition, the evaluation should also consider the following areas, which go beyond the
original objectives of the Programme, but where GCE and partners are keen to evaluate the
potential impact of the programme:
4.2.6
The extent to which the CSEF programme has contributed to GPE strategic
objectives in relevant GPE-partner countries in which CSEF operates, vis:
4.2.7
The contribution to (i) national policy change (ii) the Local Education Groups,
Education Sector Working Groups and Joint Sector Review processes of the relevant
Ministries of Education, (iii) the development, monitoring and evaluation of Education
Sector Plans, (iv) influencing national resource investment to the sector and, (v)
promoting more efficient, transparent and accountable use of sector resources;
4.2.8
4.2.9
The degree to which CSEF has addressed gender equality and human rights in
programme implementation and, as far as possible, the contribution of the CSEF in
impacting on gender equality and human rights.
5. Methodology
The evaluation will draw information from various sources. This will include a review of existing
relevant documents, including but not limited to programme and coalition plans, as well as
monitoring and assessment reports. A combination of participatory approaches including both
external and internal assessments is considered appropriate interviews and observation,
surveys, case studies, collection and analysis of qualitative and quantitative data - involving
partners, their constituencies, relevant stakeholders and programme staff.
A thorough document review of existing secondary sources including the full range of
progress reports published over the years as well as key programme documents and
key meeting/workshop reports and minutes etc. available at global, regional and
national levels.
5.1.2
5.1.3
Members of the GCE Board including members of the GOC, members of the CSEF
Regional Funding Committees
GCE staff and staff of the CSEF Regional Secretariats and Financial Management
Agencies and CSEF funded national coalitions
Decision Makers (amongst them the LEG conveners, the GPE contracted
Supervising and/or managing Entities, Ministries of Education, country offices of
EFA convening agencies, as well as other external stakeholders to be proposed
by the evaluation team)
5.1.4
5.1.5
Face to face meetings with the Global CSEF Secretariat to be undertaken, thus at least
1 trip should be budgeted to Johannesburg where GCE and the Global CSEF
Secretariat is based.
5.1.6
The Evaluation Team will be expected to participate in the GCE World Assembly and
CSEF Global Learning Event (23-27 Feb 2015 in South Africa) to present the
Evaluation Teams evaluation plan and to conduct a first round of interviews with key
partners. These events intend to bring together all CSEF grantees, as well as future
potential participants of the CSEF programme. It is therefore obligatory for the
consultant team to participate in this meeting and use this vantage event for interviews
and in-depth engagement with the GCE and CSEF stakeholders.
Whilst GCE will arrange translation of the final report the evaluation team must arrange for
translation/interpretation for survey responses and for telephone/Skype and face-to-face
interviews. The CSEF programme currently works in French, Spanish, Portuguese, English
and Arabic.
To support proposal preparations, an initial list of targeted Interview Partners, Survey
Participants, Focus Group Participants is provided in the Annex A.
6. Expected Deliverables
6.1 Initial Inception Report: including proposed sampling and sampling rationale, a detailed
work plan showing relevant activities, including plan for interviews/focus groups sessions
during the World Assembly, outline of proposed evaluation tools/instruments, limitations if
any, description of outputs and indicators, as well as responsible persons and timeframes.
6.2 Final Inception Report: with reflections on initial findings and gaps following engagements
with respondents at the GCE World Assembly and final methodology, sampling and tools/
instruments.
6.3 A Participatory Debriefing and Validation Workshop Plan, and Presentation (PPT): on the
preliminary findings and recommendations of the evaluation.
6.4 Draft Evaluation Report: with Executive Summary, description of methodology and
limitations, evaluation findings, conclusions and recommendations.
6.5 Final Evaluation Report: incorporating valid feedback and including relevant appendices
and submission of data sets, pictures/graphics, audio/visual recordings and any other
relevant materials from the evaluation.
NR Activity
Responsible
Deadline
2014/12/01
December
2014
SUBMISSION TO POTENTIAL
SERVICE PROVIDERS WITH
THE SUBMISSION DEADLINE
31.12.2014
SELECTION PANEL REVIEWS
Selection Panel
2015/01/15
GCE
2015/01/16
Selection Panel
2015/01/19 to
2015/01/21
GCE Chair
2015/02/01
Evaluation Team
2015/02/01 to
2015/02/12
January
2015
SHORTLISTED CANDIDATES
January
2015
CONTACTED TO SCHEDULE
INTERVIEW
SHORTLISTED POTENTIAL
SERVICE PROVIDERS
INTERVIEWED
CONTRACT WITH
February
2015
SUCCESSFUL BIDDER IS
SIGNED
DOCUMENTS REVIEW/DESK
STUDY AND PRODUCTION OF
INITIAL INCEPTION REPORT
February
2015
January
2015
DELIVERABLE 1
Initial inception report submitted by 12 February 2015
FEEDBACK ON INITIAL
Selection Panel
2015/02/20
February
2015
INCEPTION REPORT
23-27 Feb
2015
PRODUCTION OF FINAL
Evaluation Team
2015/03/16
March
2015
February
2015
INCEPTION REPORT
DELIVERABLE 2
Final inception report submitted by 16 March 2015
CONTINUATION OF
Evaluation Team
2015/03/17 to
2015/05/15
March to
May 2015
10
DATA ANALYSIS
2015/05/16 to
2015/06/12
12
PRODUCTION OF
Evaluation Team
2015/06/13 to
2015/06/20
PARTICIPATORY WORKSHOP
PLAN AND PRESENTATION
June
2015
Evaluation Team
FINALISATION
May/June
2015
11
DELIVERABLE 3
Participatory debriefing and validation workshop plan and presentation
30th June 2015 (date TBC)
WRITING FIRST DRAFT OF
Evaluation Team
EVALUATION REPORT
2015/07/01 to
2015/07/20
Evaluation Team
2015/09/01 to
2015/09/20
September
2015
15
AND SUBMITTED TO
EVALUATION TEAM
WRITING FINAL EVALUATION
REPORT INCORPORATING
VALID FEEDBACK
July to
August
2015
14
DELIVERABLE 4
Draft evaluation report submitted by 20 July 2015
FEEDBACK ON DRAFT
GCE
2015/07/21 to
REPORT GATHERED FROM
2015/08/31
GCE, UNESCO AND GPE
July
2015
13
DELIVERABLE 5
Final evaluation report and submission of evaluation data sets and materials by no
later than 20 September 2015
16
SUBMITTED TO
2015/09/21 to
2015/09/30
September
2015
8.3 Gender and geographic balance to be respected in the evaluation team, which may not
include any members with previous involvement in any of the activities under review.
8.4 Capacity to manage the evaluation process in the CSEF programme languages.
8.5 Before a contract is awarded the successful tenderer (and/or any subcontractors/
partners) will be required to provide a current tax clearance certificate valid for contract
purposes.
8.6 The lead consultant is expected to have the following (mandatory):
A strong and proven track record in conducting multi-country evaluations and in leading
a team(s) of evaluators to conduct large programme evaluations which demand both
quantitative and qualitative research skills.
Excellent knowledge of Education For All goals and priorities and post 2015 education
agendas in the global context.
Proficient knowledge of advocacy and campaign work with civil society, Ministries, Bilateral and Multi-lateral agencies and International Funding Agencies.
In addition, the following attributes of the lead consultant are highly desirable:
8.7 The support team shall collectively demonstrate the following knowledge/skills/experience:
Mandatory:
Education expertise
Desirable:
Participatory workshop/consultative
skills/experience
meetings
facilitation
and
organisation
6. Based on feedback (in 5 above), provide and submit the final detailed report with an
executive summary and tangible recommendations of no more than 70 pages.
7. Organise and submit data sets, pictures/graphics, audio/visual recordings and any
other relevant materials generated and/or developed through the evaluation.
9.2 GCE will:
1. Provide background literature including programme documents, reports and other
relevant data.
2. Provide a database of programme partners and stakeholders with contact details.
3. Provide logistical support to facilitate travel and meetings at the GCE World Assembly
/ CSEF Learning Event,
4. Pay consultancy fees and disbursements as per agreed payment schedule according
to deliverables and output dates.
5. Monitor evaluation progress and quality as the evaluation process progresses.
9.3 Management of the process
The GCE Global Coordinator has ultimate responsibility for oversight of the evaluation
mission. The day-to-day management of the evaluation will be the responsibility of the CSEF
Global Programme Manager with the support of the CSEF global secretariat.
The lead consultant will have direct oversight of the evaluation team members.
The first phase of the CSEF programme 2011-2013 was evaluated independently. The evaluation
report should be taken into account in the design of the forthcoming evaluation.
http://www.campaignforeducation.org/en/building-the-movement/good-practice
http://www.campaignforeducation.org/en/resources
https://drive.google.com/folderview?id=0B9V5kYLpWIaCM2FsMGRHZnlYTVU&usp=sharing
For more information on CSEF and GCE please visit the website
www.campaignforeducation.org
A signed and initialed detailed Price Schedule which includes all fees and identified
expenses.
2.
The submissions must reach the following address by 23:00 GMT on 31st of December 2014:
consultants@campaignforeducation.org and copied to wolfgang@campaignforeducation.org
Late proposal tenders will not be accepted in any circumstances and will not be assessed.
Timely delivery of submissions is the responsibility of tenderers and the Global Campaign for
Education will not in any circumstances accept liability for late or unsuccessful delivery of
proposal submissions.
CSEF 2013-2015 Evaluation Terms of Reference / Final 151114
P a g e | 11
10
40
(a) Presentation of methodology and sequence of activities is clear and the planning
is logical
10
(b) Proposal reflects a feasible and sound methodology, considering the limitations
and risks of each proposed tool/method
15
(c) Quality of samples of previous evaluation work relate to the subject of the
current evaluation and align with methodology requirements as set in the TOR
15
10
deliverables
60
(40)
20
Advanced university degree in the area of Education Policy, Education Financing and/or
Education Planning and Evaluation or similar
Excellent knowledge of quality education for all, including relevant policy related issues, and
post 2015 education agendas in the global context
Proficient knowledge of advocacy and campaign work with civil society, Ministries, Bi-lateral
and Multi-lateral agencies and International Funding Agencies.
Planning, team leading, supervisory research and analysis skills for complex information.
20
40
100
NOTE: The acceptability threshold for technical proposals is set at a minimum score of 70
points out of 100 points. Technical proposals which do not reach this minimum score
will not be considered for financial evaluation.
CSEF 2013-2015 Evaluation Terms of Reference / Final 151114
P a g e | 13
No
YES
NO
2.
3.
4.
5.
6.
Financial proposal
PART B
1.
Tender submissions which fail to include the above relevant documents assigned with a * will
be administratively non-compliant and will be automatically rejected.
Type of empirical
evidence
collection tool
Interviews
Focus Group
Discussion
Interviews with
National
Education
Coalitions (NEC)
Stakeholder
Category
Includes which
countries
Data Collection
Method
GCE Board
members
Regional
Secretariats,
Regional Finance
Management
Agencies and
Selected national
Coalitions
NEC
n/a
Face to Face at
World Assembly
Face to Face in 4
Regions
Country Visits to
Interview NECs,
LEG
representatives of
the SE/ME,
government reps
Interviews with
National
Education
Coalitions
Survey
Separate Interviews,
structured meetings
All 4 regions
List:
Africa 4
Asia 2
Latin America 1
ME and EE 1
List:
Africa 4
Asia 2
Latin America 1
Face to Face
Face to Face,
Group sessions,
LEG meetings
ME and EE 1
NEC
Representative sample
Structured Skype
Interviews
NECs
All 54
Survey Regional
and Global
Structures, IPG
Review of
national, regional
and global
reports; Audited
FS; and other
relevant
documents
Interviews / FGD
In total up to 14
structures
Survey Monkey or
similar
Questionnaire
Survey Monkey or
similar
ALL
Desk Study
GCE Global
Management Team
(with inclusion of
Board members?)
n/a
up to 8 interview
partners in
London/Johannesburg
Face to Face
Interviews
Skype
ANNEX B
STATEMENT OF AVAILABILITY
To the attention of :
Subject:
Name of expert(s)
Title of post/position
for this evaluation
Signature
(work
days/
months)
1.
2.
3.
4.
I/We understand that failure to make the named expert(s) listed above available for the
performance of the services may lead to cancellation of the Contract.
When the Tenderer is a firm or a consultancy, the signatory must be a duly authorised representative
of the firm or consultancy.
ANNEX C
DISCLOSURE DECLARATION
THIS DECLARATION MUST BE SUBMITTED BY ALL TENDERERS. WHERE THE
TENDERER IS A CORPORATION OR CONSORTIUM OR PARTNERSHIP THE
DECLARATION MUST BE COMPLETED BY A DULY AUTHORISED REPRESENTATIVE.
Name of Tenderer: .
Address:
..
I, [ insert name ], solemnly declare that I have been duly authorised to make this declaration
by the Tenderer and I hereby certify as follows:
(1)
The Tenderer has not been convicted of fraud, money laundering, corruption, or of
being a member of a criminal organisation.
(2)
The Tenderer is not bankrupt or subject to bankruptcy or analogous proceedings, or
being wound up, its affairs are not being administered by a court, it has not entered into an
arrangement with its creditors, it has not suspended its business activities nor is it in any
analogous situation arising from a similar procedure under national laws and regulations.
(3)
Neither the Tenderer, nor any of its directors or partners, has been convicted of an
offence concerning professional conduct by a judgement which has the force of res judicata
or been guilty of grave professional misconduct (proven by any means which the Contracting
Organisation can demonstrate) in the course of its or their business.
(4)
The Tenderer has fulfilled its obligations relating to the payment of taxes or social
security contributions in its country of establishment or any other State in which the Tenderer
is located.
(5)
The Tenderer has not been guilty of serious misrepresentation or omission in providing
information to a public buying agency, including the Contracting Organisation.
I further declare that the information provided above is accurate and complete to the best of
my knowledge and belief.
I understand that the provision of inaccurate or misleading information in this declaration may
lead to the Tenderer being excluded from participation in this or future tenders.
This declaration is made for the benefit of the Global Campaign for Education, Johannesburg,
South Africa.
SIGNATURE: _____________________________________
NAME (PRINT):
POSITION:
DATE: _
_________
TEL: ____________________
__________________________________________