OCA Synthesis Report
OCA Synthesis Report
OCA Synthesis Report
Program (My-EQIP)
This report was prepared by Vanessa Fullerton and Ben French from Oxford Policy Management Ltd.
My-EQIP is a joint initiative of the Government of Myanmar and the Government of Australia.
This publication has been funded by the Australian Government through the Department of Foreign Affairs
and Trade. The views expressed in this publication are the author’s alone and are not necessarily the views
of the Australian Government.
Acronyms
ATEO Assistant Township Education Officer
1 Task Teams are established by the MoE with representatives from the departments with responsibility for
the reform area. They seek to develop and test the systems within the MoE to improve the governance of the
education system. Where necessary technical assistance is sought, through the task team, to strengthen
implementation capacity.
Phase 1 Report: Organisational Constraints Analysis 1
My-EQIP is a joint initiative of the Government of Myanmar and the Government of Australia
Basic education – access, quality, inclusion (NESP Chapter 6): two themes were identified as the key
constraints and enablers for systems change NESP area: (i) rules, guidelines, policies, and systems; and (ii)
human resources and skills. Specific enablers identified within these themes were:
▪ Approval (authorisation), dissemination (acceptance), and implementation of School Quality Standards
Assurance Framework (SQASF) guidelines.
▪ Process changes, specifically obtaining authorisation at the union, state/region, and school level for
changes to admission and budgeting processes, were identified as important to moving from the
implementation of SQASF as a policy to the use of SQASF as a tool to improve access, quality, and
inclusion.
▪ Developing the technical ability at all levels of government to implement new policies and procedures.
▪ Behaviour change related to school inspection, but inspectors, principals and teachers, towards a
collaborative problem resolution approach is an important element in addressing issues of quality and
inclusion.
TVET (NESP Chapter 11): three themes were identified as the key constraints and enablers for systems
change in this NESP area: (i) rules, guidelines, policies, and systems; (ii) human resources and skills; and
(iii) work culture. Specific enablers identified within these themes were:
▪ The provision of skills at the technical institution and departmental level to implement a modern technical
and vocational education framework.
▪ The authorisation of the Vocational Education Quality Assurance Framework (VE-SQASF), enabling the
roll-out of the TVET policy and the development of guides for departmental officials.
▪ Changes in the ways of working at the institution level as well as for Department for Technical and
Vocational Education and Training (DTVET) inspectors, requiring new skills to implement and oversee
the VE-SQASF.
Themes for organisational reform. The analysis identified six sub-themes into which it was possible to
categorise the constraints and enablers identified within the three NESP areas. These themes are a useful
way of categorising the constraints and enablers across the MOE.
▪ Rules, guidelines, policies, systems: The commentary of different departments and Task Teams
noted that there is a lack of clarity on whether authorisation for action was formal (written direction from
an authoriser) or informal (assuming implicit authorisation). When there is authorisation, acceptance
exists, and departmental officials are willing to take action to implement new processes, most notably in
the VE-SQASF work. The ability to implement new rules, guidelines, and policies is often lacking, either
due to system constraints or the lack of technical ability to make these changes.
▪ Human resources and skills: Some degree of authorisation and acceptance for the development of
human resource ability and skills is in place across the NESP areas. However, actions such as the
allocation of budget to match the staffing and training requirements were lacking, and there is more work
required to enlarge the space for change in this area. The ability to train and recruit the relevant
individuals was less present, which reflects the challenges of implementing a reform system within a
government system that has had limited exposure to international best practice for 40 years. The lack of
key skills, such as IT and language skills, within the MOE limits its ability to rapidly develop its human
resource skills. For skills development, there is a tendency to prefer formal rather than on-the-job training
– this, however, is not always as effective.
▪ Work culture: The emphasis on evidence-based decision making, quality and mentoring, and building
monitoring systems requires a shift away from centralised decision making towards the delegation of
authority and a decentralised system of management. These changes are difficult to create in any
system. In the MOE, the report finds that there is limited authorisation and ability for these changes at
present, and only moderate bureaucratic acceptance. Departments recognise the need to make
changes, but there is an understandable reluctance to change tried and tested ways of working. The
leading role of senior decision makers as the primary – and often singular – decision makers is a
significant constraint on changing the working culture.
2 Approach
An OCA aims to establish an understanding of how an organisation is functioning, in terms of what
the interactions within the organisation are, how they happen, and who is responsible for them. In the
context of the MoE, the OCA was based on a participatory action research design, with the aim of putting in
place an approach to identifying constraints to effective and efficient service delivery within and across the
systems of education in Myanmar. Specifically, the analysis aimed to identify key actions that enable
progress on NESP-priority activities. As such, it provides a set of tools, and analysis, that is practical beyond
the immediate areas of focus.
Formal rules ▪ Legal framework: the legal framework within which the MoE
operates.
▪ Rules, guidelines, policies, and systems: instructions and
Processes processes followed by MoE personnel that impact the way the MoE
Structures functions. These exist within the legal framework.
Technical ability ▪ Human resources and skills: the availability and skills of individual
personnel, related to their technical function.
People
Functional ability ▪ Work culture: behavioural practices, attitudes, and culture of
working within the MoE.
The second framework utilised in the analysis was the authority, acceptance, and ability framework (Step 2
in the data collection – see Section 2.2). Building on the work of Matt Andrews (2008) and Woolsey-Biggart
and Guillen (1999), this framework recognises that reform is less about technical solutions and more about
the social-organisational space – in other words the way an organisation (in this case, a government
department) functions.3 This framework is intended to identify a space for reform, encouraging technical
teams (insiders and outsiders) to consider where they have ‘reform space’ and how they can create or
enlarge this. It can be used to map how formal and informal channels help open reform space in a
government department. The three components of the framework4 are:
▪ Authority: represents the support needed to enable a reform or change. This may be political,
bureaucratic, or personal.
▪ Acceptance: this is the recognition by those who are doing the change or who are impacted by the
change that the change is necessary. Without acceptance, resistance is the norm.
▪ Ability: this is the practical element of reform, time, money, skills, etc., enabling a reform process to
progress.
2 See: UNDP (2007). Capacity assessment methodology user’s guide. World Bank. (2017). World Development Report
2017. Governance and the Law.
3 Woolsey-Biggart, Nicole. and Mario. F. Guillén. 1999.
4 Andrews, M., Pritchett, L., and Woolcock, M. (2017). Building state capability: Evidence, analysis, action. Oxford
University Press.
The implemention of a Medium-Term Budget Framework aimed to strengthen budget management from
2003 to 2010 hightlights how fluid the reform space can be, and how important it is to be constantly re-
evaluating where reforms are positioned within this space. The Ministry of Finance led this intervention,
and the eventual result was signficant reform progress, but only during a very narrow window, and not
without signficant effort. The key elements in this process were:
Throughout this process, the space to act (reform space) fluctuated, as demonstrated by the
graphics above. The key was recognising when there was enough support for reform and being
able to act. When considering the space to act for NESP reforms, it is important to look for ‘reform
movements’, but it is equally important to be working to build reform space consistently, by cultivating
ability, acceptance, and authority.
5Reference Group members: Dr Choo Htun Aung, Director Minister’s Office; U Aung Than, Deputy Director Minister’s
Office; and, Daw Aye Mon Oo, Director Department of Education Research, Planning and Training.
Each step was associated with a specific diagnostic tool, aligned to the analytical framework (see the
process report for further details). The steps were:
▪ Step 1 – identify NESP implementation enablers: starting with their NESP objectives, Task Teams
were asked to identify their specific activities within this priority area and then identify the constraints and
enablers that either prevent or facilitate progress towards this objective. This tool relates to the first
framework discussed in Section 2.1.
▪ Step 2 – assess the space to act: based upon the identified enablers, an analysis of the space to act
(using the change space tool) was undertaken. This analysis seeks to identify where reform potential is
the highest, and where further support or ability is required to create the conditions for reform. This tool
relates to the second framework discussed in Section 2.1.
▪ Step 3 – identify the actions required: based upon the available evidence, the Task Team were asked
to identify activities that would positively contribute to their reform space, by increasing authority, ability,
or acceptance.
These steps were undertaken by the MoE Task Teams with a focus on three essential NESP transformation
shifts, covering: basic education – access, quality, inclusions; TVET; and, management, capacity
development, and quality assurance). See Figure 1. The report reflects an analysis of the understanding of
these teams collected during the period (June–September 2019). Circumstances on the ground are always
changing, and some of the findings in this paper are likely to have evolved in the past.
Working through existing Task Teams provides several benefits but also creates some limitations. The
benefits are the ability to provide useful policy analysis tools to the MoE and the limited impact on MoE
resources; it is particularly significant given the competing pressure on all MoE personnel time that the views
reflected in the report are those of the MoE personnel and not the authors’ interpretation of interview
findings. The limitations are the narrow focus of the analysis to the existing areas of support of the Task
Teams, and the lack of exhaustive interviews and consultations
The following sections present the synthesis of the analysis by NESP area, while the detailed findings for
each Task Team are presented in Error! Reference source not found.. To ensure consistency between
each Task Team, a review and comparison of the evidence collected was undertaken as part of the analysis.
To ensure that the final data present was consistent between groups, some data was re-coded or re-
classified by the authors. In general, modifications were made only where information could not be verified
against existing evidence, or where the assessment provided based upon the available evidence appeared
to be an outlier in comparison against other groups’ assessments (for example, where a Task Team ranked
reform authority as high, but then described a lack of support from the Union Minister and/or Director
General). The result is data that is broadly consistent against a common comparative set.
As part of the process, a feedback survey was administered to MoE Task Team participants; 19 MoE
personnel provided feedback. The key findings from this feedback were:
▪ 100% of respondents found either or both of the change space (Step 2) or implementation enablers
(Step 1) tools useful to their work planning.
▪ 77% of respondents indicated that they felt they would be able to use the tools in their work, outside of
the Task Teams.
▪ 64% of respondents had heard about the tools from colleagues, although only 25% of respondents
had been shown the tools by them.
Written feedback indicates that participants founds the tools useful, and that they could see the value in
work planning. Some participants noted that the tools were merely interesting and unlikely to be used
regularly, while others felt that more training or support would be required.
3 Consolidated findings
This section consolidates the findings from each NESP focus area and looks at the six implementation
constraints and enablers as identified in Section 2.1. It consolidates the data collected to identify the reform
potential for each of these areas (as assessed by authority, acceptance, and ability), and draws out the
actions that were identified as increasing the space to act in these reform areas.
3.1 NESP
The OCA focused on three NESP transformations, as explained in Section 2. This section presents the
findings for each of these areas, identifying the key constraints and enablers to NESP implementation, and
identifying the space to act within each area.
Management, capacity development, and quality assurance (Chapter 13): this sets out a vision for
strengthening education sector management, structures, systems, and tools. This chapter focuses on how
evidence-based decision making, planning, and monitoring play a significant role in creating a modern
education system and why they are central to the successful implementation of the NESP. Key activities
assessed under this chapter were the Department Annual Implementation Plans and the Departmental
Annual Progress Reports, education management information system6, and establishing the capacity for
evidence-based decision making.
The following three implementation constraints and enablers identified in this NESP area were: rules,
guidelines, policies and systems; human resources and skills; and work culture. Specific enablers identified
within these themes were:
▪ Putting in place (authorising) and disseminating (acceptance) the policies and procedures required to
improve information management and data flow. The lack of data sharing between departments was a
key constraint, as was the need for a policy decision to authorise data sharing.
▪ Ensuring the skills and understanding (ability) to undertake evidence-based decision making was in
place across the relevant departments. Limitations in data analysis and processing constrain effective
communication and M&E, and limit data quality.
▪ Encouraging effective cross-departmental collaboration. Limitations in communication and coordination,
a global problem in bureaucracies, is a barrier to making progress on improving departmental planning
and monitoring of NESP implementation. The lack of an effective cross-department, MoE-wide
coordination mechanism is an important barrier to ensuring there is effective authorisation for actions,
with repercussions for inaction. At present, the MoE Executive Committee makes decisions on hundreds
of agenda items in its bi-weekly meeting, limiting strategic oversight.
6The education information management system covers the information systems required to manage the
education sector, including: human resource management information, school data, etc.
Phase 1 Report: Organisational Constraints Analysis 10
My-EQIP is a joint initiative of the Government of Myanmar and the Government of Australia
Figure 3 Space to act – management, capacity development, and quality assurance
The VE-SQASF reform work constructively highlights the importance of the themes that emerge in
this section. For background, the VE-SQAF was originally part of the wider SQASF work covering all
schools. DTVET staff recognised the value and potential of developing a specific VE-SQASF and obtained
the Director General’s agreement to develop the framework within the department. A new Task Team was
formed for DTVET, consisting of six officials from DTVET, six principals from technical high schools, and
three principals from the technical institutes. It was led by the Director TVET. The members of the VE-
SQASF team worked hard to build broad acceptance of the reform, securing approval at the school level
and from the National Accreditation and Quality Assurance Committee and NESP.
The following lessons emerge from the VE-SQASF case study:
▪ A limited and focused reform team provided the basis for close working, building acceptance and
ensuring the ability to address emerging problems. ‘We select only vocational education person […]
six members from the department and six members from the government technical high schools.’
▪ Focused on building acceptance for the reform agenda. ‘Our members principals are in faraway
places (not in Nay Pyi Taw) when we are about to go for first pre-pilot testing […] We took more time
to meet with them.’
▪ Authorisation comes from the Director General and the team has a clear mandate. ‘Have to
report to DG [Director General] and Deputy Director General [DDG] and no further approval
necessary.’ And: ‘We had one activity. We already informed them in the survey periods about what
they have been doing in terms of school and their managements to the department. We organised a
workshop for GTHS principals when VE-SQASF was drafting. We invited director level personnel and
other invite-worthy personnel for internal communication.’
▪ The presence of acceptance and authorisation make building ability, using departmental
systems, feasible. ‘The Department Director General has already accepted that this is important and
all the sections. Everyone accepts the existence and importance of the framework. Departmental
7This challenge is also identified in reporting on the My-EQIP programme (see My-EQIP Monitoring and Evaluation
Report, October 2018–March 2019, p. 7).
The work on communication, knowledge, and management information systems provides a useful
illustration of the themes that emerge in this section. For background, early work on the communications
systems struggled to gain traction and support from within the MoE. A significant amount of effort was put
into organising a forum in late June 2019 that has been viewed as very successful and helped to build
support for the strengthening of communications systems. The forum and the engagement of the Union
Minister have created more authority for the activities in this space. However, reforms are still perceived to
be slow, and there is limited acceptance of the reform agenda from different departments in the MoE.
The following lessons emerge from the communication and management information systems case study:
▪ Limited authorisation below the Union Minister may have led to limited departmental
engagement. ‘We don’t really need the decisions from the directors of the departments. We only need
the Union Minister approval once the Task Team agree to conduct an activity.’ And: ‘Director Generals
and Deputy Director Generals couldn’t participate consultation meetings and only Deputy Staff
Officers and three or four Deputy Director Generals attend meetings. Presence of all Director
Generals would make the discussion more alive.’
▪ Challenging, non-specific objectives for reform have created confusion. ‘I would say they didn’t
see CSTT as important. In terms of priority, we are not the first for sure. Some participants are just
adding to the numbers by their departments. Some just attend the meetings without even saying a
word […] Looking at this, most departments do not really prioritise CSTT activities as their priority
activities.’
▪ Acceptance of information reforms has proven difficult. Building a shared understanding of the
objectives of the reform agenda has taken time and is not yet complete. ‘A department, from our
assessment, thought the report might pose a threat to the responsible department and rejected to
generate the report.’
▪ Broad group of stakeholders to consult, across multiple levels of the MoE, limits authorisation
and acceptance. Directors General not aware of activities – there is a ‘need to publish weekly or
monthly release regarding […] activities for awareness. Maybe regular fact sheets would be great for
awareness. It would be difficult for directors to send something to DG [Director General] […] Maybe
then DGs are aware of what we are doing in Task Teams. Department reports might have some
procedural challenges. Official letters might aware them about what’s going on. There are not even
five departments who have great awareness.’
8 To obtain more detailed findings, a more intensive process of interviews and consultations would be required.
Ability: looking across the various reforms and Task Teams, the following indicators are proposed:
▪ focal points appointed in all departments, with regular focal point meetings;
▪ better quality briefings and reporting from M&E and planning focal points produced on a regular basis;
▪ training sessions provided to relevant departments aligned to NESP policy priorities;
▪ providing leadership and management training at the district and school level;
▪ regular attendance and participation by the same individuals in focal groups or Task Teams; and
▪ human resources allocated to NESP-priority areas.
5 Conclusions
This report has consolidated and synthesised the findings emerging from the research conducted by MoE
personnel and the My-EQIP support teams. The analysis reflects the consolidated lessons of MoE personnel
who are working to implement the NESP reform agenda. As set out in the introductory section, the
assignment’s two objectives were to provide a toolkit for MoE personnel to identify key constraints and
enablers for reform, and to use the information collected to identify the constraints to effective and efficient
service delivery.
Beyond the key actions (section 4) the process of data collection and participatory research identified a set
of broader lessons that the MoE and My-EQIP may wish to consider:
▪ Develop skills for policy analysis in the MoE. In line with the My-EQIP approach of learning-by-doing,
the use of the Task Teams and other MoE teams for data collection is an opportunity for such learning.
Tools developed for this assignment form the backbone of good policy analysis for any public sector
organisation and may be useful in the MoE on a longer-term basis.
▪ Reflect on how development partner programmes embed their activities in the MoE. The tools, in
particular the change space analysis, provide a useful benchmark as to whether a development partner
programme is gaining traction within the MoE, and whether it is focused on building the systems and
abilities in the MoE required to embed this change – or whether it is simply providing a solution outside
of the MoE system. Regularly revisiting these tools within the MoE, and in context of development
programming, proves valuable to assessing progress and understanding what has changed.
▪ Align and prioritise. The change space analysis tool may be useful as part of the annual work plan
process in the future to prioritise and focus interventions in areas where there is space to act.
Beyond the lessons and actions that have emerged from Phase 1 of the assignment, there are two areas
where further analysis may be relevant during Phase 2:
No. Date Activity M F Operational Senior Consultant Executive MOE My-EQIP DFAT Total
1 11-Jul-19 TWG Meeting 18 34 18 33 0 1 25 26 1 52
2 09-Aug-19 M&E Core Team Meeting 3 10 2 11 0 0 7 6 0 13
3 15-Aug-19 SQASF Team Meeting and Workshop 4 10 9 5 0 0 10 4 0 14
4 28-Aug-19 VEQASF team Meeting for Annual Work Plan 2019-2020 2 6 3 4 1 0 5 3 0 8
5 29-Aug-19 Research Task Team Meeting 0 21 13 6 1 1 17 4 0 21
6 21-Aug-19 CSTT Finalize to Questionaire of CSA P2 9 9 10 7 1 0 13 5 0 18
8 02-Oct-19 FGD for OCA with VEQASF 3 3 1 5 0 0 5 1 0 6
9 02-Oct-19 FGD for OCA with CSTT 5 3 4 3 1 0 5 3 0 8
53 108 63 83 5 10 102 57 2 161
Total