0% found this document useful (0 votes)
11 views10 pages

SABER_EMIS_Rubric - Questionnaire

Questionnaire

Uploaded by

Jean Marc
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
11 views10 pages

SABER_EMIS_Rubric - Questionnaire

Questionnaire

Uploaded by

Jean Marc
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 10

SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4) EMIS NFBE
Cameroon
Scoring
The system
contains crucial
components of a
comprehensive
enabling The system lacks The system The system The system
environment, major contains basic contains most contains
POLICY AREA 1: ENABLING ENVIRONMENT which addresses components of a components of a components of a crucial
related policy comprehensive comprehensive comprehensive components of
elements and enabling enabling enabling a
enables the environment environment environment comprehensive
functioning of enabling
an effective and environment
dynamic system

Institutionalization of system:
EMIS is institutionalized as an
integral part of the education
system and
the government
Responsibility: responsibility for
collecting, processing, and
disseminating education statistics
is given to a clearly designated Basic
institution or agency There is an components of a There is an Latent
existing legal legal framework Most elements of existing legal
Legal Dynamic framework: the legal There is not a legal
1.1 framework to or informal a legal framework framework to Emergin
Framework framework is dynamic and elastic framework in place
support a fully- mechanisms are are in place support a fully- g
so that it can adapt to functioning in place functioning EMIS
advancements in technology Establish
EMIS ed
Data supply: the legal framework Advanced
mandates that schools participate
in the EMIS by providing
education
data
Comprehensive, quality data: the
requirement for comprehensive,
quality data is clearly specified in
the EMIS legal framework

Page 1 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Data sharing and coordination: the


legal framework allows for
adequate data sharing and
coordination between the Ministry
of Education and agencies and/or
institutions that require education
data
Utilization: the legal framework
emphasizes data-driven education
policy
Budget: the education system
budget includes a line item for the
EMIS
Confidentiality: the legal
framework guarantees that
respondents' data are confidential
and used for the sole purpose of
statistics
The system is The system is
The institutional The institutional
institutionalized The system is not institutionalized
structure of the structure of the
within the specified in within the
system is not system is defined Latent
government, has policies and what government, has
Organizational clearly specified within the
well-defined exists does not well-defined
structure and Organizational structure and in policies, it has government, it has Emerging
1.2 organizational have well- defined organizational
institutionalize institutionalized processes some defined
processes, and has organizational processes, and has
d processes organizational organizational Established
several processes; EMIS several
processes and its processes, but its
functionalities has limited functionalities
functionalities functionalities are Advanced
beyond statistical functionalities beyond statistical
are limited limited
reporting reporting

Minimum Some staff are The majority of All staff are Latent
Qualified staff standards of qualified to staff are qualified qualified to operate
operate the
Personnel: the core tasks of the qualification are operate the to operate the the system and Emerging
Human system and not met for the system and system and well-established
1.3 EMIS are identified and the EMIS
resources opportunities are majority of staff limited frequent opportunities are
is staffed with qualified people Established
available to that operate the opportunities are opportunities are constantly available
improve their system and available to available to to improve staff Advanced

Page 2 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

performance and opportunities are improve staff improve staff performance and
retention not available to performance and performance and retention
Professional development: improve their retention retention
professional training is available for performance and
EMIS staff retention

Data collection: tools for data


collection are available
Database(s): databases exist under
The system has a The system has a
the umbrella of the data warehouse
well-defined well-defined
and have both The system has an
infrastructure to infrastructure to
hardware and software means The system has a infrastructure that Latent
perform data The system lacks a fully perform its
1.4 Infrastructur Data management system: there is a collection, well-defined basic or allows it to data collection,
incomplete perform some of Emerging
al capacity system in place that manages data management, and infrastructure management, and
collection, processing, and dissemination infrastructure its functions in an dissemination
integral manner Established
reporting functions in an functions in an
integral manner integral manner
Data dissemination: data Advanced
dissemination tools are available
and maintained by the agency
producing education statistics
Personnel and professional
development: the EMIS budget
contains a specific budget for
EMIS personnel and their The system budget
professional contains the
development The system
majority of The system budget Latent
Maintenance: the EMIS budget budget is
comprehensive, The system has a required categories is comprehensive,
contains a specific budget for The system suffers Emerging
ensuring that the basic or to ensure that most ensuring that the
1.5 Budget system maintenance and recurrent from serious
system is incomplete parts of the system system is
costs budgetary issues
budget are sustainable and sustainable and Established
sustainable and
Reporting: the EMIS budget efficient efficient efficient
contains a specific budget for Advanced
reporting costs

Physical infrastructure: the EMIS


budget contains a specific budget
for physical infrastructure costs

Page 3 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Efficient use of resources:


processes and procedures are in
place to ensure that resources are
used efficiently
A data-driven
The system has a culture exists that
A data-driven data-driven prioritizes data
culture prioritizes The system suffers culture that A data-driven management and
data as a because there is Latent
demonstrates a culture exists that utilization within
fundamental not a data-driven basic prioritizes data and beyond the
element of culture that Emerging
1.6 Data- Data-driven Culture appreciation of management and education system
driven operations and prioritizes data data and interest utilization within and evidence of
decision making, management and Established
Culture in developing and beyond the that culture is
both inside and data utilization in better data education system. present in daily
outside of the decision making. Advanced
utilization interaction and
education system. practices. decision-making at
all levels.

The system
The system has
The processes has basic The processes
some processes
and structure of processes and a and structure of
The system and a structure,
the EMIS are structure that the system are
POLICY AREA 2: SYSTEM SOUNDNESS lacks processes but they do not
sound and do not support sound and
and structure fully support the
support the the support the
components of an
components of an components of components of an
integrated system
integrated system an integrated integrated system
system
The system's data
structure has most
The data The system's elements of the The data Latent
architecture is The system's data data architecture data architecture, architecture is well-
Data structure does not includes some Emerging
2.1 Data architecture well-defined to however, it has defined to ensure
architectur ensure full system have a well-defined components, some deficiencies full system
e functionality data architecture however, it is that affect the functionality Established
incomplete system's
functionality Advanced

The data in the The data in the The data in the


2.2 Data coverage Administrative data: the The data in the The data in the
system is system is far from system is
EMIS contains administrative system includes system includes
comprehensive being comprehensive and
data

Page 4 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Financial data: the EMIS and covers comprehensive some of the data most but not all of covers all data
Latent
contains financial data administrative, and coverage is areas the data areas areas
financial, human limited
Emerging
Human resources data: the EMIS resources, and
contains human resources data learning outcomes
Established
data
Learning outcomes data: the EMIS
contains learning outcomes data Advanced
Basic tools and
processes are
Tools and available, but the Tools and Latent
processes are system is not processes are Tools and processes
available to There are tools and capable of available; are available to
processes to perform data Emerging
2.3 Data analytics Data analytics perform data conducting however, data
analytics at perform limited advanced analytics are not analytics at
tabulations different levels on a Established
different levels on analytical steps performed
a regular basis (e.g., predictive regularly regular basis
Advanced
models,
projections, etc.)

Quality assurance measures: the


system is dynamic and maintains The system in
quality assurance measures The system in The system in place place is not easily
place is elastic and is not easily adaptable and The system in The system in place Latent
Data requirements and easily adaptable adaptable to requires place is easily is elastic and easily
considerations: there are to allow for changes/advancem significant time adaptable, but it adaptable to allow Emerging
2.4 Dynamic system mechanisms for addressing new changes/advance ents in data needs, and resources to remains for changes /
and emerging data requirements ments in data accommodate
as no quality reasonably advancements in Established
System adaptability: the EMIS needs assurance standards changes and/or complex data needs
is elastic and easily adaptable to are used advancements Advanced
allow for changes and/or
advancements in data needs
Validity across data sources: Services provided Services provided
information brought together from by the system are There are The data is by the system are
valid across data There are serious inconsistencies consistent and valid across data
different data and/or statistical
2.5 Serviceability sources, integrate issues related to related to data valid; however, sources, integrate
frameworks in the EMIS is placed
non-education data validity and validity and some concerns non-education
within the data warehouse using
databases into the consistency consistency still exist databases into the
structural and consistency
measures EMIS, and archive EMIS, and archive

Page 5 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Integration of non-education data at the service data at the service


databases into EMIS: data from of EMIS clients of EMIS clients
sources collected by agencies by ensuring the by ensuring the
outside of the EMIS are integrated relevance, relevance,
into the EMIS data warehouse consistency, consistency, Latent
usefulness, and usefulness, and
Archiving data: multiple years of timeliness of its timeliness of its Emerging
data are archived, including source statistics statistics
data, metadata, and statistical Established
results
Services to EMIS clients: Services Advanced
provided by the system to EMIS
clients include ensuring the
relevance, consistency, usefulness,
and timeliness of its statistics
The system has
most mechanisms
The system has in place needed to
the mechanisms collect, save and The system has the
required to The system has produce timely, required
collect, save, basic high-quality mechanisms in
The system
produce, and lacks mechanisms to information for place to collect,
utilize mechanisms to collect, save, and use in decision save, produce, and
information, produce timely, making; however, utilize
POLICY AREA 3: QUALITY DATA collect, save, or
which ensures quality some additional information, which
produce timely,
accuracy, high-quality information; measures are ensures accuracy,
security, and information for however, its needed to ensure security, and
timely, high- decision making accuracy might accuracy, timely, high-
quality be questionable security, and/ or quality
information for timely information for use
use in decision information that in decision making
making can be used for
decision making
Concepts and definitions: data The The The The The methodological
fields, records, concepts, indicators methodological methodological methodological methodological basis for producing
and metadata are defined and basis for basis for producing basis for basis for educational
3.1 Methodological documented in official operations producing educational producing producing statistics from raw
soundness manuals along with other national educational statistics does not educational educational data follows
datasets, and endorsed by the statistics from raw follow statistics follows statistics follows internationally
government data follows internationally the basics of most required accepted standards,

Page 6 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Classification: there are defined internationally accepted standards, internationally internationally guidelines, and
education system classifications accepted guidelines, or good accepted accepted good practices
based on technical guidelines and standards, practices standards, standards,
manuals guidelines, and guidelines, and guidelines, and
good practices good practices good practices
Scope: the scope of education Latent
statistics is broader than and not
limited to a small number of Emerging
indicators (e.g., measurements of
enrollment, class size, and Established
completion)
Basis for recording: data recording Advanced
systems follow internationally
accepted standards, guidelines,
and good practices
Source data: available source data
provide an adequate basis for
compiling statistics Source data and
Source data and Source data and statistical
Validation of source data: source Source data and
statistical statistical techniques follow Latent
data are consistent with the Source data and statistical
techniques are techniques have most required
definition, scope, classification, as statistical techniques are
Accuracy sound and basic soundness elements to be Emerging
3.2 well as time of recording, reference techniques lack sound and reliable,
and reliable, and and reliability, sound and
periods, and valuation of education soundness and and statistical
reliability statistical outputs but statistical reliable, but Established
statistics reliability outputs sufficiently
sufficiently outputs do not statistical outputs
portray reality
Statistical techniques: statistical portray reality portray reality do not portray Advanced
techniques are used to calculate reality
accurate rates and derived
indicators
Professionalism: EMIS staff Education Education Education statistics
exercise their profession with Education statistics statistics contained within
statistics Education statistics Latent
technical independence and contained within contained within the system are
without outside interference that contained within contained within the system are the system are guided by all 3
the system are system are not Emerging
3.3 Integrity could result in the violation of the guided by limited mostly guided by principles of
public trust in EMIS statistics and guided by guided by principles of principles of integrity:
principles of principles of Established
the EMIS itself integrity (1 of the integrity (2 of the professionalism,
integrity integrity 3 principles of 3 principles of transparency, and
Transparency: statistical policies Advanced
professionalism, professionalism, ethical standards
and practices are transparent

Page 7 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Ethical standards: policies and transparency, transparency, and


practices in education statistics are and ethical ethical standards)
guided by ethical standards standards)
Periodicity: the production of Latent
The system
reports and other outputs from the
The system The system produces some The system The system
data warehouse occur in Emerging
Periodicity produces data and produces data and data and produces most produces all data
accordance with cycles in the
3.4 and timeliness statistics statistics neither statistics data and statistics and statistics
education system Established
periodically in a periodically nor in periodically and periodically and in periodically and in a
Timeliness: final statistics and timely manner a timely manner in a timely a timely manner timely manner
financial statistics are both manner Advanced
disseminated in a timely manner
The system is
The system is There are no The system is The system is
used by most
wholly utilized signs that the used by some wholly utilized by
education
by different users EMIS is utilized education different users for
stakeholders, but
POLICY AREA 4: UTILIZATION FOR DECISION for decision in decision stakeholders, decision making
is not fully
MAKING making at making by the but not for at different levels
operational in
different levels of majority of major policy of the education
governmental
the education education decision making system
decision making
system stakeholders
EMIS stakeholders: EMIS primary
stakeholders are identified and use
the system in accordance with the The system lacks The system is The system is
legal framework The system is openness to open to some open to the
The system is open Latent
open to education education education majority of
User awareness: current and to all education
stakeholders in stakeholders in stakeholders in education
potential EMIS users are aware of stakeholders in Emerging
4.1 Openness terms of their terms of their terms of their stakeholders in
the EMIS and its outputs terms of their
awareness and awareness and awareness and terms of their
awareness and Established
User capacity: EMIS users have capacity to utilize capacity to utilize capacity to utilize awareness and
capacity to utilize
the skills to interpret, manipulate, the system the system the system capacity to utilize
the system Advanced
and utilize the data produced by the the system
system in order to ultimately
disseminate findings
Utilization in evaluation: Data Data produced Data produced by
Data produced by Data produced by Data produced by
produced by the EMIS is used to by the system is the system is used
the system is used the system is not the system is used
assess the education system used in practice in practice by the
4.2 Operational use in practice by the used in practice by in practice by the
Utilization in governance: Data by some majority of
main education education main education
produced by the EMIS is used for education education
stakeholders stakeholders stakeholders
governance purposes stakeholders stakeholders

Page 8 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

Utilization by schools: Data


produced by the EMIS is used
by
schools
Latent
Utilization by clients: data
produced by the EMIS is used Emerging
byclients (including parents,
communities, and other actors)
Established
Utilization by government: the
system is able to produce Advanced
summative indicators (derived
variables) to monitor education
system
Understandable data: data are
presented in a manner that is
easily digestible Education
Widely disseminated data: statistics are Education statistics
education statistics are presented in an are presented in an
disseminated beyond the Ministry understandable understandable
of Education and/or the education manner, are Latent
The system suffers The system has The system has manner, are widely
statistics-producing agency to widely disseminated using
4.3 Accessibility from serious major minor accessibility
other EMIS stakeholders disseminated Emerging
accessibility issues accessibility issues a clear platform for
using clear utilization,
Platforms for utilization: platforms issues
platforms for Established
are standardized across the EMIS complemented by
utilization, user support
and are customizable to user needs complemented by Advanced
User support: assistance is user support
provided to EMIS users upon
request to help them access the
data

Effectiveness in Dissemination strategy: national Dissemination of Dissemination is A dissemination The dissemination


4.4 Dissemination is
disseminating governments have an information education neither strategic plan has been of education
reasonably
findings dissemination strategy in place statistics via an nor effective implemented; statistics via an

Page 9 of 10
SABER-Education Management Information Systems (EMIS) Rubric

Description of Scoring
Policy Levers Indicators
Best Practices Latent (1) Emerging (2) Established (3) Advanced (4)

EMIS is strategic, but however, there is EMIS is


Latent
strategic and ineffective room for strategic and
Dissemination effectiveness: effective improvement (for effective
Emerging
dissemination of EMIS statistics full effectiveness
is effective in relation to
Established
strategic
engagement)
Advanced

Participant's Name and title/designation: ____________________________________________________________________________


_____________________________________________________________________________________________________________
Date: _________________________________________________________________________________________________________

Page 10 of 10

You might also like