Performance Audit India
Performance Audit India
Performance Audit India
MANUAL OF
PERFORMANCE AUDIT
(Revised Edition, 2009)
Issued by
Principal Accountant General (Civil & Commercial Audit), Kerala.
P R E F AC E
Office and this office for the guidance of staff engaged in performance audit.
Nothing in this Manual shall be quoted as authority in correspondence
with outside authorities.
Suggestions for the improvement in the form and content of this Manual
are welcome. The Manual of Performance Audit will be maintained and updated
from time to time by the EPA(HQ) Section.
Thiruvananthapuram
Dated: 3.11.2009
S.NAGALSAMY
Principal Accountant General (C&CA),Kerala,
Thiruvananthapuram
CONTENTS
Chapter
Subject
Page
General
1-10
II
11-33
III
34 - 41
IV
Miscellaneous
42 - 49
Annexures
Annexure I
50
Annexure II
52
Annexure III
54
Annexure IV
68
Annexure V
70
CHAPTER 1
GENERAL
1.1
Introductory
SAI India has been carrying out performance audits, hitherto termed as
from 1
st
purpose of the reorganization was to enable the section to devote more attention to
Efficiency cum Performance audit of development schemes (Comptroller &
Auditor Generals letter No.2806-Admn 1/8 codes 61 Vol.II dated 18.11.1963 and
O.O.H.A/2-1.60-64/796 dated 1.1.1964).
1.3
The existing guidelines for performance auditing have been fine tuned in
1
PDF created with pdfFactory Pro trial version www.pdffactory.com
Performance Auditing:
Definition
1.4
2
PDF created with pdfFactory Pro trial version www.pdffactory.com
Performance audit should not confine the objectives to what has been
done but also examine what has not been done to meet policy objectives.
Appendix-C of Performance Auditing Guidelines contains illustrative list of issues
in performance audit of public sector programmes.
Given the size, complexity and diversity of entity operations, it is
generally not practicable to attempt assessment of the overall performance of
departments or entities. Consequently, performance audits are usually directed
towards specific functions, activities, programmes or operations of the entity.
Performance audit findings are not a random assortment of various financial and
regularity audit findings but an assessment of either the whole or part of the
programme/subject/function/system.
(Paragraphs 1.30,1.31 and 1.32 - Performance Auditing Guidelines-SAI India)
The Process
1.6
The
3
PDF created with pdfFactory Pro trial version www.pdffactory.com
expected impact and value of the audit, the likely improvements, better value for
money and quality of expenditure resulting from the audit should be considered
throughout the audit.
(Paragraphs 1.50, 1.51, 1.52, 1.53 and1.54 - Performance Auditing Guidelines SAI India).
Mandate for Performance Audit
1.7
The mandate of SAI India for audit is derived from the constitution of
India, as established under the Comptroller & Auditor Generals (DPC) Act 1971.
The mandate of Comptroller & Auditor General of India for performance audit is
governed under Sections 13, 14, 15, 16, 17, 19 and 20 as the case may be, read
with Section 23 of this Act.
Annexure I contains instructions of the Government of India and Annexure
II
contains
instructions
by
Government
of
Kerala
issued
to
all
The Performance Audit Wing comprises EPA HQ section and EPA parties
entrusted with the performance audits. The EPA parties each under the control of
an Audit Officer/Senior Audit Officer and the HQ section headed by an Audit
4
PDF created with pdfFactory Pro trial version www.pdffactory.com
Officer/Senior Audit Officer are under the charge of a Group Officer who is the
designated supervisory officer.
Supervision of performance audit involves ensuring that:
the audit is carried out in accordance with the auditing standards and
practices of the SAI;
the audit plan and action steps specified in the plan are followed unless
a variation is authorised;
working
papers
contain
evidence,
adequately
supporting
all
1.9
by the audit officer, during the course of field audit, further supervised
by group supervisory officer; and
implementation of the audit and reporting rests with the group supervisory officer,
who should be involved with all key elements of the performance audit process.
5
PDF created with pdfFactory Pro trial version www.pdffactory.com
The performance audit and the process documentation should demonstrate the
discharge of his/her supervisory role at each stage.
1.12
All audit staff and officers are individually and collectively responsible for
the quality of the audit reports. It is, however, imperative that the audit personnel
understand the most important role that they have to play. The Audit team is
primarily responsible for data collection.
Supervisory Officer are responsible for data analysis. Audit findings, conclusions
and recommendations should be arrived at with the prior approval of the Prl
Accountant General.
(Paragraphs 7.5, 7.6 and 7.7.-Performance Auditing Guidelines-SAI India)
Responsibility of the Supervisory Officer
1.13
that the work plan is executed with integrity and care in relation to the
auditing standards;
6
PDF created with pdfFactory Pro trial version www.pdffactory.com
particularly the filed audit rest with the Audit Officer. Some of the more important
supervisory responsibilities of the audit officers are:
ensuring that the audit work is carried out in harmony with audit plan,
more particularly in tune with the audit objectives;
the work performed and the results including the process of audit are
separately documented, first in support of audit findings, conclusions
and recommendations and the second in support of due diligence
exercised by the audit team; and above all
Progress reporting
1.15
The Audit Officer and Group Supervisory Officer will be responsible for
reporting the progress of audit to the Prl Accountant General, at intervals as may
be provided in the detailed audit implementation plan or as ordered by the Prl
Accountant General. The progress report should contain all important information
relating to the progress of audit, extent of data collection, sources of data
collection, analysis of evidence, time spent in audit against the time allotted,
dialogue with entity, problems encountered in the course of audit and modification
applied to the audit plan, if any.
The Group Supervisory Officer and the Audit Officer should also furnish
assurance Memo, as prescribed by the Prl Accountant General, on completion of
audit of each unit or stage in the performance audits.
(Paragraphs 7.8 to 7.11 of performance Auditing Guidelines-SAI India)
1.16
The Group Supervisory Officer and the Audit Officer should discuss with
the Prl Accountant General the progress of performance audit periodically and get
his guidance.
7
PDF created with pdfFactory Pro trial version www.pdffactory.com
Headquarters Section
1.17. EPA Wing comprises EPA (HQ) section and EPA Parties entrusted with
performance audit of selected topics. EPA Parties each under the control of an
Audit Officer and the HQrs section headed by an Audit Officer are under the
change of Sr. Deputy Accountant General (Commercial).
The following are the main items of work assigned to the EPA(HQ)
section:
(i)
(ii)
(iii)
(iv)
(v)
(vi)
(vii)
(viii)
(ix)
(x)
(xi)
1.18. In order to watch the progress of work connected with performance audit
EPA(HQ) section should maintain a register showing the names of schemes
selected for performance audit, details of allotment among various parties, the
stage of work from time to time, details of performance audits finalised, details of
issue of copies of performance audit reports etc. This register should be submitted
to the Prl Accountant General on the 15th of every month.
The responsibility for keeping this Manual up-to-date rests with
EPA(HQ)/Section.
1.19. The general instructions in the Manual of the Outside Audit Department
applicable to OA(HQ) and OA Parties will apply mutatis mutandis to EPA(HQ)
and EPA parties.
Leakage of information
1.20. Performance audit of a scheme may often involve probing into policies of
governments. It may happen that the facts brought to light may be such as will not
be in public interest to be divulged to any but officers competent to deal with them
finally. Leakage of information on such points will not only cause considerable
embarrassment to the Government but also result in possible damage to the
prestige of this office. It has therefore, to be ensured that cases dealt with by the
EPA wing are processed with utmost secrecy and tact notwithstanding the fact that
they may be eventually brought to the notice of the Legislature/Parliament
through the report of the C&AG. The instructions laid down for dealing with
secret documents should be observed by all the members of the staff in dealing
with such cases.
Data collected by Audit
1.21. Data collected by Auditor either directly or through consultants or through
other sources engaged to carry out surveys etc. in connection with Performance
Audits should not be made available to any other individual or organisation.
(Headquarters Office order No.391-Rep(C)/141-2006 dated 15 November 2006)
9
PDF created with pdfFactory Pro trial version www.pdffactory.com
CHAPTER II
PROCEDURE FOR PERFORMANCE AUDIT
2.1
law and order and revenue collections agency has enlarged and the activities
of the Government embrace multifarious functions and developmental
programmes covering almost all sectors of the State economy.
This has
how far the physical and financial targets have been achieved.
(ii)
how far the social and economic objectives have been realized.
(iii)
(iv)
(v)
10
PDF created with pdfFactory Pro trial version www.pdffactory.com
2.3
done with utmost care after making a preliminary study and taking into account
the various factors apart from the financial outlay involved. It is desirable that
schemes which are going on for atleast two to three years are taken up for
performance audit.
2.5
audit strategic planning. After setting the strategic goals and objectives, the data
on entity contained in budget papers, programme papers, plan documents, annual
reports, parliamentary debates and reports, media concerns, research and reports
of international agencies, follow up and leads from past audits etc. should be
analysed on the parameters of risk, materiality, significance, visibility, coverage
etc. to select subject for performance audits to be carried out over the strategic
plan period.
2.6
11
PDF created with pdfFactory Pro trial version www.pdffactory.com
2.8
(ii)
Portfolios
maintained
by
Central
Audit
Sections
and
EPA(HQ)Section.
(iii)
(iv)
Press cuttings
(v)
(vi)
2.12
All the performance audits suggested by the CAG should be taken up and
2.14. Performance Audit Topics proposed for inclusion in State Audit Report
have to be sent to CAGs Office by such dates as intimated by HQrs. For this
purpose the process of selection of topics has to be started sufficiently early. For
getting suggestions from State Government, letters are issued by EPA Hqrs to
Government Secretaries of important departments like Finance and Planning and
Economic Affairs in September/October each year. Suggestions are also invited
from all Group Officers. Topics suitable for Performance audits are also identified
by EPA Hqrs from budget documents, administrative reports, plan documents etc.
From the list of topics available eight to ten topics are short listed for further
examination. While selecting these topics the following factors may also be
considered.
Topics which have been reviewed during the last five years may not be
considered
13
PDF created with pdfFactory Pro trial version www.pdffactory.com
14
PDF created with pdfFactory Pro trial version www.pdffactory.com
from the auditability angle, sensitive subject from one or other points of view,
very low risk or materiality and negligible perceived impact of audit. The topics
proposed for Performance Audit are assigned to EPA Parties for pilot study. The
pilot study should be completed within one month. The Party may visit offices
connected with the implementation of the scheme/project,
collect necessary
so that an overall
(2)
(3)
Accounts
(4)
Economic Review
(5)
(6)
Project Reports
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
scheme has
been covered)
(15)
Audit Reports (Civil) of Kerala State for earlier years and Audit
Reports for Revenue Receipts/commercial undertakings.
(to see whether the scheme has been reviewed already in whole or
part)
(16)
(17)
15
PDF created with pdfFactory Pro trial version www.pdffactory.com
(18)
Departments
implementing
the
programmes.
2.16
(19)
(20)
Secretariat files
(21)
Departmental files
understand the nature of the programme right from the stage it was conceived.
During the pilot study, it should be seen :
(i) Whether adequate survey was made before launching the project
(ii)
(xi) What were the areas where it was being implemented and who were
the implementing agencies.
2.17
The results of the pilot study should be submitted to the Prl Accountant
General within the time allowed and his instructions obtained for the conduct of
detailed performance audit.
Performance Audit -Implementation
2.18
16
PDF created with pdfFactory Pro trial version www.pdffactory.com
2.20
(ii)
(iii)
(iv)
(v)
(vi)
(vii)
Section of the Act under which a particular audit is covered, read with
Section 23 of the Act; and
17
PDF created with pdfFactory Pro trial version www.pdffactory.com
2.22
Strategic planning for performance audit is not the same as the strategic
planning of SAI India, but should be consistent with it.
Prepare performance audit strategic plan to fulfill the strategic goals and
objectives and document how the selected performance audits will
accomplish them.
Ensure that the strategic goals and objectives are set in the context of
perceived risks and materiality of issues of financial, non financial or
governance nature;
Be alive to the major policy shifts affecting the governance and large
sections of public and select cutting-edge and sunrise subjects for
performance audit;
2.23
18
PDF created with pdfFactory Pro trial version www.pdffactory.com
skill and knowledge required and those available in-house which forms a
basis for training programmes, engagement of consultants/experts and
outsourcing.
2.24
Gather all relevant data and documents to understand the entity and the
programme;
Intimate the entity about the intent to carry out the performance audit.
State the reasons for conducting the performance audit by setting out
audit objectives and sub-audit objectives;
Set audit objectives under distinct themes and sub-themes with reference
to programme objectives, further developed in the context of audit
concerns;
19
PDF created with pdfFactory Pro trial version www.pdffactory.com
Make a formal presentation to the entity of the audit plan, including the
audit objectives, criteria, evidence required and tentative location of
audits and invite the representatives of other concerned departments also.
2.25
Examine and document how the required skill can be fully met in-house;
without compromising audit quality; and
Follow the procedure in vogue within the SAI in the matter of procedure
for procurement of services of expert/consultants.
2.26
Entity cooperation and response being the hallmark for the success of
performance audits, Prl Accountant General will be called upon to adopt
a persuasive approach to attain goal-matching;
Rather than quitting in the face of inadequate response, the objective will
be to continue making efforts with a view to making such cooperation a
routine in time to come;
The methods of persuading the entity for full cooperation is left to the
judgment of Prl Accountant General;
and
finally
to
the
implementation
of
the
recommendations and
implementation of the
recommendations.
2.27
The members of audit team and supervisory officer will be made aware
of the quality control system within the offices of Prl Accountants
General and in SAI headquarters;
SAI may draw up a quality assurance programme for each office; and
21
PDF created with pdfFactory Pro trial version www.pdffactory.com
The duties and responsibility of each member of the audit team, audit
officer and supervisory officer shall be stated clearly with reference to
compliance to the prescribed procedures, professional conduct, field
audit, evidence/data gathering, quality of data and documents,
documentation, dialogue with entity, audit test, audit findings,
recommendations, guidance to the team members,
monitoring,
A review may be made during the course of audit and upon conclusion
of the performance audit on the quality of fulfillment of the
responsibility by the performance audit team members and supervisors;
for
each
procedure,
data
collection,
data
analysis,
The process document should contain all considerations that do not form
part of the working papers for the performance audits in support of the
audit findings, conclusions and recommendations; and
2.32
22
PDF created with pdfFactory Pro trial version www.pdffactory.com
Fundamental principles
Apart from the question whether the things are being done the right way,
it also addresses the question of whether the right things are being done,
in other words, it also focuses on what is not being done rather than only
on what is being done;
Performance audits also address the issues of equity and ethics, which
impacts one or more of the core concerns of economy, efficiency and
effectiveness and include, apart from other, integrity in preparation of
performance reports;
23
PDF created with pdfFactory Pro trial version www.pdffactory.com
The subjects selected for performance audits should include cutting edge
issues that form the core of governance and sunrise issues in the light of
policy shifts;
While the performance audit may and should assess the implementation
of the policy through one or more programmes, the scope of audit should
be limited to assessing the impact of the implementation of policy and
the policy per se should not be questioned;
knowledge-based
exercise,
in which
more EPA Parties. Usually the Party which did the pilot study would be assigned
the topic. Based on the Pilot study the Party is required to prepare detailed audit
implementation guidelines.
specify the
24
PDF created with pdfFactory Pro trial version www.pdffactory.com
method, size of sample, audit objectives, audit criteria etc. The time frame in the
guidelines should be such that the Report is finalized within the overall time
limit prescribed by CAGs office for submission of Performance Audit Reports.
The guidelines approved by Prl AG are forwarded to CAGs Office for approval.
Changes suggested on comments of HQrs on the guidelines should also be
considered while conducting performance audit.
For All India Performance Audits the detailed guidelines are received from
DGACR, PD(ESM), PD(SD) etc. and the audit is to be carried out strictly as per
the guidelines and adhering to the prescribed time schedule.
2.35
Audit objectives
Audit objectives will be the focus of field audit and data collection;
All audit objectives and sub-objectives will address one or more of the
core audit concerns of economy, efficiency and effectiveness and the
concerns addressed by each audit objective and sub-objective will be
identified against each of them;
The evidence testing will also revolve around the audit objectives; and
25
PDF created with pdfFactory Pro trial version www.pdffactory.com
Performance audits need not confine to the entity established criteria, but
should go beyond to establish more criteria to provide tests for all audit
objectives and sub-objectives; and
2.37
26
PDF created with pdfFactory Pro trial version www.pdffactory.com
Some of the
Sampling
2.39
Audit findings
Audit findings should be developed on the basis of audit tests carried out
on the sample;
All evidence used for audit findings should be tested transparently or the
standards of relevance, competence and sufficiency and the basis on
which the satisfaction of fulfilling the standards is established, should be
documented in the working papers.
2.40
2.41
expert opinion
Relevance
28
PDF created with pdfFactory Pro trial version www.pdffactory.com
ii.
Objectivity
iii.
Documentation
iv.
Externality
v.
Sample size
vi.
Sampling method
vii. Corroboration
viii. Timeliness
ix.
Authoritativeness
x.
Directness
xi.
Adequacy of controls
B.
procurement are:
Requirement /provisioning
C.
D.
Contract Management.
Tender procedures
E.
Agreed by entity
Free from auditors bias
Clear, understandable and comparable.
F.
prescribed:
a) Determining the need for a consultant
b) Identifying and engaging the consultant
c) Monitoring the work of the consultant
d) Evaluation of final out put
Determining the need for a consultant
Services of consultants can be used for advice and guidance on a specific
issue before audit or for carrying out specified tasks on behalf of Audit.
Identifying and engaging consultants
GFR and Manual of Policies and Procedure of Employment of Consultants
issued by GOI in August 2006 are applicable which cover the use of Individual consultants
Consulting firms
Universities and research organizations
Government agencies and
Non Governmental organizations
Engagement of consultant is normally done in two stages:
a) by inviting expressions of interest and
b) by asking the short listed consultants to submit technical and financial
proposals.
Monitoring the work of consultants can be done by
a) Appointing a nodal officer
b) Through a work plan to be approved before commencing work
c) Consultants interaction with auditee
Evaluation of work done by the consultant
Final compliance by the consultant with contract engagement would be
carried out using commonly applicable bench marks of completeness of work,
availability of inputs when required, reliability, usability, accuracy, timeliness,
31
PDF created with pdfFactory Pro trial version www.pdffactory.com
discussion papers to draft performance audit report, forwarding of the draft report
to the entity for confirmation, acceptance and comments, if any, procedure for
approval of performance audit report within the SAI and presentation to the
Parliament, Legislature etc. Thus the reporting process begins with discussion
papers, navigates through the stages of audit observation, field audit report and
ultimately to the draft performance audit report and the final report. While every
performance audit is to culminate in development of a report containing the audit
findings and recommendations, report writing is to be viewed by the performance
audit teams as a continuous process.
3.2
The performance audit teams should keep the following in mind during
should take action to get timely replies to the audit enquires. In case the
replies are not received till the finalization, it should be mentioned in the
report that information called for by audit (period) has not been received
from the department till then (period). The data collected or obtained from
departmental offices and unit offices should be consolidated.
The emphasis should be on quality than on lengthy narration. More stress
should be on analysis of the strength and weakness of the organisation.
The performance audit should encompass economy, efficiency and
effectiveness of the project/scheme. The report should be so balanced that
among other things, points from financial audit as well as achievements of
social objectives/aspects of the scheme are highlighted.
32
PDF created with pdfFactory Pro trial version www.pdffactory.com
There may be some plus points in favour of the project authority. The
positive aspects noticed in the performance audit shall also appropriately
be included. However, serious irregularities like non-realisation of social
and economic objectives, non-observance of time schedule and cost
estimates, over capitalisation, large overhead expenditure, over-staffing,
idle personnel, work backlogs, delay in construction of projects resulting
in cost overrun, absence of trained manpower, plants operating below rated
capacity, excessive inventories, absence of sound pricing policy,
unauthorized occupation of government lands, idle plant and equipment,
leakage of revenue, overpayments, loss due to pilferages or nonobservance of proper procedures, improper, avoidable or infructuous
expenditure etc. should be included in the Report.
For expenditure and receipts figures, the accounts figures should generally
be adopted. The departmental figures should also be mentioned, specifying
the reasons for the differences, if analysed or pointing out the nonreconciliation of the figures by the department. When figures are not
ascertainable from accounts and departmental figures are adopted, the fact
should be mentioned in the report.
In the case of centrally assisted schemes, the pattern of central assistance,
conditions attached, actual amount of central assistance received,
expenditure incurred and position of excess/shortfall in respect of central
assistance should also be mentioned. When a scheme is implemented in
more than one sector, such as under plan with central assistance and under
non-plan with state finance alone, the audit observations may be so
grouped that it is easy to identify, to which sector they relate.
Information regarding the number of units test checked and out of how
many, particular defects or weaknesses that have been noticed is to be
furnished so that the comment in the performance audit report is
appreciated by the PAC in its proper perspective.
The report should contain significant evidence of audit. As such leaning
heavily on departmental reports and just copying from them should be
avoided. Even when extracts from departmental records are quoted, it
33
PDF created with pdfFactory Pro trial version www.pdffactory.com
audit reports:
v The audit report should be complete i.e. all pertinent information
required to satisfy the audit objective, including the information relating
to the scope, criteria, evidence, conclusions and recommendations should
be available in the report;
v The obligation of the audit report to be accurate implies that the evidence
prescribed is true and the conclusions are correctly portrayed;
v The objectivity of audit report is convincing if the results of audit are
presented persuasively and the conclusions and recommendations
followed logically from the facts presented;
v The report should be clear, which signifies that it should be easy to read
and understand
v The report should be concise, which requires that the report should be of
optimum size, no longer than necessary to convey the audit opinion and
conclusions.
v Balanced reporting should be adopted in the presentation of reports.
Audit findings and conclusions should not only be based on relevant and
34
PDF created with pdfFactory Pro trial version www.pdffactory.com
sufficient evidence, but also presented in an objective, fair and nonpartisan manner. For this,
o apart from deficiencies / short comings/ lapses, the positive
contribution of audited entities should also be mentioned in the
reports wherever possible.
o use of the terms tenable and irregular may be discontinued and
instead suitable expressions may be used such as
(i) the reply does not explain why.
Or
(ii) the reply is not in consonance with .
Or
(iii) the reply is contrary to .
Or
(iv) the reply does not correctly interpret etc.
The rebuttals should always be in the form of a reasoned argument.
v Consistency of the report is secured by ensuring that it does not contain
contradictory findings or conclusions in similar context or the
conclusions on the same segment in different sections or parts of the
report are not incompatible.
v The report is constructive if it manifests a remedial approach rather than
a critical approach and includes appropriate recommendations.
v The report adds value to the entity, if it is timely.
v The acquiescence to the report, including the audit conclusions and
recommendations grows with display of entity cooperation, entity
responses, audit methodology, audit criteria and evidence, etc. within the
performance audit reports.
3.4
structure:
Title: the subject of the performance audit.
Highlights: major audit findings either in the sequence of their
materiality or in the same sequence as the audit objectives and sub
objectives;
35
PDF created with pdfFactory Pro trial version www.pdffactory.com
The
36
PDF created with pdfFactory Pro trial version www.pdffactory.com
as
the
statement
of
the
audit
objectives.
Conclusions,
The
co-operation,
acceptance
of
the
37
PDF created with pdfFactory Pro trial version www.pdffactory.com
to
the
orders
of
the
Government
issued
on
the
38
PDF created with pdfFactory Pro trial version www.pdffactory.com
On receipt of the response of the entity and observations of the SAI top
Publication
39
PDF created with pdfFactory Pro trial version www.pdffactory.com
CHAPTER- IV
MISCELLANEOUS
4.1
However, such
Has the
competent
authority
(i.e.
Legislature)
for
the
programme
Objectives
40
PDF created with pdfFactory Pro trial version www.pdffactory.com
Implementation
Direction
Economy and
Efficiency
Do
system
procedures
and
practices
promote
Has the
management
monitored,
reported and
41
PDF created with pdfFactory Pro trial version www.pdffactory.com
Effectiveness
adverse
or
beneficial
consequences
occurred?
Acceptance
Responsiveness
appropriately
to
changing
technology,
Protection of
resources
Monitoring and
reporting
Accountability
Relationship
42
PDF created with pdfFactory Pro trial version www.pdffactory.com
Review
managing
with
economy,
efficiency
and
effectiveness?
Equity
impartiality
Ethics
Transparency
4.3
The impact
From the time a subject is selected, through the strategic planning and
throughout the pilot study and performance audit, the group supervisory officer,
EPA(HQ) section and the audit team must keep in mind that the performance
43
PDF created with pdfFactory Pro trial version www.pdffactory.com
audit culminates in creating the following impact in the entity and adds value to
the programme management.
4.4
Economy
4.5
4.6
Nationalisation of facilities.
Efficiency
Effectiveness
4.7
4.8
44
PDF created with pdfFactory Pro trial version www.pdffactory.com
4.9
Improved accountability
4.10
Internal control
One of the objectives of performance audit is study and evaluation of the
internal control that assist the conduct of the business of the entity in an economic,
efficient and effective manner, ensuring adherence to the management policies
and producing reliable and timely financial management and performance
information.
45
PDF created with pdfFactory Pro trial version www.pdffactory.com
4.11
controlled by the specialized IT audit group, the performance auditors may come
across large number of cases wherein they will have to conduct audit where data
and information systems are entirely or largely maintained in an IT environment.
The performance auditors will, therefore, be called upon to develop detailed
guidelines for audit in IT environment and seek collaboration with the IT Audit
wing, where specialized skill and knowledge are required. Appendix B of The
Performance
Audit
more
important
Portfolios
Each IAU Section should send a control Register indicating the details of
Audit Report of the state concerned, year, paragraph number, brief particulars, etc.
should be noted. This register should be referred to by the EPA parties when they
commence performance audit of any scheme.
Maintenance of Library books
4.14
46
PDF created with pdfFactory Pro trial version www.pdffactory.com
entries should be made in the Register of books. The issue of the publications
should be noted in the sections issue register and necessary acknowledgements
obtained. The return of the documents should also be watched.
verification should be conducted at least once a
year
and
the
Physical
results
of
47
PDF created with pdfFactory Pro trial version www.pdffactory.com
ANNEXURE I
(Referred to in Para 1.7)
F.No. 6(5)-B(R)/99
Ministry of Finance
Department of Economic Affairs
Budget Division
New Delhi the 13th June, 2006.
Office Memorandum
Clarification has been sought whether Performance Audit falls within the
scope of audit by C&AG under Comptroller and Auditor Generals(Duties,
Powers and Conditions of Service) Act.1971.
2.
The Government has considered the matter. Under Section 23 of the DPC
Act, 1971, the Comptroller and Auditor General of India has the powers to make
regulations for carrying into effect the provisions of the Act in so far as they relate
to scope and extent of audit. In pursuance of these provisions C&AG has been
conducting performance audits in addition to financial audits and compliance
audits based on guidelines/principles/regulations framed for the purpose.
All
audit reports of the C&AG are placed before Parliament and State legislatures, as
the case may be, as constitutionally mandated.
3.
the audit of economy, efficiency and effectiveness in the receipt and application of
public funds is deemed to be within the scope of audit by Comptroller and Auditor
General of India for which Performance Auditing Guidelines drawn up by the
Comptroller and Auditor General of India already exist.
4.
September, 1978 issued from the Ministry of Finance, clarifying the procedure in
respect of submission of official documents for audit without any apprehension
and with due care with respect to custody and handling of classified files in
accordance with standing instructions.
5.
The respective subordinate officers and other entities that come under the
(P.R.Devi Prasad)
Officer on Special Duty (FRBM)
49
PDF created with pdfFactory Pro trial version www.pdffactory.com
ANNEXURE II
(Referred to in Para 1 .7)
GOVERNMENT OF KERALA
No.52/2006/Fin
and
Auditor
General
of
India
and
all
Government
(ii)
(iv)
The replies to the audit enquires shall be furnished at the time of audit
itself so that the instances of dispute of facts and figures after
finalisation of the Reports do not arise.
(v)
K. Jose Cyriac
Principal Secretary (Finance)
ANNEXURE III
(Referred to in Para 2.35)
51
PDF created with pdfFactory Pro trial version www.pdffactory.com
Key questions
1.
Explanatory notes
Apart from collection of
documents and data,
their processing for the
desired objective is
equally important. The
processing is aimed at
comprehensive
understanding of the
subject.
Have
other
stake-holder Involvement of other
(Ministry
department
of
departments/agencies
Finance,
Planning
and taking note of their
Commission/ Board, other
concerns
on
connected
ministries/
performance strengthens
departments,
etc.
been
the procedure and the
associated in planning/ during
performance audit is
presentations etc.?
likely to attract greater
and wider support and
acceptance.
Has pilot study/preliminary
5.
52
PDF created with pdfFactory Pro trial version www.pdffactory.com
6
Programme
flow chart and
risk assessment
Thrust areas
53
PDF created with pdfFactory Pro trial version www.pdffactory.com
Audit
objectives
10
11
12
It is rare that an
assessment can be
made with straight
yes or no answer.
13
14
54
PDF created with pdfFactory Pro trial version www.pdffactory.com
effectively?
15
16
Presented
in 17
order
of significance
Statement
of
audit
objectives in order of their
significance will facilitate
communication
of
conclusion in the same
order.
Relate to one 18
or more of
economy,
efficiency and
effectiveness
Stating
obviously
the
concerns of economy,
efficiency
and
effectiveness(and
within
each of them of equity
and ethics) provides
assurance of adherence to
the
Principles
of
performance audit.
19
20
Self test
55
PDF created with pdfFactory Pro trial version www.pdffactory.com
Guidelines?
21
22
23
Value addition 24
orientation
25
56
PDF created with pdfFactory Pro trial version www.pdffactory.com
It is important to relate
the audit objectives to
the
subject(target/beneficia
ry/affected public) to
turn
around
the
performance
audits
from management to
performance and from
government
to
governance
with
emphasis on results.
Affirmation
and
verifications of the
expected outcome of
the performance audits
ensures that these are
carried out with view to
adding value to public
sector programme.
26
Scope
27
B.
Use
of
evaluative
techniques
in
performance
audit
renders
the
performance
audit
more incisive and is
consistent with the
contemporary
best
practices.
57
PDF created with pdfFactory Pro trial version www.pdffactory.com
agreement to the criteria used for audit test programme on various questions,
without having to share the entire study design with them.
It is important to note that the conclusions on performance cannot be
straightaway developed on the basis of numerical count of the answers to the
detailed issues for each objective. The findings(answers) of the lowest and their
higher level sub-issues ought to be weighed and evaluated critically with
reference to their relative values in providing appropriate answers to the next
higher level questions and finally assessment of the performance against the audit
objective to which the issues, sub issues and sub-sub issues relate.
Key questions
Explanatory notes
Feature
Issue
analysis
28
29
30
31
32
58
PDF created with pdfFactory Pro trial version www.pdffactory.com
It is important to keep
the issues within the
boundary of each
audit objectives to
enable an assessment
on the basis of the
answers to the issues
While it is not
intended
to
straightway apply the
rule of seven being
followed by NAO,
the ground rule that
may be followed is
the capacity of the
memory to retain the
connected issues at a
time/together.
34
It is important to find
definite answers to
the
lowest
level
questions to level
questions to enable
convincing and clear
assessment
of
performance
35
36
37
C. Study design
Study design is the methodology to find answers to the lowest levels of
questions developed as a result of issue analysis. The answers are found with help
of audit test programme consisting of the test of the hypothesis behind the
question with help of a comparison between the expectation/criteria (what should
59
PDF created with pdfFactory Pro trial version www.pdffactory.com
be) with the observation (what is). For comparison against the norm one or more
criterion has to be adopted or determined for each test. The test is carried out
against the criteria with help of the observed data
1,
Key questions
Explanatory notes
Study
design
38
Criteria
39
Data/
Evidence
40
41
42
43
44
60
PDF created with pdfFactory Pro trial version www.pdffactory.com
Feature
Key questions
Explanatory notes
beneficiaries, attendance
data, etc.) been identified
and details indicated in
the explanatory notes?
D:
45
46
46
Criteria
Criteria provide the basis of comparison between the expectation and
that, which actually exists. Without determining the expectation in advance there
can be no objective and unbiased assessment of performance. It may be noted that
criteria have relevance in the context of audit questions and audit tests against
them. Therefore, they are not always available readily, except where audit
questions are such that the entity set parameters, including national and
programme indicators can be straightaway applied for particular tests. In some
Prior determination of data, its gathering methods and analysis techniques should not be viewed
as being rigid. It does not preclude a review and revision as per the professional judgement of the
Prl Accountant General if it is warranted by circumstances as the performance audit proceeds. Yet
the measure of the robustness of audit implementation guidelines is in the minimal necessity of
revisions in them.
61
PDF created with pdfFactory Pro trial version www.pdffactory.com
Source
criteria
Key questions
48
Explanatory notes
Criteria being the most
crucial for convincing
and objective audit
test;
must
be
determined
as
perfectly as possible.
The limitation of skill
and
capacity
to
determine the most
appropriate
criteria
within the Department
must be overcome, if
necessary
through
subject specific expert
consultancy.
51
62
PDF created with pdfFactory Pro trial version www.pdffactory.com
The requirement of an
answer in the form of
Transparent
testing
and documentation is
an effective frame
work of quality control
and quality assurance.
54
Identification of the
criteria with reference
to the issues that
address input, process,
outputs and outcomes
assist determination of
the most appropriate
criteria
55
The
output
and
outcome attributed to
the programme can be
established only if
their status before the
programme or at the
beginning of the
period covered in
performance audit is
known.
56
52
53
Even during the period of the programme under audit, there could be other factors that may
contribute to the output and outcome. While it is recognized that it is difficult to segregate them
between what is attributable to the program in question and hose attributable to other factrs, an
attempt in this direction will add further quality to the performance audits.
63
PDF created with pdfFactory Pro trial version www.pdffactory.com
57
It is not intended to
obtain concurrence of
the entity to the audit
questions/tests, which
is the prerogative of
the audit, but only for
acceptance of criteria
for tests. Care will
have to be taken that
the transparency may
not lead to the
undesirable outcome
of either complete or
selective withholding
of information/data or
possible manipulation
of data by the entity.
Thus only what is
required to be tested
may be shared with the
entire issue analysis
and study design in
their original form.
64
PDF created with pdfFactory Pro trial version www.pdffactory.com
58
59
60
65
PDF created with pdfFactory Pro trial version www.pdffactory.com
Annexure IV
(Referred to in para 3.5)
CHECK LIST FOR PERFORMANCE AUDITS REPORTS
Issues
A: General
Quality Features:
B: Audit
objectives
C: Evidence
D: Audit
conclusions/
Conclusions
/Highlights
Quality parameters
i Confirm that the structure of the report is consistent with
that prescribed in paragraph 6.29 of the Performance
Auditing Guidelines;
ii Confirm that the procedures prescribed in the
Performance Auditing Guidelines, in particular with
reference to the following have been adhered to and list out
the exceptions, if any
- Pilot /preliminary study;
- issue analysis and study design (including evidences and
audit criteria); and
- cooperation of the auditee.
iii
Confirm that testing of objectives (para 3.16 of PA
Guidelines), evidences (para 5.22 of PA guidelines) and
recommendations (para 4.43 of PA Guidelines) were
carried out; and
iv
list the expected value addition to the
programme/organization through the performance audit;
i State the total number of audit objectives set for the
performance audit;
ii Confirm that audit objectives are set out in order of their
significance and materiality;
iii Relate each audit objective to the issues of economy,
efficiency and effectiveness1; and
iv Relate each audit objective (only numbers) to the total
number of issues (and each issue to sub issues).2
i. State the method (s) of sampling used for evidence
gathering;
ii Confirm that the size of the sample used for forming the
basis of the conclusions is uniform throughout the report
(for each type/stage of data);and
iii Confirm that the reporting is balanced and the test results
on the entire sample, including positive achievements have
been analyzed for conclusions rather than reporting only the
cases of adverse finding of individual transactions.
i. Identify the paragraphs containing conclusions on
performance with conclusions/ each audit objective3.
ii Do the highlights consist of self- contained audit
conclusions on performance stated as complete sentences
and are arranged in order of their importance?
66
PDF created with pdfFactory Pro trial version www.pdffactory.com
iii
Do the self-contained highlights and the paragraphs
dealing with each audit objective contain:
The conclusions;
Impact and /or future risk of underperformance;
The causes of under performance; and
Factors leading to satisfactory or good performance
E:
i. State the number of recommendations and correlate them
Recommendations
to the audit conclusions4; and
ii. Relate each recommendation to the causes of
underperformance
and
factors
for
satisfactory
5
performance .
F:
Language
i Confirm adherence to style guide; and
and
ii Attest that all technical/special/uncommon terms or
presentation
processes
have
been
explained
by
way of
footnote/glossary/box for the convenience of a common
reader.
G: Entity
i
Confirm that the status of auditee responses
response/
(acceptance,/ disagreement or non response with reference
Acknowledgement to the audit finding & conclusions and recommendations)
are included at appropriate places within the report;
ii State the number of each of them (audit findings,
conclusions and recommendations) not accepted6.
iii Indicate the dates and the level at which meetings were
held with the auditee on (i) presentations by the entity on
the subject (ii) presentation of audit plan (entry conference
at the apex level) and meeting to discuss criteria, if held
separately (iii) meeting to discuss the recommendations, if
held separately from exit conference and (iv) meeting to
discuss the draft performance audit report (exit conference
at the apex level).
67
PDF created with pdfFactory Pro trial version www.pdffactory.com
Annexure V
(Reference to Para 3.5)
No.718 Rep(S)/252-2003
OFFICE OF THE COMPTROLLER AND
AUDITOR GENERAL OF INDIA
Date: 16.6.2005
To
All Principal Accountants General (Audit)
All Accountants General (Audit)
(with ADAI-RS)
Sub: Measuring effectiveness of Audit revision of Desirability
Acceptability Matrix (weighted money value) for the transaction
audit paras and the review and long paras (in respect of Civil Audit
Reports)
Sir / Madam,
Please refer to the Hqrs circular letter No. 985 Rep(S)/252-2003 dated 17
September 2004 inviting your comments on the proposed matrix parameters and
matrix value for both transaction audit paras and the reviews and long paras. The
matrices have now been revised after through examination and consultation with
the concerned Wings of Hqrs.
The agreed matrices separately for the transaction audit paras and the
reviews and long paras(for Civil Audit Reports) are enclosed. These may please
be adopted in the Audit Report (Civil) 2004-05.
Kindly indicate matrix identity, money value and matrix value against
each draft paragraph, draft review and long paragraph, while sending the Draft
Audit Report and the Bond copy of audit Report to the Hqrs. A statement
indicating matrix identity, money value and matrix value in respect of all the
transaction paras, long paras and reviews should also be sent while forwarding the
Bond copy to the Hqrs.
Encl: as above
Yours faithfully,
(Rita Mitra)
Principal Director(RS)
68
PDF created with pdfFactory Pro trial version www.pdffactory.com
i).
Fraud/misappropriat
ion/
embezzlement/losse
s detected in audit;
overpayment
accepted by
department
(recovered or not)
that is indicative of
fraud
misappropriation
etc.
ii). Excess payment
wasteful/
infructuous
expenditure
iii). Violation of
contractual
obligations, undue
favour to
contractors,
avoidable,
expenditure
iv). Idle
investments/ idle
establishment/blocki
ng of funds, delays
in commissioning
equipment;
diversion/
misutilisation of
funds
v). Regularity issues
and Others
Violation of
procedure/
system/
guidelines
identified
Reasons for
If
Responsi
Irregularities/ bilities located/ modern
lapses/
recovery made technique
mistakes/
of
errors
gathering
analysed
evidences
adopted
@
0.35
0.30
0.10
0.10
Government Maximu
responses m score
included with
rebuttal/
Audit
observations
accepted by
the
Government/
Department
0.15
1.00
Matrix
Identity
0.35
0.20
0.10
0.10
0.15
0.90
0.25
0.20
0.10
0.10
0.15
0.80
0.20
0.15
0.10
0.05
0.10
0.60
0.20
0.10
0.05
0.05
0.10
0.50
@ Include photograph, interview, beneficiary survey, joint physical verification (by Audit and Auditee unit)
duty authenticated by the and unit
Note: Matrix value of an audit Paragraph will be the money of the paragraph multiplied by matrix weight for
the para,
69
PDF created with pdfFactory Pro trial version www.pdffactory.com
Scheme/
Program
Review and
integrated
Audit
Audit of
implementtation of Acts
and Rules/
Regulatory
functions
0.25
0.25
Violation
of
acts/
Rules
analysed
and
Prosecution
/Conviction
analysed
0.30
Administrat
ive of legal
difficulties
in
implementtation
0.20
Maximum Weighted
score
(matrix)
money
value
1.00
X multiplied by
actual
money
value
@ Include photograph interview, beneficiary survey, joint physical verification (by Audit and Auditee Unit) duly
authenticated by the Auditee unit
Note: Matrix value of an Audit review/long paragraph will be the money value multiplied by matrix weight for the
review / long para
70
PDF created with pdfFactory Pro trial version www.pdffactory.com
Rakesh Jain
Principal Director (RS)
While finalizing the Bond copy of Audit Report (Civil), it was observed
that adequate caution was not taken for adherence to the instructions issued from
headquarters office for preparation of the bond copy. Some of the headquarters
office circular letters on the matter issued in the past are mentioned in the margin
for your ready reference. This apart, adequate care should be taken while
attributing money value to paragraphs and sub-paragraphs of reviews included in
Audit Report, in view of CAGs observations at the time f approval of Bond copy.
No money value shall be attributed in the following cases:
(i)
Diversion of funds
(ii)
Excess/savings/surrenders
(iii)
Pendency in receipt of utilization certificates
(iv)
Time over-run and cost over rum
(v)
Unspent funds/funds lying in Civil Deposits/Banks
(vi)
Curtailment of Central assistance
(vii) Unrealised revenue/Outstanding loans
(viii) Events noticed by the Department
(ix)
Statistical information used in support of audit comment
(x)
Any other areas where no audit effort is involved
To ensure this, you are requested to get the money value vetted at Group Officer
level before the material is sent to headquarters. Regarding the score mark for
calculation of Matrix value, this office circular No. 718-Report (S)/252-2003
dated 16 June 2005 may be strictly adhered to. While drafting the Audit Report,
the contents of the Style Guide may also be kept in view.
I would also request you to kindly enforce all the instructions contained in
headquarters letter forwarding the approved Bond copy of the Audit Report for
printing in order to prevent any inaccuracies, errors or inconsistencies in the
contents of the Audit Report before adoption for printing.
Yours sincerely,
To
All Principal Accountants General(Audit
All Accountants General (Audit)
(General Category States)
71
PDF created with pdfFactory Pro trial version www.pdffactory.com
Dhiren Mathur
Director (RS)
72
PDF created with pdfFactory Pro trial version www.pdffactory.com