Control Exceptions and Deficiencies Evaluation Framework
Control Exceptions and Deficiencies Evaluation Framework
Control Exceptions and Deficiencies Evaluation Framework
Version 3
Page
Guiding Principles 3
Terminology 14
This paper should be read in conjunction with Auditing Standard No. 2, An Audit of
Internal Control Over Financial Reporting Performed in Conjunction With an Audit of
Financial Statements (AS 2), especially the definitions in paragraphs 8 through 10, the
section on evaluating deficiencies in paragraphs 130 through 141, the examples of
significant deficiencies and material weaknesses in Appendix D, and the Background and
Basis for Conclusions in Appendix E. The framework is not a substitute for AS 2 and
other relevant professional literature.
In addition, William F. Messier, Jr., Professor, Georgia State University, also contributed
to the development of the framework.
This framework reflects their views on a framework consistent with their understanding
of AS 2.
The framework represents a thought process that will require significant judgment. The
objective of the framework is to assist knowledgeable and experienced individuals in
evaluating deficiencies in a consistent manner. The mere mechanical application of this
framework will not, in and of itself, necessarily lead to an appropriate conclusion.
Because of the need to apply judgment and to consider and weigh quantitative and
qualitative factors, different individuals evaluating similar fact patterns may reach
different conclusions.
1
recognize that the risk of misstatement might be different for the maximum possible
misstatement than for lesser possible amounts.
This paper does not address the determination of materiality. Reference, in that regard,
should be made to AS 2.23, which states:
The same conceptual definition of materiality that applies to financial reporting applies
to information on internal control over financial reporting, including the relevance of
both quantitative and qualitative considerations.*
2
Guiding Principles
The principles set forth below correspond to the box numbers on the appropriate charts
included in this paper.
Evaluating Exceptions
Found in the Testing of Operating Effectiveness (Chart 1)
General. The testing of controls generally relates to significant processes and major
classes of transactions for relevant financial statement assertions related to
significant accounts and disclosures. Therefore, the underlying assumption
is that all exceptions/deficiencies resulting from the testing must be
evaluated because they relate to accounts and disclosures that are material
to the financial statements taken as a whole.
3
confidence that the upper limit deviation rate does not exceed 10%
typically would not provide a high level of assurance. (Refer to the AICPA
Audit and Accounting Guide, Audit Sampling).
Box 2. If the test objective is not met, consideration should be given to whether
additional testing could support a conclusion that the deviation rate is not
representative of the total population. For example, if observed exceptions
result in a non-negligible deviation rate, then the test objective initially is
not met. In a test designed to allow for finding one or more deviations, the
4
test objective is not met if the actual number of deviations found exceeds
the number of deviations allowed for in the plan.
Box 3. If the test objective initially is not met, then there are two options:
o If the observed exceptions and resulting non-negligible deviation
rate are not believed to be representative of the population (e.g.,
because of sampling error), the test may be extended and re-
evaluated.
o If the observed exceptions and resulting non-negligible deviation
rate are believed to be representative of the population, the
exceptions are considered to be a control deficiency and its
significance is assessed.
Box 2&3. If there are controls that effectively mitigate a control deficiency, it is
classified as only a deficiency, absent any qualitative factors, including
those in AS 2.9, 137, 139, and 140. Such controls include:
o Complementary or redundant controls that achieve the same control
objective
o Compensating controls that operate at a level of precision that would
result in the prevention or detection of a more than inconsequential
misstatement of annual or interim financial statements
5
Step 2. Determine whether a material weakness exists:
Box 5. Compensating controls that operate at a level of precision that would result
in the prevention or detection of a material misstatement of annual or
interim financial statements may support a conclusion that the deficiency is
not a material weakness.
Box 6. In evaluating likelihood and magnitude, related factors include but are not
limited to the following:
o The nature of the financial statement accounts, disclosures, and
assertions involved; for example, suspense accounts and related
party transactions involve greater risk.
o The susceptibility of the related assets or liability to loss or fraud;
that is, greater susceptibility increases risk.
o The subjectivity, complexity, or extent of judgment required to
determine the amount involved; that is, greater subjectivity,
complexity, or judgment, like that related to an accounting estimate,
increases risk.
o The cause and frequency of known or detected exceptions in the
operating effectiveness of a control; for example, a control with an
observed non-negligible deviation rate is a deficiency.
o The interaction or relationship with other controls; that is, the
interdependence or redundancy of controls.
o The possible future consequences of the deficiency.
o An indication of increased risk evidenced by a history of
misstatements, including misstatements identified in the current year
(AS 2.140).
o The adjusted exposure in relation to overall materiality.
6
Box 7&8. When determining the classification of a deficiency, consider AS 2.137,
which states:
7
Evaluating ITGC Deficiencies (Chart 3)
There are three situations in which an ITGC deficiency can rise to the level
of a material weakness:
o An application control deficiency related to or caused by an ITGC
deficiency is classified as a material weakness
o The pervasiveness and significance of an ITGC deficiency leads to a
conclusion that there is a material weakness in the company’s
control environment
o In accordance with AS 2.140, an ITGC deficiency classified as a
significant deficiency remains uncorrected after some reasonable
period of time
8
control deficiencies is a deficiency, significant deficiency, or material
weakness.
Box 3&4. If there is a control deficiency at the application level related to or caused
by an ITGC deficiency, the ITGC deficiency is evaluated in combination
with the deficiency in the underlying application control and generally is
classified consistent with the application control deficiency, that is:
o A material weakness in an application control related to or caused by
an ITGC deficiency indicates that the ITGC deficiency also is a
material weakness.
o A significant deficiency in an application control related to or caused
by an ITGC deficiency indicates that the ITGC deficiency also is a
significant deficiency.
o An application control deficiency (that is only a deficiency) related
to or caused by an ITGC deficiency generally indicates that the
ITGC deficiency is only a deficiency.
9
o Whether an ITGC deficiency relates to applications or data for
accounts or disclosures that are susceptible to loss or fraud
o The cause and frequency of known or detected exceptions in the
operating effectiveness of an ITGC; for example, (1) a control with
an observed non-negligible deviation rate, (2) an observed exception
that is inconsistent with the expected effective operation of the
ITGC, or (3) a deliberate failure to apply a control .
o An indication of increased risk evidenced by a history of
misstatements relating to applications affected by the ITGC
deficiency, including misstatements in the current year
Additional consideration:
ITGCs support the proper and consistent operation of automated application controls.
Therefore, consideration should be given to the nature, timing, and extent of the
testing of related application controls affected by, or manual controls dependent on,
the deficient ITGC.
10
Evaluating Control Deficiencies in Pervasive Controls Other than ITGC (Chart 4)
Box 3. Certain controls could result in a judgment that the deficient control is
limited to a deficiency and classified as only a deficiency, considering
qualitative factors, including those in AS 2.9, 137, 139 and 140. Such
controls include:
o Complementary or redundant programs or controls
o Compensating controls within the same or another component
Box 4. A deficiency with a more than remote likelihood that the deficiency would
contribute to a more than inconsequential misstatement is a significant
deficiency. Such judgment considers an evaluation of factors such as:
o The pervasiveness of the deficiency across the entity
o The relative significance of the deficient control to the component
o An indication of increased risks of error (evidenced by a history of
misstatement)
o An increased susceptibility to fraud (including the risk of
management override)
o The cause and frequency of known or detected exceptions for the
operating effectiveness of a control
o The possible future consequences of the deficiency
Box 5. The evaluation of certain controls could result in a judgment that the
deficient control is limited to a significant deficiency and classified as
such, considering qualitative factors, including those in AS 2.9, 137, 139
and 140. Such controls include compensating controls within the same or
another component.
11
Box 6. A deficiency with a more than remote likelihood that the deficiency would
contribute to a material misstatement is a material weakness. Such
judgment considers an evaluation of factors such as:
o The pervasiveness of the deficiency across the entity
o The relative significance of the deficient control to the component
o An indication of increased risks of error (evidenced by a history of
misstatement)
o An increased susceptibility to fraud (including the risk of management
override)
o The cause and frequency of known or detected exceptions for the
operating effectiveness of a control
o The possible future consequences of the deficiency
12
Consider and Evaluate Deficiencies in the Aggregate
13
Terminology
Adjusted exposure – gross exposure (see below) multiplied by the upper limit deviation
rate.
Compensating controls – controls that operate at a level of precision that would result in
the prevention or detection of a misstatement that was more than inconsequential or
material, as applicable, to annual or interim financial statements. The level of precision
should be established considering the possibility of further undetected misstatements.
Complementary controls – controls that function together to achieve the same control
objective.
Control deficiency – a deficiency in the design or operation of a control that does not
allow management or employees, in the normal course of performing their assigned
functions, to prevent or detect misstatements on a timely basis.
o A deficiency in design exists when (a) a control necessary to meet the control
objective is missing or (b) an existing control is not properly designed so that, even if
it operates as designed, the control objective is not always met.
o A deficiency in operation exists when a properly designed control does not operate
as designed, or when the person performing the control does not possess the
necessary authority or qualifications to perform the control effectively.
Control objective – the objective(s) related to internal control over financial reporting to
achieve the assertions that underlie a company’s financial statements.
14
Inconsequential
o Potential misstatements equal to or greater than 20% of overall annual or interim
financial statement materiality are presumed to be more than inconsequential.
o Potential misstatements less than 20% of overall annual or interim financial
statement materiality may be concluded to be more than inconsequential as a result
of the consideration of qualitative factors, as required by AS 2.
Information technology general controls (ITGCs) – policies and procedures that relate to
many applications and support the effective functioning of application controls by helping
to ensure the continued proper operation of information systems. This includes four basic
IT areas that are relevant to internal control over financial reporting:
o Program development
o Program changes
o Computer operations
o Access to programs and data
Pervasive controls other than ITGC – the general programs and controls within the
control environment, risk assessment, monitoring, and information and communication,
including portions of the financial reporting process, that have a pervasive impact on
controls at the process, transaction, or application level.
Remote likelihood – the chance of the future event or events occurring is slight.
Test objective – the design of the test of a control activity to determine whether the
control is operating as designed, giving consideration to:
o The nature of the control and the definition of an exception
o The frequency with which the control operates
o The desired level of assurance in combination with the reliability of the control, for
example, whether the control is designed to achieve the control objective alone or in
combination with other controls
o The number of exceptions expected
15
Upper limit deviation rate – the statistically derived estimate of the deviation rate based
on the sample results, for which there is a remote likelihood that the true deviation rate in
the population exceeds this rate (refer to AICPA Audit and Accounting Guide, Audit
Sampling).
16
CHART 1 – Evaluating Exceptions Found in the Testing of
Operating Effectiveness
No
Yes
No Box 3. Extend testing and re-evaluate. Was the test Yes Negligible exception,
Control deficiency objective met? not a control
deficiency. No further
consideration needed.
Individual boxes should be read in conjunction with the corresponding guiding principles.
17
CHART 2 – Evaluating Process/Transaction-Level Control
Deficiencies
This decision tree is to be used for evaluating the classification of control deficiencies from the
following sources:
• Design effectiveness evaluation
• Operating effectiveness testing (from Chart 1)
• Deficiencies that resulted in a financial statement misstatement detected by management or
the auditor in performing substantive test work.
No
Box 7. Would a prudent
Box 2. Are there complementary or official conclude that
Yes No
redundant controls that were tested and the deficiency is at least
a significant deficiency Deficiency
evaluated that achieve the same
control objective? considering both annual
No and interim financial
No statements?
No
No
Material
Weakness
Individual boxes should be read in conjunction with the corresponding guiding principles.
18
CHART 3 – Evaluating Information Technology General
Control (ITGC) Deficiencies
This decision tree is to be used for evaluating the classification of information technology general
control (ITGC) deficiencies from the following sources:
• ITGC design effectiveness evaluation
• ITGC operating effectiveness testing (from Chart 1)
• ITGC design or operating deficiencies identified as a result of application control testing
(from Chart 2)
No
Material
Weakness
Individual boxes should be read in conjunction with the corresponding guiding principles.
19
CHART 4 – Evaluating Control Deficiencies in Pervasive
Controls Other than ITGC
This decision tree is to be used for evaluating the classification of control deficiencies in
pervasive controls other than ITGC from the following sources:
• Design effectiveness evaluation
• Operating effectiveness testing (from Chart 1)
No
No
Box 3. Are there complementary or redundant
programs or controls or compensating controls that
were tested and evaluated that result in a judgment that Yes Box 7. Would a
the deficient control is limited to a deficiency? prudent official
conclude that the No
Yes
No
No
Material
Weakness
Individual boxes should be read in conjunction with the corresponding guiding principles.
20