Issai 300 English
Issai 300 English
The International
Standards
of Supreme
Audit Institutions,
ISSAIs, are issued by INTOSAI,
ISSAI 300
Fundamental
Principles
of Performance
Auditing
the International Organisation of Supreme Audit Institutions. For more information visit
www.issai.org
INTOSAI
Fundamental Principles of
Performance Auditing
I NT OS AI P r ofe ss i o n a l S t an d ar ds Co m mi t te e
PSC-Secretariat
Rigsrevisionen Store Kongensgade 45 P.O. Box 9009 1022 Copenhagen K Denmark
Tel.:+45 3392 8400 Fax:+45 3311 0415 E-mail: [email protected]
INTOSAI
EXPERIENTIA MUTUA
EXPERIENTIA MUTUA
OMNIBUS PRODEST
OMNIBUS
PRODEST
INTRODUCTION ................................................................................................................................................ 1
PURPOSE AND AUTHORITY OF THE FUNDAMENTAL PRINCIPLES OF PERFORMANCE AUDITING ..... 1
FRAMEWORK FOR PERFORMANCE AUDITING ............................................................................................2
Definition of performance auditing ................................................................................................................. 2
Economy, efficiency and effectiveness .......................................................................................................... 2
Objectives of performance auditing................................................................................................................ 3
Applicability of ISSAI 300 ............................................................................................................................... 3
ELEMENTS OF PERFORMANCE AUDITING ................................................................................................... 4
The three parties in performance auditing ..................................................................................................... 4
Subject matter and criteria in performance auditing ...................................................................................... 4
Confidence and assurance in performance auditing ...................................................................................... 5
PRINCIPLES OF PERFORMANCE AUDITING ................................................................................................. 5
General principles .......................................................................................................................................... 5
Audit objective ............................................................................................................................................ 6
Audit approach ........................................................................................................................................... 6
Criteria........................................................................................................................................................ 7
Audit risk .................................................................................................................................................... 8
Communication .......................................................................................................................................... 8
Skills ........................................................................................................................................................... 9
Professional judgement and scepticism .................................................................................................. 10
Quality control .......................................................................................................................................... 10
Materiality ................................................................................................................................................. 11
Documentation ......................................................................................................................................... 11
Principles related to the audit process ......................................................................................................... 13
Planning........................................................................................................................................................ 13
Selection of topics .................................................................................................................................... 13
Designing the audit .................................................................................................................................. 14
Conducting ................................................................................................................................................... 15
Evidence, findings and conclusions ......................................................................................................... 15
Reporting ...................................................................................................................................................... 16
Content of the report ................................................................................................................................ 16
Recommendations ................................................................................................................................... 16
Distribution of the report........................................................................................................................... 17
Follow-up ...................................................................................................................................................... 17
INTRODUCTION
1. Professional standards and guidelines are essential for the credibility, quality and
professionalism of public-sector auditing. The International Standards of Supreme Audit
Institutions (ISSAIs) developed by the International Organisation of Supreme Audit Institutions
(INTOSAI) aim to promote independent and effective auditing and support the members of
INTOSAI in the development of their own professional approach in accordance with their
mandates and with national laws and regulations.
2. ISSAI 100 Fundamental Principles of Public-Sector Auditing provides the fundamental
principles for public-sector auditing in general and defines the authority of the ISSAIs.
ISSAI 300 - Fundamental Principles of Performance Auditing builds on and further develops
the fundamental principles of ISSAI 100 to suit the specific context of performance auditing.
ISSAI 300 should be read and understood in conjunction with ISSAI 100, which also applies to
performance auditing.
3. ISSAI 300 Fundamental Principles of Performance Auditing consists of three sections.
The first section establishes the framework for performance auditing and for reference to the
relevant ISSAIs.
The second section consists of the general principles for performance audit engagements
that the auditor should consider prior to commencement and throughout the audit process.
The third section contains principles of relevance to the main stages of the audit process
itself. Each principle is followed by a brief explanation.
7. Where an SAIs auditing standards are based on or consistent with the Fundamental Principles
of Performance Auditing, these may be referred to by stating:
We conducted our audit[s] in accordance with [standards], which are based on [or
consistent with] the Fundamental Principles of Performance Auditing of the International
Standards of Supreme Audit Institutions.
The reference may be included in the audit report or communicated by the SAI in a more
general form covering a defined range of engagements.
8. SAIs may choose to adopt the Performance Audit Guidelines (ISSAIs 3000-3999) as the
authoritative standards for their work. Where an SAI has chosen so to adopt these guidelines, it
must comply with them in all relevant respects. Reference in this case may be made by stating:
We conducted our [performance] audit[s] in accordance with the International
Standards of Supreme Audit Institutions [on performance auditing].
Performance audits often include an analysis of the conditions that are necessary to ensure
that the principles of economy, efficiency and effectiveness can be upheld. These conditions
may include good management practices and procedures to ensure the correct and timely
delivery of services. Where appropriate, the impact of the regulatory or institutional framework
on the performance of the audited entity should also be taken into account.
In such cases, the primary objective of the audit should guide the auditors as to which
standards to apply. In determining whether performance considerations form the primary
objective of the audit engagement, it should be borne in mind that performance auditing
focuses on activity and results rather than reports or accounts, and that its main objective is
to promote economy, efficiency and effectiveness rather than report on compliance.
Audit objective
25. Auditors should set a clearly-defined audit objective that relates to the principles of
economy, efficiency and effectiveness.
The audit objective determines the approach and design of the engagement. It could simply be
to describe the situation. However, normative audit objectives (are things as they ought to be?)
and analytical audit objectives (why are things not as they ought to be?) are more likely to add
value. In all cases, the auditors need to consider what the audit pertains to, which
organisations and bodies are involved and for whom the ultimate recommendations are likely to
be relevant. Well-defined audit objectives relate to a single entity or an identifiable group of
government undertakings, systems, operations, programmes, activities or organisations.
Many audit objectives can be framed as an overall audit question which can be broken down
into more precise sub-questions. They should be thematically related, complementary, not
overlapping and collectively exhaustive in addressing the overall audit question. All terms
employed in the question should be clearly defined. The formulation of audit questions is an
iterative process in which the questions are repeatedly specified and refined, account being
taken of known relevant information on the subject as well as feasibility.
Instead of defining a single objective or overall audit question, auditors may choose to develop
several audit objectives, which need not always be broken down into sub-questions.
Audit approach
26. Auditors should choose a result-, problem- or system-oriented approach, or a
combination thereof, to facilitate the soundness of audit design.
The overall audit approach is a central element of any audit. It determines the nature of the
examination to be made. It also defines the necessary knowledge, information and data and
the audit procedures needed to obtain and analyse them.
Performance auditing generally follows one of three approaches:
a system-oriented approach, which examines the proper functioning of management
systems, e.g. financial management systems;
a result-oriented approach, which assesses whether outcome or output objectives have
been achieved as intended or programmes and services are operating as intended;
a problem-oriented approach, which examines, verifies and analyses the causes of
particular problems or deviations from criteria.
All three approaches can be pursued from a top-down or bottom-up perspective. Top-down
audits concentrate mainly on the requirements, intentions, objectives and expectations of the
legislature and central government. A bottom-up perspective focuses on problems of
significance to people and the community.
Criteria
27. Auditors should establish suitable criteria which correspond to the audit questions and
are related to the principles of economy, efficiency and effectiveness.
Criteria are the benchmarks used to evaluate the subject matter. Performance audit criteria are
reasonable and audit-specific standards of performance against which the economy, efficiency
and effectiveness of operations can be evaluated and assessed.
The criteria provide a basis for evaluating the evidence, developing audit findings and reaching
conclusions on the audit objectives. They also form an important element in discussions within
the audit team and with SAI management and in communication with the audited entities.
The criteria can be qualitative or quantitative and should define what the audited entity will be
assessed against. The criteria may be general or specific, focusing on what should be
according to laws, regulations or objectives; what is expected, according to sound principles,
scientific knowledge and best practice; or what could be (given better conditions).
Diverse sources can be used to identify criteria, including performance measurement
frameworks. It should be transparent which sources were used, and the criteria should be
relevant and understandable for users as well as complete, reliable and objective in the
context of the subject matter and audit objectives.
The criteria should be discussed with the audited entities, but it is ultimately the auditor's
responsibility to select suitable criteria. While defining and communicating criteria during the
planning phase may enhance their reliability and general acceptance, in audits covering
complex issues it is not always possible to set criteria in advance; instead they will be defined
during the audit process.
Whereas in some audit types there are unequivocal legislative criteria, this is not typically the
case in performance auditing. The audit objectives, question and approach determine the
relevance and the type of suitable criteria, and user confidence in the findings and conclusions
of a performance audit depends largely on the criteria. Thus it is crucial to select reliable and
objective criteria.
In a problem-oriented performance audit, the starting point is a known or suspected deviation
from what should or could be. The main objective is therefore not just to verify the problem (the
deviation from the criterion and its consequences) but to identify causes. This makes it
important to decide how to examine and verify causes during the design phase. Conclusions
and recommendations are primarily based on the process of analysing and confirming causes,
even though they are always rooted in normative criteria.
Audit risk
28. Auditors should actively manage audit risk, which is the risk of obtaining incorrect or
incomplete conclusions, providing unbalanced information or failing to add value for
users.
Many topics in performance auditing are complex and politically sensitive. While simply
avoiding such topics may reduce the risk of inaccuracy or incompleteness, it could also limit the
possibility of adding value.
The risk that an audit will fail to add value ranges from the likelihood of not being able to
provide new information or perspectives to the risk of neglecting important factors and, as a
consequence, not being able to provide users of the audit report with knowledge or
recommendations that would make a real contribution to better performance.
Important aspects of risk may include not possessing the competence to conduct sufficiently
broad or deep analysis, lacking access to quality information, obtaining inaccurate information
(e.g. because of fraud or irregular practices), being unable to put all findings in perspective,
and failing to collect or address the most relevant arguments.
Auditors should therefore actively manage risk. Dealing with audit risk is embedded in the
whole process and methodology of performance audit. Audit planning documents should state
the possible or known risks of the work envisaged and show how these risks will be handled.
Communication
29. Auditors should maintain effective and proper communication with the audited entities
and relevant stakeholders throughout the audit process and define the content, process
and recipients of communication for each audit.
There are several reasons why planning communication with the audited entities and
stakeholders is of particular importance in performance audit.
As performance audits are not normally conducted on a regular (e.g. annual) basis on the
same audited entities, channels of communication may not already exist, While there may
be contacts with the legislature and government bodies, other groups (such as academic
and business communities or civil society organisations) may not have been engaged with
previously.
Often there are no predefined criteria (such as a financial reporting framework), and thus an
intensive exchange of views with the audited entity is necessary.
The need for balanced reports requires an active effort to obtain insight into the points of
view of the various stakeholders.
Auditors should identify the responsible parties and other key stakeholders and take the
initiative in establishing effective two-way communication. With good communication, auditors
can improve access to information sources and to data and opinions from the audited entity.
Using communication channels to explain the purpose of the performance audit to stakeholders
also increases the likelihood that audit recommendations will be implemented. Auditors should
therefore seek to maintain good professional relations with all relevant stakeholders, promote a
free and frank flow of information in so far as confidentiality requirements permit, and conduct
discussions in an atmosphere of mutual respect and understanding for the role and
responsibilities of each stakeholder. However, care should be taken to ensure that
communication with stakeholders does not compromise the independence and impartiality of
the SAI.
Auditors should notify audited entities of the key aspects of the audit, including the audit
objective, audit questions and subject matter. Notification will usually take the form of a written
engagement letter and regular communication during the audit. Auditors should maintain
communication with audited entities throughout the audit process, by means of constructive
interaction as different findings, arguments and perspectives are assessed.
Audited entities should be given an opportunity to comment on the audit findings, conclusions
and recommendations before the SAI issues its audit report. Any disagreements should be
analysed and factual errors corrected. The examination of feedback should be recorded in
working papers so that changes to the draft audit report, or reasons for not making changes,
are documented.
At the end of the audit process, stakeholder feedback can also be obtained on the quality of the
published audit reports. The audited entities perception of audit quality may also be solicited.
Skills
30. Collectively, the audit team should have the necessary professional competence to
perform the audit. This would include sound knowledge of auditing, research design,
social science methods and investigation or evaluation techniques, as well as personal
strengths such as analytical, writing and communication skills.
In performance auditing, specific skills may be required, such as knowledge of evaluation
techniques and social science methods, and personal abilities such as communication and
writing skills, analytical capacity, creativity and receptiveness. Auditors should have a sound
knowledge of government organisations, programmes and functions. This will ensure that the
right areas are selected for audit and that auditors can effectively undertake reviews of
government programmes and activities.
There may also be specific ways of acquiring the necessary skills. For each performance audit
the auditors need to have a full understanding of the government measures which are the
subject matter of the audit, as well as the relevant background causes and the possible
impacts. This knowledge must frequently be acquired or developed specifically for the
engagement. Performance audits often involve a learning process and the development of
methodology as part of the audit itself. On-the-job learning and training should therefore be
available to auditors, who should maintain their professional skills through ongoing professional
development. An open attitude to learning and an encouraging management culture are
important conditions for enhancing individual auditors professional skills.
In specialised areas, external experts can be used to complement the knowledge of the audit
team. Auditors should evaluate whether and in what areas external expertise is required, and
make the necessary arrangements.
10
11
As in all audits, performance auditors should keep an adequate documentary record of the
preparation, procedures and findings of each audit. However, the purpose and context of
documentation are somewhat specific in performance auditing.
Frequently the auditor will have acquired specialised knowledge about the audit topic that is
not easily reproduced in the SAI. Since the audit methodology and criteria may have been
developed specifically for a single engagement, the auditor carries a special responsibility to
make his reasoning transparent.
In performance auditing, as well as containing findings and recommendations the report
describes the framework, perspective and analytical structure that were adopted and the
process that was followed to arrive at the conclusions. To some extent, the report performs
functions that in other types of audits are provided by general standards or audit
documentation.
Documentation should not only confirm the accuracy of facts, but also ensure that the report
presents a balanced, fair and complete examination of the audited question or subject
matter. Thus, for example, it might be necessary for the documentation to include reference
to arguments not accepted in the report, or to describe how different viewpoints were dealt
with in the report.
The purpose of the audit report in performance auditing is frequently to persuade
reasonable users by providing new insights rather than a formal statement of assurance.
Just as the audit objectives determine the nature of the necessary evidence, they also
determine the nature of documentation.
Maintaining adequate documentation is not only part of safeguarding quality (e.g. by helping
to ensure that delegated work has been performed satisfactorily and that the audit
objectives have been achieved) but also of the SAIs and individual auditors professional
development, as it can shape good practice for similar audits in the future.
12
Planning
Selection of topics
36. Auditors should select audit topics through the SAIs strategic planning process by
analysing potential topics and conducting research to identify risks and problems.
Determining which audits will be pursued is usually part of the SAIs strategic planning process.
If appropriate, auditors should contribute to this process in their respective fields of expertise.
They may share knowledge from previous audits, and information from the strategic planning
process may be relevant for the auditors subsequent work.
In this process, auditors should consider that audit topics should be sufficiently significant as
well as auditable and in keeping with the SAIs mandate. The topic selection process should
aim to maximise the expected impact of the audit while taking account of audit capacities (e.g.
human resources and professional skills).
13
Formal techniques to prepare the strategic planning process, such as risk analysis or problem
assessments, can help structure the process but need to be complemented by professional
judgement to avoid one-sided assessments.
Designing the audit
37. Auditors should plan the audit in a manner that contributes to a high-quality audit that
will be carried out in an economical, efficient, effective and timely manner and in
accordance with the principles of good project management.
In planning an audit, it is important to consider:
the background knowledge and information required for an understanding of the audited
entities, so as to allow an assessment of the problem and risk, possible sources of
evidence, auditability and the significance of the area considered for audit;
the audit objectives, questions, criteria, subject matter and methodology (including
techniques to be used for gathering evidence and conducting the audit analysis);
the necessary activities, staffing and skills requirements (including the independence of the
audit team, human resources and possible external expertise), the estimated cost of the
audit, the key project timeframes and milestones and the main points for control.
To ensure the audit is properly planned, therefore, the auditors need to acquire sufficient
knowledge of the subject matter. Performance auditing generally requires that audit-specific,
substantive and methodological knowledge be acquired before the audit is launched (prestudy).
When planning the audit, the auditor should design the audit procedures to be used for
gathering sufficient appropriate audit evidence. This can be approached in several stages:
deciding on the overall audit design (which questions to ask, e.g.
explanatory/descriptive/evaluative); determining the level of observation (e.g. looking at a
process or individual files); methodology (e.g. full analysis or sample); specific data-collection
techniques (e.g. interview or focus group). Data-collection methods and sampling techniques
should be carefully chosen. The planning phase should also involve research work aimed at
building knowledge, testing various audit designs and checking whether the necessary data are
available. This makes it easier to choose the most appropriate audit method.
Senior and operational management and the audit team should be fully cognisant of the overall
audit design and what it entails. Decisions on the overall audit design and its consequences in
terms of resources will often involve the senior management of the SAI, who can ensure that
skills, resources and capacities are in place to address the audit objectives and the audit
questions.
Planning should allow for flexibility, so that the auditors can benefit from insights obtained
during the course of the audit. The audit methods chosen should be those which best allow
audit data to be gathered in an efficient and effective manner. While the auditors should aim to
adopt best practices, practical considerations such as the availability of data may restrict the
choice of methods. It is therefore advisable to be flexible and pragmatic in this respect. For this
reason, performance audit procedures should not be overly standardised. Excessive
prescriptiveness may hamper the flexibility, professional judgement and high levels of
14
analytical skills that are required in a performance audit. In certain cases where, for example,
the audit requires data to be gathered in many different regions or areas or the audit is to be
conducted by a large number of auditors there may be a need for a more detailed audit plan
in which audit questions and procedures are explicitly defined.
When planning an audit, auditors should assess the risk of fraud. If this is significant within the
context of the audit objectives, the auditors should obtain an understanding of the relevant
internal control systems and examine whether there are signs of irregularities that hamper
performance. They should also determine whether the entities concerned have taken
appropriate action to address any recommendations from previous audits or other
examinations that are of relevance to the audit objectives. Lastly, the auditors should seek
contact with stakeholders, including scientists or other experts in the field, in order to build up
proper knowledge regarding, for instance, good or best practices. The overall aim at the
planning stage is to decide, by building up knowledge and considering a variety of strategies,
how best to conduct the audit.
Conducting
Evidence, findings and conclusions
38. Auditors should obtain sufficient appropriate audit evidence to establish findings, reach
conclusions in response to the audit objectives and questions and issue
recommendations.
All audit findings and conclusions must be supported by sufficient appropriate evidence. This
should be placed in context, and all relevant arguments, pros and cons and different
perspectives should be considered before conclusions can be drawn. The nature of the audit
evidence required to draw conclusions in performance auditing is determined by the subject
matter, the audit objective and the audit questions.
The auditor should evaluate the evidence with a view to obtaining audit findings. Based on the
findings, the auditor should exercise professional judgement to reach a conclusion. Findings
and conclusions are the results of analysis in response to the audit objectives. They should
provide answers to the audit questions.
Conclusions can be based on quantitative evidence obtained using scientific methods or
sampling techniques. Formulating conclusions may require a significant measure of judgement
and interpretation in order to answer the audit questions, due to the fact that audit evidence
may be persuasive ("points towards the conclusion that ...") rather than conclusive
("right/wrong"). The need for precision should be weighed against what is reasonable,
economical and relevant to the purpose. The involvement of senior management is
recommended.
Performance auditing involves a series of analytical processes that evolve gradually through
mutual interaction, allowing the questions and methods employed to develop in depth and
sophistication. This may involve combining and comparing data from different sources, drawing
preliminary conclusions and compiling findings in order to build hypotheses that can be tested,
if necessary, against additional data. The whole process is closely linked to that of drafting the
15
audit report, which can be seen as an essential part of the analytical process that culminates in
answers to the audit questions. It is important for auditors to be goal-oriented and for them to
work systematically and with due care and objectivity.
Reporting
Content of the report
39. Auditors should strive to provide audit reports which are comprehensive, convincing,
timely, reader-friendly and balanced.
To be comprehensive, a report should include all the information needed to address the audit
objective and audit questions, while being sufficiently detailed to provide an understanding of
the subject matter and the findings and conclusions. To be convincing, it should be logically
structured and present a clear relationship between the audit objective, criteria, findings,
conclusions and recommendations. All relevant arguments should be addressed.
In a performance audit, the auditors report their findings on the economy and efficiency with
which resources are acquired and used and the effectiveness with which objectives are met.
Reports may vary considerably in scope and nature, for example assessing whether resources
have been applied in a sound manner, commenting on the impact of policies and programmes
and recommending changes designed to result in improvements.
The report should include information about the audit objective, audit questions and answers to
those questions, the subject matter, criteria, methodology, sources of data, any limitations to
the data used, and audit findings. It should clearly answer the audit questions or explain why
this was not possible. Alternatively, the auditors should consider reformulating the audit
questions to fit the evidence obtained and thus arrive at a position where the questions can be
answered. The audit findings should be put into perspective, and congruence should be
ensured between the audit objective, audit questions, findings and conclusions. The report
should explain why and how problems noted in the findings hamper performance in order to
encourage the audited entity or report user to initiate corrective action. It should, where
appropriate, include recommendations for improvements to performance.
The report should be as clear and concise as the subject matter permits and phrased in
unambiguous language. As a whole it should be constructive, contribute to better knowledge
and highlight any necessary improvements.
Recommendations
40. If relevant and allowed by the SAIs mandate, auditors should seek to provide
constructive recommendations that are likely to contribute significantly to addressing
the weaknesses or problems identified by the audit.
Recommendations should be well-founded and add value. They should address the causes of
problems and/or weaknesses. However, they should be phrased in such a way that avoids
truisms or simply inverting the audit conclusions, and they should not encroach on the
managements responsibilities. It should be clear who and what is addressed by each
recommendation, who is responsible for taking any initiative and what the recommendations
16
mean i .e. how they will contribute to better performance. Recommendations should be
practical and be addressed to the entities which have responsibility and competence for
implementing them.
Recommendations should be clear and presented in a logical and reasoned fashion. They
should be linked to the audit objectives, findings and conclusions. Together with the full text of
the report, they should convince the reader that they are likely to significantly improve the
conduct of government operations and programmes, e.g. by lowering costs and simplifying
administration, enhancing the quality and volume of services, or improving effectiveness,
impact or the benefits to society.
Distribution of the report
41. Auditors should seek to make their reports widely accessible, in accordance with the
mandate of the SAI.
Auditors should bear in mind that distributing audit reports widely can promote the credibility of
the audit function. Reports should therefore be distributed to the audited entities, the executive
and/or the legislature and, where relevant, be made accessible to the general public directly
and through the media and to other interested stakeholders.
Follow-up
42. Auditors should follow up previous audit findings and recommendations wherever
appropriate. Follow-up should be reported appropriately in order to provide feedback to
the legislature together, if possible, with the conclusions and impacts of all relevant
corrective action.
Follow-up refers to the auditors examination of corrective action taken by the audited entity, or
another responsible party, on the basis of the results of a performance audit. It is an
independent activity that increases the value of the audit process by strengthening the impact
of the audit and laying the basis for improvements to future audit work. It also encourages the
audited entities and other users of reports to take the latter seriously, and provides the auditors
with useful lessons and performance indicators. Follow-up is not restricted to the
implementation of recommendations but focuses on whether the audited entity has adequately
addressed the problems and remedied the underlying situation after a reasonable period of
time.
When conducting follow-up of an audit report, the auditor should concentrate on findings and
recommendations that are still relevant at the time of the follow-up and adopt an unbiased and
independent approach.
Follow-up results may be reported individually or as a consolidated report, which may in turn
include an analysis of different audits, possibly highlighting common trends and themes across
a number of reporting areas. Follow-up can contribute to a better understanding of the value
added by performance auditing over a given time period or subject area.
17