Wpiea2019303 Print PDF
Wpiea2019303 Print PDF
Wpiea2019303 Print PDF
IMF Working Papers describe research in progress by the author(s) and are published
to elicit comments and to encourage debate. The views expressed in IMF Working Papers
are those of the author(s) and do not necessarily represent the views of the IMF, its
Executive Board, or IMF management.
Finance Department
Prepared by Elie Chamoun, Nicolas Denewet, Antonio Manzanera and Sanjeev Matai1
December 2019
IMF Working Papers describe research in progress by the author(s) and are published to
elicit comments and to encourage debate. The views expressed in IMF Working Papers are
those of the author(s) and do not necessarily represent the views of the IMF, its Executive Board,
or IMF management.
Abstract
1
We would like to thank Simon Bradbury and George Kabwe for their review and insightful comments. The
authors are also grateful to staff in the IMF Monetary and Capital Markets Department (MCM), Office of Internal
Audit (OIA) and Office of Risk Management (ORM) for their review and valuable comments. The views expressed
in this paper are solely those of the authors, and do not purport to represent those of the IMF, its Executive
Board, or IMF management. All errors and omissions are our own.
3
Table of Contents
ABSTRACT 2
I. INTRODUCTION 4
VI. CONCLUSION 14
ANNEXES
I. Risk Management Maturity Assessment Tool 15
II. Overview of ISO 31000 and COSO ERM 25
I. INTRODUCTION
When the IMF provides financing to a member country, a safeguards assessment is carried
out to obtain reasonable assurance that the country’s central bank is able to manage the
Fund’s resources and provide reliable monetary data on the IMF-supported program.
Safeguards assessments are diagnostic reviews of central banks’ governance and control
frameworks, and involve an evaluation of central bank operations in five areas: the External
audit mechanism, the Legal structure and autonomy, the financial Reporting framework, the
Internal audit mechanism, and the system of internal Controls, denoted by the acronym
ELRIC.2
The safeguards assessment framework was adapted in 2010 to include a review of the risk
management practices as an integral part of the system of internal controls. Initially, this was
limited to reviewing and stocktaking the existence and attributes of basic risk management
structures, and in 2015 the approach was intensified to include a deeper evaluation of risk
management functions and their effectiveness.3
Considering risk management does not have universal international standards, a phased
approach was adopted to implement this new requirement. A benchmarking review of widely
used risk management frameworks was conducted to distill the core elements of a fully-
fledged risk management framework. A second phase then took into consideration the
different levels of implementation of central bank risk management functions to develop a
maturity spectrum. The two phases culminated in the development of the maturity
assessment toolkit.
The assessment toolkit was developed to guide the evaluation of risk management practices
at central banks in a structured and comprehensive manner, and to facilitate consistent and
tailored recommendations for a modular progression in maturity. As such, it combines a
periodic checkpoint and a path forward to continue developing the risk management
practices.
2
The safeguards policy is an integral part of the IMF’s risk management framework for its lending
activities, with 311 assessments covering 97 central banks completed as of April 2019. More information on
the IMF safeguards policy is available at: Safeguards Factsheet
3
In its 2015 review of the safeguards policy, the Executive Board of the IMF recognized, inter alia, the
importance of integrated risk management frameworks in strengthening institutions, and called for a
broader coverage in this area, tailored to each central bank’s capacity.
II. METHODOLOGICAL APPROACH
During the 2015 review of the safeguards policy, the IMF Executive Board endorsed an
external review panel’s recommendation to sharpen the focus of safeguards assessments on
risk management at central banks.4 This represented a new policy requirement and entailed a
shift from the previous approach adopted in 2010 towards the assessment of risk
management functions at central banks. Initially, such assessment was limited to that of
conducting a stocktake of the extent to which a central bank had developed an integrated risk
management function. As risk management is demanding from a conceptual and technical
perspective, the breadth and maturity of risk management functions depend largely on the
central bank’s capacity. Central banks are at different stages of maturity in adopting
enterprise-wide risk management operations.5 Experience under the safeguards policy
indicates that few central banks have a full-fledged risk management framework. Further,
given that there is no “one size fits all”, challenges in deciding on an appropriate framework
for implementation are widespread.
In order to implement this new policy requirement, a phased approach to assessing risk
management frameworks at central banks was adopted. As risk management is a relatively
new or evolving function at many central banks, we have found that frameworks differ across
central banks and regions. As a result, the first step was to establish common elements of a
risk management framework to serve as a benchmark for evaluating risk management
practices in safeguards assessments. The next step was to introduce a maturity model
approach, providing high-level guidance on determining the maturity level of these practices.
The last step was the development of a tool to assess risk management practices in order to
make tailored safeguards recommendations. The tool is a matrix combining both the
elements of the risk management framework and the attributes for each maturity level of each
of the elements (see Annex I for a detailed description of the tool).
While the accounting and audit industries are guided by international standards, risk
management does not have a single universal standard that is widely applied.6 Central banks
with advanced risk management functions acknowledge that the choice of components in
implementing a framework is driven by the unique circumstances and environment in which
the bank operates. The current available risk management guidelines include: (i) ISO
31000:2018, Risk management – Guidelines (provides principles, framework and a process
4
Safeguards Assessments - Review of Experience and Safeguards Assessments Policy - External Expert Panel's
Advisory Report
5
Per COSO Enterprise Risk Management – Integrated Framework (2004), “Enterprise risk management is a
process, effected by an entity’s board of directors, management and other personnel, applied in strategy
setting and across the enterprise, designed to identify potential events that may affect the entity, and manage
risk to be within its risk appetite, to provide reasonable assurance regarding the achievement of entity
objectives.”
6
Certain guidelines and principles for specific central banking functions exist such as the IMF Guidelines for
Foreign Exchange Reserve Management and the BIS Principles for Financial Market Infrastructures.
for managing risk and can be used by any organization regardless of its size, activity or
sector); and (ii) COSO Enterprise Risk Management—Integrating with Strategy and
Performance (highlights the importance of considering risk in both the strategy-setting
process and in driving performance). Our stocktaking of central banks since 2010 found that
these were the most widely used (see Annex II for a detailed description of both guidelines).7
The benchmarking risk management framework was then defined based on the ISO and
COSO guidelines. It includes the broad concepts and common elements that are expected to
be found in a strong risk management framework (see below).
A. High-Level Principles
Effective risk management practices are guided by the following high-level principles:
• Accountability: Risk management is facilitated through a clear mandate and a
comprehensive approach as an integral part of all activities.
• Robust governance: Risk management roles and responsibilities are well defined with
clear reporting lines, providing for independence from operations and adequate “checks
and balances” at all levels, including Board oversight.
• Proportionality: Risk management is enabled by a dedicated structure (framework and
processes) that is tailored to a central bank’s risk profile and operational environment,
and maturing along with other organizational processes.
• Adequate resources: The risk management function should have appropriate capabilities
to fulfill its mandate, including the right mix of skills, competencies, tools and systems.
• Transparency and effective communication: Risk management maintains a systematic
and timely monitoring and reporting on risk exposures and action plans at all levels.
• Assurance and continuous improvement: Risk management is dynamic and continually
improved with experience and periodic reviews (e.g., audits and external assessments).
7
In addition, the International Operational Risk Working Group (IORWG), a global forum dedicated to
advancing the management of operational risk in the central banking industry, produces guidelines of
topical interest for its members.
8
This section draws extensively on common leading practices in risk management, in particular (i) ISO
31000:2018, Risk Management-Guidelines, and (ii) COSO Enterprise Risk Management- Integrating with
Strategy and Performance as the main sources of the benchmarking exercise.
9
As defined in ISO 31000:2018, risk management is the “coordinated activities to direct and control
an organization with regard to risk (the effect of uncertainty of outcomes)”.
B. Risk Culture
Complementing the high-level principles is the risk culture advocating for the right tone at
the top and promoting risk awareness as a foundation for sound risk management. For
example, the right risk culture bolsters effective risk management; promotes sound risk-
taking; and ensures that emerging risks and excessive risk-taking activities are assessed,
escalated and addressed in a timely manner.10 This places risk culture at the intersection of
behavior and risk management. Despite the recent focus on risk culture, it remains at initial
stages of development and substantial work is yet to be done in this area.11
The initial step in evaluating the risk management practices in the context of a safeguards
assessment at a central bank is a benchmarking exercise to determine whether (i) a systematic
approach to risk management has been adopted, and (ii) it is facilitated by a strong risk
management framework incorporating the key elements expected to be found in leading
practices (shown in Figure 1).
Figure 1. Risk Management Framework – Key Elements
Effective risk management is best enabled by a sound framework embedded throughout the central bank
that supports the design and execution of risk management activities.
10
Illustrative objectives extracted from the “Guidance on Supervisory Interaction with Financial Institutions on
Risk Culture - A framework for assessing risk culture”: Financial Stability Board, April 2014.
11
This observation draws on safeguards experience at central banks assessed under the IMF safeguards
policy and the review of risk management related literature, including on risk culture.
Risk management strategy, policies and guidelines
The risk management strategy, usually approved and adopted by the highest governing body
such as the Board of the central bank, describes the high-level objectives and scope of risk
management. It also serves to define the risk culture of the institution and is communicated
through a formal and concise umbrella document.
Risk appetite and tolerance levels are also determined at this level, i.e., approved by the
Board, and are expressed through qualitative statements and quantitative indicators, and then
communicated down to the operational levels.12, 13
The risk management strategy is further delineated in a set of specific policies and guidelines
detailing the approach to the management of each type of risk. It also documents the roles
and responsibilities of the stakeholders involved in the management of risks, and outlines key
aspects of the risk management processes, tools and methodologies, including reporting lines
and requirements.
12
Risk appetite: the broad level and type of risk a financial institution is willing to take in pursuit of its
strategy and objectives. In theory, this represents the extent of risk that the financial institution would be able
to assume and safely manage over an extended time horizon, which in turn is reflected in its policies,
processes and procedures around key functions/activities.
13
Risk tolerance: the acceptable levels of deviation from the Board-approved risk appetite. These levels
are difficult to determine and need to be specific for each function of the bank.
14
While governance arrangements differ amongst central banks, reference to “Board” in this paper relates to the
highest governing (oversight) body of the central bank.
15
Executive Management sometimes delegates some responsibilities to a dedicated committee, such as an
Investment Committee or a Risk Management Committee.
16
Separation between financial and non-financial risk management is common, with in some cases the Middle
Office taking responsibility for the management of financial risks.
17
This broad structure mirrors the three lines of defense model, in which the business areas perform the
first control activities embedded in the operations, the risk management is responsible for the second layer
of controls and compliance, and the internal audit provides an independent assurance on the adequacy of
the control systems.
Risk management process
This is a set of coordinated activities that cycles continuously through the process of: (i)
risk identification – the inventory and classification of all risks the central bank is exposed
to; (ii) risk assessment – the analysis and measurement of the identified risks; (iii) risk
treatment – the selection and implementation of a risk mitigation strategy; and (iv) risk
monitoring and reporting – the mechanisms to continuously monitor and report risk
exposures and risk events to the relevant stakeholders. The risk management process should
be rigorously documented and periodically evaluated.
Adopting a framework is the first step in establishing a risk management practice. However,
the nature of implementation varies across central banks. The maturity model approach to
assessing risk management practices assumes that the quality and depth of these practices
should evolve and improve with time, following a pathway of development stages. This is
indeed what has been observed in practice where such frameworks grow organically over a
period of time. Table 1 provides a broad classification of the four maturity levels used to
determine the adequacy and effectiveness of risk management practices for safeguards
assessment purposes:
Source: IMF Staff - “Maturity Progression of Risk Management Practices at a Central Bank – Assessment Guidance”.
A key feature of this maturity assessment is that the various stages occur in sequence and that
the central bank has the ability to progress from one level to the next. However, it should be
noted that: (a) certain components may evolve more quickly than others; (b) a desired level
of maturity is a function of the central bank’s risk profile, culture, domestic environment,
investments needed to move to higher levels of maturity, and potential benefits; and (c) it is
not necessary, and may not even be possible, to achieve the highest level of maturity for all
components. In addition to the cost/benefit considerations, the evolution along the maturity
continuum is a journey influenced by capacity considerations and the availability of adequate
resources.
B. Considerations for Maturity Progression of Risk Management
The working assumption of this paper is that a maturity level can be determined based on
assertions of completeness, adequacy, and consistency in application of the key components
laid-out in Section III. As such, the recommendations on how central banks can strengthen
risk management practices and facilitate a gradual evolution from one level to another on the
maturity scale should be guided by the following considerations:
• Desired state of maturity. This is typically the extension of central banks’
commitment to risk management, which is influenced by their risk appetite and
tolerance levels.
• Closing gaps. The focus should be on actions that will achieve the greatest impact in
terms of progression. However, in deciding on the pace of the evolution, the central
bank should always take into consideration capacity constraints.
• Integration. Embedding risk management processes across the central bank should
be a continuous process rather than a one-off annual exercise. Ultimately, risk
assessment and management would become a routine element of policy design and
implementation.
V. MATURITY ASSESSMENT TOOL
The Maturity Assessment Tool (MAT) is a combination of the benchmarking framework and
the maturity model approach (see Annex I).
The MAT is a tool designed internally by the Safeguards Assessments Division of the IMF’s
Finance Department to be used in the context of safeguards evaluations. Its objective, as
described above, is twofold: (i) evaluate the development status of the risk management
function relative to all the elements of a risk management framework, and (ii) provide a basis
for the identification of development needs and recommendations.
It is important to distinguish the purpose of the creation of the MAT from other objectives. In
particular, while the MAT is not necessarily intended to be a self-evaluation tool, central
banks may use it to guide the implementation of their risk management frameworks or
identify improvement needs to align the quality of their existing risk management functions
with leading practices.
The MAT is a matrix: (i) the rows contain the elements of the risk management framework
described in Section III, and (ii) the columns list the maturity levels introduced in Section
IV. Within the matrix, each cell provides a high-level description of the status of an element
of the risk management framework, for a given maturity stage. In other words, the MAT
describes the attributes that each element of the framework should display so that it can be
determined as adequate for that level of maturity (see Annex I for illustration).
As an example, with respect to governance and an instance where a Risk Management
Committee is not established, the MAT indicates that for the level of maturity of a central
bank to be considered at least "developing", “oversight of risk management activities is
ensured through other governance arrangements (e.g., Audit Committee) on ad-hoc basis.”
This section provides illustrative examples on the use of the MAT, each described in a table
with three columns:
• The first column contains a hypothetical response obtained from the central bank;
• The second column presents the description offered by the MAT that best matches that
response; and
• The third column offers a possible recommendation to facilitate a modular transition to
the next maturity level.
Example 1: Risk Appetite
The risk appetite is a key element in risk management because it identifies the risks that will
be tolerated ex ante (i.e., will not require specific treatment, such as mitigation plans).
Description obtained from the Best fit relative to expected Possible recommendation to the
central bank attribute in the MAT central bank
“The central bank has a definition “Risk appetite is not articulated in The central bank should define
of risk appetite that we use inside a formal statement” and approve a risk appetite
our department. This is enough (“developing”) statement to be approved by the
because we are the experts…” Board and communicated down to
the operational levels (see
description in “implementing”
stage).
Description obtained from the Best fit relative to expected Possible recommendation to the
central bank attribute in the MAT central bank
“Even if our RMC lacks a charter, “The RMC exits but its operations The central bank should enhance
it is composed of all Heads of are not optimal: For example, (i) its RMC by appointing senior
Department and meets once a its members lack requisite skills, executives with relevant expertise
year. During the last meeting, (ii) absence of clear mandate, (iii) and approving a charter
important issues relating to the low frequency of meetings or containing its mandate and
physical security of our main random agendas” responsibilities (see description in
building were discussed…” (“implementing”) “optimal” stage).
Description obtained from the Best fit relative to expected Possible recommendation to the
central bank attribute in the MAT central bank
“We identify new controls to “Risk treatment / mitigation The central bank should develop
mitigate major risks. The Head of measures have been identified for and record action plans to
the Department is in charge of some risks, but not converted into implement mitigation measures,
their implementation. This formal action plans and no and establish a process to monitor
responsibility falls within his mechanism to ensure their their implementation
purview, and he may decide to implementation and for assessing (see description in
develop an action plan…” their effectiveness” “implementing” stage).
(“developing”)
Example 4: Risk Management Annual Report
Annual risk reports are usually prepared for the oversight body. The report highlights all
relevant developments in the function and contains a detailed description of the evolution of
the central bank’s risk profile.
Description obtained from the Best fit relative to expected Possible recommendation to the
central bank attribute in the MAT central bank
“Our Board is informed “The oversight body is informed The risk management department
immediately on all important on ad-hoc basis” (“developing”) should provide a summary of the
issues relating to risk department’s activities in an
management, such as major annual report and present it to the
incidents. In these instances, the oversight body. The report should
risk management department include the risk management
elaborates a detailed report strategy and the description of the
containing all relevant risk profile of the central bank
information…” (see description in
“implementing” stage).
Description obtained from the Best fit relative to expected Possible recommendation to the
central bank attribute in the MAT central bank
“We do not quantify risks, neither “No quantification” (“informal”) 1. The central bank should
financial risks, nor operational quantify financial risks as a first
risks…” step (see description in
“developing” stage).
18
Operational risk is defined in the 2005 Revised Basel II Framework as “The risk of loss resulting from
inadequate or failed internal processes, people, and systems or from external events.”
19
While not widely applied among central banks, the quantification of operational risks is an indicator of
an advanced level of maturity, as it requires a certain level of sophistication in terms of skills and tools.
VI. CONCLUSION
ISO 31000
ISO 31000 was originally published by the International Standards Organization (ISO) in
2009 and an updated version was published in February 2018. A key feature of this
international standard is integrating the management of risk into a strategic and operational
management system, and expanding the responsibility for risk management to a broader
group of risk owners across an organization. ISO 31000 suggests that effective risk
management is characterized by principles, framework and process as depicted in the figure
below, and will depend on its integration into all aspects of the organization:20
Figure 2. Principles, Framework and Risk Management Process from ISO 31000
While the revised standard is very similar to the original version, key changes include: (i)
risk management is no longer an activity conducted in silo, but rather integral part of high-
level and operational decision-making; (ii) risk management is iterative and should be
continuously improving to adapt to external and internal changes.
20
A Risk Practitioners Guide to ISO 31000: 2018 – Institute of Risk Management (IRM)
COSO/ERM
Probably the most widely applied Enterprise Risk Management (ERM) framework-the
COSO ERM framework- was first developed by the US Committee of Sponsoring
Organizations of the Treadway Commission (COSO) in 2004. It was defined as “a process,
affected by the entity’s board of directors, management, and other personnel, applied in
strategy setting and across the enterprise, designed to identify potential events that may affect
the entity, and manage risk to be within the risk appetite, to provide reasonable assurance
regarding the achievement of objectives”.
The framework was updated in 2017 with the aim of improving organizational performance
through better integration of strategy, risk, control and governance. It clarifies the importance
of enterprise risk management in strategic planning and emphasizes embedding ERM
throughout an organization, as risk influences strategy and performance across all functions.
The COSO Enterprise Risk Management Framework, as shown below, is a set of principles
organized into five interrelated components.21
Source: Reproduced from COSO – Enterprise Risk Management – Integrating with Strategy and Performance
The two frameworks touch on similar aspects of the risk management process. While there
are nuances between ISO 31000 and COSO ERM, the basis of both frameworks is essentially
the identification of high-level objectives that are used as the standards for evaluating the
effectiveness and efficiency of risk management. Both COSO ERM and ISO 31000, because
of their maturity, their holistic approach and their similarities in methodology, can help
organizations to realize the potential benefits connected with the application of a generic risk
management standard.
21
Enterprise Risk Management – Integrating with Strategy and Performance, June 2017 (Committee of
Sponsoring Organizations of the Treadway Commission COSO)
REFERENCES
A Risk Practitioners Guide to ISO 31000: 2018 – Review of the 2018 version of the ISO
31000 risk management guidelines and commentary on the use of this standard by risk
professionals (Institute of Risk Management- irm).