Estrategias Nacionales de E - Salud
Estrategias Nacionales de E - Salud
Estrategias Nacionales de E - Salud
page I
Printed in Geneva
Foreword
The World Health Organization (WHO) and the International Telecommunication Union
(ITU) are pleased to present this National eHealth Strategy Toolkit. WHO and ITU have a long
history of working together, and this new publication represents one of our most substantial
and significant collaborations of recent years. It fully reflects the importance that the governing
bodies of our two organizations attach to the development of national eHealth strategies.
This is a shared work that reflects a shared goal responding to the needs of countries, at every
level of development, who seek to adapt and employ the latest information communication
technologies (ICT) in health for the measurable benefit of their citizens. The National eHealth
Strategy Toolkit is a milestone in our understanding of what eHealth is, what it can do, and why
and how it should be applied to health care today.
The Toolkit is a comprehensive, practical guide that all governments, their ministries,
departments and agencies can adapt to suit their own circumstances and their own vision and
goals. Its publication is very timely. This is a period when all health systems face stringent
economic challenges, greater demands for efficiencies and higher expectations from citizens.
There is, everywhere, an urgent challenge to provide more care and better care to more people,
especially those most in need.
This Toolkit expertly demonstrates how all nations can rise to that challenge, each in its
own way. While it brings the sectors of health and ICT much closer together, the Toolkit also
encourages the active participation of a wider range of stakeholders, including the general
public, reflecting important issues of social justice and equity. By bringing all of these interested
parties together, the Toolkit offers them a chance to share in a unique national project whose
ambition is nothing less than to achieve lasting progress in public and individual health.
Dr Margaret Chan
Director-General
World Health Organization
Dr Hamadoun I. Tour
Secretary General
International Telecommunication Union
page i
Acknowledgements
The World Health Organization and the International Telecommunication Union gratefully
acknowledge the contributors, peer reviewers, and consultants whose dedication, expertise, and
support made this first edition of the National eHealth Strategy Toolkit possible.
Steering committee
Najeeb Al-Shorbaji, Joan Dzenowagis (WHO); Hani Eskandar, Mario Maniewicz (ITU).
Consultants
Adam Powick, Mark Watson, Benjamin McCartney, Gilda Chilcott, (Deloitte Touche Tomatsu,
Australia).
Special thanks
Thomson Prentice, editor; Marilyn Langfeld, graphic designer; Valentina Pistritto (ITU), initial
project support.
Independent experts
Zakiuddin Ahmed, Omar Alkurdi,Baljit Bedi, Peter Drury, Stephen Settimi, Petra Wilson.
page ii
Contents
Foreword
Acknowledgments
Introduction to the National eHealth Strategy Toolkit
Parts
1. Establishing a National eHealth Vision
2. Developing a National eHealth Action Plan
3. Monitoring and Evaluation
page iii
page iv
The Toolkit is designed in three parts, with the second and third parts building progressively
on the work of the first:
Part 1: A national eHealth vision that responds to health and development goals
Part 1 develops a national eHealth vision that responds to health and development goals. It
explains why a national approach to eHealth is needed, what a national eHealth plan will need
to achieve, and how it will be done.
Why: This is the strategic context for eHealth, encompassing the health of the population,
the status of the health system, the health and development priorities, and the resulting
implications for eHealth.
What: This is the role eHealth will play in the achievement of health-sector goals. It serves
as a high-level message for policy-makers that answers the question of where does our
country want to go with health, and how will eHealth help us get there?
How: This gives the various eHealth components or building blocks that must be in
place to realize the national eHealth vision.
Part 2 lays out an eHealth action plan that reflects country priorities and the eHealth context. It
structures activities over the medium term, while building a foundation for the long term.
Part 3 establishes a plan to monitor implementation and manage associated risks. It shows
the progress and the results of implementation and helps in securing long-term support and
investment.
Each of these three sections describes the activities required, along with practical advice
informed by real-world experience. Countries can undertake the entire set of activities, or those
specific to their contexts and constraints. How the Toolkit is used, and the end result, will
depend on these factors and on each countrys priorities and vision.
Countries can focus on a range of structured activities that lead to the progressive development
of a national eHealth strategy. These include:
involving the key health and non-health stakeholders in creating a national eHealth vision
and plan and its subsequent implementation.
establishing governance mechanisms to provide improved visibility, coordination and
control of eHealth activities that are occurring across the countrys health sector.
establishing the strategic context for eHealth to provide the foundation for the eHealth vision
and plan, and to enable the government to make informed decisions on whether to pursue
opportunities that present themselves from the ICT industry and other stakeholders.
forming an understanding of the current eHealth environment in terms of the programmes,
projects and eHealth components that already exist.
the Toolkit also identifies the short-, medium- and long-term goals for countries,
recognizing the importance of demonstrating outcomes and benefits throughout the
process of national strategy implementation, and to build and maintain momentum and
support for eHealth; and thereby improve the health of their populations.
Finally, while it is aimed at a specialized, professional readership, the Toolkits approach keeps
the general public firmly in mind, recognizing that it is the public who will be the ultimate
beneficiaries of eHealth in their country.
page v
Printed in Geneva
Part 1
Purpose
The National eHealth Strategy Toolkit is an essential resource for developing or revitalizing a
countrys eHealth strategy. It can be used equally by countries just setting out and those which
have already invested significantly in eHealth. This latter group includes countries now seeking
to build on promising results from pilot initiatives, to establish foundations for scaling-up
eHealth projects, or to update current strategies to reflect changing economic circumstances.
Whatever the starting point, experience shows that eHealth efforts can be strengthened,
accelerated or aligned through a national strategic planning process.
Audience
The Toolkit is intended for use by government health sector leaders in ministries, departments
and agencies who will manage the development of an eHealth strategy. The successful
application of the Toolkit requires a team experienced in strategic planning, analysis and
communication.
Part 1
Part 2
Part 3
National eHealth
action plan
National eHealth
monitoring and evaluation
Orientation to Part 1
The first part of the Toolkit consists of 12 chapters and focuses on developing the national
eHealth vision.
Chapters 13 give an overview of eHealth, the elements of a national eHealth vision, and
the method of developing it.
Chapters 45 describe how to manage the vision process and work with stakeholders.
Chapters 612 provide a detailed guide to gathering and analyzing information,
constructing and refining the eHealth visions and recommendations. Appendices give
additional information and tools to support this Toolkit, including definitions of some
frequently used terms.
page i
Contents
10
12
15
20
27
35
38
47
60
67
71
Annexes
A. Examples of eHealth
78
B. eHealth benefits
81
82
D. Method summary
83
85
F. Governance continuum
87
88
page ii
Figures
1. National context for eHealth development
2. eHealth components
10
12
16
19
23
42
58
59
68
73
85
87
Boxes
1. Examples of eHealth outcomes
40
41
42
42
44
6. Sample scenario
45
51
53
54
75
82
page iii
Tables
1. Examples of the impact of eHealth
17
21
23
24
25
26
28
29
30
33
40
16. Sample questions for describing the vision for important stakeholders
43
48
49
50
52
53
55
56
72
73
81
83
page iv
Chapter 1
recognized the importance of collaboration for eHealth in their governing body resolutions3,
which encourage countries to develop national eHealth strategies. This Toolkit supports those
recommendations.
Ministries of health play a pivotal role, not only in meeting peoples needs for care and
protecting public health, but in preserving health systems through uncertain times. Ministries
of information technology and telecommunications are essential to development in all spheres,
and can make a vital contribution to the health sector. Common goals and a predictable ICT
environment enable coordinated action: building consensus on policy, facilitating better use
of shared resources and involvement of the private sector, and investment in ICT skills and
infrastructure to improve health outcomes.
While eHealth strategies deliver direct national benefits, they can also improve regional
cooperation. This is demonstrated by European Union countries, which are experiencing a
political momentum to advance eHealth for the benefit of their citizens and health systems.
These countries are being encouraged to establish new mechanisms to foster smart growth and
innovation to overcome current economic challenges.
3 World Health Assembly Resolution 58.28 (2005): www.who.int; World Telecommunication Development Conference
Resolution 65 (2010): www.itu.int.
4 See definition of eHealth in: National E-Health and Information Principal Committee. National E-Health Strategy, 30th September
2008. Adelaide, Deloitte Touche Tohmatsu, 2008.
Stakeholders
Impact of eHealth
Citizens
Enables personalized care, throughout the health system and across the lifespan
Makes health care available at home, at work or in school not just the hospital or clinic
Professionals in research
and practice
Gives access to current, specialized, accredited knowledge for clinical care, research and
public health; and to research, publications and databases
Makes high-quality distance learning for basic and continuing professional education
readily available
Allows remote consultations with patients, for second opinions, and with professional
networks
Monitors quality and safety; improves care processes and reduces the possibility of
medical errors
Assists mobility of citizens and their medical records providing patient information
when and where needed
Opens new opportunities in basic and applied research; from health knowledge to
policy and action
Extends collaboration and shared computing power (e.g. grid and cloud computing)
Health-related businesses
Facilitates research and development of new products and services: electronic health
records, information systems, and clinical registries.
Enables broad and cost-effective marketing for health products and services to
businesses and governments, locally and abroad.
Governments
Delivers more reliable, responsive and timely reporting on public health; as health
becomes increasingly central to economy, security, foreign affairs and international
relationships.
Offers new roles for stakeholders, health professionals, authorities, citizens and others.
Identifies disease and risk factor trends; analyses demographic, social and health data;
models diseases in populations
5 Dzenowagis J. Connecting for health: global vision, local insight. Geneva, World Health Organization, 2005.
Mainstreaming
Scale up
Developing
and building up
Emerging
enabling
environment
for eHealth
II.
Early adoption
III.
I.
Established
enabling
environment
for eHealth
Experimentation
Emerging
ICT environment
Based on the ICT environment and enabling environment for eHealth, the national context can
be described in the following way:
Experimentation and early adoption, where both the ICT and enabling environments are at an
early stage
Developing and building up, where the ICT environment grows at a faster rate than the
enabling environment
Scaling up and mainstreaming, during which the enabling environment matures to support
the broader adoption of ICT.
These contexts are explained in the next three sections with a summary at the end (Table 2).
The driving factors for eHealth in this case are improving access to health care for the citizens,
and improving the quality of that care. Classic examples of eHealth include provision of
telemedicine services to remote areas, and asynchronous consultations such as via e-mail for
access to medical advice.
A national plan for a country in this context should focus on making the case for eHealth,
creating awareness and establishing a foundation for investment, workforce education and
adoption of eHealth in priority systems and services. There is a common misconception that
countries can leapfrog to more advanced eHealth systems. But without a parallel focus on
creating the enabling environment, innovations in ICT will stay isolated and have only a limited
impact on health.
A national plan for a country in this context should focus on strengthening the enabling
environment for eHealth, creating legal certainty, establishing the policy context for delivering
eHealth services more broadly, and identifying the standards to be adopted to ensure that
building ever-larger vertical systems is avoided.
providing incentives for innovation and integration of eHealth into core services;
responding to the expectations of citizens for more efficient, effective and personalized
services;
using data and information for public health planning, policies for privacy and security of
information;
undertaking monitoring and evaluation to ensure that eHealth delivers according to health
priorities.
Context
Characteristics
I. Experimentation
and early adoption
eHealth is project-based with initiatives usually small, few in number and disconnected
Projects are rarely sustainable due to the lack of infrastructure, skills and integration
The commercial ICT market is fragmented with little local expertise available
Funding and technical support is often provided by aid agencies, donors and external actors
eHealth is still project-based, but larger in scale with greater awareness of its potential
eHealth systems (e.g. health information systems, supply-chain management systems, electronic
medical records systems) emerge, but remain vertical, fragmented and unable to scale up
Growth occurs in the commercial ICT market, with significant effort to attract international ICT
vendors. Local vendors emerge and government interest grows
Initiatives such as e-government, e-banking and other commercial ICT services begin to take
hold; but the health sector lags behind
Aid agencies and donors are still active funders; there is more private sector and government
investment in development and adoption of cost-effective technologies
eHealth is viewed as part of a broader effort to expand ICT and economic development
Early successes are promising, but scale-up is not possible and health impact remains limited
International obligations for public health reporting can sometimes be met through vertical
systems
Examples of eHealth include more extensive telemedicine networks, adoption of EMR systems on
a limited basis, procurement and stock tracking systems, and mHealth trials
The commercial ICT market is well established with larger vendors, both international and local
The health sector takes a leading role in planning and using eHealth to deliver on health
objectives
The health ICT industry is active; with new business models and competition, paid services
commonplace, and insurance reimbursement increasing
New businesses and economic opportunities arise; there are new platforms for innovation and
services, including for other markets
Health information systems are increasingly linked, but still face problems due to legacy systems
Examples of eHealth include hospital and care networks, home health monitoring, chronic
disease management applications, and tailored online services for self-management of health
records
Context
Example focus
Example actions
I. Experimentation
and early adoption
Strengthen
infrastructure; establish
core services and
platforms; engage
investors; make the case
for eHealth.
eHealth components
The national eHealth environment is made up of components, or building blocks (Figure 2),
which will be introduced or strengthened through the eHealth strategy.
Figure 2. eHealth components
Leadership and governance
Strategy
and
investment
Legislation,
policy and
compliance
Infrastructure
Workforce
The components can be grouped into the ICT environment and the enabling environment
(Table 4).
Table 4. Role of eHealth components
Component
Role
Description
Leadership,
governance and
multi-sector
engagement
Enabling environment
Strategy and
investment
Enabling environment
Align financing with priorities; donor, government and privatesector funding identified for medium term.
Legislation, policy
and compliance
Enabling environment
Workforce
Enabling environment
Standards and
interoperability
Enabling environment
Infrastructure
ICT environment
Services and
applications
ICT environment
Chapter 2
Population health
Health system status
Health strategy, goals and priorities
Economic and social development goals
Goals and challenges
Implications for eHealth
eHealth vision
Desired outcomes
Required components
Elaborating the health goals and challenges helps to identify specific areas where investing
in ICT can add value for health; the national development context (e.g. economic growth,
innovation), and shows how eHealth will also support development or market objectives.
Together, these aspects constitute the strategic context for the national eHealth vision.
Chapter 3
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Chapter 4
Identify
required
components
Draft an
initial vision
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
Effective leadership and governance of the vision development process improves transparency
and credibility, facilitates guidance, and ensures that mechanisms for approving, endorsing and
owning the national eHealth vision are in place. Effective management ensures that the process
is undertaken in a structured and timely manner with appropriate stakeholder consultation.
Activities
The process requires establishing or ensuring:
Outputs
A credible, well-managed process resulting in a national eHealth vision that supports the
national health agenda and reflects the needs of health system stakeholders.
Oversight and steering (i.e. input, escalation, review and endorsement of deliverables)
national health system and services delivery, including health workforce and budget
population health
national health strategy and policy
current health ICT and eHealth environment
other sectors including national infrastructure, telecommunications, education and
workforce capacity building, finance, etc.
Communications management.
Steering committee
Stakeholder
reference and expert
advisory groups
Broader stakeholder
environment
Group
Responsibilities
Composition
Health sector
leadership
Steering
committee
Stakeholder
reference
and expert
advisory
groups
eHealth
strategy team
Broader
stakeholder
environment
The complexity of the nations health system and the associated stakeholder environment will
determine the number of individuals required in each group. This is particularly the case for the
eHealth strategy team as the effort associated with coordinating, management and consultation
is directly related to the complexity and size of the stakeholder environment.
The core project team should include or have access to the following skills, knowledge and
expertise:
ability to research, analyse and extract lessons from international programmes and projects;
broad knowledge of ICT, eHealth, its components and its application in the sector;
senior health sector, ministerial or government representatives should also be in the team.
10
11
12
13
14
15
16
17
18
19
Chapter 5
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
Producing a national eHealth vision that is well researched and supported requires working
with a range of multisectoral stakeholders, consistent with the governments role in eHealth.
There is likely to be a number of stakeholder groups with an interest in a national eHealth
vision, which are keen to provide input and follow its progress. Careful management of them
is critical to ensure that the vision has appropriate input, support and acceptance. An inclusive
approach builds relationships and educates stakeholders while gaining valuable perspectives on
what eHealth should deliver. This engagement is carried on throughout the process to ensure
that stakeholders interests are understood, that they remain informed on progress, and that the
vision has their continued support.
Activities
Given the range of stakeholders that may need to be involved, working with them can be a
complex undertaking. Managing this complexity requires:
developing a pragmatic approach to managing these groups, taking into account influence,
knowledge, and expertise; and
defining the points at which consultation will occur, ensuring this is communicated to
stakeholders and carried out as planned.
Outputs
An informed national eHealth vision that is relevant to, and supported by, stakeholders.
Market
Description
Fully regulated
Guided market
Free market
general public
Stakeholders from beyond the health sector also play an important role in developing and
implementing the vision, (e.g. expertise or services), or may benefit directly (e.g. through new
business opportunities). Examples include:
ICT/telecommunications ministries
international organizations and donors such as the European Commission, the World
Bank, the International Monetary Fund and United Nations specialized agencies.
These stakeholders should be analysed to inform the engagement process and communication
plan.
What are the main concerns, interests, mandate, experience and views of each stakeholder
group?
How supportive and influential is each group?
What expertise and/or resources may be available for the present strategy development, as
well as for implementation of the action plan?
What should be the role of each and how should they be involved (Figure 7)?
Are there stakeholders that are not organized but whose interests should be considered?
Understanding the different stakeholders makes it possible to determine the level, focus,
frequency and medium of engagement to use. Their interests, level of influence, and potential
contribution should be well understood before the start of communication. Research on
stakeholder interests and capabilities is useful not only for the strategy development process, but
will also be required for Part 2, implementation planning.
The strategy team will need to decide how to prioritize its efforts and how to engage most
effectively, particularly with those stakeholders most affected by the strategy, or most capable of
influencing it and its implementation. Serving the true customers of the strategy is as critical as
achieving buy-in for the vision.
Key influencers
Engaged stakeholders
ders and g
ehol
ene
tak
ra
s
r
l
a
t
k
s
e
de
h
d
old
ge
a
e
g
r
En
fluence
n
i
r
ey
c
bli
pu
Br
oa
Broader stakeholders
and general public
Decision-makers
Decisionmakers
Role
Description
Examples
Decisionmakers
Key influencers
Engaged
stakeholders
Broader
stakeholders
and general
public
Individuals
Carers
Families
Community groups
Role
Approach to engagement
Decision-makers
Frequent and formal contact to seek input, and guidance, present material for final review, and
seek acceptance and endorsement of recommendations.
Key influencers
Frequent and more informal contact to seek input and guidance and assistance in forming key
directions and recommendations.
Engaged
stakeholders
Broader stakeholders
and general public
May be managed through mass media or online questionnaires and surveying techniques. These
enable publication of material such as a summary of the eHealth vision, and seek input from the
general public through a questionnaire, poll or survey.
Generally, face-to-face consultations with the general public are not required during the
development of the national eHealth vision and action plan, although public consultation forums
can be used if needed.
Decision-makers
Stage
Key influencers
Broader stakeholders
N/A
N/A
N/A
N/A
N/A
General public
The final plan should take into account the availability of stakeholders, and in particular seek
to reduce the number of consultations, interviews and discussions that need to be held with the
same stakeholder. This may be accomplished over a number of rounds, rotating the stakeholders
involved in each round (Table 10).
Table 10. Sample approach to stakeholder consultations
Round
Proposed mechanism
One
What are the priority challenges within the health sector that
eHealth may be able to resolve?
What is our vision for eHealth over the next 510 years?
What are the risks and barriers to delivering eHealth in our country?
Three
eHealth components
--discuss findings and recommendations with individual decisionmakers and stakeholders where required.
Chapter 6
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
Developing a national eHealth vision begins by establishing the strategic context, which
describes the priority health system goals and challenges that eHealth will help to address. The
strategic context is developed by researching population health; the health system; national
health strategy, priorities and goals; and social and economic development goals.
Activities
Identify work already done on strategies for eHealth, ICT or health information systems.
Identify the strategic goals and challenges most directly affected by the eHealth vision.
Describe how a national eHealth environment can support these goals and challenges.
Outputs
The strategic goals and challenges to delivering improved health outcomes, along with an
understanding of the relative strategic priorities for the sector.
The potential role for eHealth in addressing these goals and challenges.
Dimension
Sample questions
Size and
demographics
What are the primary geographic, social, economic and other demographic segments (e.g.
population living below the poverty line, age groups, literacy, and other relevant indicators)?
Current health
outcomes
Implications of
demographic trends
What challenges will these changes create for the health system?
Implications of
health outcome
trends
What health and non-health factors are expected to be responsible for these changes?
What challenges will these changes create for the health system?
Recommended outputs
This step should produce an understanding of:
specific challenges for segments of the population (age groups, socioeconomic groups, etc.).
Approach
Internal research and analysis, supported by stakeholder interviews.
Stakeholder interviews
Interviews should be conducted with health ministries, departments and agencies responsible
for monitoring and reporting on population health, where internal research has been unable
to locate the required information. Additional interviews with ministries, departments and
agencies responsible for health planning may also be useful to gain insights into the health and
non-health drivers of population health outcomes.
Dimension
Sample questions
Services
What health-care services cannot be delivered to the population and what challenges or barriers are
responsible for this?
Structure and
roles
Which entities2 plan, manage and deliver health services at a national, state, regional and local level?
What are the responsibilities of these entities and what are their relationships with each other?
What gaps or challenges exist with the current health system structure?
Workforce
What impact will these imbalances have on the health system, services and health outcomes?
Funding
What changes in health-care spending and funding models are likely to occur?
What are the funding and budget cycles for the health system, and which entities are involved?5
Governance,
policy
and regulation
What governance and policy mechanisms exist at a national, state, regional and local level?
How are regulation and performance monitoring of the health system undertaken?
Effectiveness
and efficiency
What challenges affect the effort, time and cost associated with delivering health services?
Accessibility
What challenges affect the ability of certain population segments to access health services?
Notes:
1 Examples of health-care services include primary care, allied health, specialist services, pharmacy, community health,
diagnostic and laboratory, acute care, and health services for the aged.
2 Examples may include public health departments, agencies, organizations and providers, private health-care organizations,
networks and providers, and nongovernmental organizations (NGOs).
3 Countries may not have this information available. This should not be viewed as a barrier to creating a national eHealth
vision. But it may increase the complexity of constructing an economic case for investment in eHealth.
4 Funding models may include taxation, social health insurance, private health insurance, out-of-pocket payments, donor
funding.
5 This includes consideration of planning and funding processes for major donors.
Recommended outputs
This step should produce a summary of:
Approach
Internal research and analysis, supported by interviews with health sector stakeholders.
Stakeholder interviews
Health-sector stakeholders should be consulted as part of developing an understanding of
the health system and associated challenges. Both broad and specialized perspectives should
be sought. Consultation ensures that the necessary information is collected and provides
stakeholders with the opportunity to outline their views on the potential role and contribution
of eHealth.
Dimension
Sample questions
Challenges
What are the current challenges to the health system and broader health sector? Areas to consider:
--population health
Priorities
What are the governments stated priorities for addressing these challenges?
Strategy
How recently has the strategy been developed and what is its timeframe?
Goals and
targets
What goals and targets have been identified as part of the national health strategy?
Timeframes
What are the timeframes for delivering the health strategy, goals and priorities?
Initiatives
What major health system improvement, transformation or reforms are underway or planned?
Funding
What are the implications for future funding of the nations health system?
Notes:
1 Such as the Millennium Development Goals (MDGs), which UN member states have committed to achieving by 2015.
2 Such as the International Health Regulations (IHR), and the Partnership for Maternal, Newborn and Child Health (PMNCH).
Recommended outputs
The output of this step should be a set of strategic themes, goals and priorities that are
supported by the relevant health-sector leaders and decision-makers.
Approach
Countries may not have a well-articulated health strategy, set of goals, or priorities. Often
multiple versions of these co-exist at national, state and regional levels. This step will require
consultation with health-sector stakeholders to identify and refine these to an agreed set that
can be used for the basis of developing a national eHealth vision.
Stakeholder interviews
Interviews with stakeholders should refine or confirm internal research. Stakeholders
responsible for health strategy, planning and policy at a national, state, regional and local level
should be selected, including:
health strategists and planners from both the public and private sectors
health policy-makers
Workshops may need to be conducted where discussion is required to explore and resolve
divergent strategies, goals and priorities.
Recommended outputs
This step should identify additional non-health sector drivers that are relevant to eHealth and
that should be considered in the development of a national eHealth vision.
Approach
Internal analysis followed by validation with high-level sector stakeholders.
Chapter 6. Establishing the strategic context page 31
Internal analysis
Regional documentation, reports, announcements or cooperation agreements should be
obtained from development partners in other ministries, agencies or institutions. These
agreements may take the form of policies, major commitments such as the Millennium
Development Goals, and instruments such as directives and recommendations used by entities
such as the European Commission, for example. These agreements can then be analysed to
understand how the development of a national eHealth environment may provide opportunities
to align with or to further their goals and targets.
Approach
Internal analysis followed by validation with high-level sector stakeholders.
Internal analysis
Review of health and ICT ministry documentation, including a review of resolutions, mandates,
policy statements or commitments. Previous reports or other documentation can yield valuable
insights and lessons for the current effort.
6.6 Select goals and challenges where eHealth will have the
most impact
Objective
This step focuses on combining the knowledge gained through the previous steps to identify the
strategic goals and challenges that can best be supported by eHealth. While there may be many
of these only some will be directly supported by a national eHealth environment. This step aims
to identify those where eHealth can have the biggest impact, to be used as the basis for defining
the national eHealth vision.
The goals selected may be common across the areas of population health, health system,
health strategy, and broader social and economic development, or may be important goals and
challenges that have occurred in only one of these areas (Table 14).
Area
Sample questions
Population health
What are the strategic goals for improving the health outcomes of the population?
What challenges will be created by current and expected changes in population health?
What are the challenges impacting the delivery of equitable and accessible health services
across the population?
What are the challenges facing the supply of the nations health workforce and its ability to
support effective and efficient health-care delivery at all levels of care?
What are the challenges related to the distribution of a nations health workforce and its
ability to support effective and efficient health-care delivery in metropolitan, regional, rural
and remote parts of the nation?
What are the challenges caused by the existing structural, funding, governance and
leadership arrangements of the nations health system?
Effectiveness and
efficiency of health-care
delivery
What are the challenges that affect the quality and safety of health services delivered to the
population?
What are the challenges affecting the effort, time and cost associated with delivering health
services to the population?
Emergence of advanced
medical treatment
regimes
What are the opportunities and challenges associated with the emergence of advanced
medical treatment regimes and the demand for these by the population and health-care
providers?
Funding
What are the funding challenges for health systems, trends in public and private spending,
sustainability of the health system, projected funding and its impact on future health
services?
These are just examples, and the specific goals and challenges may differ significantly between
countries. However, the process for reaching them is the same.
Recommended outputs
This step should produce a clear description of the main strategic goals and challenges around
which the national eHealth vision will be developed.
Approach
Internal analysis followed by validation and refinement with health-sector stakeholders.
Internal analysis
The information collected so far should be consolidated to form a manageable number of
strategic goals and challenges around which a national eHealth vision can be constructed.
Based on existing country experiences, between five and eight strategic goals and challenges
are recommended. More than eight increases the complexity of developing a well-structured,
understandable vision and action plan. A large number of goals and challenges should be
grouped into a set of strategic themes. The vision can then be drafted to respond to these themes.
It is also important to avoid overlap and duplication among goals and challenges. If, for
example, one challenge is actually a result of another, the focus should be on the main
challenge.
What are the main information flow challenges that currently exist?
How do these challenges act as a barrier to achieving a strategic goal or overcoming a
strategic challenge?
How will the flow of information in the health sector need to change?
What information, knowledge and tools would need to be made available to individuals,
health-care providers, managers and policy-makers?
Recommended outputs
This step should describe the implications for eHealth arising from the themes identified in the
previous step. These should be described in terms of health information flows or the potential
impact on other sectors.
Approach
Internal analysis to determine and describe how eHealth will support health and development
goals:
the strategic goals and challenges for the health system and social and economic
development;
the implications of these goals and challenges;
description of how sharing and access to information and other electronic health services
can address health goals;
description of how a national eHealth environment may allow non-health goals and
challenges to be addressed.
Chapter 7
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
Research on the eHealth experience of other countries (including successes and failures), as well
as trends and best practice can provide an understanding of the outcomes that can be achieved
and the types of goals for which eHealth is relevant.
Activities
Outputs
An understanding of:
the types of health system goals or challenges that eHealth can address
evidence of the specific benefits that eHealth has delivered in similar settings.
health system goals and challenges that countries are trying to address through eHealth
non-health sector goals and challenges where eHealth has been applied
This step should focus on countries that may be similar in terms of:
Recommended outputs
This step should produce a broad understanding of the national eHealth visions, strategies and
implementation programmes of similar countries.
Approach
Internal research and analysis, complemented with exploratory interviews with representatives
from other countries.
Exploratory interviews
Relying on research alone for a full understanding of another countrys eHealth programme,
and the lessons associated with its implementation, can also be challenging. For countries of
particular interest there may be value in organizing regional meetings, study tours or interviews
with individuals who are responsible for eHealth. It is important to focus the enquiry on
experience and lessons learned. Most countries are open to sharing knowledge about their
eHealth experience. The primary challenge is often locating the right individual(s) with whom
to communicate, particularly in those countries without a nationally-coordinated approach to
eHealth.
health system goals and challenges that eHealth services and applications address
health system settings in which these services and applications are being used
Recommended outputs
This step should lead to an understanding of the common ways in which eHealth has been used
in other countries to address specific health system goals and challenges, and the benefits and
outcomes that it has delivered.
Approach
Research should focus on information on the use of eHealth to address health system goals
and challenges. Most of this research can be conducted via the Internet. Common sources
of information include government, agency and industry reports on the use of eHealth and
studies found in clinical, technology and other journals and publications. Information from
international agencies such as WHO can also be used as input to this step.
Chapter 8
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
A national eHealth vision describes how eHealth will contribute to achieving a countrys health
goals. It will reflect stakeholder input obtained so far, and be informed by research on global
eHealth trends and practices.
Activities
Describe the rationale for each outcome sought; link outcomes to the strategic context.
Describe what delivering the national eHealth vision will mean for stakeholders.
Develop one or more scenarios that put the national eHealth vision into practice (optional).
Outputs
A description of:
the rationale between outcomes and the strategic context for eHealth
one or more scenarios that demonstrate the national eHealth vision in practice (optional).
the national health strategy and its timeframe for targets and goals
Recommended outputs
This step defines the timeframe for the national eHealth vision, agreed to by health sector
leadership.
Approach
Internal analysis followed by review and agreement of relevant stakeholders.
eHealth outcomes are derived from strategic themes (goals and challenges) and country context.
Once agreed, the eHealth outcomes form the basis for determining the required components.
Sample question
Models of care
Access to medical information and care delivery tools that support health-care providers
in delivering care to individuals
Access to health education and awareness information for individuals and carers
Recommended outputs
This step should describe the eHealth outcomes, followed by:
the required changes to health information flows or the way in which health services are
delivered; and
the health system outcomes that result.
This approach ensures each description can stand alone, but that its value to the health system
is clear (Box 1).
Box 1. Examples of eHealth outcomes
Enable electronic access to appropriate health-care services for citizens in remote, or rural communities.
Facilitate continuous improvement of the health system through more effective utilization of health outcome
information.
Improve the quality, safety and efficiency of clinical practices by giving care providers better access to patient
information, clinical evidence and decision support tools.
Support more informed policy, investment and research decisions through access to timely, accurate and
comprehensive reporting health-care system activities and outcomes.
Ensure the right consumer health information is made available electronically to the right person at the right place
and time to enable informed care and treatment decisions.
Enable the health sector to operate more effectively as a connected system, overcoming fragmentation and
duplication of service delivery.
Provide consumers with electronic access to the information needed for better management and control of their own
health.
Enable multi-disciplinary teams to communicate and exchange information electronically and provide bettercoordinated services across the continuum of care.
Approach
Internal working sessions to formulate a concise description of how eHealth will be used to
respond to health system goals, encompassing insights from research into eHealth trends and
best practice. Experience suggests that consultation with stakeholders on eHealth outcomes
should be delayed until the vision statement has been drafted and the impact on stakeholder
groups identified.
Recommended outputs
This step should produce a description of the rationale between eHealth outcomes and the
health system goals defined as part of the strategic context for eHealth (Box 2).
Box 2. Sample links between eHealth outcomes and health system goals
Health system goal or challenge
Health workforce shortages primarily affect rural and remote communities, due to the concentration of professionals in
urban areas.
eHealth outcome
Rationale
Rationale
eHealth outcome
Rationale
Additional information could be provided to strengthen the rationale for the associated eHealth
outcome. Examples include outcomes of relevant eHealth projects and other studies, identified
through research and stakeholder consultation.
Approach
Internal working sessions are held to develop a sound rationale for each outcome sought. The
knowledge to support this step should exist largely through activities already undertaken.
Country experience recommends that consultation with stakeholders on the rationale should
be delayed until the national eHealth vision statement has been drafted, and impacts on
stakeholders identified.
Recommended outputs
This step should produce a vision statement that has been reviewed and refined with the
relevant stakeholders (Box 3).
Box 3. Sample structure for an initial vision statement
By [timeframe]
eHealth will deliver [strategic benefits and outcomes for the health system and population]
through [strategic changes to health information flows].
This structure ensures that the vision statement for eHealth can exist in isolation and still
communicate the value of investing in a national eHealth environment (Box 4).
Box 4. Sample country vision statement for eHealth
By 2020
eHealth will enable a safer, higher quality, more equitable and sustainable health system
for all citizens
by transforming the way information is used to plan, manage and deliver health services.
Visual models can be used to communicate complex vision statements (Figure 8).
Figure 8. Sample visual model for an eHealth vision statement
Benefit 1
Benefit 2
Benefit 3
eHealth
outcomes
Outcome 1
Outcome 2
Outcome 3
The model above communicates a vision for eHealth through three elements:
Approach
This step requires internal working sessions to draft a compelling vision statement for eHealth.
Once developed, the statement should be reviewed with a small group of stakeholders. The
focus should be on refining the content of the statement, the eHealth outcomes that underpin
it, and the manner in which the vision has been articulated. Broader consultation on the vision
statement should be deferred until the impact of the vision has been described for stakeholders.
Example questions
Potential considerations
Individuals
Health-care providers
Medical researchers
Others, including subgroups within the above stakeholder groups (e.g. rural and
remote individuals, rural and remote health-care providers)
Note that this should build on stakeholders understanding that has been developed
during the activities in Section 4.
This should be driven by the health system challenges that were identified through the
strategic context, which may include areas such as:
Recommended outputs
This step should describe the eHealth vision for important stakeholder groups, including:
challenges they currently experience in relation to health services or the health system
improvements they would experience if the vision were delivered (Box 5).
Approach
This step is an internal activity that develops descriptions of what the eHealth vision will
mean for important stakeholder groups, particularly in terms of benefits and improvements
in their current experience with the health system. Once developed, the descriptions should
be reviewed and refined with each group to ensure they are accurate and meaningful. This is
where stakeholders start to understand what the vision means for them, so consultation may
uncover opinions, perspectives and concerns that require revisiting the eHealth outcomes. In
fact, this is often the point where refining the national eHealth vision begins.
the current health system challenges that the scenario should focus on demonstrating
Recommended outputs
This step should produce one or more scenarios that will assist important stakeholder groups to
understand how delivering the national eHealth vision will improve their experience with the
health system (Box 6).
Box 6. Sample scenario
How eHealth would change Akeyos experience
Akeyo and her family live in a rural area in east Africa where over 65 per cent of the 4.4 million people live below the
poverty line. Akeyo has recently been diagnosed with Type 2 diabetes. This happened almost by chance, when she was
visiting the nearest health centre with her daughter for a routine immunization. During the discussion with the doctor,
Akeyo reporting feeling frequently tired herself. The doctor requested a blood test, which led to the diagnosis.
How eHealth would change Akeyos experience with the health system
With growing mobile phone penetration in the country, Akeyos experience could have been quite different. For
example, her husband has a mobile phone which could have been used to deliver mobile eHealth (or mHealth) services.
With the introduction of mHealth, the events that occurred in the above scenario would have been different in the
following ways:
Preemptive care
--Education diet and general health information regarding diabetes could have been delivered to Akeyo via her
husbands mobile phone, telling her what she should and should not be eating in order to manage her blood sugar
levels better.
--Helpline a helpline could enable Akeyo to get advice and consult about her diabetes with a health worker or
doctor. Akeyo could receive dietary counselling to help manage her blood sugar levels, and information on when a
medical adviser would be at the nearest health centre if she needed to make an appointment.
--Treatment support a mobile community health worker would visit Akeyos village once a week and provide it with
Bluetoothbased blood glucose metres. Akeyo could now regularly measure her blood glucose level and upload
this to a diabetes management service via mobile phone. This would enable remote health-care providers to
monitor her blood glucose levels and send her an SMS with health management information. She would also receive
a weekly SMS with updated advice, and information, to help keep her focused and motivated.
Safer care with the implementation of Electronic Health Records (EHRs) or summary records Akeyos medical
practitioners would now be aware of her diagnosis and help her manage her chronic illness. They would know to
check her glucose levels when they meet and to review her treatment options, prescribing medications if necessary.
More efficient use of a care providers time having access to Akeyos EHR means that the visiting mobile communitybased health worker would no longer have to ask Akeyo for her health information each time they meet. This record
would also be available to other medical professionals that Akeyo may interact with either in person or by phone.
In this scenario, Akeyo is now much more successful in managing her Type 2 diabetes and in avoiding the serious
complications, because there is adequate monitoring of her condition and control of her blood sugar levels. This means
that her quality of life and life expectancy will be dramatically improved, and she will be able to continue to work, and
care for her family.
Approach
Developing scenarios is a creative exercise that involves constructing a story to demonstrate
how eHealth will improve the health system experience for stakeholders. Examples of eHealth
services and applications (such as those described in Annex A) can be used to add further
credibility and realism to the scenario. Once developed, scenarios should be reviewed and
refined with the relevant stakeholder groups. This provides an opportunity to gather input and
insights to ensure the scenario is accurate, and builds awareness and support for the national
eHealth vision.
Chapter 9
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
Once the initial unconstrained vision for the national eHealth environment has been drafted, it
is possible to define the required eHealth components, or building blocks, of a national eHealth
environment.
Activities
Identify the required eHealth components across the seven component areas:
infrastructure
workforce.
An eHealth strategic architecture model may also be created at this stage, to communicate the
required eHealth components in a visual manner (optional).
Outputs
A description of:
the set of eHealth components needed to deliver the national eHealth vision
Component
Description
Examples
Programme
management
Project coordination
Risk management
Dependency management
Stakeholder
engagement
Reference groups
Engagement forums
Public consultation
Strategic
architecture
Requirements definition
Component models
Functional architecture
Reference architecture
Clinical safety
Management
and operation
Change management
Monitoring
and evaluation
Policy
oversight
Policy linkages
These components may exist at different levels including at national, state, regional and local
(e.g. hospital, health-care provider organization) levels. Roles, relationships and responsibilities
will need to be defined during implementation planning.
Recommended outputs
This step should produce a description of the leadership and governance required for the
national eHealth environment. This should include a description and chart, or visual model,
of the recommended functions and mechanisms required at national, state, regional and local
levels including:
Approach
This step should be approached as an internal activity that involves brainstorming and working
sessions to identify the preferred leadership and governance model, including defining the
relationship to existing bodies at national, state and local levels.
Component
Description
Examples
Strategy and
planning
Funding
Investment
management
Recommended outputs
This step should produce a description of the eHealth strategy and investment components
required to support the development and operation of the national eHealth environment.
Approach
Internal activity that involves brainstorming and working sessions to identify the required
eHealth strategy and investment components needed to develop, operate and support the
national eHealth environment.
Where possible, these components should be linked back to the eHealth outcomes defined
in Section 8.2, as a means of creating traceability to the strategic context for eHealth. Given
the enabling nature of these components, they may also be linked to service and application,
infrastructure or standards components.
Internal activity that involves brainstorming and working sessions to identify the required
eHealth strategy and investment components needed to develop, operate and support the
national eHealth environment.
Component
Description
Examples
Individual
electronic health
information
Health-care
communications
and
collaboration
Health-care
service delivery
tools
Medications management
Health
information and
knowledge
Health-care
management
and
administration
Risk analysis
Compliance monitoring
Recommended outputs
This step should produce a description of the eHealth service and application components
required to deliver the eHealth outcomes described by the initial eHealth vision.
Approach
This step should be approached as an internal activity that involves brainstorming and working
sessions to identify the required eHealth service and application components, and link these
back to the eHealth outcomes defined within the initial vision for national eHealth. This helps
stakeholders understand why the identified eHealth service and application components are
required in the national eHealth environment (Box 7).
Box 7. Linking an eHealth service and application component to an eHealth outcome
Rationale
Rationale
These components should not be defined in detail, as this may require a significant amount of
time for little additional benefit. It may also unnecessarily constrain the way in which these
components can be realized physically. The implementation plan will determine the detailed
requirements and design of these components.
Other components will probably be identified during this step. Often, these are enabling
components, such as infrastructure, policy and standards. They should be noted as they are
identified, and considered when analysing that specific component.
9.4 Infrastructure
Objective
This step identifies the eHealth infrastructure components required to support the sharing
of structured and meaningful health information across geographical and health-sector
boundaries, and to support new and improved ways of delivering health-care services and
information.
Strong international evidence shows that countries only make significant progress at a
national level once they have established eHealth infrastructure components to support
health information exchange. It is significantly more cost-effective to develop core eHealth
infrastructure components at a national level, rather than duplicating effort and expenditure
across a fragmented set of eHealth programmes.
Infrastructure components span both physical technology infrastructure and software platforms
and services that support health information exchange across the health sector (Table 20).
Component
Description
Examples
High-speed data
connectivity
Mobile coverage
Computing
infrastructure
Identification
and
authentication
services
Secure messaging
Directory
services
Health-care
provider
systems
Individual
Electronic
Health
Record (EHR)
repositories
Health
information
datasets
Recommended outputs
This step should produce a description of the eHealth infrastructure components required
to support the eHealth service and application components identified in Section 9.3, and the
broader changes to health information flows required to deliver the eHealth outcomes described
in the initial.
Approach
This step should be approached as an internal activity that involves brainstorming and
working sessions to identify the required eHealth service and application components,
and linking these back to the eHealth outcomes defined in the initial eHealth vision. This
helps stakeholders understand why these components are required in the national eHealth
environment (Box 8).
Rationale
Infrastructure component
Description
Delivering health services to rural and remote communities will require high-speed data
connectivity, technically able to support telemedicine applications, for communities and
urban health facilities.
Infrastructure component
Description
Computing infrastructure
The delivery of telemedicine applications will require that urban facilities and rural
and remote communities have access to the appropriate computing infrastructure,
networked with a high-speed data connection and with appropriate software and
peripherals (such as video camera).
As above, these components should not be defined in detail, as this may require a significant
amount of time for little additional benefit. It may also unnecessarily constrain the way in
which these components can be realized physically. The implementation plan will determine
the detailed requirements and design of these components. Other eHealth components will
likely be identified during this step, usually enabling components such as policy, standards and
information protection for example. They should be noted as they are identified, and considered
when analysing that specific component.
Component
Description
Examples
Data structure
standards
Care plans
Appointments
Common
terminologies
Component
Description
Examples
Messaging
standards
Message structures
Message acknowledgement
protocols
Secure messaging
standards
Authentication
Non-repudiation
Software
accreditation
standards
Quality
Security
Interoperability
Recommended outputs
This step should produce a description of the eHealth standards and interoperability
components required to support:
broader changes to health information flows required to deliver the eHealth outcomes
described in the initial eHealth vision.
Approach
This step should be approached as an internal activity that involves brainstorming and working
sessions to identify the required eHealth standards and interoperability components, and link
these back to the eHealth outcomes. The link can also be made by describing how eHealth
standards and interoperability components are required to support a service and application or
infrastructure component, which in turn has been linked to an eHealth outcome (Box 9).
Box 9. Linking eHealth standards and interoperability to eHealth outcome
Rationale
Requires the ability to capture, store and access health information for an
individual regardless of the health-care provider(s) that the individual has
visited. An EHR component will ensure that key health information, such as
medical conditions, health event summaries, and test results, can be stored and
used to support surveillance activities.
Other eHealth components will probably be identified during this step, usually enabling
components such as policy, standards, and information protection. They should be noted as
they are identified, and considered when analysing that specific component.
Component
Description
Examples
Legislation
Policy
eHealthspecific policy
Compliance
Components required to
support the development of
eHealth products and which are
compatible with the national
eHealth environment.
Recommended outputs
This step should produce a description of the eHealth legislation, policy and compliance
components required to develop and operate the national eHealth environment.
Approach
This step should be approached as an internal activity that involves brainstorming and working
sessions to identify the eHealth legislative, policy and compliance components required to
deliver and operate the national eHealth environment; consultation with subject matter experts
may be required.
Where possible these components should be linked back to eHealth outcomes. This link may
also be achieved via eHealth service and application, infrastructure or standards components.
9.7 Workforce
Objective
This step identifies the eHealth workforce components required to design, develop, operate and
support the national eHealth environment (Table 23). These components encompass workers
who will use eHealth as part of performing their jobs (such as health-care providers) and those
who will design, implement and support the broader national eHealth environment (such as
health IT workers and health informaticians).
Table 23. Examples of common eHealth workforce components
Component
Description
Examples
Health
workforce
Health ICT
workforce
Recommended outputs
This step should produce a description of the eHealth workforce components required to
develop, operate and support the national eHealth environment.
Approach
This step should be approached as an internal activity that involves brainstorming and working
sessions. Where possible these components should be linked back to eHealth outcomes,
including through eHealth service and application, infrastructure or standards components.
Recommended outputs
This step should produce a model that describes the eHealth components required to deliver the
national eHealth vision (Figures 9 and 10).
eHealth Governance
Strategy
Investment
Governance
eHealth Solutions
Individual Electronic
(IEHR )
Health Record
Health
Information
Consumer
Health
Knowledge
Portal
Adverse Event
Monitoring
Clinical Practice
Improvement
Care Provider
Health
Knowledge
Portal
Risk Analysis
Clinical Decision
Support
Research and
Improvement
Test Results
Receipt and
Analysis
Compliance
Monitoring
Health Program
Design and
Optimisation
Medications
Management
Chronic
Disease
Management
Surveillance and
At Risk
Identification
Health Policy
Development
Appointment
Booking and
Management
Clinical
Decision
Support
IEHR Access
and Update
Health Care
Operations
Management
Health Care
Research
Alerts
Monitoring and
Management
Electronic
Consultations
Real -Time
Clinical Data
Access and
Analysis
Patient
Demographics
Personal Health
Diary
Referrals
Sending and
Receipt
Allergies
Test Results
Event
Summaries
Sending and
Receipt
Current Health
Profile
Event
Summaries
Notifications
Sending and
Receipt
Prescriptions
Sending and
Receipt
Current
Medication List
Access Control
Care Plan
Management
Medications
Prescription
Test
Ordering
Decision Support
Decision
for Medications Support for Test
Prescribing
Ordering
Practice
Performance
Analysis
eHealth Infrastructure
Computer
Systems
Universal
Health Identifier
Service (UHI )
Practice, Patient
and Clinical
Management
Systems
Broadband
Connectivity
National
Authentication
Service (NASH )
Provider and
Services
Directories
Prescription
Transfer
Service
Individual
Electronic Health
Record (IEHR )
Repositories
Health
Information
Datasets
National
Product
Catalogue
eHealth Enablers
Privacy
Privacy
Regulations
Consent
Management
Policy
Standards
Compliance
Referrals
Data
Structure
Standards
Orders and
Test Results
Notifications
Care Plans
Clinical Coding
Standards
Medical
Terminology
Standards
Prescriptions Appointments
Event
Summaries
Real -time
Clinical Data
Data
Presentation
Standards
Security
Standards
Messaging
Standards
Software
Accreditation
Standards
Adoption
Workforce
Compliance
Services
Awareness
Campaigns
Professional
Accreditation
Standards
Care Provider
Workforce
Development
IEHR Licensing
Regime
Incentives
Professional
Practice
Standards
Health IT
Workforce
Development
Engagement
Forums
Accreditation
Regime
Clinical Practice
and Process
Redesign
Procurement
Standards
6 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
Family
Consumer
Community
monitoring devices
Record symptoms
Review care plans
Electronic connectivity will
provide consumers with new and
more appropriate interaction
channels with care providers or
multidisciplinary teams
medication
Monitor health and well-being
Update medication details
Remote access to clinician
support
Create, view and monitor
appointments
Support care of family
community
dispensing
Approach
Annex E provides the basis for developing an eHealth component map for a national eHealth
vision, which can be extended or refined as needed, and accompanied with descriptions that
define the intent or scope of each component.
7 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
Chapter 10
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
This stage focuses on understanding the current national eHealth environment in terms of
eHealth components that already exist, or will be delivered within the timeframe of the eHealth
strategy.
Activities
Investigate the current eHealth environment across the seven common component areas:
infrastructure
workforce.
Outputs
A description of the existing or planned eHealth components that can be used to identify
opportunities for re-use and sharing, as well as any gaps that will have to be addressed in the
eHealth action plan.
Which organizations and bodies coordinate and develop eHealth at national, state, regional
and local levels? What are their roles and responsibilities?
Which organizations or groups are dedicated to the development of eHealth8, and what is
their current role in the development of a national eHealth environment?
What competencies and capacities do the above groups have in order to deliver a national
eHealth vision and associated work programme? For example, the question is whether they
are competent and capable to perform:
Which organizations, bodies and other mechanisms are responsible for health strategy and
planning at national, state, regional and local levels?
How well integrated is health strategy and planning between the national, state, regional
and local levels?
How is investment in eHealth and the broader health ICT environment funded?
Are there any government programmes or schemes through which funding is available for
investing in health ICT or eHealth services and applications, and eHealth infrastructure?
8 Examples include Canada Health Infoway and Australias National eHealth Transition Authority (NEHTA).
Are there any existing funding mechanisms for eHealth investments? Are these linked to
priority health information flows or the implementation of eHealth standards?
Which government organizations or bodies perform investment management roles for the
development of national infrastructure?
Have there been any eHealth strategies or plans that have failed or stalled? If so, what were
the reasons?
Which eHealth services and applications have been or are being implemented across the
health sector, and what is the reason for their introduction?
Which projects or pilots are underway to deliver eHealth services and applications, and
what health challenges are these attempting to address?
Which health information flows currently exist or are being implemented within the
health sector?
Which individual electronic health information services and applications are currently in use?
What level of diversity exists among the health ICT applications and products9 that are
used today within the health sector? For example, are there applications or products that
have a strong presence across the sector, or is there a proliferation of different applications
or products in use to address local needs?
Can existing eHealth services and applications be integrated with other services and
applications, or scaled up beyond their current use to support larger individual and healthcare provider populations?
Which electronic communication channels are being used to deliver health-care services
to individuals remotely, such as telephone, videoconference, web conference, mobile phone
and other electronic consultation tools?
What national health or other information and knowledge sources exist today?
What level of adoption of eHealth standards has occurred among existing eHealth services
and applications?
How is investment in eHealth services and applications being funded (e.g. publicly,
privately, other)?
Which eHealth services, applications and information sources are used today to undertake
health management, administration, analysis and reporting at a national, state and regional
level?
What are the challenges or barriers to the introduction and use of eHealth services and
applications within the nations health system?
Have there been any large-scale eHealth services or application projects that have failed or
stalled? If so, what were the primary reasons?
9 Primarily those vendors that provide products and solutions that assist in the management and delivery of care to individuals,
such as systems for practice management, patient management, clinical information and electronic medical records.
Infrastructure
What is the penetration of computers and high-speed Internet in the general public?
What is the penetration of mobile phones and other smart devices in the general public?
What national, state and regional computing infrastructure exists across the country, including
components such as server farms, data centres, support systems and personnel, etc.?
Can existing infrastructure components scale up to support broader national use?
Have there been large-scale eHealth or other ICT infrastructure projects that have failed or
stalled? If so, what were the primary reasons?
What work has been done on establishing standards for the following:
What work has been done on establishing common medical and clinical terminologies?
Are there any commonly agreed interoperability requirements or standards for eHealth and
other health ICT services and applications?
Are there any accreditation standards for eHealth services and applications which focus on
ensuring interoperability with other services and applications?
Which organizations or bodies are currently developing eHealth standards and other material
to support interoperability across the health sector, and what is the scope of their work?
Have there been eHealth standards or interoperability initiatives that have failed or stalled?
If so, what were the primary reasons?
individuals choice to opt in or opt out of the collection of their personal health
information;
purposes for collection, use, disclosure, accuracy, retention, access to and correction of
erroneous information, security of an individuals personal health information;
10 May encompass aspects such as privacy, access, consent, use and disclosure of personal health information, as well as
mechanisms by which complaints and breaches are identified and investigated.
Workforce
What is the current level of skill of the health workforce in the use of eHealth and health
ICT to support the day-to-day delivery of care to individuals?
Are there any accreditation requirements regarding the use of eHealth and health ICT as a
health-care provider?
What education in the use of eHealth and health ICT to support delivery of care to
individuals is currently provided by training programmes, such as those offered by
universities, vocational training institutions and professional bodies?
What level of consistency or commonality exists among different training programmes
in the use of eHealth and health ICT to support the delivery of care to individuals? For
example, is there a common definition of eHealth and understanding of the knowledge and
skills that providers will require, or does this differ among training programmes?
Which organizations or bodies are responsible for the development of education and
training curricula for universities, vocational training institutions and professional bodies,
in particular for health-care providers?
What is the current state of the ICT workforce, and in particular the health ICT, eHealth
and health informatics workforce?
What training programmes exist to provide education in the design, implementation and
operation of health ICT, eHealth and health informatics services?
Are there recognized qualifications in the domains of health ICT, eHealth and health
informatics?
What is the market and availability of professionals in eHealth and informatics
(e.g. domestic workforce, international workforce, other)?
Recommended outputs
This step should produce a description of the countrys current eHealth environment across the
seven common eHealth component areas.
Approach
This step will require a combination of internal research and analysis, and consultation with
health-sector stakeholders.
Stakeholder consultation
Experience suggests that considerable information can be obtained through interviews and
consultation with health-sector stakeholders, listed below.
Individuals from national, state, regional and local health departments and organizations,
such as:
Chapter 11
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
This stage combines knowledge of the eHealth components and current eHealth environment to
identify opportunities for re-using or sharing components, gaps to be addressed, and potential
risks or barriers to doing so. This is a critical stage of the process because it will be the basis for
refining the draft vision towards an aspirational, but still prgamatic, eHealth vision.
Activities
Assess existing or planned eHealth components against the required components, across the
seven common areas:
infrastructure
workforce.
Outputs
A description of:
the risks and barriers associated with opportunities and gaps identified.
Re-use and sharing opportunities: What existing eHealth components can be used in the
delivery of the national eHealth vision?
Gaps: Where are there no suitable existing eHealth components identified as needed in the
draft vision?
Risks and barriers: What risks and barriers may affect the ability to deliver the required
eHealth components?
The required eHealth components (Chapter 8) are compared with the existing eHealth
components (Chapter 10) to determine the opportunities, gaps, risks and barriers (Figure 11).
Figure 11. Identifying leverage opportunities, gaps, risks and barriers
Vision for national
eHealth
Required eHealth
components
Implications
compare
Understanding of the
current eHealth
environment
Leverage
opportunities
Gaps
Risks and barriers
Existing eHealth
components
What would be the broad timeframes for modifying or extending existing components?
Identify gaps
Questions below to assist in identifying gaps.
Which required eHealth components in the draft vision have no existing components to
build on (components do not exist or are inadequate)?
What investment in eHealth components will be required to support these gaps, including
where an existing (or planned) component needs to be augmented or extended as it only
partially delivers a required eHealth component?
What actions or activities need to occur as part of this investment?
Does undertaking these activities depend on any other investment (e.g. legislation, funding,
policy, other components, etc.)?
What risks and barriers are associated with using an existing or planned eHealth
component in the national vision? Examples of potential risks include:
What would be the impact on the eHealth vision of not addressing these gaps?
Recommended outputs
This stage should produce a description of the re-use and sharing opportunities, gaps, and
associated risks and barriers for delivering the initial national eHealth vision.
Approach
This stage requires a combination of internal assessment supported by consultation with
stakeholders to validate and refine the outcomes of the assessment.
Internal assessment
The assessment process should include four steps:
1. Compare eHealth components required by the initial eHealth vision with the
understanding of the components that exist or are planned to exist in the current eHealth
environment.
2. Identify and describe the opportunities to re-use or share existing eHealth components.
3. Identify and describe the gaps in delivering the components required by the initial eHealth
vision (i.e. those instances where there appears to be no suitable existing components in
the current eHealth environment).
4. Identify and describe the risks and barriers identified during the analysis of re-use and
sharing opportunities and gaps, along with any other broader sectoral or environment risks
and barriers that should be considered.
Stakeholder consultation
Stakeholders should be consulted to confirm whether eHealth components can indeed be
re-used or shared, as well as additional considerations, risks and barriers that may have to be
considered. This input can be used to validate or refine the assessment. There may not be an
immediate stakeholder, or set of stakeholders, associated with a particular gap, risk or barrier.
In this case a stakeholder reference group11 may identify stakeholders who should be consulted.
11 The role of a stakeholder reference group is discussed as part of the recommended approach to governing the development of
a national eHealth vision (Section 4.2).
Chapter 12
Draft an
initial vision
Identify
required
components
Assess
opportunities
and gaps
Refine vision
and develop
strategic
recommendations
Objective
This stage refines the initial unconstrained vision by considering the opportunities and gaps
that have been identified, along with other risks and barriers to the delivery of a national
eHealth environment. This creates an aspirational yet pragmatic vision for national eHealth.
A set of strategic recommendations to deliver this refined vision is also developed during this
stage, and forms the primary input into Part 2 of this Toolkit.
Activities
Outputs
Type
Description
Examples
Internal
Knowledge and
insights developed
over the course
of developing the
national eHealth
vision.
External
Guidance and
direction provided
by political and
health sector
decision makers and
stakeholders.
Likely available resources and funding that the country has (or will have) to direct
towards implementing the vision
This process examines the vision against the following criteria: (1) is it realistic, given the
opportunities, gaps and risks; (2) do eHealth outcomes align with health priorities; and (3) is
there enough support?
It is not the intention of this step to develop a detailed roadmap of prioritized activities, but
rather to identify the broad set of eHealth components that should be delivered within the
timeframe of the national eHealth vision (Part 2 of the Toolkit focuses on the development of
a national action plan). It is also not the focus of this stage to develop a detailed business case,
covering benefits and costs. While funding is explored briefly during this stage, and in more
detail in Part 2, the development of a detailed business case is beyond the scope of the Toolkit.
Recommended outputs
This step should describe the eHealth components that will be delivered and the rationale for
their selection.
Approach
This step is an iterative process consisting of internal analysis, supported by consultation with
political and health-sector stakeholders (Figure 12, Table 25).
eHealth
components
that can be realistically
delivered
Refined vision
for eHealth
Review of
eHealth
outcomes,
priorities,
timeframes
Step 3
Assessed
commitments and
funding
Step 2
Revised components
or timeframe
Step
1
Inputs
Sample questions
Possible outcomes
Analysis of eHealth
environment:
An understanding of the
eHealth components that
can be realistically delivered
within the desired timeframe.
Understanding of health
system outcomes
Understanding of
population health outcomes
An optimized set of
eHealth components; or
Stakeholder commitment to
national vision
gaps
vision timeframe
2
While the above diagram and table would suggest a structured and linear approach to this
prioritization, in reality the process needs to be flexible in moving between these various
steps as knowledge and direction is provided by political and health-sector stakeholders. It is
also important to recognize that this step focuses on prioritization at a strategic level, not a
programme planning level. Detailed planning and associated prioritization is the focus of Part 2
of this Toolkit.
How effectively can the eHealth outcomes defined in Chapter 8, Section 8.2, be achieved
with the prioritized set of eHealth components?
What revision to the eHealth outcomes is required to reflect accurately the prioritized set of
eHealth components?
What changes to the initial vision statement for eHealth is required as a result of revision to
the eHealth outcomes?
What do these changes mean for each of the stakeholder groups for whom the initial
eHealth vision was originally described, and how do these descriptions need to be
updated?
What changes to the eHealth strategic architecture models are required?
Recommended outputs
This step should update the outputs developed in Chapters 8 and 9 to reflect the prioritized set
of eHealth components. Outputs to be updated include:
descriptions of what the vision means for important stakeholder groups (Section 8.5)
Content that is no longer required is maintained rather than deleted, and referred to as potential
future directions for eHealth. This ensures that work is not lost and can be revisited at a later
point in time, potentially as part of the process of revising the national eHealth vision.
Approach
This should be an internal activity, because it focuses on refining previously developed material.
The outputs of this step should be reviewed by the stakeholders who were originally involved in
the development of the initial eHealth vision.
Recommended outputs
Each strategic recommendation (Box 10) should be uniquely referenced to enable traceability to
the national action plan (to be developed in Part 2) and should include:
Actions are indicative and are intended to assist with understanding the implications of the
strategy. These actions will be refined during the detailed planning conducted in Part 2.
Box 10. Example of a strategic recommendation for a national eHealth vision
Strategic recommendations
Ref
Recommendation
Dependencies
R.1
Implement a unique
national health
identification regime
and service
R.15, R.17
R.2
Establish
mechanisms
to encourage
care providers
to invest in the
implementation and
maintenance of an
acceptable baseline
of computing
infrastructure
R.24, R34
Approach
This step should be an internal activity that will involve brainstorming and working sessions
to formulate a set of recommendations that collectively deliver the eHealth components
underpinning the refined actions. The strategic recommendations should be tested and refined
with stakeholders, who should provide input on each recommendation.
Recommended outputs
This step will produce the above endorsements by the appropriate decision-maker(s) and
communicate them to the broader stakeholder community. It also facilitates their understanding
and support ahead of the development of the action plan.
Approach
This step involves presenting, reviewing and obtaining endorsement of the national eHealth
vision and associated recommendations by the appropriate decision-maker(s). This will typically
be the steering committee that was established to govern the development of the national
eHealth vision.
Once endorsed, the national eHealth vision and strategic recommendations should be published
and communicated to the broader stakeholders and public. This launches a period of education
and awareness building of the national eHealth vision and what it will mean for the country.
This period requires listening and responding appropriately to views, opinions and feedback.
Some input may also trigger adjustment to some aspect of the vision or recommendations.
The period of education, awareness building and listening will vary in duration, depending
on the urgency to proceed with developing an action plan. For example, some countries
may opt to have a period of broader consultation regarding the national eHealth vision and
recommendations, potentially in the form of inviting public submissions and comments. This
Chapter 12. Refine vision and develop strategic recommendations page 76
may precede the final refinement of the national eHealth vision. Another country may be
comfortable that stakeholder engagement was sufficient and that developing the action plan
should proceed.
This period may also overlap with the mobilization of the team that will be responsible for the
plans development. These activities are described in Part 2 of this Toolkit. Part 2 also concerns
the need to revise the national eHealth vision to reflect the availability of funding.
Annex A
Examples of eHealth
These examples are taken from the Global Observatory for eHealth (http://www.who.int/goe/en).
Telemedicine (telehealth)
Telemedicine supports the provision of health-care services at a distance; that is, the individual
and health-care providers need not be in the same location. Telemedicine enables the delivery of
safe and quality care to individuals living in areas with limited access to services. Examples of
telemedicine services are provided below.
Store-and-forward services involve acquiring medical data (e.g. images) and transmission
to a health-care provider (e.g. doctor or medical specialist) for offline assessment and
treatment recommendation. Examples include teleradiology and telepathology.
Remote monitoring services enable health-care providers to monitor an individuals
condition remotely, using technologies such as implanted devices and sensors with wireless
or wired connections.
Interactive services enable real-time interaction between an individual and her or his
health-care provider through means such as telephone, web conference, video conference,
and other forms of online and remote communication. Psychiatry and mental health
services are classic examples.
Telecare services enable care and support to older individuals and those with special needs.
This helps them to remain independent in their homes and increases their sense of connectivity
with the broader community. Services include alerts (e.g. domestic accidents such as falls) and
monitoring (e.g. vital signs, blood glucose, weight).
data collection for surveillance and public health (e.g. outbreak investigation)
12 Health Metrics Network (HMN). Framework for Health Information Systems Strengthening:
www.who.int/healthmetrics/documents/framework/en/index.html.
Annex B
eHealth benefits
Table 26. Examples of eHealth benefits 13,14,15
Benefit area
Examples
Access to services
Ability to deliver basic and enhanced health services to rural and remote communities
Ability for patients to locate health-care providers that offer the services they require
Access to health
knowledge and
education
Improved access to consumer health knowledge sources, including health education and
awareness, and prevention information for certain health conditions
Improved access to quality data sources to inform health-care service and workforce
planning and development
Empowering individuals
Annex C
Title
Foreword
Purpose
Audience
How to read this document
Executive summary
1. Strategic context for eHealth
1.1 Population health
1.2 Health system status
1.3 Strategic health and development goals and challenges
1.4 Implications for eHealth
2. Vision for eHealth
2.1 Our national eHealth vision
2.2 eHealth outcomes for the health system
2.3 Changes and impact on stakeholders
2.4 The eHealth vision in practice (optional scenario)
3. Foundations for change
3.1 Leadership and governance
3.2 Strategies and innovation
3.3 ICT services and applications
3.4 Infrastructure
3.5 Standards and interoperability
3.6 Legislation, policy and compliance
3.7 Workforce
4. Strategic recommendations
Annex D
Method summary
This Annex summaries the method described in the Toolkit (Table 27).
Table 27. Method summary
Stage
Activities
Outputs
Gather information
about the
current eHealth
environment
A description of:
Identify relevant
eHealth trends and
best-practice
An understanding of:
Stage
Activities
Outputs
Draft an initial
vision
A description of:
Identify the
required eHealth
components
A description of:
A description of:
Annex E
Strategy and
investment
Strategy & planning
Stakeholder
engagement
Program
execution
Architecture
Management
and operation
Clinical safety
Outcomes
management
National
Electronic health
record (EHR)
Electronic referrals
Electronic test
ordering
Care plan
management
Medications
management
Alerts monitoring
and management
State
Electronic medical
record (EMR)
Electronic
specialist letters
Individual health
record access
Appointment
booking and
management
Prescription
decision support
Disease
management
Regional
Personal health
records (PHR)
Electronic health
event summaries
Electronic test
results
Real-time clinical
data access and
analysis
Electronic
prescription
Directories access
Clinical decision
support
Telemedicine
(Telehealth)
Local
Mobile health
(mHealth)
Integrated strategy
and planning
Funding
National
Infrastructure
Identification & authentication services
State
Regional
Local
Investment
management
Unique health
identifiers
Health-care provider
authentication
Directories
Secure messaging
Healthcare
organisations and
providers
Health-care provider
systems
Health-care
services
Practice
Management
Computing infrastructure
National
State
Regional
Local
Health-care
providers
Rural
Remote
Mobile
Test orders
& results
Care plans
Regional
Investment case
development
Evaluation and
priorization
Investment
allocation
Referrals
Budgeting and
tracking
Prescriptions
Messaging standards
Security messaging
standards
Software accreditation
standards
Health-care management
and administration
Individual health
knowledge sources
Adverse event
monitoring
Healthcare provider
knowledge sources
Risk analysis
Legislation
Clinical practive
improvement
Health identifiers
Clinical decisions
support research
& Improvement
Privacy policy
Education &
training
Compliance
monitoring
Health programme
design and
optimization
Access and
consent policy
Accreditation
Surveillance and At
Risk identification
Health policy
development
Usage and
disclosure policy
Priority cadres
Health-care
operations
management
Health-care and
clinical research
Storage and
retention policy
Audit and
complaint policy
Infrastructure
Licensing
Directories
Clinical information
systems
Patient management
systems
Individual
electronic health
record (EHR)
repositories
Education &
training
Accreditation
Non-health
sector policy
Compliance
Standards
development
Policy
eHealth-specific
policy
Specialist letters
Health sector
policy
Appointments
Health workforce
Clinical events
Conformance and
accreditation
Priority cadres
Annex F
Governance continuum
The governance model for the national eHealth vision will depend on the country context and
the role of the government (Figure 14).
Figure 14. Governance continuum16
Fully regulated
Type of governance
Bureaucratic
governance
Structure
Centralised
Controls
Legislation
and sanctions
Guided market
Market
governance
Free market
Network
governance
Combines centralised
and decentralised
Decentralised
Performance
based on
outcomes
Coproduction
and
cooperation
Fully regulated
At one end of the continuum is the centralized bureaucratic model under which decisions are
mandated, rules and protocols are defined centrally, and there is a heavy reliance on direct
supervision to ensure enforcement and adherence. If applied to eHealth, the centralized
bureaucratic leadership and governance model would drive eHealth adoption from a central
mandate and all aspects of eHealth would be implemented through large-scale national or state
programmes and projects.
Free market
At the other end of the continuum is the free-market model in which there is no clear central
authority and a reliance on external parties such as customers, care providers and suppliers
to produce outcomes collaboratively. The free-market model supports collaboration and
innovation, allowing grass-roots eHealth initiatives to continue with little or no intervention
from a central authority.
Guided market
Between these two extremes lies the guided-market model which balances the need for
local initiative and innovation against the need to coordinate centrally specific aspects of
implementation. The guided-market model is characterized by central coordination in areas
of national significance, combined with greater flexibility and reduced central control and
regulation in areas where the market is best positioned to play a role. The model relies on
competition and the use of incentives, funding and compliance mechanisms to drive outcomes
in the marketplace.
16 Adapted from National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide,
Deliotte Touche Tohmatsu, 2008.
Annex G
Term
Definition
Part I:
eHealth outcomes
What will be achieved or changed through using eHealth, and how will
the health system and services change by:
Establishing a
national eHealth
vision
National eHealth
environment
eHealth components
Strategic
recommendations
Part 2:
Action lines
Developing an
eHealth action plan
Broad areas to group national activities of similar focus and intent that
are required to deliver a nations eHealth vision.
eHealth outputs
Activities
Output indicators
Part 3:
National eHealth
monitoring
and evaluation
guidelines
Outcome indicators
Printed in Geneva
Part 2
Purpose
Part 2 of this Toolkit builds on the national eHealth vision that was articulated in Part 1. Using
the results obtained from there as the starting point, it now moves forward to discuss how the
vision can be achieved through the development of a comprehensive, well-structured national
action plan for eHealth.
A country embarking on a national eHealth strategy will shape the action plan to reflect its own
unique circumstances, constraints and priorities. The primary value of this exercise is to enable
a government to plan eHealth activities and funding over the short- to medium-term, while
building a solid foundation for investment and growth over the longer term.
The action plan can be regarded as a self-contained document that will be widely published for
all the countrys eHealth stakeholders and other interested parties to read and refer to in order
to understand and begin to implement the plan.
Some elements of it will be unavoidably and of necessity complex. Nevertheless, efforts to render
it accessible and understandable to a wide audience are worthwhile, and on this basis a definition
of terms frequently used is provided in Annex G. This approach benefits not just the immediate
readership, but those including ultimately the general public to whom the plan and its main
elements should be championed and communicated. An example of how to construct this
document and shape it into chapters or sections is contained in Annex A. The running order of
the sections should be modified as necessary according to the particular intended audience.
Audience
The complete, three-part Toolkit is a guide for government health-sector leaders in ministries,
departments and agencies who will manage the development of an eHealth strategy and action
plan for their country. Building the plan begins with understanding what it should do (Part
1), which was particularly directed towards a political audience that has to win endorsement
and support for the goals of the strategy. It also included professionals, working largely but
not exclusively within a government, and already familiar with the current and potential
applications of information communication technologies (ICTs) to health.
The intended audience for Part 2 is also political, but more directed towards those who will be
implementing the plan, including the stakeholders described in Part 1 and referred to again in
Part 2, and their involvement is crucial.
The main readership of Part 2 therefore is decision-makers who have developed a national
eHealth vision through other means and who seek to develop their own plan for its
implementation. As with all three parts of the Toolkit, successful application of the plan
requires a team experienced in strategic planning, analysis and communication. The focus of
Part 3 will be on ensuring that the plan does what it is supposed to do, refining and redirecting
it if necessary, and if done well, also informing practice in other countries.
page i
Toolkit overview
To recap from the general introduction, the Toolkit provides a framework and method for
the three-part development of a national eHealth vision, an action plan and a monitoring
framework, with the second and third parts building progressively on the work of Part 1.
Part 1: A national eHealth vision that responds to health and development goals.
Part 2: A national eHealth action plan that reflects country priorities and the eHealth
context.
Part 3: A plan to monitor implementation and manage associated risks.
Part 1
Part 2
Part 3
National eHealth
action plan
(This document)
National eHealth
monitoring and evaluation
Orientation to Part 2
Part 2 consists of nine chapters and six annexes:
Chapters 1 and 2 provide guidance on managing the process and working with
stakeholders.
Chapter 2 summarizes the outputs from Part 1 to be used as the starting point for
developing the action plan.
Chapter 3 describes the main elements and method by which an action plan for eHealth is
developed.
Chapter 4 is concerned with engaging further with stakeholders in developing the plan.
The annexes provide additional information to support this Toolkit, including a definition of
terms and a suggested structure for the plan document.
page ii
Contents
10
16
27
33
41
46
Annexes
A. Structure of an eHealth action plan
51
B. Methodology summary
52
54
56
61
63
65
page iii
Figures
1. From vision to action plan
12
18
24
28
39
47
53
Boxes
1. Examples of strategic recommendations and outputs
19
48
3. Implementation targets for the Connect and Communicate phase (Years 1-3)
49
51
page iv
Tables
1. Suggested governance mechanisms for developing an eHealth action plan
11
13
14
15
17
20
21
30
34
36
12. Suggested dimensions for determining the approach to securing skills and resources
37
42
44
47
52
55
56
58
59
60
60
61
61
61
page v
Introduction
the health and development context and specific health goals that eHealth will support;
the eHealth components required to deliver this vision, taking into account the current
eHealth environment; and
the strategic recommendations, including priorities, for putting these components in place.
Part 1 shows why eHealth is required and what a national eHealth plan will deliver.
Part 1
Vision
Part 2
Strategic
recommendations
Activities
Integrated
action plan
identify all components and how they should be governed, funded and coordinated to
ensure that results are achieved at a national, state and local level; and to
work closely with multisector stakeholders who will be involved in implementing the plan.
Chapter 1
Resources
Strategic phases
Implementation phases
Strategic focus
Implementation targets
1.2 Resources
Examples of the resources required to implement an eHealth action plan include human
resources people and their skills and expertise, vendors and suppliers and infrastructure.
Among other considerations, the quality, cost and availability of these resources, and whether
they are local or international, will affect the scope, timing and delivery of activities in the
action plan. For this reason, resources are carefully considered in the planning stage in order to
optimize, share and leverage current and potential resources for implementation.
Chapter 2
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
A national eHealth action plan is developed as an iterative process, similar to that used in
developing the national eHealth vision. First, an initial plan is drafted based on the vision and
recommendations developed in Part 1 of this Toolkit. Next, the draft is refined based on a
countrys constraints (such as resources and funding) and eHealth environment. This approach
ensures that the plan is grounded in the current context, but is not overly constrained. It also
allows for the identification of activities that could be implemented should additional resources
become available. This section summarizes the method, with details provided in Chapters 3
and 5 and a summary table in Annex B.
Chapter 3
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
Effective management under the responsibility of a core team ensures that the development
of an eHealth action plan is undertaken in a structured and timely manner, with appropriate
stakeholder engagement.
Activities
The leadership, governance and management mechanisms established during Part 1 should be
continued into the planning process. They are:
Outputs
A credible, well-managed process resulting in a national eHealth action plan informed and
supported by stakeholders.
Health-sector leadership
Steering committee
Stakeholder
reference and expert
advisory groups
Broader stakeholder
environment
Mechanism
Responsibilities
Composition
Health-sector
leadership
Steering
committee
Oversees progress
Stakeholder
reference group
Broader
stakeholder
environment
The governance model suggested in Part 1 can remain largely unchanged to support the
development of an eHealth action plan. The main change is that the mechanism for broader
stakeholder environment becomes the primary means to consult with those stakeholders who
may (1) ultimately be required to deliver activities within the action plan; and (2) can provide
subject matter expertise and input to support the planning process.
deep understanding of the national eHealth vision and the strategic context
Chapter 3. Manage the process page 8
Week
Stage
Develop an integrated
action plan
Determine high-level resource
requirements
Apply funding constraints to
plan
10 11 12 13 14 15
Chapter 4
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
Producing an informed and supported action plan requires consultation with a broad range
of multisectoral stakeholders, consistent with the governments role in eHealth. Stakeholders
who will be responsible for implementation of the national action plan should be involved in its
development, to ensure feasibility and facilitate support as the plan is rolled out.
Activities
Working with stakeholders can be a complex undertaking given the diversity of those who may
need to be involved. Managing this complexity requires:
determining a pragmatic approach to working with the stakeholder groups, which takes
account of influencing power, knowledge, skills and expertise
planning where stakeholder consultation will occur during the planning process, and
ensuring that it is accomplished.
Outputs
Stakeholders broadly accept and support a pragmatic action plan for eHealth.
Market
Governments role
Fully regulated
Guided market
Free market
patient associations
private care providers including private health organizations, NGOs and charitable
affiliates.
Stakeholders from beyond the health sector will also play an important role in delivering the
national eHealth vision. They may contribute resources (expertise or services) and may have
a strong interest in the outcome of the eHealth environment; for example in creating new
business opportunities. Examples of these types of stakeholders include:
international organizations and donors such as the European Commission, the World
Bank, the International Monetary Fund and United Nations specialized agencies.
Health and non-health stakeholders engaged during Part 1 should be analysed to understand
how they should be involved in the development of the action plan, as in the example questions
below.
How influential is each stakeholder in the development and adoption of the action plan?
What expertise or resources may be available to support the development of the action
plan?
What role may the stakeholder be able to play in the implementation of the plan itself?
Ministries of health,
education, development,
ICT and telecommunications
Activity owners
ader stakeholder
s
Bro
matter exp
t
c
e
ert
bj
s
Su
o
y
w
t
i
n
v
i
e
t
r
c
s
A
influencer
ey
K
Broader stakeholders
Decisionmakers
Key influencers
Decision-makers
Stakeholder
group
Description
Examples
Decision-makers
They are not involved directly in decisionmaking, but are able to influence decisions
due to their:
Eminent academics
Activity owners
They are not involved directly in decisionmaking, but their potential accountability
for delivering many core activities In the
plan makes it necessary to consult them.
Standards bodies
ICT/telecommunications ministries
Subject-matter
experts
Broader
stakeholders
Stakeholder group
Approach
Decision-makers
Frequent and formal contact to seek input and guidance, present material for final review,
and seek acceptance and endorsement of the action plan.
Key influencers
Frequent and more informal contact to seek input, guidance and assistance in forming the
action plan.
Activity owners
Targeted consultation and participation to seek input and guidance in identifying and
definition of activities required for a particular eHealth action line.
Subject-matter experts
Consulted to gather broader political, sectoral
and other considerations that may influence the
definition of eHealth action lines.
Develop action
plan
Determine
resourcing and
funding
Apply funding
constraints to
refine the action
plan
Define
implementation
phases
Decision-makers
Stakeholder groups
Develop
eHealth action
line plans
Stage
Key influencers
N/A
Activity owners
N/A
Chapter 5
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
Developing an eHealth action plan begins with understanding and logically grouping the
activities that are required to deliver the national eHealth vision and recommendations
developed in Part 1. Grouping activities enables the identification of broad action lines, which in
turn form the basis of the eHealth action plan.
Activities
Identify the activities required to deliver the outputs of each action line.
Outputs
An indicative plan for each eHealth action line, which communicates the outputs, activities,
dependencies, timings and risks.
Action line
Example characteristics
Governance
Provides coordination, visibility and oversight of the eHealth action plan (i.e. programme
activities).
Foundations
Deliver eHealth components that support secure electronic information exchange across
a countrys geographical and health-sector boundaries, or improve access to health-care
services through electronic channels.
Are of national significance, and too risky or complex to deliver successfully if approached by
other means than by a national, coordinated approach.
Are more cost effective to develop only once at a national level rather than duplicating effort
and expenditure across states, regions, and private sector.
Solutions
Encourage the development and use of high-priority eHealth services and applications to
improve the efficiency and effectiveness of health system management and care delivery.
Deliver eHealth components that enable individuals, health-care providers and health-care
managers to access, view, use and share health information as part of care provision.
Deliver eHealth components that provide the tangible means by which stakeholders will
benefit from the national eHealth environment.
Deliver eHealth components that access, interact with and use national foundations and
infrastructure to access and share information.
Motivate, prepare and support the health system in adopting and using eHealth in health-care
management and delivery.
Establish incentives, facilitate the adoption of eHealth services and applications, and change
work practices to be able to use eHealth effectively.
The broad action lines described above are one example of a starting point for grouping
activities, but it is not essential to finalize them at this stage. As other aspects of the work plan
take shape, these action lines can be extended or refined, based on factors such as:
the scope of recommendations from the national eHealth vision (Part 1), and whether there
are specific themes or clusters of recommendations that indicate the need for an additional
or different action line;
key stakeholders expectations regarding the inclusion of specific action lines; and
The focus at this point should be on developing a high-level plan. Detailed programme planning
will take place following approval to proceed with implementation.
Recommended outputs
This step should produce an initial set of action lines that together form the basis of the eHealth
action plan. Each action line should have a clearly defined intent or focus. Between four and
six main action lines is a manageable structure for an eHealth action plan, and encourages the
right level of depth and detail in the plans for each one. A large number of activities should
be avoided as this tends to result in a very detailed level of analysis and planning, which can
consume a significant amount of time, for little benefit, given that the focus should be on a
high-level plan.
Approach
This step requires a combination of internal analysis, supported by input from stakeholders.
Internal analysis
This step should focus on reviewing the suggested eHealth action lines and determining
whether these need to be refined or extended. The action lines should encompass the full range
of activities required to deliver the recommendations from Part 1. The components from Part 1
can be mapped to these action lines (Figure 7).
Figure 7. High-level mapping of eHealth components to four common action lines
Legislation,
policy and
compliance
Workforce
Infrastructure
Key: Action lines
Governance
Foundations
Solutions
Change and
adoption
The Infrastructure component may be mapped to both Foundations and Solution action lines
depending on a countrys definition of the scope of these action lines. It is suggested that
activities associated with delivering Infrastructure components be mapped to the Foundations
action line. See Annex C for a more detailed representation of Figure 7.
As Part 1 developed strategic recommendations for each eHealth component area, the above
mapping may be a useful tool in determining:
where activities associated with strategic recommendations should be mapped to; and
whether eHealth action lines need to be refined or extended as there would appear to be no
eHealth action line where an activity could be allocated.
This step requires consideration of the broad range of activities required to deliver each strategic
recommendation produced by Part 1 of the Toolkit. These activities will be further refined as
described later in Section 6.4.
Stakeholder consultation
The initial action lines can be tested with a small number of stakeholders to identify any
considerations that may influence how the action lines are framed.
governance outputs
foundational outputs
solution outputs
Answering these questions requires a clear definition of the scope or focus of each action line.
If all the outputs from one strategic recommendation can be assigned to one action line, the
recommendation can be assigned to that action line. Other strategic recommendations may have
outputs that can be assigned to several action lines. This may be the case where change and
adoption outputs are required in addition to foundational, solution and governance outputs.
Recommended outputs
This step should produce a set of outputs for each eHealth action line. Each output should be
traceable back to a strategic recommendation from Part 1 (Box 1).
Box 1. Examples of strategic recommendations and outputs
Solutions
Governance
Vendor community
has added support
for national health
identifiers into most
popular products
and solutions.
Software
compliance function
established and has
accredited a number
of products and
solutions.
Health-care organizations
and providers support the
introduction of the service.
Operational governance
and oversight mechanism
for the national health
identifier service
established.
Appropriate funding
secured for the
development and operation
of the national health
identifiers service.
Strategic recommendation: Implement a national telehealth service for rural and remote communities
Required outputs
Foundations
Solutions
Governance
National telehealth
service established.
Fit-for-purpose data
connectivity established
to priority communities.
Fit-for-purpose local
computing and
communications
infrastructure established
in priority communities.
Fit-for-purpose and
compliant telehealth
solutions available
in marketplace.
Communities aware of
telehealth; services widely used
by priority communities.
Operational governance
and oversight mechanism
for the national telehealth
service established.
Appropriate funding
secured for the
development and operation
of the national telehealth
service.
Approach
This step should be an internal activity involving working sessions focused on identifying outputs
for each of the strategic recommendations from Part 1, and assigning these to action lines.
In some instances the process may result in the identification of outputs that cannot be assigned
to an action line. In these cases, the action lines should be reviewed to determine whether the
scope of the action lines needs to be refined to accommodate the output (preferred), or whether
a new action line is required.
Different stakeholders may be accountable for delivering outputs for eHealth action lines.
Understanding the potential leadership and accountability for a particular output allows these
stakeholders to be identified so that they can be involved in defining the required activities.
The questions below help to identify the stakeholder(s) accountable for a particular output.
Who is perceived by the health sector and/or public as being the right entity to deliver the
output?
Who is able to engage effectively with and influence health and non-health-sector
stakeholders?
Who has access to the appropriate financial resources?
Element
Description
Role
Scope
Duration
Dependencies
Recommended outputs
This step should produce a description of the high-level activities for each action line, including
the scope, duration and dependencies of each activity (Table 8). Annex D provides further
examples of potential activities in each of the eHealth action lines.
Table 8. Sample activities in four common eHealth action lines (not exhaustive)
Action line
Sample activities
Governance
Design and establish national eHealth entity to direct and manage national eHealth investment
Formalize governance interactions with other national, regional and local governance bodies
Foundations
Agree and adopt nationally consistent regulatory framework for health information protection
Solutions
Develop high-level requirement and design for priority national eHealth services and applications
Select implementation partner to perform detailed design and build of national eHealth service
Change and
adoption
Approach
This step should begin as an internal activity, but it may be extended to involve participation of
health and non-health-sector stakeholders who may ultimately be accountable for activities in
the action plan.
Internal analysis
Initially, internal working sessions should be undertaken to identify the activities required to
deliver the outputs for each eHealth action line. The identification of activities should consider
the strategic recommendations from which the relevant outputs were derived; in particular, any
specific activities that may have been explicitly or indirectly described by the recommendation.
How might the activity impact stakeholders such as consumers, healthcare providers,
managers and administrators?
How will stakeholders understand and react to the potential impact of the activity?
What are the risks and challenges to be overcome to ensure understanding and acceptance?
Answering these questions will assist in understanding the change and adoption strategy
required to support the delivery of the national eHealth vision. This strategy will be articulated
through the various activities that are defined within the Change and Adoption eHealth action
line.
Recommended outputs
A description of the change and adoption activities required to deliver the national eHealth
vision, including scope, duration and dependencies of each activity. Collectively, these activities
constitute the high-level change and adoption strategy for the country. Examples of change and
adoption activities are provided in Annex D.
Approach
In practice, the identification of change and adoption activities should occur as the outputs and
activities of each eHealth action line are identified (Section 6.3), but is highlighted here as it is a
critical part of the action plan.
Timing. Some activities may be unable to start until others have finished; some may start
earlier, but will be unable to finish until others have been completed.
Resources. Available resources may constrain the number of activities that can be delivered
at any one time.
Change. The health system will only be able to accept a certain amount of change over
a given time period, which may limit the number of activities that realistically can be
delivered at any one time.
Dependencies will exist between activities in the same action line as well as activities in other
action lines. This step should identify both types of dependencies, as they will inform the
development of individual activity plans as well as the action plan.
Recommended outputs
This step should identify the primary dependencies between activities and the rationale for
each dependency. Dependencies must be understood to a sufficient level of detail to be useful in
informing the sequencing of activities in a work plan.
Approach
This step should be undertaken as an internal activity to identify the relationships between
activities and other causes of dependencies, and use this to define the dependencies within and
across eHealth action lines.
Recommended outputs
This step should produce a plan for each eHealth action line that communicates the activities,
their duration and timing (Figure 8).
National
E-Health
Information
Standards
Year 0
Year 3
3 Years
Year 6
6 Years
Implement UHI
service
Implement
NASH service
10 Years
Year 10
Reporting
datasets
IEHR
Terminologies
Secure
messaging
Implement and enhance standards
Develop new standards
Computing
Infrastructure and
Core Systems
National Broadband
Services
Determine
State/Territory
funds allocation
Define
accreditation
requirements
Maintain infrastructure
The above example describes the activities within the foundations action line, along with the
high-level timing and sequencing of activities. Dependencies are not explicitly shown, but they
form an important input into sequencing activities. The outputs are shown at a high level along
the left of the diagram.
The individual plan for an eHealth action line may be accompanied by a list of the stakeholders
who may have accountability and leadership for the various activities. The information can
be summarized as a table (if complex), or on a single diagram if accountability does not differ
substantially across the activities.
Approach
This step should be approached as an internal activity to identify the sequencing and timing of
activities, which in turn will be influenced by duration and dependencies with other activities
in the same action line. The impact of dependencies between action line plans will be explored
in the next stage as the individual plans are integrated.
The timeframe for action line plans should be consistent with the strategic timeframe for the
national eHealth vision. A consistent timeframe will support the integration of individual action
line plans into a single eHealth action plan.
1 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
implementation approach
external dependencies.
Risks are an important input to the integration of the individual action line plans into a holistic
action plan, which occurs in the next stage. As part of the integration, the action plan is
structured and refined to mitigate risk as much as possible.
Recommended outputs
The output of this step will be a description of the risks associated with each of the individual
eHealth action lines.
Approach
This step should be approached as an internal activity that will require working sessions to
identify the relevant risks. Some risks may be specific to a particular activity, while others will
be broader and span one or more action line.
Once risks are identified, additional analysis should be undertaken to determine how they can
be mitigated. There may be multiple ways in which this can be done, including through changes
to the work plans for individual action lines.
numerous activities that do not logically fit into one of the defined action lines
too few outputs and activities in an action line for it to be considered an action line in its
own right
too many outputs and activities in an action line, which has resulted in it being too
complex to interpret and communicate.
Whatever the reason, there are various examples of how refinement could be done, including:
creating one or more new action lines into which activities can be assigned
Recommended outputs
This step will refine the initial set of eHealth action lines based upon the outputs and activities
that have been identified and explored during this stage.
Approach
This step should be approached as an internal activity focused on reviewing the outputs of
the previous steps and determining whether the initial set of eHealth action lines needs to be
refined.
Specific reasons for the creation of action lines, such as the need for visibility of certain activities
as expressed by stakeholders, should be taken into account. This may require consultation with
stakeholders where refinement of those particular eHealth action lines has been identified as
being required.
Chapter 6
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
Once the individual plans for each eHealth action line have been developed, they can be
integrated to form a holistic action plan for delivering the national eHealth vision. The
integration of this plan needs to revisit alignment with the strategic priorities of the national
health system, and the focus of the key stakeholders and funders.
Activities
Outputs
A national action plan for eHealth that has been refined to improve alignment with health
system and stakeholder priorities, and reduce or mitigate identified delivery risks.
Recommended outputs
This step should create an initial draft of the consolidated action plan (Figure 9) capturing:
the various action lines that collectively make up the national action plan
Dependencies do not need to be explicitly shown, as doing so may impact the readability of the
work plan.
Figure 9. Sample consolidated work plan for an eHealth action plan2
eHealth activity area
Year 0
Implement service
NASH
Implement service
Year 0
NHIRF
Foundations
Year 3
UHI
E -Health
Standards
Year 6
Operate UHI service
Year 3
Year 10
Year 10
Physical
Infrastructure
Development
fund
Compliance
E -Health
Solutions
Solutions
Infrastructure
Set accreditation
requirements
Establish fund
Maintain infrastructure
Change and
Adoption
Governance
Awareness
Campaigns
Define awareness
programmes
Incentive
Programmes
Define incentive
regime
Professional
Accreditation
Education and
Training
Professional
Set accreditation
practice standards requirements
Accredit care providers and care provider organisations against new requirements
Engagement
Forums
Establish
reference groups
National
E -Health Entity
Establish national
E -Health entity
E -Health
Regulation
Establish E -Health
regulatory function
2 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
Approach
This step involves internal working sessions to develop an initial action plan, and may be
supported by limited stakeholder consultation to validate the plan.
The development of an action plan occurs over two steps.
Step 1: Integrate eHealth action line plans. The individual eHealth action line plans are brought
together and re-sequenced based upon the dependencies between activities in different action
lines.
Step 2: Refine consolidated action plan to reduce risks. Refine the consolidated action plan to
mitigate risks identified during the development of the individual eHealth action-line work
plans.
Refining the consolidated action plan may mitigate some risks, but others will probably remain.
These will need to be clearly identified and managed on an ongoing basis.
The action plan should be compared to these priorities and options identified for refining the
plan accordingly.
Recommended outputs
This step will produce an understanding of how well aligned the action plan is to health-system
and stakeholder priorities, and identify the preferred option(s) for improving this alignment.
Approach
This step requires internal analysis supported by consultation with relevant stakeholders to
explore their views on priorities for the action plan and to seek their guidance regarding the
options for improving alignment with these priorities (Table 9).
Table 9. Description of steps for exploring alignment of action plan
Step
Description
Outputs
Review alignment
with health-system
priorities.
How well aligned are the outputs of the action plan with
the priorities of the health system?
An understanding of the
alignment of the action
plan with health-system
priorities.
Review alignment
with stakeholder and
funder expectations.
An understanding of the
alignment of the action
plan with stakeholder and
funder expectations.
Recommend the
most appropriate
option(s) for
modifying the action
plan to align it with
health-system,
stakeholder and
funder priorities.
Do the health sector and other supporting partners and sectors have the capacity to accept
and support this activity and the associated level of change it will require?
Does the country have the financial, human and other resources to support the delivery of
the plan?
Does the plan account for the time it will probably take to develop support and momentum
for eHealth in the health sector and broader public?
Have all the key dependencies between activities been identified and reflected in the
sequencing?
Do health and non-health stakeholders think that the action plan is achievable?
Are there any particular activities that would be completely stop implementation of the
action plan should they be delayed, or could not be delivered?
Recommended outputs
This step should identify delivery risks for the action plan, and options that may exist for
mitigating or reducing their likelihood or impact.
Approach
This step should be approached as an internal activity and supported with input from relevant
health and non-health stakeholders that have been involved in the development of the action
plan.
Internal analysis
Initially internal working sessions should be undertaken to identify potential risks associated
with the action plan. Sessions should explore the action plan from different perspectives (such
as those in the sample questions above in the Objectives section).
Multisectoral input
Health and non-health stakeholders should be consulted to gain their input regarding the
achievability and risks of the action plan. Stakeholders may have specific knowledge or
experience with previous programmes and projects that allows them to provide constructive
feedback.
Re-sequencing of activities. The sequencing and timing of activities are altered to ensure that
the outputs of the plan more closely align with the health system and stakeholder priorities.
Refining scope of activity. The scope of activities may be refined to provide greater focus on a
particular priority (e.g. on a particular health-sector segment or geographical location).
Re-visiting activity durations. The duration of one or more activities is altered so that the
outputs of those and subsequent activities more closely align with the health system and
stakeholder priorities. Often these changes are associated with refining the scope of a
particular activity.
Adding or removing activities. New activities may be required to provide greater emphasis
on particular priorities. Alternatively, activities may be removed if they are deemed not
relevant to addressing priorities.
Refining an outcome approach. It may also be necessary to consider a completely different
approach to achieving a particular output for an eHealth action line. This approach may
require a different set of activities to be undertaken.
Recommended outputs
The output of this step will be a refined action plan, which achieves a better balance between
health-system and stakeholder priorities and the long-term development of the national eHealth
environment.
Approach
This step should be approached as an internal activity focused on modifying the action plan in
line with the preferred option(s) that were agreed with stakeholders.
Chapter 7
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
Once an action plan has been developed, the focus shifts to understanding the skills and
expertise required to deliver it. Assessing these against the countrys current skills and expertise
allows potential constraints to be identified, which will have implications for the approach
adopted to obtaining the skills and resources required. With this understanding formed, it also
becomes possible to explore the magnitude of funding required to deliver the action plan.
Activities
Identify the skills and expertise required to deliver the action plan.
Outputs
This stage will determine the resource requirements for delivering the action plan and the
approach to securing them. Based on this, this stage will also estimate the magnitude of funding
required to deliver the action plan.
Dimension
Description
Type of resource
Financial modelling
Change management
Resource capacity
Resource
distribution
National
State
Regional
Local
Recommended outputs
This step should provide a consolidated view of the skills and expertise needed to deliver the
action plan. While this understanding will be developed through assessing the requirements for
delivering individual activities, the output of this step should seek to roll this up to a high-level
set of resource requirements that describe the skills and expertise, capacity and distribution.
Approach
This step should initially be approached as an internal activity. However, it may need input from
subject matter experts.
Internal analysis
This step will involve assessing each of the activities within the action plan to identify the
requirements for each the dimensions described above in Table 10. Knowledge of domestic
and international eHealth programmes and projects can be utilized during this step to assist in
identifying the required skills and expertise, and in providing guidance as to the magnitude of
resources that may be needed.
The focus should be on identifying at a high level the resources required, rather than
determining project resource at a micro-level. Detailed resource planning will occur later as part
of the activities that are described within the action plan.
Does the country have personnel with the required skills and expertise?
Does the country have sufficient levels of resources with these required skills and
expertise?
Are personnel located where they will be needed, or can they be easily deployed to the
required locations?
Are there any current or planned national or international programmes or projects that
may generate competition for these personnel?
Exploring questions such as these involves considering the broader resource pool from which a
country can draw. The required skills and expertise may exist in the public and private sector,
as well as in the broader health and non-health sectors.
Recommended outputs
This step should document the skill and expertise constraints that will affect the delivery of the
action plan at the consolidated level, rather than the activity level.
Approach
This step should initially be approached as an internal activity and may require input from
subject matter experts.
Internal analysis
This step will involve assessing the countrys ability to fulfil the requirements identified in
Section 7.1. This assessment should explore each of the dimensions and consider potential
competition for resources from other domestic and international projects, and how this may
impact the available resources for delivering the action plan.
The constraints identified also need to be understood in terms of their implications. This will
assist in identifying the high-priority constraints that need to be resolved.
Approach
Description
Examples
Recruit
Contract
Technology vendors
Partner
Alliances
Sectoral relationships
Develop
These options can be considered from a domestic and international perspective. For example, a
country may obtain skills and expertise either locally or internationally.
A country will probably need a combination of the above approaches. Some skills and expertise
may be available through partnering with other organizations, while others will need to be
contracted from a third-party provider or organization.
Recommended outputs
This step will describe the high-level approach to accessing the skills and expertise required
to deliver the action plan. As per the previous steps, the approach should be described at the
consolidated level, rather than the activity level.
Approach
This step should initially be approached as an internal activity and may require input from
subject matter experts.
Internal analysis
This step explores options to securing the required skills and expertise (Table 12).
Table 12. Suggested dimensions for determining the approach to securing skills and resources
Dimension
Description
Example considerations
Constraints
Timing
If they are required in the medium or long term, the country may be
able to consider developing its local workforce to provide these at
the appropriate time.
Duration
If skills and expertise are required only for a short period, it may
be more appropriate to engage these from a third-party provider
organization or through partnerships and alliances.
Government
policy
Availability
If the required skills and expertise are simply not available from
third-party provider organizations, or through partnerships, the
country may need to develop these capabilities itself.
Ownership
The skills and expertise required may exist in the local workforce
but may be owned largely by third-party providers. In this case, the
pragmatic approach would be to engage these providers.
This step should not be focused on performing a detailed financial costing exercise, but rather
on estimating the magnitude of funding. It requires an understanding of the above factors and
other domestic and international eHealth programmes and their associated funding levels.
Recommended outputs
This step should produce an estimate of the range of funding required to deliver:
Some countries may have additional requirements on the information that needs to be produced
as part of this step. Country experience suggests that other common requirements include
being able to:
distinguish between incremental funding and total funding, which may be required when
the action plan incorporates programmes and projects that already have funding;
describe the cash flow for the action plan, as this provides visibility of how the required
funding varies over time.
Approach
There are various approaches to estimating funding requirements. This can be done through a
combination of bottom up and top down estimation techniques (Figure 10).
Top-down
funding estimate
Refined funding
estimate
and assumptions
Resourcing levels
Activity duration
Approach to securing
resources
Bottom-up
funding estimate
funding for other non-eHealth programmes and projects that have similar characteristics or
attributes to activities in the action plan;
pre-existing financial or cost modelling undertaken for eHealth programmes and projects;
Bottom-up estimation involves estimating costs based on identifying the particular costdrivers for each activity in the action plan. For this reason, it can be significantly more
time-consuming.
Examples of inputs to a bottom-up estimation approach include:
the proposed approach for securing skills and expertise, as this will influence the cost of
accessing the appropriate resources;
estimates of capital and operational funding for ICT infrastructure that are being delivered
by a particular activity, which may require input from eHealth/ICT vendors and other
experts;
additional funding associated with a particular activity, such as incentives and funding
programmes that form part of the approach to change and adoption.
Top-down and bottom-up estimates can be used together to refine the total funding estimate for
the programme.
A funding range (i.e. a minimum and maximum) should be specified during this step. Using
a range makes it clear that the funding estimate has a degree of uncertainty, and avoids
misperceptions that an exact funding figure has been achieved. Any important assumptions
that underpin the estimate should also be clearly described to ensure that decision-makers have
the full context.
Chapter 8
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
This stage will assess the financial resources available to implement the proposed action plan,
from a magnitude and timing perspective. This knowledge will be used to refine the action plan
so that it is realistic, pragmatic and implementable.
Activities
Agree how to refine the action plan to account for funding availability.
Revise the national eHealth vision to reflect changes arising from the availability of
funding.
Outputs
A refined action plan that takes the availability of funding into account. The implications for the
national eHealth vision that arise from the refined plan will also be identified and documented.
Considerations
Description
Examples
Funding sources
Funding
mechanisms
Donation
Loan
Magnitude
Timing and
duration
Short-term
Medium-term
Long-term
Conditions
Recommended outputs
This step should identify the potential funding sources and magnitude of funding that could be
available to support the action plan. It is not the objective of this step to formalize agreements to
secure this funding.
Approach
The approach to this step depends on whether a country is seeking to develop an understanding
of the broader funding that may be available to deliver its action plan.
Internal analysis
The extent of internal analysis will depend on a countrys interest in identifying broader
sources of funding that could be available for the action plan. This should involve research and
analysis of funding sources such as those in Table 13. It may also be useful to research how
other countries have funded national eHealth programmes and projects, in order to identify any
innovative approaches to funding that may be relevant.
Chapter 8. Apply funding constraints to refine plan page 42
Recommended outputs
This stage will identify an agreed set of changes to the action plan that will enable it to be
delivered with the funding that will likely be available.
Approach
This step will require a combination of internal analysis and consultation with decision-makers
to agree how the action plan will be refined based on availability of funds (Table 14).
Table 14. Approach to refining action plan to take account of funding availability
Step
Description
Outputs
Identify the
various options
for refining the
action plan so that
it can be delivered
within the funding
that will likely be
available.
Understand
the impact of
each option on
achieving the
required health
system goals and
challenges.
Jointly evaluate
each option with
relevant decisionmakers and
stakeholders and
select a preferred
option for refining
the action plan.
The above approach may need to be undertaken in an iterative fashion. The evaluation of
options must be undertaken with the primary decision-makers of the national eHealth
vision, as this is likely to require consideration of trade-offs (i.e. benefits versus costs). Other
stakeholders may be consulted to support the identification of options, and the assessment of
their impact on the national eHealth vision and associated health system goals and challenges.
Recommended outputs
The output of this step will be the refined national eHealth action plan which can be
realistically delivered within the likely funding that will be available.
Approach
This step should be approached as an internal activity focused on updating the action plan by
changing various activities to reflect the preferred option, such as:
re-sequencing of activities
removing activities
applying a different approach to achieving a particular outcome of the action plan, which
will involve changing the activities within it.
Recommended outputs
The output of this step will be an updated national eHealth vision, which reflects the realities of
the nations probable funding for eHealth.
Approach
This step should be approached as an internal activity focused on updating the national eHealth
vision to reflect the preferred option selected during Section 9.2. This step should utilise the
knowledge developed during the Assess impact of options step described in Section 8.2.
Chapter 9
Develop an
integrated action plan
Determine
high-level resource
requirements
Apply funding
constraints
to refine plan
Define
implementation
phases
Objective
This stage defines implementation phases which can be used to communicate the often complex
content of the action plan for eHealth in a manner that can easily be grasped. Targets for the
development and use of eHealth can also be defined for each phase.
Activities
Outputs
A set of implementation phases, associated targets and communication messages for the action
plan.
Implementation phase 1
Implementation phase 2
Implementation phase 3
Time period
Time period
Time period
Action line 1
Action line 2
Action line 3
Action line 4
Recommended outputs
This step will identify three to four implementation phases, including the strategic focus and
time period of each phase.
Approach
This step requires internal analysis to identify three to four implementation phases for the
action plan. Country experience suggests that decision-makers and stakeholders find this easier
to understand, manage and fund (Table 15).
Table 15. Approach to identifying implementation phases
Step
Description
Outputs
--a 5-year plan could be split into three periods of 0-18 months,
1836 months and 36 months to 5 years.
2
Analyse the
strategic focus
within each
of these time
periods.
An understanding of
the strategic focus of
each implementation
phase.
Refine time
periods based
on the identified
strategic focus.
Finalized set of
implementation
phases.
Recommended outputs
This step will produce a set of stakeholder communication messages for each implementation
phase, which describe the strategic focus or intent of that phase (Box 2).
Box 2. Example of messages for implementation phases3
Given the long time over which eHealth will need to be delivered and the realities of the three-to-four year political
cycles in some countries, breaking the journey down into 3, 6, and 10 year planning horizons will provide the
programme with an ability to remain focused by delivering incremental and tangible blocks of capability.
These planning horizons are focused on achieving three progressive states of maturity in information sharing:
Connect and communicate in which the focus is on establishing the foundations for eHealth and providing basic
connections that allow information sharing to occur between care providers and across the health sector.
Collaborate in which the focus shifts from basic communication to collaboration, joint care planning and multidisciplinary care delivery through more extended information sharing.
Consolidate in which eHealth becomes part of business-as-usual for health-care provision. In this stage there is a
focus on maintaining and enhancing a sustainable health information-sharing environment that supports ongoing
innovation and the development of future models of care based on rich and extensive information sharing.
Approach
This step should be approached as an internal activity, potentially with consultation with select
stakeholders to test and refine the communication messages.
Internal activity
Initially the focus should be on developing a set of stakeholder communication messages for
each of the implementation phases. It is expected that the analysis and knowledge developed
during Section 9.1 will be an input to the development of these messages. The messages should
not be overly lengthy or complicated, but instead be concise and tailored to the intended
audience.
Stakeholder consultation
There may be value in informally testing the initial set of messages with a small group of
stakeholders. This may assist in identifying concepts, language or other aspects that need to be
further refined before being communicated to the broader stakeholder environment.
3 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
Recommended outputs
This step will produce a set of implementation targets for each phase, articulated in terms of the
improvements that important stakeholder groups will experience (Box 3).
Box 3. Implementation targets for the Connect and Communicate phase (Years 13)4
Consumers
Consumers will begin to be able to be uniquely identified by the health sector through the roll-out and initial
adoption of the Unique Health Identifiers.
The national Consumer Health Portal has been implemented and consumers are beginning to use this as one of their
primary online sources of health information to assist in management of their health care.
Twenty per cent of consumers of access to a limited form of electronic health record and two to five per cent of
consumers begin to access personal health information from initially available IEHR solutions.
Care Providers
Broadband connectivity available to the majority of care providers; organizations are investing in new infrastructure.
Care provider adoption of eHealth is increasing with key care-provider segments becoming more computerised
(95+% of GPs, 60+% of specialists, 95+% of pharmacists and 95+% of pathologists/radiologists).
Increasing numbers of care providers are adopting and utilising eHealth standards-compliant systems that support
electronic transfer of prescriptions and electronic test orders/results (50% of GPs, 20% of specialists, 70% of
pharmacists and 70% of pathologists/radiologists).
Healthcare Managers
Healthcare managers are gaining increasing awareness and understanding of the benefits of eHealth and the
potential for improved reporting and research datasets.
Small amounts of improved reporting data, primarily relating to prescriptions and test ordering is starting to become
available to healthcare managers for analysis.
Healthcare managers, particularly those in target segments are investing funds in IT infrastructure to provide base
computing and systems capability which will support eHealth.
Vendors
Funding available to provide incentives for the development of high priority, standards compliant eHealth solutions.
Vendors see the emergence of clearly defined national eHealth standards and can rely on these standards when
enhancing existing, or developing new solutions.
Vendors are engaged around the eHealth software compliance process and timelines have been agreed for highpriority solution compliance.
Background Activities
A consistent privacy and information protection regime has been agreed and implemented across the country.
Standards for electronic prescriptions, test orders/results, IEHR, care plans and telehealth have also been defined and
are being used as the basis for solutions by vendors.
A national eHealth entity has been established with responsibility for developing and maintaining the national
eHealth strategy, sourcing and managing eHealth investment, managing the delivery of national eHealth
infrastructure components, encouraging the development and use of high-priority eHealth solutions, testing eHealth
solution compliance with defined standards and regulations, and designing and overseeing national stakeholder
adoption, incentive, change and training programmes.
4 National E-Health and Information Principal Committee. National E-Health Strategy, 30th September 2008. Adelaide, Deloitte
Touche Tohmatsu, 2008.
Approach
This step is an internal activity focusing on defining the targets for each implementation phase.
This will require an analysis of the activities within each implementation phase to determine:
What each activity or set of activities will have delivered by the completion of an
implementation phase;
What impact the activity or set of activities has had on important stakeholder groups in
terms of improving their interaction with the health system.
Annex A
Annex B
Methodology summary
This Annex summarizes the methodology described in Part 2. This is intended to help users of
this Toolkit to organize and manage the development of an action plan for eHealth.
Table 16. Methodology summary for developing a national eHealth plan
Stage
Activities
Outputs
Manage the
process
Engage with
stakeholders
Develop eHealth
action lines
Develop an
integrated
action plan
Determine
high-level
resource
requirements
Apply funding
constraints to
refine the plan
Determine
implementation
phases
Recommended implementation
phases for the action plan.
Annex C
Stakeholder
engagement
Program
execution
Architecture
Management
and operation
Clinical safety
Outcomes
management
Governance
Strategy and
investment
Strategy & planning
National
Electronic health
record (EHR)
Electronic referrals
Electronic test
ordering
Care plan
management
Medications
management
Alerts monitoring
and management
State
Electronic medical
record (EMR)
Electronic
specialist letters
Individual health
record access
Appointment
booking and
management
Prescription
decision support
Disease
management
Regional
Personal health
records (PHR)
Electronic health
event summaries
Real-time clinical
data access and
analysis
Clinical decision
support
Telemedicine
(Telehealth)
Solutions
Electronic test
Electronic
prescription
Local
results
Directories access
Mobile health
(mHealth)
Integrated strategy
and planning
Funding
National
Governance
State
Regional
Local
Investment
management
Infrastructure
Identification & authentication services
Unique health
identifiers
Computing infrastructure
National
Directories
Health-care provider
authentication
Health-care
organizations and
providers
Secure messaging
Foundations
State
Health-care provider
systems
Health-care
services
Regional
Local
Health-care
providers
Rural
Remote
Mobile
Practice
management
Regional
Investment case
development
Evaluation and
priorisation
Foundations
Investment
allocation
Referrals
Budgeting and
tracking
Health event
summaries
Prescriptions
Messaging standards
Test orders
& results
Security messaging
standards
Care plans
Software accreditation
standards
Governance
Health-care management
and administration
Individual health
knowledge sources
Adverse event
monitoring
Health-care provider
knowledge sources
Risk analysis
Legislation
Clinical practive
improvement
Health identifiers
Clinical decisions
support research
& improvement
Privacy policy
Education &
training
Compliance
monitoring
Health program
design and
optimization
Access and
consent policy
Accreditation
Surveillance and at
risk identification
Health policy
development
Usage and
disclosure policy
Priority cadres
Health-care
operations
management
Health-care and
clinical research
Solutions
Foundations
Storage and
retention policy
Audit and
complaint policy
Infrastructure
Licensing
Directories
Clinical information
systems
Patient management
systems
Individual
electronic health
record (EHR)
repositories
Foundations
Compliance
Standards
development
Foundations
Electronic health
records (EHRs)
Education &
training
Accreditation
Specialist letters
Policy
eHealth-specific
policy
Solutions
Health sector
policy
Appointments
Health workforce
Clinical events
Conformance and
accreditation
Solutions
Priority cadres
Change &
adoption
Annex D
Governance activities
These activities focus on those components that provide coordination, visibility and oversight
for eHealth implementation. These are the components that will manage the delivery of
the action plan, and govern the broader development of the eHealth environment. These
activities often focus on establishing governance structures and mechanisms for accountability,
transparency and leadership of a national eHealth programme (Table 17).
Table 17. Examples of governance activities (not exhaustive)
Example activities
Description
Focuses on the design and establishment of a board or council that has accountability for
setting overall national eHealth direction and priorities, for reviewing and approving national
eHealth strategy and funding decisions, and for monitoring of national eHealth strategy
progress and evaluating outcomes. Such a council would typically have an independent chair
and would comprise of a mix of eHealth stakeholders, including government, health-care
providers, health-care management and administrators and citizens representatives.
Focuses on the design and establishment of a function geared towards implementing and
enforcing national eHealth regulatory frameworks. For example, this function would be
responsible for implementing and enforcing health information data-protection frameworks.
The development of this function would need to address relationships and interactions with
existing regulatory bodies and functions.
Global experience suggests that having a national entity that focuses on coordinating and
overseeing the national eHealth strategy, investment and execution plays an important role in
the development of a national eHealth environment. Such entities may also perform, or play a
key role in standards development and solutions compliance.
Formalize governance
interactions with other
national, regional
and local governance
bodies
Dedicated eHealth governance functions, such as a national eHealth entity, will need to coexist
with existing governance functions operating at a national, regional and local level. As such,
there is a need to identify and formalize the relationships with these governance functions,
and clearly define how they will interact with relation to eHealth strategy, investment and
coordination.
Foundation activities
These activities typically focus on delivering those eHealth components that are needed to
support the secure electronic exchange of health information across geographical and healthsector boundaries, or to improve access to health-care services through electronic channels.
These activities develop the backbone for a national eHealth environment.
The activities are typically of national significance, and would be too risky or complex to deliver
successfully unless through a strong nationally-coordinated approach. It may also be more cost
effective to develop these activities just once at a national level rather than duplicating effort and
expenditure across states, regions and the private sector (Table 18).
Table 18. Examples of foundation activities (not exhaustive)
Example activities
Description
Once developed, the foundation eHealth service will need to be deployed and
operated reliably so that it supports the nations eHealth environment.
National eHealth standards are essential to ensuring that health information can
be exchanged across geographical and health-sector boundaries. This requires
a clear process for developing, reviewing, approving and publishing national
eHealth standards, and which is supported by the health sector and the health ICT
industry.
Example activities
Description
Countries will work with selected providers and operators to deploy data
connectivity infrastructure that enables high-priority parts of the health
sector and population to interact with and benefit from the national eHealth
environment.
Solutions activities
These activities focus on encouraging the development and use of high-priority eHealth services
and applications to improve the efficiency and effectiveness of health-care management and
delivery. This often focuses on ensuring that individuals, health-care providers and managers
have access to the services and applications that allow them to access, view, use and share
health information. These services and applications will often utilize eHealth components
established through the activities delivered via the foundation action line (Table 19).
Example activities
Description
Establish a national
eHealth solutions
investment fund
Design and establish an investment funding programme to encourage the development and
implementation of high-priority eHealth solutions that support national standards and that
can be effectively scaled and leveraged across the countrys health sector.
Develop investment
rules and criteria
Develop the rules and criteria required to guide the allocation of investment funds and
establish appropriate investment fund governance, processes, control mechanisms and
functions.
Foster development of
high priority eHealth
solutions
Engage with the health ICT industry and the broader health sector to build awareness and
understanding of available investment funds and encourage the development of highpriority eHealth solutions
Design and establish a national compliance function that is responsible for testing eHealth
services and applications and certifying their compliance with national eHealth standards.
The function must have sufficient authority, funds, infrastructure and resources to conduct
effective national eHealth services and application testing and certification.
Develop compliance
processes
Operate certification
process
Perform ongoing certification of eHealth services and applications as they emerge from the
health ICT and broader health sector.
Develop and publish criteria that guide health-care organizations and vendors in determining
what is required to certify their eHealth and other health ICT solutions as compliant with
national eHealth standards.
Develop high-level
requirement and design
for priority national
eHealth services and
applications
The national eHealth vision may have identified a number of priority eHealth services or
applications that should be developed and deployed on a national scale. This activity defines
the high-level requirements and designs for these priority services or applications.
Select implementation
partner to perform
detailed design and
build of national eHealth
service or application
Once developed the national eHealth service or application will need to be deployed and
operated reliably so that it can be accessed and used by the intended users (e.g. individuals,
health-care organizations and providers, health-care managers and administrators).
Examples may include national electronic health record systems, health information
exchange, health information portals, national prescription services, and health information
datasets.
Example activities
Description
Identify the priority consumer, care provider and health-care manager stakeholder segments that
should be targeted for eHealth adoption, assess their readiness to adopt specific eHealth solutions
and identify opportunities to build momentum.
Develop eHealth
awareness campaigns
Develop awareness campaigns that utilize appropriate communication mechanisms and forums to
promote awareness of eHealth, specific eHealth services and applications, and the benefits of these.
Roll-out eHealth
awareness campaigns
Roll-out awareness campaigns to high-priority change and adoption targets, and in time extend
these to the broader health sector and public.
Define clear criteria and targets for eHealth awareness and progress, and periodically measure
actual awareness and programmes against these, to assess the effectiveness of eHealth change and
adoption activities across consumers, care providers and health-care managers and administrators.
Establish a national, web-based knowledge repository that captures eHealth project successes and
enables sharing of learnings across the national health sector.
Develop financial
incentive regime
Design a financial incentive programme to encourage the adoption and use of high-priority eHealth
services and applications. This needs to include conditions of funding, eligibility criteria, application
and approval processes, funding administration, and associated roles and responsibilities.
Develop financial
incentive communications
programme
Develop communication strategy and materials to publicize incentives and put in place necessary
mechanisms to support this, including funding guidelines, information and application forms.
Roll-out financial
incentive communications
programme
Roll-out communications programme to high-priority change and adoption targets, and, in due
course, extend this to the broader health sector.
Monitor adoption of priority eHealth solutions in target segments over time and scale-back financial
incentives and other change and adoption activities as the tipping point is reached.
Define professional
practice standards
Work with cross-sectoral stakeholders to guide the development of a professional practice standard
for health-care providers, which should define the expectations and obligations of these providers
to collect, store and share high-quality electronic health-care information in a timely, appropriate
and secure manner.
Identify and define changes to existing professional accreditation programmes for health-care
organizations and individual healthcare providers to encompass eHealth.
Liaise with the appropriate professional bodies and working groups to agree changes to
accreditation requirements and implement these changes throughout high-priority segments of the
health sector, and in time the broader health sector.
Develop a standard eHealth competency framework for health workers and health ICT practitioners.
This framework would provide an understanding of required eHealth knowledge, skills and
attributes for these various professional groups.
Determine the changes that are required to existing education and training courses to ensure the
development of eHealth workforce capabilities.
Work with education institutions (e.g. universities, vocational training institutions, professional
bodies) to insert eHealth into their curricula.
Establish specialized
eHealth courses and
qualifications
Identify and establish nationally recognized tertiary qualifications in eHealth (e.g. health informatics)
and implementing formalized training/education programmes designed to recognize and promote
the spread of eHealth skills and expertise.
Design targeted
stakeholder reference and
working groups
Global experience suggests that the lack of meaningful engagement of health-care participants
is often a significant barrier to the development of a national eHealth environment. This activity
designs a set of targeted stakeholder engagement forums that have clear goals, objectives and
deliverables.
Identify cross-sectoral
representatives
Identify the participants to participate in targeted stakeholder engagement forums, ensuring broad
and appropriate representation across health-care providers, professionals, governments, vendors,
industry, consumers, community and other relevant stakeholder groups.
Regularly engage and involve stakeholder reference and working groups throughout the
development of the countrys eHealth environment. These groups should be involved in exploring
particular issues and risks related to the development of the countrys eHealth environment, and the
identification of acceptable solutions to these.
Annex E
Type of risk
Description
Like any large-scale change initiative, eHealth requires high-profile leadership that will
provide top-level, sustained vision and commitment throughout the programme.
Inadequate governance
and oversight mechanisms
Conflicting agendas
Decision-makers from different levels of government, regions or parts of the health sector
may have conflicting agendas and will be unable to reach agreement on implementation
approach, activities or other aspects of the action plan.
Resistance to change
existing governance
mechanisms
Stakeholders may resist making changes to existing governance mechanisms that are
required to support the delivery of the action plan, which will delay effective governance
and oversight of activities.
Type of risk
Description
Inadequate
engagement
with clinical
stakeholders
Many eHealth programmes and projects have failed as a result of not ensuring adequate
engagement and participation of clinical representatives in the design and delivery of eHealth
transformation. This may result in technology and process changes that are not relevant to
clinicians and do not add value to their practice.
Fragmentation in
the health sector
Fragmentation of the health system may increase the complexity and effort associated with
achieving effective stakeholder involvement.
Non-organized
stakeholders
Some important stakeholders may not be organized in a manner that permits them to be easily
engaged, yet their involvement is critical.
Resistance to
eHealth
Some parts of the health sector may resist the notion of eHealth, particularly those organizations,
providers and individuals that do not understand what eHealth is, how it could be applied to
address current challenges, and the benefits that it may deliver.
Inability to meet
expectations
The activities within the action plan may not meet the expectations of various political, healthsector and other important stakeholders even if the programme delivers in accordance with
objectives and scope.
Type of risk
Description
The successful delivery of eHealth activities depends on skills and expertise which are not
available or are difficult to access.
Insufficient resource
capacity
The successful delivery of activities within the action plan requires a greater number of
skilled resources than are available to a country.
Imbalanced geographical
distribution
The resources may not be geographically located where they will be required.
Scarcity of funding
There may be an inability to secure sufficient funding within the required time period to
make the necessary investments in eHealth, meaning that the vision cannot be achieved.
Type of risk
Description
Activities may attempt to focus too broadly, rather than targeting specific, high-priority
needs and segments.
Activities may be too aggressive in driving towards particular outcomes and not take
account of the sectors capacity to accept and support activities, and the associated level
of change required.
The implementation approach may not deliver tangible benefits early enough or fast enough
to address the expectations of stakeholders. This may have an impact on perceptions about
the ability of the government and other partners to deliver the programme, delaying the
realization of benefits, and justifying ongoing investment in ad hoc eHealth solutions.
Type of risk
Description
Required infrastructure
not available
The action plan is dependent on the delivery of technology, business or other infrastructure,
but this will not be available when required.
The action plan is dependent on the delivery of data, technical or other standards but this will
not be available when required.
Inability to re-use or
share
The action plan is dependent on external systems or infrastructure that may prove unsuitable
for re-use or sharing.
The action plan is dependent on vendors having changed their products and solutions to
support the national eHealth environment, but they will not be available to the marketplace
when required.
Annex F
political attractiveness
budgetary constraints.
Operation and maintenance contract (O and M). These projects involve the private sector
operating a publicly-owned facility under contract with the government.
Lease, develop and operate (LDO). This type of project involves a private developer
being given a long-term lease to operate and expand existing infrastructure. The private
developer agrees to invest in infrastructure improvements and can recover the investment
plus a reasonable return over the term of the lease.
Build, operate and maintain (BOM). This arrangement involves the private-sector
developer building, owning and maintaining infrastructure. The government leases the
infrastructure and operates it using public sector staff.
Build, own, operate and transfer (BOOT). These projects involve a private developer
financing, building, owning and operating infrastructure for a specified period. At the
expiration of the specified period, the infrastructure is returned to the government.
Build, own and operate (BOO). These projects operate similarly to a BOOT project, except
that the private sector owns the infrastructure in perpetuity. The developer may be subject
to regulatory constraints on operations and, in some cases, pricing. The long-term right to
operate the infrastructure provides the developer with significant financial incentive for the
capital investment in the facility.
5 Tasmanian Department of Treasury and Finance. Guiding principles for private sector participation in public infrastructure
provision. Hobart, 2000.
6 Government of Karnataka. Infrastructure Development Department. PPP models in practice. Bangalore, 2012 (http://idd.kar.nic.
in/ppp-models.html, accessed 17 May 2012).
Technology projects are notoriously challenging as PPPs, in part due to the shorter lives of
the technology assets compared to infrastructure. This may affect funding structure and
conditions.
Much of the value in a technology PPP derives from the abililty to transfer to the private
sector, for example in regard to delivery (development and implementation) as well as
ongoing support and maintenance.
PPPs use a complex legal and financing structure which can be expensive and more timeconsuming to establish than other mechanisms. This means that the project needs to be
sufficiently large to warrant this investment.
There will need to be sufficient depth and capability in the local market, particularly in
regard to capital markets capacity to achieve funding for PPPs. There will also need to be
sufficient depth and sophistication in the technology supplier market to be willing to enter
into what are complex, risk-based transactions.
As with all PPPs, a transparent and robust performance regime and payment mechanism
will need to be put in place.
PPPs require a favourable tax jurisdiction, particularly in regard to the treatment of
depreciation, as this can be an important incentive.
There is no one size fits all PPP model. The short-, medium- and long-term requirements
of projects need to be individually considered when determining the most appropriate PPP
model.
It is important to recognize that PPPs are a distinct funding model, which should not be
confused with the need to gain private-sector involvement in eHealth development. For
example, the private sector may be involved through various forms of outsourcing.
Annex G
Term
Definition
Part I:
eHealth outcomes
What will be achieved or changed through using eHealth, and how the
health system and services will change by:
Establishing a
national eHealth
vision
National eHealth
environment
eHealth components
The building blocks of a national eHealth environment that will allow the
eHealth outcomes to be achieved. They describe what is needed to be
introduced or strengthened to achieve the eHealth vision in terms of:
Infrastructure
Workforce.
Strategic
recommendations
Part 2:
Action lines
Developing an
eHealth action plan
Broad areas to group national activities of similar focus and intent that
are required to deliver a nations eHealth vision.
eHealth outputs
Activities
Output indicators
Outcome indicators
Part 3:
National eHealth
monitoring
and evaluation
guidelines
Printed in Geneva
Part 3
Purpose
Part 3 of the National eHealth Strategy Toolkit is a guide to establishing a framework to monitor
the action plan developed in Part 2, and to evaluate the outcomes. The main aspects of this
work are the development of indicators and targets to be measured, and the definition of the
governance and processes required.
Audience
Like Parts 1 and 2 of the Toolkit, Part 3 is intended for use primarily by government,
ministerial and health sector leaders, including personnel in health ministries, departments
and agencies who will monitor and evaluate their national eHealth action plan. It is designed to
be used by countries that have developed a national eHealth vision and action plan using the
previous two parts, with the assumption that the outputs from them are available and have been
endorsed. Part 3 should also be of use to other decision-makers who have developed their action
plans but are uncertain how to monitor and evaluate the results.
Overview
The Toolkit provides a framework and method for the development of a national eHealth vision,
action plan and monitoring and evaluation framework. The Toolkit is designed in three parts,
with the second and third building progressively on the work of Part 1.
Part 1: A national eHealth vision that responds to health and development goals.
Part 2: A national eHealth action plan that reflects country priorities and the eHealth
context.
Part 3: A plan to monitor implementation and evaluate outcomes achieved.
How this Toolkit will be used, and the end result, will be based on a countrys context,
priorities and vision.
Part 1
Part 2
Part 3
National eHealth
action plan
National eHealth
monitoring and evaluation
(This document)
page i
Orientation to Part 3
Part 3 provides guidance on establishing a national monitoring and evaluation framework.
The introduction summarizes the outputs of Part 2 and how these relate to monitoring and
evaluation.
Chapters 12: The elements of a monitoring and evaluation framework, and the method by
which the framework is developed.
Chapters 35: Detailed guidance on defining a national monitoring and evaluation
framework.
Annexes provide additional information to support this Toolkit, including a definition of terms.
page ii
Contents
18
24
6. Conclusion
31
Annexes
A. Results-based management
32
35
37
page iii
Figures
1. Results-based management
10
14
21
26
29
32
34
Tables
1. Examples of eHealth outcomes for stakeholders (non-exhaustive)
10
12
14
15
17
21
22
25
27
30
33
35
page iv
Introduction
defining indicators that provide insight into the adoption of eHealth and the tangible
results for health and non-health stakeholders;
identifying indicator baseline and target measures to allow monitoring and evaluation of
progress over the duration of the plan; and
describing the governance and processes required.
Programme
inputs
Programme
activities
Results
eHealth
outputs
eHealth
outcomes
Attribution
Measure execution of integrated action plan
Impact
Contribution
Measure change delivered
Monitoring and evaluation framework
Are we on the right track?
Programme management
Are we on track?
Introduction page 1
A clear distinction should be made between a monitoring and evaluation framework for a
national eHealth strategy and the programme management activities that are designed to
implement and manage a large-scale eHealth action plan.
Programme management monitors the execution of the action plan, and is central in answering
the question of whether the country is on track in terms of its implementation of a national eHealth
environment. It focuses on three main components.
Programme inputs: funding, budgets, resources and other inputs required to deliver the
eHealth action plan.
Programme activities: these correspond to the activities defined in the action plan.
eHealth outputs: the deliverables, such as eHealth components, resulting from the activities
undertaken.
eHealth outputs: the deliverables, such as eHealth components, resulting from the activities
undertaken (as above).
eHealth outcomes: the strategic outcomes that eHealth outputs enable, or contribute to
enabling.
Impact: the change that eHealth outcomes create for health and non-health sector
stakeholders.
A monitoring and evaluation framework assigns accountability (who), and determines the
approach (how) and timing (when) for measuring the results. Part 3 of the Toolkit focuses
specifically on eHealth. Countries seeking information on programme management should refer
to one of the programme management frameworks that are in wide use, such as PMBOK or
PRINCE2 2.
2 Project Management Institute. Making project management indispensable for business results. Philadelphia, PA, 2012 (http://www.
pmi.org/, accessed 17 May 2012).
PRINCE2.com. London, 2012 (http://www.prince2.com, accessed 17 May 2012).
Introduction page 2
Introduction page 3
Chapter 1
Indicators
for monitoring
and evaluation
Measures
Monitoring and evaluation
timeframes
Baseline measures
Target measures
Baseline and
target measures
for indicators
Governance
Governance structures,
functions and processes
Governance
and processes
Chapter 2
Measures
Define indicators
for eHealth
Define baseline
and target measures
for indicators
Governance
Define supporting
governance and
processes
This is a sequential process that begins with determining the indicators to be monitored and
outcomes to be evaluated. Baseline and target measures are set for each indicator. Targets serve
as the basis for tracking actual progress against planned progress, and determining whether
corrective action is required. A monitoring and evaluation framework also describes the
governance model and processes through which national monitoring and evaluation will be
performed. Stakeholders are consulted throughout the process in order to gain commitment and
understanding, as well as to ensure that their roles are considered in the governance structure
and processes.
The development of a monitoring and evaluation framework is closely linked to the outputs of
Parts 1 and 2 of the Toolkit, in particular:
A considerable portion of developing a monitoring and evaluation framework involves using this
existing knowledge.
Chapter 3
Measures
Governance
Define baseline
and target measures
for indicators
Define supporting
governance and
processes
Objective
This step defines eHealth output and outcome indicators that will assist in measuring the
results of the eHealth action plan. Indicators should be linked to the stakeholders and outcomes
identified in Part 1, so that the true success of eHealth is understood, above and beyond noting
the progress of eHealth implementation.
Activities
Outputs
eHealth output indicators, which will be used to measure the adoption and take-up of
eHealth within the health sector.
eHealth outcome indicators, which will be used to measure the results of the adoption and
take-up of eHealth.
Recommended outputs
This step should determine the priority health- and non-health-sector stakeholders for whom it
is especially important to demonstrate eHealth outcomes. It is recommended that stakeholders
are described at the level of an organization, group or role, rather than as a specific individual
or political party, because these will change with time. For example, a stakeholder could be
defined as the Department of Health (organization-level) or the Health Minister (role-level)
rather than the particular individual fulfilling the role of the health minister. An example of a
stakeholder group could be Individuals aged 65 years or older.
Approach
This step is based on the knowledge of multisectoral stakeholders developed in Parts 1 and 2.
As this may be a long list, this step should focus on stakeholders for whom the demonstration of
progress and outcomes of eHealth is important in building support and momentum for further
adoption of and investment in eHealth.
Stakeholders for whom eHealth outcomes may be especially important are:
consumers
healthcare providers
Funding bodies, such as social and economic development agencies and other donors, should
also be considered. While they are not direct beneficiaries of eHealth programmes, these bodies
may have stipulated requirements for monitoring implementation progress and the results of
their investment in a national eHealth programme (as part of their provisions of funding).
eHealth
outcome
indicators
eHealth outcomes (from Part 1)
Recommended outputs
This step should describe the expected outcomes (concrete improvements) for each prioritized
stakeholder. These will be based on the eHealth outcomes described in Part 1 of the Toolkit
(Table 1).
Table 1. Examples of eHealth outcomes for stakeholders (non-exhaustive)
Stakeholder
Consumers
Improve the ability of consumers located in rural and remote locations to access primary care
services, and reduce the need to travel large distances to access care.
Enable pregnant women in rural and remote areas to access knowledge and services to assist in
managing their pregnancy.
Enable consumers to access knowledge and services that support early detection and treatment of
preventable communicable and noncommunicable diseases.
Improve care coordination by ensuring their health information can be easily exchanged between
their health-care providers.
Improve access to knowledge resources and support for better management of their chronic
conditions, and their adherance to treatment and medication regimes.
Health-care
providers
Improve the ability of providers to access health information at the point of care.
Improve the ability of providers to exchange patient information with other providers.
Enable providers to access clinical knowledge, evidence and expertise to support skills development
and the delivery of health care within their local communities.
Health-care
managers and
administrators
Support national and regional health authorities to predict and plan for the spread of infectious
diseases.
Enable health authorities to monitor and respond to outbreaks and other emergencies more
effectively and to meet reporting obligations.
Support the education, training and development of the countrys health workforce.
Provide reliable and quality data to inform and monitor the results of clinical, policy, investment and
administrative decisions.
Provide access to quality data sources that inform service and workforce planning and management.
Enable effective management of the supply, distribution and availability of vaccines and essential
medicines.
Health and
medical
researchers
Provide researchers with greater access to evidence-based information to support clinical decisionmaking and treatment design and assessment.
Approach
This step is based on the eHealth outcomes developed during the development of the national
eHealth vision in Part 13. Formulating the vision involved defining a set of eHealth outcomes,
which answered the question of what will be achieved or changed through using eHealth? The
process of developing the vision also involved exploring what each of these eHealth outcomes
would mean for stakeholders4.
This activity should take these eHealth outcomes and refine them where required to describe
the concrete results that the vision is expected to deliver to each stakeholder. The descriptions
should be concrete enough to support the identification of indicators that will allow these
outcomes to be measured.
eHealth
outcome
indicators
eHealth outcomes (from Part 1)
eHealth
output
indicators
eHealth outputs (from Part 2)
The eHealth outputs and associated activities defined in the action plan (Part 2) should be
linked to the eHealth outcomes defined in the previous step.
Recommended outputs
This step should define a set of outputs for each eHealth outcome (Table 2).
Stakeholder
eHealth outcomes
Consumers
Care providers
Health-care
managers and
administrators
Approach
This step is based on the eHealth outputs developed in Part 2 of the Toolkit5.
Some eHealth outputs will be delivered progressively over time (such as the adoption of a
particular eHealth solution by care providers) while others will represent a point in time event.
Recommended outputs
This step should produce a list of the eHealth outcomes and associated outputs that will be the
focus of national monitoring and evaluation efforts.
Approach
This step will require consultation with stakeholders to review and confirm the eHealth
outcomes and outputs that are of particular importance to them. Consultation should focus
on understanding those aspects that must be monitored and evaluated, versus those that
should or could be measured. Typically this discussion will tend to focus more on stakeholder
priorities in the short to medium timeframes.
Once eHealth outcomes and outputs are prioritized, stakeholders should also be consulted
regarding the indicators that they regard as being practical and appropriate to measure.
eHealth output indicators provide information and insight into the adoption of eHealth
eHealth outcome indicators provide information and insight into the results for
stakeholders.
Stakeholders
eHealth
outcome
eHealth
output
eHealth
outcome
indicator
eHealth
output
indicator
N/A
N/A
eHealth outputindicators
Typically, eHealth output indicators are used for those outputs that are delivered progressively,
such as the deployment of data communications infrastructure, or the take-up of standardscompliant software by care providers.
Recommended outputs
This step should produce meaningful indicators that can be used to monitor and evaluate the
results of implementing the eHealth action plan (Table 3).
Table 3. Example of eHealth outcome indicators (non exhaustive)
Stakeholder
eHealth outcomes
Indicators
Consumers
Care providers
Stakeholder
eHealth outcomes
Indicators
Healthcare
managers and
administrators
Table 4 provides examples of eHealth output indicators for the various eHealth outcomes and
associated indicators listed in the above table.
Table 4. Example of eHealth output indicators (non exhaustive)
Stakeholder
Consumers
Care providers
Stakeholder
Health-care
managers and
administrators
Perceptions of issues/challenges
impacting their use of eHealth to
monitor, track and respond to disease
outbreaks and other emergencies
Quantitative indicators minimize the level of ambiguity regarding the results achieved. Some
outcomes require the use of qualitative indicators, which are usually derived from surveys,
questionnaires, feedback and other evaluation mechanisms, and may also allow for greater
insights into the potential cause(s) of divergence from expected results. The choice of indicators
is explored further in the following section.
Approach
This activity requires internal analysis to define a set of candidate eHealth output and outcome
indicators, which can then be confirmed with stakeholders. It also requires working through
each outcome or output, and answering the question of what needs to be monitored or measured
to monitor progress towards that outcome or output.
Consultation with stakeholders should focus on confirming the initial set of candidate
indicators and identifying any others that should be considered. This may include confirming
that indicators meet the criteria that they are observable, reliable and controllable (Table 5).
Subject-matter experts and stakeholders may be consulted on how best to measure a particular
eHealth outcome or output.
Criteria
Meaning
Linked to objectives
Indicators should provide information that can be linked to and support the monitoring and
evaluation of eHealth outcomes and outputs
Quantifiable
Indicators should be concrete, as opposed to conceptual, and should be measurable and easily
expressed in relevant units of measurement
Observable
Measurement data exists (or will exist) that will allow an indicator to be derived
Reliable
The data used for the indicators should not be arbitrarily derived and should reflect accurate,
verifiable information as much as is possible
Controllable
Indicators should measure the results of delivering the eHealth action plan, and should be
selected to control the potential impact of activities that fall outside the scope of the plan
Ongoing and
comparable
Indicators should provide information that is comparable and relevant across periods, rather
than being one time indicators of progress
There is little value in defining a set of indicators where the data do not exist or cannot be
regularly collected, analysed and reported. This step should consider the reality of the countrys
current environment, in particular the challenges or barriers that exist to gathering the required
data. The result of this may be the need to consider using a mixture of quantitative and
qualitative indicators.
In practice, a country will use a mixture of both quantitative and qualitative measures
over the course of implementing the plan. Both types of measures can play a useful role in
understanding whether the desired outcomes and outputs are being delivered, as well as
providing insights into the results obtained. Countries need to ensure that the appropriate skills
and expertise exist to do both types of research.
Chapter 4
Measures
Define indicators
for eHealth
Governance
Define baseline
and target measures
for indicators
Define supporting
governance and
processes
Objective
This stage defines baseline and target measures for each indicator along with the timeframes for
measuring indicators against targets.
Baseline measures provide an understanding of a countrys starting point and assist in defining
realistic and achievable targets, which allow evaluation of the progress in implementing the plan
(i.e. Are we achieving what we set out to achieve?).
Evaluating indicators against targets should occur at regular intervals to ensure that the
programme is delivering tangible results to stakeholders in a timely manner and that potential
problems are identified and addressed as soon as possible.
Activities
Outputs
Agreed baseline and target measures for eHealth output and outcome indicators.
Recommended outputs
This step establishes the intervals for national monitoring and evaluation. Ideally, a single set of
consistent timeframes should be defined for all indicators but this may not always be possible
due to the nature or requirements of a particular indicator.
Approach
Monitoring and evaluation timeframes should align with the implementation phases defined in
the action plan (Figure 7).
Figure 7. Aligning national monitoring and evaluation timeframes with implementation phases
National monitoring and evaluation timeframes
eHealth action plan
Implementation phase 1
Implementation phase 2
Implementation phase 3
Time period
Time period
Time period
For example, a country may define a set of implementation targets that align with the strategys
three implementation horizons, which in turn lead to the definition of quantitative and qualitative
implementation targets for timeframes of 3, 6 and 10 years.
While the implementation phases provide a good starting point, other factors may require using
different timeframes.
Specific stakeholder requirements, such as those related to reporting requirements that may
need to be met as part of the provision of funding.
Political and funding cycles, such as government election terms and national funding cycles
which may influence when reports on the results of investing in eHealth are required.
Level and timing of eHealth implementation activity, which in turn drives when indicators
should be measured. Monitoring and evaluation timeframes have little point if nothing is
expected to be delivered during them. Conversely, periods of very high eHealth activity
may require closer monitoring of particular indicators.
Recommended outputs
This step should identify baseline measures for each eHealth output and outcome indicator,
which represents the value of that indicator at the start of the action plan.
Approach
This step will require research and analysis to determine baseline measures for each indicator.
As a first step, it is suggested that countries determine whether their overall starting position
warrants further effort in identifying a baseline measure for a particular indicator.
For example, consider a government that has defined an eHealth outcome indicator to measure
the percentage increase in the number of primary care-related consultations conducted via
telemedicine. If that country has few or no telemedicine services in place, it may opt to define
a baseline measure for this indicator as zero. A country that has already made substantial
investment in telehealth, however, would need to research and identify an appropriate baseline
measure to allow the results of further investment to be quantified and demonstrated.
Once it has been confirmed that a baseline measure for an indicator is required, a country will
need to analyse historical data that allows a baseline measure to be calculated. If no historical
data is available, the country may need to consider using a proxy source of data to infer a
baseline measure for the indicator.
Examples of potential sources of historical data are shown below.
Advocacy groups
In practice, many countries may not have the people, processes or infrastructure in place to
support the collection of data. They may need to build this capacity over time and incorporate it
into the action plan.
Recommended outputs
This step should produce a set of achievable target measures for each eHealth output indicator
within a given timeframe (Table 6).
Table 6. Illustrative example of target measures for eHealth output indicators
Stakeholder
Consumer
Baseline
measure
(%)
6
Years
10
Years
35
60
80
95
30
50
70
30
50
70
Approach
This step should begin within internal analysis, though it may be extended to involve input
from subject-matter experts and other health experts (Figure 8).
Figure 8. Suggested approach to defining target measures for eHealth output indicators
eHealth output
indicators
Review rationale
and draft target
measures
Stakeholders
and experts
review
Refine target
measures
Internal analysis
Internal analysis should focus on drafting an initial set of targets for each output indicator.
Defining targets is an estimation exercise that considers the various questions below.
Baseline measures and timeframe: What is the starting point for this indicator and what can
be realistically achieved within the monitoring timeframe?
eHealth activities: What other activities (in the action plan) are occurring in the same
timeframe and how will this influence what can be achieved?
External research: What have other relevant national programmes achieved and what
timeframes were associated with this output?
Chapter 4. Define baseline and target measures for indicators page 21
Target measures for other eHealth output indicators: What relationships exist between eHealth
output indicators, and how do target measures that have been defined for other indicators
influence the targets for this indicator?
This step should also take as input the implementation targets that were defined during the
development of the action plan. These targets describe, at a broad level, the targets for each
implementation phase of the plan and may provide direction as to the specific targets for
eHealth output indicators.
This internal activity should establish a set of draft targets for eHealth output indicators,
supported by rationale as to why these measures represent achievable adoption targets.
similar initiatives or change programmes, and the outcomes that these were able to deliver;
other national or international programmes, initiatives or events that may influence the
adoption of eHealth in the country.
The draft indicators should be reviewed in consultation with relevant subject matter experts and
multi-sector stakeholders to refine the targets and ensure that the rationale is sound.
Recommended outputs
This step should produce a set of targets for each eHealth outcome indicator across the
previously defined timeframes (Table 7).
Table 7. Example of target measures for eHealth outcome indicators
Stakeholder
Consumers
Baseline
measure
(%)
6 Years
10 Years
20
40
50
30
50
70
Approach
The process for identifying targets for outcome indicators is similar to that used for output
indicators to identify target measures for eHealth output indicators.
Internal analysis
Internal analysis should focus on drafting an initial set of targets for each eHealth outcome
indicator by considering the questions below.
Related eHealth output indicators: What results can be achieved given the targets that have
been defined for related output indicators?
Baseline eHealth outcome indicator measures: What is the countrys starting point in terms of
the tangible results that are to be measured? Are there results already delivered that need to
be accounted for?
Monitoring and evaluation timeframes: What results can realistically be achieved within the
monitoring and evaluation timeframe?
This internal activity should establish a set of draft target measures for eHealth outcome
indicators which will reflect the tangible results that can be expected, given the rates of
adoption of eHealth anticipated.
Given the level of adoption of an eHealth service or solution, what do they anticipate that
will mean in terms of delivering health services to the population?
Given the change in the ability to deliver health services, what does that mean in terms of
patient outcomes?
Is the proposed target realistic, given the level of adoption anticipated?
The draft list of indicators and rationale should be reviewed with relevant subject-matter experts
and stakeholders.
Chapter 5
Measures
Define indicators
for eHealth
Governance
Define baseline
and target measures
for indicators
Define supporting
governance and
processes
Objective
This stage defines the governance and processes through which the actors and levels are all
brought together for monitoring and evaluation of eHealth.
Activities
Outputs
Function
Purpose
Responsible Party
Monitoring oversight
and steering
Health Department
departmental executive
committee
Project management
National indicator
development
National measures
definition
National capability
development
Activity monitoring
and evaluation
Health Departmentperformance
management business unit
Health sector
monitoring and
evaluation
Health Departmentperformance
management business unit
Non-health sector
monitoring and
evaluation
Health DepartmenteHealth
programme management office
Collate and analyse activity, health sector and nonhealth-sector reporting to report against national
indicators and targets, and identify where corrective
actions may be required.
Cross-sector coordination
authority or committee
Non-health-sector infrastructure
and service providers
Function
Purpose
Responsible Party
Expert support
Research
Recommended outputs
The step should produce a definition of the governance model required to monitor and evaluate
eHealth. It should identify and describe:
A governance mechanism is a committee, council, team or special group that has the mandate
or responsibility to perform one or more of the functions described. The composition of a
governance mechanism should be the best available to carry out this mandate or responsibility
(Figure 9).
Figure 9. Sample governance model for national monitoring and evaluation
Health sector leadership
Programme
management
Action plan
eHealth project
National
monitoring
and evaluation
function
Subject-matter experts
Multi-sector
stakeholders
External eHealth projects
(dependencies)
eHealth project
eHealth project
In the above example, the responsibility for monitoring and evaluation at a national level
belongs to the national monitoring and evaluation function. This complements programme
management, and provides an independent view of eHealth adoption and associated results
to the programme steering committee. This function could be implemented as a new
organizational group, or could sit within an existing government entity or eHealth agency.
Alternatively, it could be contracted to a professional services firm.
Chapter 5. Define supporting governance and processes page 26
Individual eHealth projects, including external projects on which the action plan is dependent,
are responsible for monitoring their own progress within the overall national framework. External
projects include those undertaken outside the scope of the national action plan (Table 9).
The framework enables the rolling up of project level performance into the defined output and
outcome indicators.
Table 9. Role of governance mechanisms as they relate to national monitoring and evaluation
Mechanism
Responsibilities
Health sector
leadership
Acting as the vocal and visible champion of the national eHealth work programme
Accountable for the delivery of national eHealth adoption and associated results
National eHealth
programme
steering committee
--Reviewing and endorsing national indicators, measures, and monitoring and evaluation
timeframes
--Assisting in resolving risks, issues and conflicts related to monitoring and evaluation
--Reviewing and endorsing recommendations on corrective actions to the programme to
address divergences between actual and target targets
--Ensuring targets are being achieved and that corrective actions are being made to the
eHealth work programme to resolve divergences.
Programme
management
Ensuring monitoring and evaluation processes and tools are aligned and integrated with
broader programme management processes and tools
Working with the national monitoring and evaluation function to identify options for taking
corrective action to address divergences between actual and target indicator measures
Undertaking corrective actions that have been endorsed by the programme steering
committee
National monitoring
and evaluation
function
Project management (i.e. daytoday management of activities, progress, financials, risks and
issues)
Liaising with subject matter experts and stakeholders to gain input into the definition of
indicators and baseline/target measures for indicators
Develop and communicate processes, schedules, templates, etc., for the operation of the
national monitoring and evaluation process
Collate and analyse activity, health-sector and non-health-sector reporting to assess against
national indicators and targets, and identify where corrective actions may be required
Provide expert support in the monitoring, analysis and evaluation of eHealth adoption and
associated results
Provide broader analytical capabilities to support monitoring and evaluation, including the
provision of data and insights from other national programmes
Subject matter
experts
Provide input into the definition of and insights into the achievability of the draft target
measures for indicators
Provide input into corrective actions that may be appropriate to address divergence
Multi-sector
stakeholders
Provide input into the definition of and insights into the achievability of the draft target
measures for indicators
Provide input into corrective actions that may be appropriate to address divergence
Define eHealth output and outcome indicators and targets aligned to national indicators and
targets
Mechanism
Responsibilities
External eHealth
projects on which
the action plan is
dependent
Define eHealth output and outcome indicators and targets aligned to national indicators and
targets
Same as per External eHealth projects except that their focus is on the eHealth outputs and
outcomes within a particular part or segment of the countrys health sector
Same as per External eHealth projects except that their focus is on the adoption eHealth
outputs and outcomes in other sectors (e.g. ICT industry), and broader social and economic
development linked to eHealth
Approach
A suggested approach for defining a governance model for national monitoring and evaluation
involves a number of steps.
engagement and influence: the ability of that mechanism to engage with, influence and
consult with stakeholders;
Defining a pragmatic governance model that will deliver the required governance
functions, taking into account the existing governance mechanisms that can be used, and
new mechanisms that need to be developed to address gaps. The role and responsibilities of
each governance mechanism, and the nature of the relationships and interactions between
them, also need to be clearly defined.
Recommended outputs
This step should produce a description of the national process for monitoring and evaluation
of eHealth during the implementation of the action plan, including the governance required to
ensure that it will be done (Figure 10).
Figure 10. Example of a national monitoring and evaluation process
Inputs
eHealth output and outcome indicators
Monitoring and evaluation timeframes
Baseline and target measures for indicators
Governance model (mechanisms, roles, responsibilities)
Planning
and
initiation
Refinement
Execution
and
measurement
Corrective action
planning
Agree corrective actions to address
divergence between target and actual outcomes
Implement eHealth
activities and measure
their impact and results
Progress analysis
and reporting
Analyse and report on actual versus target
eHealth adoption and results
Approach
Defining a pragmatic monitoring and evaluation process is a complex undertaking, particularly
for large-scale eHealth programmes in which many parties will be involved.
Table 10. Example of national- and activity-level monitoring and evaluation activities
Process
National-level (non-exhaustive)
Activity-level (non-exhaustive)
Planning and
initiation
Execution and
measurement
Progress analysis
and reporting
Corrective action
planning
Review and gain endorsement programmelevel corrective actions with the programme
steering committee
Refinement
Chapter 6
Conclusion
This Toolkit has been developed as a guide to assist countries to develop a national eHealth
vision, an action plan to achieve that vision, and a framework by which results can be
monitored and evaluated. Like all strategies and plans, the outcomes of this Toolkit are not
static and represent a point-in-time understanding of what a country needs to achieve in
order to address its particular goals and challenges. For example, the various eHealth visions,
strategies and plans that are referenced in Annex C represent a point-in-time view for each of
the countries that developed them.
Changes in a countrys strategic context will require a dynamic approach to updating the
vision for eHealth and the associated action plan so that they remain relevant. This requires
understanding the key triggers for refreshing the vision and action plan, whether they be
specific events that change a nations strategic context for eHealth or a defined period of time
after which a revision is required.
Ongoing engagement with essential health and non-health stakeholders must also be
maintained. Success in implementing a national eHealth vision is heavily dependent on having
the continued support and guidance of stakeholders, and thus does not stop after a national
strategy has been developed.
Continued communication is also vital. Part 3 has emphasized that stakeholders should be
regularly informed of the progress of the programme, and in particular, any impacts or results
arising from implementation. This ensures transparency, which is essential in maintaining
stakeholder support and momentum for further activity and investment in eHealth.
Annex A
Results-based management
Results-based management (RBM) has become increasingly important for the United Nations
and its specialized agencies as they have sought to improve their ability to respond to new
demands within the limits of resource constraints, and to demonstrate that they have delivered
on expectations. It is also of direct relevance to the establishment of monitoring and evaluation
for a national eHealth programme.
Indicator of
achievement
Expected
accomplishment
Results
achieved
Verification of
results
Output
Activity
Planning
Management
Input
Results-based management is both a planning process from the top down and a management
process in the reverse direction. Planning starts with defining objectives future end-states,
deciding what accomplishments are expected if the objective is to be achieved, determining
which outputs will lead to those accomplishments, defining the activities necessary to produce
those outputs and, finally, identifying the inputs that are necessary to carry out the activities.
The management process is exactly the opposite. The inputs are acquired and deployed to carry
out the activities, the activities lead to the production of outputs and, if they are well designed
and executed, the output will lead to the expected accomplishments (or expected results)
(Table 11).
Table 11. Monitoring and evaluation concepts
Concept
Meaning
Objective
An overall desired achievement involving a process of change aimed at meeting certain needs of
identified end-users within a given period of time (i.e. is the situation that would be observed at
the end of a specific period).
Expected
accomplishment
Indicator of
achievement
The measures of whether and/or the extent to which the objectives and/or expected
accomplishments have been achieved. They correspond either directly or indirectly to the
objective or the expected accomplishment for which they are used to measure performance. All
results should have a corresponding indicator of achievement.
Results achieved
The actual outcome that delivers benefits to end-users, expressed as a quantitative or qualitative
standard, value or rate. It describes what has actually been achieved.
Verification of
results
The actual measures that demonstrate that a particular result has been achieved.
Output
Activity
Input
Personnel and other resources necessary for producing outputs and achieving accomplishments.
Inputs are the objects of expenditure that are used to undertake activities.
monitoring is the continuing function of collecting data indicating the extent of progress
and achievement of objectives, and progress in the use of allocated funds;
evaluation is the process that seeks to determine as systematically and objectively as
possible the relevance, effectiveness and impact of an activity in light of its goals, objectives
and accomplishments.
The focus of M&E is best demonstrated by understanding its relationship to the key concepts
that were introduced in the previous section (Figure12).
Implementation
Programme
inputs
Results
Programme
activities
eHealth
outputs
Attribution
Measure execution of integrated action plan
eHealth
outcomes
Impact
Contribution
Measure change delivered
Monitoring and evaluation framework
Are we on the right track?
Programme management
Are we on track?
reviewing performance indicators to ensure that they are pragmatic, simple and achievable;
determining when the programme will be evaluated, which may be at specific times in the
programme or at other key events in the programme (e.g., problem is perceived, results are
supposed to have happened);
planning for the collection of information to support evaluation, including:
data sources
collection method
baseline data for performance indicators
time required for collection
responsible organization/personnel;
Annex B
Country
Type
Link
Published
Australia
http://www.health.gov.au/internet/
main/publishing.nsf/content/
national+Ehealth+strategy
September
2008
Australia
http://www.health.qld.gov.au/
ehealth/docs/eh_strat_public.pdf
September
2006
Denmark
http://www.sst.dk/publ/Publ2004/
National_IT_strategy.pdf
2003
http://www.epractice.eu/en/
library/310063
2007
European Commission,
DG Information Society
and Media, ICT for
Health Unit
http://www.ehealthnews.eu/
publications/latest/2494-european-countries-on-theirjourney-towards-national-ehealthinfrastructures
January 2011
European Commission,
DG Information Society
and Media, ICT for
Health Unit
http://ec.europa.eu/information_
society/activities/health/docs/
policy/ehealth-era-full-report.pdf
2007
European Commission
http://www.ehealth-era.org/
database/database.html
N/A
Finland
http://www.stm.fi/en/publications/
publication/_julkaisu/1056833
2007
Kenya
http://svn.who-mahler.net/hcicontent/ethiopia/lib/exe/fetch.
php?media=workshops:ethiopia
:kenya_final_national_ehealth_
strategy_2011-2017_.pdf
2011
Mauritius
http://www.gov.mu/portal/goc/
moh/file/plan.pdf
2010
Saudi Arabia
http://www.moh.gov.sa/en/
Ministry/nehs/Pages/default.aspx
2011
Scotland
http://www.scotland.gov.uk/
Publications/2011/09/09103110/9
September
2011
Sweden
http://sweden.gov.se/
sb/d/574/a/64324
2006
Country
Type
Link
Published
Switzerland
http://www.hpm.org/en/Surveys/
USI_-_Switzerland/11/Toward_
one_national_e-health_strategy.
html
2007
BAG/National Ministry of
Health
Switzerland Country Brief: eHealth
Strategies
2010
http://ehealth-strategies.eu/
database/documents/Switzerland_
CountryBrief_eHStrategies.pdf
http://healthit.hhs.gov/portal/
server.pt?open=512&objID=1211&
parentname=CommunityPage&pa
rentid=2&mode=2
March 2011
Annex C
Term
Definition
Part I:
eHealth outcomes
What will be achieved or changed through using eHealth, and how will
the health system and services change by:
Establishing a
national eHealth
vision
National eHealth
environment
eHealth components
Strategic
recommendations
Part II:
Action Lines
Developing an
eHealth action plan
Broad areas to group national activities of similar focus and intent that
are required to deliver a nations eHealth vision
eHealth Outputs
Activities
Output indicators
Part III:
National eHealth
monitoring
and evaluation
guidelines
Outcome indicators
Indicators that provide insights into the tangible results for stakeholders
that arise from the adoption and use of eHealth