Nasa Fy2020 Volume of Integrated Performance PDF
Nasa Fy2020 Volume of Integrated Performance PDF
Nasa Fy2020 Volume of Integrated Performance PDF
FY 2020
Volume of Integrated Performance
FY 2018 Annual Performance Report
FY 2019 Annual Performance Plan Update
FY 2020 Annual Performance Plan
www.nasa.gov
Letter from the Chief Financial Officer
I have learned a lot about NASA and working in the Federal Government since I arrived at the Agency back in
April 2018. I have learned that working in Washington, D.C., means adapting to a culture unlike any I have ever
experienced, to include a lifetime’s worth of acronyms. What I have enjoyed most has been learning from the peo-
ple across NASA as they plan new missions, build hardware, conduct testing, analyze scientific data, and assess
ongoing business operations to become more efficient. I have had the pleasure of seeing NASA accomplish
amazing achievements against the most challenging odds. I have also experienced the pain when something did
not go as well as we wanted it to, when we had to dig in, learn what went wrong, and figure out how we are going
to fix it.
In the process, I have also learned something about the NASA family. We aim high and our successes are simply
phenomenal. We recently landed Insight on the surface of Mars, an instrument we will use to study the core of the
planet by creating mini “Mars-quakes.” The engineering it takes to land on Mars is as impressive as the spacecraft
itself, as well as the scientific knowledge we will gain as Insight continues sending data back to Earth. In FY 2018,
we launched the Parker Solar Probe, our first ever attempt to “touch the Sun,” and TESS, which will study extra-
solar planets as never before. Our scientists found evidence of what could be liquid water on Mars, and we
launched Earth observing satellites—GRACE-FO and ICESat-2, which will use different techniques to observe
the changing landscape of Earth. Our commercial partners saw some amazing successes too, like the SpaceX
Falcon Heavy test launch. Working with our partners, we developed plans and contracted with Boeing to develop
a quieter supersonic aircraft. It really has been an amazingly successful year.
In FY 2018, we also had the opportunity to learn from our mistakes. As a bunch of “top of the class students,” we
do not give up on a good idea when things go wrong. We study, we analyze, we reassess, and we rework our
plans with the knowledge we have gained. This year, we learned valuable lessons on managing our largest mis-
sions—the really complex efforts that pose science and engineering challenges that come with the first attempt to
do anything completely new. For example, the James Webb Space Telescope Independent Review Board high-
lighted technical challenges that we could have worked differently. Importantly, the findings also included lessons
that we can apply to all of our work—that we can more actively and aggressively manage our contracts, we can
better understand and manage risk, and we must better communicate within the Agency and with our partners
and stakeholders. Can NASA apply these lessons? Of course. Will we apply these lessons? Absolutely!
In the FY 2020 Volume of Integrated Performance, NASA presents a performance framework for how the Agency
will accomplish its Mission. Our strategic goals, as outlined in the NASA 2018 Strategic Plan, are supported by
strategic objectives, multi-year performance goals, and annual performance indicators against which we can
measure steady progress of our scientific and engineering ventures. The document also demonstrates how our
FY 2018 performance fared compared to our plans and expectations. It also describes some of the approaches
the Agency will take to strengthen our activities in acquisition management, cost and schedule estimating, and
management and control. We are committed to stewardship of taxpayer dollars, to safety, and to security. We
must do better in areas that have traditionally been challenging to manage, and with our new action plans in
place, we will.
You will see the Agency’s commitment to “doing better” throughout the FY 2020 Volume of Integrated
Performance. We have updated our plans and milestones for the Lunar Gateway, an early step in using the Moon
as a testing ground for eventual human exploration of Mars and beyond. We are strengthening our planning for
the Space Launch System and Exploration Mission-1, applying management lessons learned in development of
NASA’s heavy-lift Earth-to-space transport. We have reprioritized our technology investments, seeking better and
more efficient solutions for exploration. We are aggressively managing research aboard the International Space
Station, applying what we learn to protect human health for future long-duration space travel. We are reworking a
plan to complete and launch the James Webb Space Telescope, a long-standing priority of astrophysicists seek-
ing answers to the mysteries of the universe. Finally, we have renewed our intent to serve national interests by
more thoughtfully managing all of our contracts, grants, investments, and partnerships.
I have been NASA’s Chief Financial Officer for almost a year now. My team has come to know that I like to chal-
lenge the old ways of doing things, to ensure that what we are doing is a “value add” to the Agency, and to identify
better and more effective ways of working. I have learned since last April that we do have the right goals, as out-
lined by the National Space Council and the Administration. I have also seen that we have the right tools in place
to do the job, and more importantly, we have the right workforce—an extremely capable and dedicated corps of
people committed to mission success.
I am proud to release NASA’s FY 2020 Volume of Integrated Performance. This document represents the perfor-
mance plan that ties directly to NASA’s FY 2020 Budget Estimates. In this volume, we have applied the Agency’s
continuous learning and improvement philosophy as we upgraded several features of this year’s report. For
example, we have condensed and tightened up several of the performance goals to remove functional stovepipes
and foster cross-pollination of ideas and infrastructures. We have also revised several of our narrative sections
to better show how our performance investments and activities interconnect and come together as a system of
measures, assessments, and evaluations. These feedback loops progressively drive the Agency to an ever-higher
level of achievement and accomplishment.
We view it as an honor that we have been chosen, on behalf of the Nation, to pursue the exploration of space and
the advancement of science and aeronautics.
Jeff DeWit
Chief Financial Officer
Overview
FY 2018 Performance The National Aeronautics and Space Administration’s (NASA’s) FY 2020
Volume of Integrated Performance1 reports on performance over the
Overview course of the last fiscal year (2018), provides the performance plan for the
Performance Goals current fiscal year (2019), and presents the initial performance plan for the
coming budget year (2020). The information reported in this document is
90% achieved or on track aligned with the performance framework established by the NASA 2018
Strategic Plan and aligns with NASA’s FY 2020 Budget Estimates,2 in
accordance with the requirements of the Government Performance and
9% slightly behind schedule or
below target Results Act (GPRA) Modernization Act of 2010. This information provides
a holistic view of NASA’s past, present, and future performance, grounded
1% significantly behind sched-
ule or below target
in sound management practices, rigorous internal and external review and
evaluation, and proactive management of risks and challenges.
Annual Performance Indicators
Executive Summary
89% achieved or on track
In February 2018, NASA unveiled a new strategic plan to guide a new
era of exploration and discovery. This report summarizes the results of
9%
slightly behind schedule or
below target
NASA’s first year executing the performance framework introduced in the
strategic plan. NASA’s strong management of operational and business
activities is reflected in performance assessments. Management of small
2% significantly behind sched-
ule or below target research and development missions and projects also shows steady
positive performance, almost across the board. Development of a com-
mercial space industry through cooperation with commercial partners was
1 The FY 2020 Volume of Integrated Performance is produced by NASA’s Office of the Chief
Above: A structural test version of the inter- Financial Officer with contractor support provided by Deloitte Consulting LLP.
tank for the Space Launch System arrives
at the Marshall Space Flight Center aboard 2 NASA’s FY 2020 Budget Estimates, which combines the President’s budget request and
the barge Pegasus on March 7, 2018. the budget justification, can be found on NASA’s Budget Documents, Strategic Plans and
Image credit: NASA/Emmett Given Performance Reports website.
Document Organization
■■ Part 1–Performance Management at NASA
summarizes how NASA conducts performance. It
provides an overview of the strategic framework
established in the NASA 2018 Strategic Plan.
Above: The USS John P. Murtha recovers the test version of
It describes how the Agency manages perfor- the Orion capsule at sunset in the Pacific Ocean. This is one
mance and uses data, evidence and evaluations, in a series of tests that will verify and validate procedures and
and reporting. Part 1 also discusses how NASA hardware that will be used to recover the Orion spacecraft after
it splashes down in the Pacific Ocean following deep space
is addressing identified management challenges
exploration missions. Image credit: NASA
and high-risk activities.
■■ Part 2–Performance Planning and Reporting
presents NASA’s FY 2018 Annual Performance
Report, the FY 2019 Annual Performance Plan Summary of Changes from
Update, and the FY 2020 Annual Performance
Plan organized by strategic goal and strategic the FY 2019 Volume of
objective, including the summary of progress
stemming from the 2018 Strategic Reviews for
Integrated Performance
each strategic objective. Each strategic objective
includes performance goals and annual perfor- The FY 2020 report includes some significant differ-
mance indicators, their FY 2018 performance ences from the prior year’s volume.
ratings, as well as rating explanations for the
performance goals. Depending on when they NASA Reorganization
started, measures show five years of historical
performance ratings alongside the two years of ■■ The Space Technology Mission Directorate did
plans for future performance goals and annual not provide a performance plan for FY 2018
performance indicators. Where NASA did not or 2019 in the FY 2019 Volume of Integrated
achieve its target or milestone for a performance Performance, as NASA was anticipating a
goal or annual performance indicator, an expla- reorganization for their activities. NASA is in the
nation describes why the target wasn’t met, and process of realigning components of its space
when appropriate, the corrective actions the technology development activities to better lever-
Agency intends to take to complete the target or age synergies across organizations, which prom-
milestone. ises to better enable deep space exploration.
As planning and implementation of the reorga-
■■ Appendices include two elements. The first nization is now underway, this document reports
is Changes to the FY 2019 Performance Plan. upon progress for a set of intermediate perfor-
The second appendix, Data Quality Elements, mance measures selected at the beginning of
provides the verification and validation informa- FY 2018, NASA’s current Performance Plan for
tion supporting the performance goals reported FY 2019, and FY 2020 to support exploration-fo-
in Part 2. cused goals. These plans may be later updated
■■ NASA’s Statement of Assurance is available to reflect closer alignment with the reorganiza-
online in the FY 2018 Agency Financial Report. tion as necessary. Performance information is
included under Strategic Objective 3.1. A further
discussion of the new organization is provided in
NASA’s FY 2020 Budget Estimates.
Table of Contents
Above: An Orbital ATK Antares rocket, with the Cygnus spacecraft onboard, is seen on the launch pad at NASA’s Wallops Flight Facility on
November 11, 2017. Image credit: NASA/Bill Ingalls
Appendices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
NASA’s Orion spacecraft test article that flew on the uncrewed Exploration Flight Test-1 on December 5, 2014, is seen on the south
lawn of the White House during a “Made in America” product showcase on July 23, 2018, in Washington, DC. NASA and prime
contractor, Lockheed Martin, are working on a more complete spacecraft to fly aboard the uncrewed Exploration Mission-1. More
than 1,000 companies from across the the United States have manufactured or contributed elements to the spacecraft. Image credit:
NASA/Aubrey Gemignani
Foundations of Performance
Vision For six decades, NASA has led the peaceful exploration of space,
To discover and expand knowl- advancing knowledge of Earth while making discoveries about the fur-
edge for the benefit of humanity. thest reaches of the universe. NASA research has advanced aeronautics,
helped develop the commercial space industry, and strengthened the U.S.
economy.
Mission
Lead an innovative and sustain- NASA’s continued success is predicated on a solid foundation of perfor-
able program of exploration with mance. The Agency uses common business and development practices
commercial and international to proactively establish expectations and assess and improve perfor-
partners to enable human ex- mance on an ongoing basis. These practices are strengthened by the
pansion across the solar system Agency’s diversity in technical and operational expertise. NASA uses data
and bring new knowledge and and evidence to inform investment decisions at all levels, from day-to-day
opportunities back to Earth. operations to selecting major missions and establishing the necessary
Support growth of the Nation’s infrastructure to pursue goals that may take a generation, or longer, to
realize.
economy in space and aeronau-
tics, increase understanding of NASA is transparent in these efforts, complying fully with requirements
the universe and our place in it, on performance reporting and accountability, in accordance with the
work with industry to improve Government Performance Results Act (GPRA) Modernization Act of 2010.
America’s aerospace technol- NASA’s commitment to performance reaches further than compliance.
ogies, and advance American The Agency has an ingrained culture of self-evaluation and continuous
leadership. improvement, using findings from these studies and assessments to
improve the Agency is the short term, and position NASA for long-term
success and sustainability.
The NASA 2018 Strategic Plan outlines NASA’s plans for the future,
provides a clear and unified direction for all of its activities, and sets the
Above: The crew of the International
foundation on which the Agency can build and measure the success of its
Space Station (ISS) snapped this image of programs and projects. This direction is captured in NASA’s Vision and
the full Moon on April 30, 2018, as the ISS Mission statements—why NASA exists, what it aspires to achieve, and
passed over the coast of Newfoundland, how it expects to make a difference that benefits all Americans.
Canada. Image credit: NASA
Discover
Expand human knowledge through new scientific discoveries.
Strategic Themes and
Goals Explore
Extend human presence deeper into space and to the Moon for
NASA’s Mission is aligned to four major sustainable long-term exploration and utilization.
themes, characterized by a single word,
that are reflected in the Agency’s activi- Develop
ties. These four themes are described in
more detail in the NASA 2018 Strategic Address national challenges and catalyze economic growth.
Plan.
Enable
Optimize capabilities and operations.
Strategic Goals are far-reaching and ambitious. Forming the top of the strategic plan
Set in the Strategic Plan
framework, strategic goals articulate clear statements of what the Agency wants to
achieve to advance its Mission.
Performance Goals span two to five years and measure the performance of investments
towards strategic objectives and strategic goals.
Agency Priority Goals, a subset of performance goals, receive additional senior management
focus and have additional reporting to external stakeholders. Agency priority goals represent
NASA’s high-priority, high-profile programs.
Annual Performance Indicators describe the smaller, achievable measurements that serve as
NASA’s basic unit of performance measurement. They reflect progress achieved during the budget
year, and NASA uses them to assess progress made towards achieving the performance goals.
Cross-agency priority goals focus on major Administration priorities that benefit from collaboration
across multiple Federal agencies. NASA contributes to cross-agency priority goals through relevant
annual performance indicators.
Annual Performance Plan matic changes that have occurred since the plan was
originally submitted the year before. Updates to the
FY 2019 Performance Plan are integrated into Part 2,
The Annual Performance Plan builds on the strategic
with a list of changes located in Appendix A.
plan framework by adding multi-year performance
goals and annual performance indicators to the
strategic goals and objectives set in the NASA Cross-Agency Priority Goals
2018 Strategic Plan. NASA develops its Annual
Performance Plan in concert with the upcoming The President’s Management Agenda, released
fiscal year budget request. The performance goals on March 20, 2018, set a plan for modernizing and
and annual performance indicators include targets reforming the Federal Government centered around
and key milestones that reflect the contents of the three key areas for improvement: modern information
budget at the program and project level. The Annual technology; data, accountability, and transparency;
Performance Plan is released to the public on the and the workforce for the 21st century. Cross-agency
same date that the Administration releases the annual priority goals have been created to implement the
President’s budget request. Part 2 includes the President’s Management Agenda and address these
FY 2020 Performance Plan. three key areas. Cross-agency priority goals drive
cross-government collaboration to tackle govern-
Annual Performance Plan Update ment-wide management challenges affecting most
agencies.
In addition to performance planning for the budget Although NASA does not lead any cross-agency
year, NASA also evaluates the performance goals priority goals, NASA’s improvements feed into several
and annual performance indicators included in the measures. Per the GPRA Modernization Act require-
Annual Performance Plan. The performance plan is ment to address cross-agency priority goals in the
issued with the previous fiscal year’s budget (i.e., the Agency strategic plan, the Annual Performance Plan,
FY 2019 Performance Plan) to ensure that the plan and the Annual Performance Report, please refer to
still accurately reflects the budget and programmat- Performance.gov for the Agency’s contributions to
ic plans. NASA may revise performance measure those goals and progress.
descriptions, add new measures, or delete unneeded
measures due to strategic, budgetary, or program-
Responsible
Agency Priority Goals and Statements Program FY 2018 Rating
1.1.15: Deliver the Mars 2020 instrument payload for spacecraft integration.
Green
Explore a habitable environment, search for potential biosignatures of past life,
collect and document a cache of scientifically compelling samples for eventual Mars
return to Earth, and contribute to future human exploration of Mars. By August 5, Exploration
2020, NASA will launch the Mars 2020 rover. To enable this launch date, NASA On track to com-
Program, SMD
will deliver the instrument payload for spacecraft integration by September 30, plete all milestones
2019. by planned launch
date
2.2.1: Achieve critical milestones in development of new systems for the Exploration Yellow
human exploration of deep space. Systems
Development,
By September 30, 2019, NASA will conduct the Ascent Abort-2 test of the Orion
Human
Launch Abort System, perform the green run hot-fire test of the Space Launch One milestone
Exploration
System’s Core Stage at the Stennis Space Center, and roll the Mobile Launcher delayed; no antic-
and Operations
to the Vehicle Assembly Building to support the start of Exploration Mission-1 ipated impact on
Mission
stacking operations.
Explore
2.2.3: Use the International Space Station (ISS) as a testbed to demonstrate Green
the critical systems necessary for long-duration missions. Between October International
1, 2017, and September 30, 2019, NASA will initiate at least eight in-space Space Station
demonstrations of technology critical to enable human exploration in deep Program,
On track to achieve
space. HEOMD
target
4.2.2: Facilitate the development of and certify U.S. industry-based crew Yellow
transportation systems while maintaining competition.
Commercial
Enable
By September 30, 2019, the Commercial Crew Program, along with its industry Two milestones
partners, will complete at least one Certification Review, following un-crewed and Crew Program, delayed; no antic-
crewed test flights to the ISS. HEOMD ipated impact on
agency priority goal
completion
accordance with the update to Office of Management NASA developed a five-year PMIAA strategic imple-
and Budget (OMB) Circular A-123, and its update mentation plan and delivered it to OMB for review on
M-16-17, and Circular A-11. NASA’s governing coun- November 30, 2018. NASA expects the document to
cils serve as the Agency’s risk management platform be finalized in late 2019.
and the Chief Operating Officer serves as the senior
official accountable for risk management. Oversight and Accountability
While NASA cannot mitigate all risks related to achiev-
ing its strategic goals and objectives, the Agency is In setting goals and establishing plans to achieve
using these risk-management strategies to identify, mission success, NASA leaders rely on information
measure, and assess challenges related to mission from multiple sources. Rigorous independent assess-
delivery to the greatest extent possible. Enterprise risk ments, both internal and external to the Agency, are
management is integrated with the Strategic Review an essential tool in ensuring the integrity of data nec-
process, providing an analysis of the risks and oppor- essary to make well-informed investment decisions.
tunities NASA faces towards achieving its strategic Independent verification and validation in planning
objectives. and executing work provides greater confidence in
performance during development and execution, and
improves expected outcomes. In many cases, these
Program and Project assessments include a routine measure of progress
Management for Executive against a predetermined set of indicators or other
targets that effectively establish an “early warning
Agencies system” so that deviations can be more quickly and
easily addressed.
The Program Management Improvement
Accountability Act of 2016 (PMIAA) established Governance Councils
requirements to strengthen program and project
management within Federal agencies. As a research NASA has three Agency-level councils that establish
and development agency, NASA uses the core strategic direction and provide oversight of Agency
concept of cost, schedule, and program and project activities. The Executive Council focuses on major
management to assess performance during the devel- Agency-wide decisions by providing strategic guid-
opment phase. NASA has established a Program ance and top-level planning. The Mission Support
Management Improvement Officer and a permanent Council is a functional council focused on mission-en-
program management working group to address abling decisions, threshold operational decisions,
PMIAA requirements and develop implementation and internal controls as well as liability. The Program
plans. NASA has met the direct requirements for Management Council is an integral part of NASA’s
PMIAA, and contributes to national goals. program and mission decisions, ensuring acceptable
■■ Assigning a Program Management performance as programs reach key decision points,
Improvement Officer. This senior official will and to determine the readiness of a program or proj-
implement program management policies and ect to progress to the next phase of the life cycle.
develop strategies to enhance the role of pro- The Senior Management Council, a fourth council
gram management throughout the Agency. comprised of NASA senior leaders, provides advice
■■ Federal standards for program and proj- and counsel to the Executive Council on Agency
ect management. OMB provided additional issues and input on the formulation of Agency strate-
PMIAA guidance, requiring development gy.
of common, principle-based Government-
wide program management standards. Technical Authorities
■■ Training and development. PMIAA recog- NASA has several technical authorities to ensure
nizes program and project management as independent oversight of critical performance areas
a specialized skill set, requiring training and that affect numerous organizations and activities
development. NASA will continue to implement across the Agency. These senior officials have direct
a variety of formal and informal practices to lines of reporting to the Administrator, ensuring work
continue employee development in this area. on these priority areas adheres to Agency policy and
performance standards. NASA’s technical authorities
are responsible for safety and mission assurance,
engineering, and health and medical issues. Approval
ations, customer satisfaction, and efficiency. These peer review for publication in professional journals.
measures typically include improvements in output NASA often leverages internal and external evalua-
or capacity, increased customer satisfaction, or other tors to assess specific initiatives for benefit, cost, and
quantifiable estimates of improvement, such as to overall impact.
reduce spending on unscheduled maintenance by at
least one percent annually on NASA’s equipment for External Advisors
maintenance and testing.
The NASA Advisory Council provides the NASA
Administrator with recommendations on major issues
Performance Results at Work related to programs, policies, plans, financial con-
trols, proposed associate administrators, and other
NASA actively promotes a strong culture of achiev-
matters pertinent to the Agency’s responsibilities. The
ing results, and leaders rely on data from numerous
Aerospace Safety Advisory Panel evaluates NASA’s
sources as they establish plans and make decisions.
safety performance and advises the Agency on ways
to improve performance. The panel bases its advice
Internal but Independent Cost and on direct observation of NASA operations and deci-
Schedule Estimating sion-making.
NASA employs independent analysts with specialized NASA’s Science Mission Directorate has goals
skills to engage in formative planning with mission that reflect broad scientific objectives, such as
managers throughout the mission development “demonstrate progress in improving the capability
process. These analysts help mission planners to craft to predict weather and extreme weather events.” To
and manage to realistic cost and schedule estimates, measure progress toward achieving these goals,
but also provide an independent perspective in estab- the Science Mission Directorate uses five Science
lishing baselines and stakeholder expectations. Other Advisory Committees managed under the Federal
analysts use earned value management expertise Advisory Committee Act: Astrophysics Advisory
to help mission planners establish meaningful mile- Committee, Earth Science Advisory Committee,
stones for performance for acquired products and Heliophysics Advisory Committee, Planetary Science
technology. Advisory Committee, and Applied Sciences Advisory
Committee. The committees are comprised of subject
External Independent Verification and matter experts in each scientific discipline. Among
Validation of Flight Software other duties, the committees assess mission results,
published peer-reviewed science, and progress on
Independent verification and validation are part of an mission development to recommend performance
Agency-wide strategy to provide the highest achiev- ratings to NASA management.
able levels of safety and cost-effectiveness for mis-
sion critical software. Overseen by the Office of Safety NASA receives expert advice from the National
and Mission Assurance, the Independent Verification Academies of Sciences, Engineering, and Medicine,
and Validation Program applies system and software which guides planning and helps ensure that the
engineering best practices to evaluate the correctness Agency’s research and development priorities align
and quality of critical and complex software systems with the needs of the exploration and science com-
throughout the software’s system life cycle. munities. The National Academies lead a series of
decadal surveys and other analyses that help inform
Peer and Subject Matter Expert Agency decisions on the balance and direction of
the Science Mission Directorate’s investment port-
Community Review folio. These decisions are reflected in the Annual
NASA relies on evaluations by external communities Performance Plan.
with expertise in areas of major scientific and academ-
NASA’s Aeronautics Research Mission Directorate
ic disciplines. The Agency uses external peer review
enlists experts in the aeronautics community to
panels to objectively assess and evaluate proposals
assess progress along six major research thrusts,
for new work in science, technology, and education.
ensuring that NASA is developing and maturing
The Science Mission Directorate also draws from
the technologies and capabilities according to the
external senior scientist reviews when determining
Agency’s aviation research agenda. See the NASA
either operational extension or closeout for a science
Aeronautics Strategic Implementation Plan for more
mission that has completed its objectives. Papers
information.
from NASA-supported research undergo independent
NASA’s commitment to good governance and stewardship of taxpayer funds means that the Agency routinely
conducts internal assessments and evaluations to aid in maintaining, managing, and improving operations.
Periodic external assessments also focus management attention on areas of high risk or potential difficulty. The
Government Accountability Office (GAO) and the NASA Office of Inspector General (OIG) conduct such external
assessments, identifying trouble spots, and formulating recommendations for addressing them. Issues raised by
the GAO and OIG represent high-priority areas for strategic rework or management attention.
A summary of the challenge areas, recently identified by GAO and OIG, are included below. Each is followed by a
short description of actions to be implemented by the Agency. For each, NASA has identified strategic objectives
that will contribute to the mitigation of these challenges.
Above: In the high bay of the Kennedy Space Center’s Space Station Processing Facility, technicians prepare the integrated the TSIS-1 pay-
load and the EXPRESS Pallet Adapter for launch. NASA launched TSIS-1 to the International Space Station on December 15, 2017. Image
credit: NASA/Cory Huston
As part of the 2019 update, High-Risk Series: The NASA Associate Administrator assumes owner-
Substantial Efforts Needed to Achieve Greater ship of the corrective action plan. The Office of the
Progress on High-Risk Areas (GAO-19-157SP), GAO Chief Financial Officer is responsible for maintain-
included a scorecard detailing which of these criteria ing documentation, tracking and reporting progress
for improving acquisition management have been met, against the plan on an annual basis. Mission director-
partially met, or have not been met. NASA has fully ates and mission support offices are responsible for
met the criterion for a corrective action plan, and has executing the plan and reporting progress.
partially met the criteria for leadership, monitoring,
capacity, and demonstrated progress. NASA is one of Several initiatives are anticipated to strengthen
only three (out of 35) high risk areas that saw a deteri- Agency acquisition management. The initiatives are
oration in ratings from the prior 2017 report. categorized by the following actions.
■■ Implement: Initiatives that NASA has determined
NASA’s management changes have yielded more should proceed and become part of regular
credible cost and schedule baselines, and both GAO Agency business cadence. Any actions taken to
and OIG have observed that NASA’s management of support execution of the described initiatives will
its small- and medium-class major flight projects has follow all established Agency control and over-
improved. The effectiveness of these tools is particu- sight boards, as applicable, to ensure no unin-
larly evident for the smaller (under $1 billion lifecycle tended consequences are experienced.
cost) projects. However, NASA needs to do better at
managing its larger, more complex projects, which ■■ Pilot: Initiatives that NASA has determined
typically involve the development of a significant num- show promise to provide value related to Agency
ber of new technologies, greater risk, and early cost acquisition management, but will initially be exe-
and sched¬ule estimation challenges. GAO observed cuted to a limited degree in scope and time until
that risks remain for NASA’s largest and flagship-type the Agency assesses and reaffirms continued
projects, such as the James Webb Space Telescope execution.
(Webb)(see Agency Priority Goal 1.1.5), the Space ■■ Research: Initiatives that are less conceptually
Launch System (SLS), and Orion (see Agency Priority mature but warrant dedicated effort to explore
Goal 2.2.1). and develop with respect to generating value for
Agency acquisition management.
A Corrective Action Plan for Each initiative in the corrective action plan includes
Acquisition Management a history and current state (as of plan publication);
near-term (two-year) anticipated next steps; output
In 2018, NASA established a new corrective action and outcome measurements by which progress can
plan to accomplish two principal objectives: 1) to be assessed; and recognition of challenges, inter-
strengthen the Agency’s cutting-edge program and dependencies, and required resources that must
project management efforts across the board and be actively managed by NASA leadership. The lead
improve transparency to stakeholders; and 2) improve organization(s) identified for each initiative will pur-
the Agency’s surveillance of contractors through sue the objectives outlined in the plan. Assessments
appropriate insight and oversight. In December will occur on an annual or biennial basis; results of
2018, the Agency Program Management Council these assessments may result in goal or initiative
approved the proposed plan, Corrective Action Plan: addition, revision, or resolution. Lead organizations
In Response to Recent Programmatic Performance are accountable to the NASA Associate Administrator,
and NASA’s Designation on GAO’s High Risk List. and NASA will share results and progress with GAO
Recommendations and strategies informing the plan annually at a minimum, and more often when possi-
included previous GAO high risk reports, GAO’s 2018 ble. NASA will keep this corrective action plan current
Priority Recommendations Letter, reports issued and up to date until the GAO removes the High Risk
by GAO during its annual programmatic reviews of designation for the Agency.
NASA’s major projects, and numerous internal anal-
yses conducted by the Agency. Direction from senior
leadership, the advice of subject matter experts drawn
from across NASA, and feedback from GAO were
also considered.
See Performance Goal 4.1.2 for more information See Performance Goals 1.2.1, 2.1.1, 2.1.2, 2.1.3,
about NASA’s performance in acquisition reforms. 4.2.1, and 4.2.2 for more information about NASA’s
performance towards achieving its ISS Program
Management Challenges research goals, ISS operations, and commercial
space transportation supporting ISS operations.
Identified by the OIG
Deep Space Exploration
Each fiscal year, NASA’s OIG issues a letter sum-
marizing what the Inspector General considers to Primary Challenge Owner: Human Exploration and
be the most serious management and performance Operations Mission Directorate
challenges facing the Agency and briefly assesses OIG’s concerns about NASA’s plans for deep space
the Agency’s progress in addressing those chal- exploration center around three main themes: the
lenges. NASA leverages the results of OIG audits resources required to support development of a lunar
to improve the overall efficiency and effectiveness gateway versus research necessary for Mars explo-
of the Agency’s programs, projects, and functional ration; the increasing costs and schedule delays
activities. NASA is also committed to ensuring timely associated with the development of the Space Launch
and responsive final management decisions, along System (SLS), Orion Multi-Purpose Crew Vehicle
with timely and complete final management action on (Orion), and Exploration Ground Systems (EGS); and
all audit recommendations issued by the NASA OIG. technical challenges in each of these engineering
To this end, NASA has implemented a comprehen- programs.
sive program of audit follow-up, intended to ensure
that audit recommendations issued by the OIG are OIG notes the tension between competing priorities to
resolved and implemented in a timely, responsive, develop a lunar gateway for research and to develop
and effective manner. NASA’s audit follow-up program the deep space transport necessary for a potential
is a key element in improving the overall efficiency Mars crewed mission.
and effectiveness of NASA’s programs, projects and
operations. The requirements for managing OIG’s rec- To achieve any deep space human exploration, NASA
ommendations is detailed in NASA FY 2018 Agency must address significant challenges in managing
Financial Report. development of these three systems. Testing and
delivery of the SLS Core Stage remains is on the
The six findings from OIG’s, 2018 Report on Top critical path for development, but there is no sched-
Management and Performance Challenges are sum- ule margin remaining to manage problems that may
marized below. NASA’s response to the OIG findings
is included in the final report.
Primary Challenge Owner: Office of Strategic The OIG states that the Agency faces an ongoing
Infrastructure challenge of ensuring grant and cooperative agree-
ment funds are administered appropriately and that
In the OIG’s review of facility maintenance, NASA esti- recipients are accomplishing agreed-upon goals. The
mated its deferred maintenance costs at $2.4 billion OIG cites recent audits that indicate a lack of NASA
in 2017. The OIG believes major contributors to this oversight leading to potential duplication of efforts
issue stem from decentralized governance, intense with other federal activities, a lack of coordination in
political interest in center assets, and competition for release of data and findings, questionable acquisi-
budget resources. Infrastructure and facilities mainte- tions, inappropriate spending, and insufficient perfor-
nance have long been of concern to the OIG, noting mance.
that throughout 8 years and 17 independent reviews,
common criticisms have been slow implementation See Performance Goal 4.1.2 to find out more about
of corrective actions, inconsistent implementation of NASA’s acquisitions reform efforts.
Agency policies, and a need for stronger lifecycle
cost considerations in facility construction decisions.
Despite special action teams to study the issue and
make recommendations on capability and future
needs, the OIG believes that these assessments were
flawed, failed to make recommendations to achieve
cost savings, and did not establish firm timeframes for
completing actions.
See Performance Goals 4.2.8, 4.6.1, 4.6.2, and 4.6.3
to find out more about NASA’s efforts to ensure that
NASA’s facilities are right-sized, efficient, and avail-
able when needed.
NASA is organized for success, with a leadership model that optimizes strategic direction at the Agency level,
facilitates management at the functional levels in the mission directorates and mission support offices, and
enables a wide range of activities at centers and facilities. The distributed and diverse nature of NASA’s work is
unified by an integrated performance culture that engages employees and stakeholders at all levels.
The innovative, responsive, and dynamic nature of NASA’s work benefits from the Agency’s highly-leveraged rela-
tionships within and between mission directorates, mission support offices, and centers. This organizational model
ensures that Agency leaders can take both a holistic and more narrowly-focused approach to programmatic,
operational, business, and safety management.
The NASA workforce of about 17,000 civil servants in 2018 is distributed among its centers, facilities, and
Headquarters. NASA’s centers and facilities manage and execute the mission work—engineering, operations, sci-
ence, and technology development—and mission-enabling activities. Each location is supported by a contractor
workforce providing technical and business operations services.
The Administrator and senior officials lead the Agency by providing top-level strategy, policy, and direction.
Headquarters offices lead the Agency’s budget development, execution, and performance assessment. Mission
directorates and mission support offices at Headquarters manage decisions on programmatic investments and
guide operations of the centers. Provided below are brief descriptions of NASA’s mission directorates and select
offices, current as of early 2019.
■■ The Administrator’s Staff Offices lead the Agency by providing guidance and direction that cuts across
all of NASA’s work. These offices represent the Administrator with respect to safety and mission assurance,
managing the workforce and its diversity, overseeing the acquisition and use of IT, conducting financial and
procurement operations, as well as coordinating international partnerships and legislative affairs.
Above: A rainbow shines over the A-1 test stand at Stennis Space Center during a test of an RS-25 engine. The A-2 test stand is visible in the
background. Image credit: KSC Unmanned Aerial Systems Team.
nurturing an organizational culture in which individu- the Office of the Chief Financial Officer established
als make full use of their time, talent, and opportuni- horizontal inter-center portfolio leads to augment the
ties to pursue the highest standards in engineering, existing vertical hierarchal organization. Each of these
research, operations, and management. portfolios is managed by a Chief Financial Officer in
the field, working at an Agency, not local, level. This
For the seventh year in a row, NASA was named the portfolio lead is responsible for migrating to com-
“Best Place to Work” among large agencies in the mon, standard enterprise services by working with
Federal Government, as ranked by Federal employ- the stakeholder community to identify and implement
ees. In the annual Federal Employee Viewpoint improvements and efficiencies within their processes.
Survey, NASA employees expressed their satisfaction Such improvements can, and have, included develop-
with and commitment to NASA’s Mission. Part 2 of ing and applying a single set of policies, tools, direc-
this document presents the results of their efforts, as tives, and decisions across all work areas in the area,
well as those of NASA’s contractors and partners, for while ensuring full compliance with Federal mandates,
FY 2018. Through teamwork and creativity, NASA had regulations, and appropriate business practices. Silos
great successes and made notable progress in tack- and inconsistent business processes are being elimi-
ling the Agency’s management challenges. nated.
Reorganizing for Success This new structure began to prove its worth during the
2018-2019 lapse in appropriations. The Office of the
and Sustainability Chief Financial Officer portfolio leads developed and
applied consistent guidance, then applied ensured it
Regular assessment of the status quo for efficiency, was applied consistently across by all centers. This
and periodic assessment of the Agency’s current improved identifying exempt and excepted activities,
versus desired future state is a hallmark of NASA’s streamlining the shutdown and reopening process
organizational commitment to achieving an innova- (including accelerating crucial vendor payments to
tive and sustainable program of exploration. This is vulnerable small businesses), and responding to
particularly important as budgets for supporting infra- customers both inside and outside of the Agency. In
structures decrease, or remain flat—in effect, reducing 2019, the Agency-wide Office of the Chief Financial
buying power. Any cost efficiencies or improvements Officer will continue to realize improvements in budget
in conduct of day-to-day operations allows the Agency management, financial reporting and monitoring,
to better sustain strategic investments in NASA’s core implementing agreements, and end user services.
scientific, engineering, and exploration missions. Performance in cost reduction and improved services
will be assessed against 2018 baselines and future
In October of 2018, NASA began rolling out a restruc- year targets. Several metrics are in use, but the most
tured approach to management of the Agency’s important one measures progress towards enterprise
support services, based on findings and recommenda- services, and the percentage of functions that are
tions from business service assessments conducted delivered using consistent processes, and providing a
in 2016 and 2017. Among other strategies, the new consistent quality of service to customers.
business models reduce duplication of effort and com-
petition for resources by combining separate support The success is not isolated; other realigned offices
organizations at centers into Agency-wide services are also performing more efficiently and effec-
managed by functional leads. This approach will help tively. The shutdown services led by the Office of
ensure a common set of business practices across the Chief Human Capital Officer were well orga-
centers and facilities, consolidate and standardize nized, and applied consistently across the Agency.
management tools, and ensure that workforce or Communications to staff, contractors, and vendors
programming decisions made at local or at a regional was viewed as a model by many agencies who
level are also aligned with the long-term interest of directed those with inquiries to NASA communication
the Agency as a whole. In 2018, the Agency realigned sites. The Agency expects similar successes with
work flow and operations support under the Office other office realignments as the process continues.
of the Chief Human Capital Officer, the Office of the In 2019, NASA will begin similar efforts for activities
Chief Financial Officer, and the Office of Legislative related to procurement, small business, equal oppor-
and Intergovernmental Affairs. tunity and diversity, and protective services.
On August 12, 2018, a Delta IV Heavy rocket launched NASA’s Parker Solar Probe, the first-ever mission to go into the Sun’s
corona. Image credit: NASA/Bill Ingalls
Performance Planning and Reporting
Discover Explore
Expand human knowledge through new scien- Extend human presence deeper into space
tific discoveries. and to the Moon for sustainable long-term
exploration and utilization.
Strategic Goal 1: Expand human knowledge through Strategic Goal 2: Extend human presence deeper into
new scientific discoveries. space and to the Moon for sustainable long-term explo-
ration and utilization.
1.1 Understand the Sun, Earth, solar system and universe.
2.1 Lay the foundation for America to maintain a constant
1.2 Understand responds of physical and biological sys- human presence in low Earth orbit enabled by a commer-
tems to spaceflight. cial market.
Develop Enable
Address national challenges and catalyze Optimize capabilities and operations.
economic growth.
Strategic Goal 3: Address national challenges and Strategic Goal 4: Optimize capabilities and operations.
catalyze economic growth.
4.1 Engage in partnership strategies.
3.1 Develop and transfer revolutionary technologies to
enable exploration capabilities for NASA and the Nation. 4.2 Enable space access and services.
3.2 Transform aviation through revolutionary technology 4.3 Assure safety and mission success.
research development and transfer.
4.4 Manage human capital.
3.3 Inspire and enable the public in aeronautics, space,
and science. 4.5 Ensure enterprise protection.
Each strategic objective includes performance goals (PGs) and annual performance indicators (APIs), asso-
ciated FY 2018 performance ratings, and rating explanations for the performance goals. Where NASA did
not achieve its target or milestone for a performance goal or annual performance indicator, an explanation
describes why the target wasn’t met, and when appropriate, the corrective actions the Agency intends to take
to complete the target or milestone.
Color-coded bookmarks on
each page correspond to
the strategic theme for the Part 2—Strategic Goal 2 Explore
strategic objective.
Please note that the PG’s numbers changed over time due to strategic plan
There are four possible ratings for framework changes. Numbering change information is not available in this
each PG and API, as shown below. report.
The mission directorates define their PGs can be rated one color but its related APIs can be rated a
own success criteria for the ratings different color. For example, the PG may be rated green but the
during the development of their per- supporting API is rated yellow. Every performance measure has
formance measures, so the success success criteria that specify the amount of performance progress
criteria are unique to each perfor- required for each color rating. For a PG, the success criteria for a
mance goal or annual performance fiscal year may be based entirely on the ratings of its API or they
indicator. More information about the may be based on additional information. This scenario may indicate
performance assessment process can that that a project’s multiyear progress was not hindered by perfor-
be found in Part 1. mance challenges in a single fiscal year.
On Track or Complete
Performance Goal 2.2.3: Use the International Space Station (ISS)
NASA completed or expects as a testbed to demonstrate the critical systems necessary for long-
to complete this performance duration missions. Between October 1, 2017, and September 30, 2019,
measure within the estimated NASA will initiate at least eight in-space demonstrations of technology
timeframe. critical to enable human exploration in deep space. (Agency Priority
Goal)
Yellow 2013 2014 2015 2016 2017 2018 ERD-18-2: Deliver both the Spacecraft
Atmosphere Monitor and Brine
Slightly Below Target and/or Green Green Yellow Green Green Green
Water Processor to the International
Behind Schedule Space Station (ISS) for technology
Planned Performance Goals for FY 2019-2020
demonstrations.
NASA completed or expects FY 2019 - 2.2.3: Use the International Space Station (ISS)
as a testbed to demonstrate the critical systems necessary
to complete this performance for long-duration missions. Between October 1, 2017, and 2013 2014 2015 2016 2017 2018
September 30, 2019, NASA will initiate at least eight in-space
measure, but is slightly below demonstrations of technology critical to enable human explo-
No APIs before FY 2018 Red
the target and/or moderately ration in deep space. (Agency Priority Goal)
Explanation of Performance
FY 2020 - 2.2.3: Use the International Space Station (ISS)
behind schedule. as a testbed to demonstrate key capabilities necessary This annual performance indicator is rated red
for long-duration missions. Between October 1, 2019, and because neither the Spacecraft Atmosphere Monitor
Red
September 30, 2021, NASA will initiate at least ten in-space (SAM) nor the Brine Water Processor were delivered
demonstrations of technology critical to enable human explo- to the International Space Station (ISS) by the end of
ration in deep space.
the first quarter of FY 2019. SAM, which continuously
measures gases in the air on the ISS and transmits
Significantly Below Target that data to researchers on Earth, will be delivered in
and/or Behind Schedule NASA continues to be on track to achieve this agency
priority goal. In spring 2018, researchers conducted
March 2019 to the Jet Propulsion Laboratory due to
the late delivery of ion pumps and other components.
the first-ever experiments on long-term exposure The Brine Water Processor, also known as the Brine
NASA did not or does not to galactic cosmic ray-like radiation at the National Processor Assembly, will demonstrate the recovery
expect to complete this Space Radiation Laboratory, at the Brookhaven
National Laboratory. These experiments will enable
of water from urine brine produced by the ISS Urine
Processor Assembly. The delivery of the Brine Water
performance measure within better assessments of space radiation health risks Processor for flight integration will be delayed to early
involved in human space exploration. September 2019 due to design issues with its bladder
the estimated timeframe. The and logic control board.
program is substantially below
the target and/or significantly Planned Annual Performance Indicators
Strategic Goal 1
Expand human knowledge through new
scientific discoveries.
Operation IceBridge is an airborne survey of Arctic and Antarctic ice sheets, ice shelves, and sea ice. It has helped fill the
data collection between ICESat, which de-orbited in 2010, and ICESat-2, which launched in September 2018. This photo of the
Larsen C ice shelf in Antarctica was taken by an IceBridge flight on October 31, 2017. Image credit: NASA/Nathan Kurtz
Part 2—Strategic Goal 1 Discover
Lead Office NASA is conducting scientific studies of the Earth and Sun from space,
Science Mission Directorate (SMD), with return data and samples from other bodies in the solar system, peer out
support from the Human Exploration into the vast reaches of the universe, and play a catalyzing role in lunar
and Operations Mission Directorate robotic exploration by supporting innovative approaches to advancing
(HEOMD)
science. These efforts are guided by national priorities and recommen-
Goal Leader dations from the National Academies’ decadal surveys and implemented
Thomas Zurbuchen, Associate through a balanced portfolio of programs.
Administrator, SMD
2018 Strategic Review Summary of
Progress
Budget
The Science Mission Directorate conducts scientific exploration
FY $M enabled by observatories that view Earth from space, observe and
visit other bodies in the solar system, and gaze out into the galaxy and
Actual 2018 6,211.5
beyond. NASA’s science programs focus on three interdisciplinary objec-
Enacted 2019 6,291.9 tives: discovering the secrets of the universe, searching for life in the
Requested 2020 6,303.7 solar system and beyond, and safeguarding and improving life on Earth.
Near-term efforts that supported the assessment included:
2021 6,319.0
■■ Discovering Secrets of the Universe: Parker Solar Probe launched
2022 6,319.0
Outyear on August 12, 2018, will fly though the Sun’s coronal atmosphere,
2023 5,846.5 revealing the fundamental science of what drives solar wind. SMD
2024 5,815.0
also continues the integration and testing of the James Webb
Above: The Juno spacecraft’s JunoCam took this color-enhanced image of Jupiter on May 23, 2018. Image credit: NASA/JPL-Caltech/SwRI/
MSSS/Kevin Gill
Summary of Strategic Objective 1.1: Understand the Sun, Earth, solar system and
universe.
Performance Goal
23 1
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings. .
40 3 1
Describe the smaller, achievable measurements that serve as NASA’s basic unit of performance.
They show progress achieved during the budget year, and NASA uses them to assess progress
made towards achieving the performance goals and the strategic objectives. The total number of
annual performance indicators is reflected in each rating box and there is no one-to-one correla-
tion to performance goal ratings.
NASA achieved this performance goal by launching HE-18-4: Launch Parker Solar Probe
the Parker Solar Probe on August 12, 2018. When the
(PSP).
spacecraft transmitted its first science observations in
December, it began to advance scientific understand-
ing of the star that makes life on Earth possible. The 2013 2014 2015 2016 2017 2018
mission’s findings will help researchers improve their No API Green Green Green Yellow Green
forecasts of space weather events, which have the
potential to damage satellites and harm astronauts on
Planned Annual Performance Indicators
orbit, disrupt radio communications and, at their most
severe, overwhelm power grids. No APIs after FY 2018
Throughout its seven-year mission, the Parker Solar
Probe will make 24 passes by the sun, journeying
steadily closer until it makes its closest approach at HE-18-5: Release the 2018 Heliophysics
3.8 million miles, inside the sun’s atmosphere. At this
Medium Explorer (MIDEX) Announcement
point, the probe will be moving at 430,000 miles per
hour, setting the record for the fastest-moving object of Opportunity.
made by humankind.
2013 2014 2015 2016 2017 2018
No API Green Green Green Yellow Yellow
Explanation of Performance
NASA delayed the release of the 2018 MIDEX
Announcement of Opportunity to early FY 2019 in
order to eliminate overlap between the proposal eval-
uation effort and the evaluation/site visits for the Small
Explorer (SMEX) 2016 concept study reports. The
2012 Decadal Survey for Solar and Space Physics
strongly recommended a robust principal investi-
gator-led Explorers program for Heliophysics. As a
result, NASA selected five SMEX mission proposals
for a Phase A study, with the intent to select two of
those missions to progress to Phase B.
NASA’s Parker Solar Probe is heading to the sun. Thermal
Protection System Engineer Betsy Congdon (Johns Hopkins
APL) outlines why the Parker Solar Probe can take the heat in Planned Annual Performance Indicators
Why Won’t it Melt? How NASA’s Solar Probe will Survive the
Sun. Image Credit: NASA
No APIs after FY 2018
Explanation of Performance
NASA and Northrop Grumman delayed the October
2018 ICON launch when they detected anomalous
data from the Pegasus XL rocket, which contained
ICON. The Pegasus XL rocket was transported back
to Vandenberg Air Force Base in California for further
analysis. A new launch date has not yet been set. The
ICON spacecraft remains healthy.
Although NASA completed some major milestones Environmental testing of the spacecraft was initiated
as planned for FY 2018, Webb will not achieve this in April 2018. After completion of the acoustics test,
agency priority goal, which assumed that Webb would which was the first of the testing series, loose screws,
launch no later than September 30, 2019. washers, and nuts were discovered and traced to the
sunshield membrane cover battens. The root cause
After successful completion of the cryovacuum testing was identified as an insufficient installation procedure
at Johnson Space Center in October 2017, Webb’s of the hardware, and all of the hardware was removed
Optical Telescope Element plus Integrated Science and replaced. NASA started the spacecraft/sunshield
Instrument Module, together known as OTIS, was environmental testing again, with a re-run of the
shipped to the Northrop Grumman Aerospace System acoustics test in October 2018.
Space Park facility in Redondo Beach, California, in
February 2018. Subsequent successful functional NASA established an Independent Review Board
testing of OTIS was performed at Space Park in May to assess the schedule, work to go, and underlying
and June 2018. causes of schedule erosion. Based on the board’s
findings and recommendations, NASA is now planning
During FY 2018, NASA completed testing of the to launch Webb in March 2021. This new launch date
sunshield, which was integrated to the spacecraft bus takes into account the lessons learned from the initial
in FY 2017. The testing included initial folding of the fold, deployment, and stow of the sunshield, as well
sunshield membrane, full deployment of the sunshield as the corrective action required for the recent loos-
structure and membrane, tensioning of the membrane ened hardware discovered after the acoustics test. In
and re-folding and stowing into the launch configura- June, NASA alerted Congress of the new launch date
tion. During this initial testing, snags with the mem- and an increase in development cost of $800 million
brane tensioning system occurred during deployment, over the $8 billion cost cap.
as well as several small tears in the membrane. The
membrane tensioning system was redesigned, tested,
and re-installed on the sunshield. The cause of the
membrane tears is fully understood, the majority have
been repaired, and corrective action has taken place
so that tears are minimized during subsequent test
deployments.
In early 2017, it was discovered that several dual
thruster valves of the propulsion system leaked due to
erosion of the seals. The replacement of the space-
craft propulsion system thruster valves was completed
in March 2018.
Performance Explanation
Integration of OTIS with the spacecraft and sunshield
has been delayed until October 2019 due to the dis-
covery of loosened hardware after an acoustics test
(see Performance Goal 1.1.5 for more information).
Webb’s two halves, the spacecraft and telescope, were
Actions are being taken by the project and program connected together using temporary ground wiring that
to minimize procedural and human errors, as recom- enabled them to “speak” to each other like they will in flight
mended by the Independent Review Board. in September 2018 This was an optional “risk reduction” test
that took advantage of an opportunity to connect the two
halves of the observatory together electrically months earlier
than planned. If any issues had been found, it would have
Planned Annual Performance Indicators given engineers more time to fix them and without causing
further delays. As a bonus, it also provided a jumpstart for the
JWST-19-1: Complete spacecraft element thermal vacuum
separate spacecraft and telescope test teams to begin working
testing.
jointly as they will when the whole observatory is reassembled
into one spacecraft in 2019. Image credit: Northrop Grumman
See page 55 for a list of FY 2020 performance measures.
NASA also completed the Key Decision Point-B AS-19-6: Complete the 2016 Astrophysics Medium Explorer
review for the Wide-Field Infrared Survey Telescope (MIDEX) Announcement of Opportunity down-select.
(WFIRST), allowing the project to explore options for See page 56 for the FY 2020 MIDEX annual performance
fulfilling the mission, advance required technologies, indicator.
and take other steps to prepare for future mission
development.
The Planetary Science Advisory Committee deter- PS-18-1: As determined by the Planetary
mined in September 2018 that NASA has remained Science Advisory Committee (PAC),
on track toward achievement of this performance goal.
Below are examples of the scientific progress reported demonstrate planned progress in
in FY 2018. advancing the understanding of how
the chemical and physical processes in
The Lunar Reconnaissance Orbiter (LRO) made
unprecedented measurements of the Moon’s radia-
the solar system operate, interact, and
tion environment, showing that the Moon receives an evolve.
increase in radiation from galactic cosmic rays, which
would be more harmful to future deep-space explor- 2013 2014 2015 2016 2017 2018
ers. Scientists suggest that particles in Venus’ lower Green Green Green Green Green Green
clouds may contain sufficient mass balance to harbor
microorganisms, water, solutes, and a potentially suffi-
cient biomass to be detected by optical methods. The Planned Annual Performance Indicators
Juno mission has made new observations of cyclonic PS-19-1: As determined by the Planetary Science Advisory
activity in Jupiter’s polar regions. Cassini observed Committee (PAC), demonstrate planned progress in ad-
storms on Saturn that can disturb atmospheric pat- vancing the understanding of how the chemical and physical
terns at the planet’s equator. The Dawn mission processes in the solar system operate, interact, and evolve.
discovered sites rich with organic molecules on the See page 55 for a list of FY 2020 performance measures.
asteroid Ceres. Scientists discovered methane ice
formations, some reaching hundreds of feet high, near
Pluto’s equator through data from the New Horizons
mission.
The Planetary Science Advisory Committee deter- PS-18-2: As determined by the Planetary
mined in September 2018 that NASA has remained Science Advisory Committee (PAC),
on track toward achievement of this performance goal.
Below are examples of the scientific progress reported
demonstrate planned progress in
in FY 2018. exploring and observing the objects in
the solar system to understand how they
LRO evaluated the shapes of 930 small craters (40
formed and evolve.
meters to 10 kilometers in diameter) to highlight
changes to the sizes of ubiquitous impact craters
across the Moon. 2013 2014 2015 2016 2017 2018
Data from the Compact Reconnaissance Imaging Green Green Green Green Green Green
Spectrometer for Mars (CRISM), aboard the Mars
Reconnaissance Orbiter (MRO), demonstrated that Planned Annual Performance Indicators
clays on Mars belong to three different chemical
PS-19-2: As determined by the Planetary Science Advisory
families, based on their crystal structure. Laboratory Committee (PAC), demonstrate planned progress in exploring
experiments demonstrated that the thicknesses of and observing the objects in the solar system to understand
surface clay minerals observed on Mars could have how they formed and evolve.
formed in a few million years or less, depending on
the temperature. The less crystalline minerals above See page 55 for a list of FY 2020 performance measures.
the clay layers are a record of a colder, dryer Mars.
The Juno mission created a detailed model of
Jupiter’s global magnetic field. Jupiter’s magnetic field
is shown to be different from all other known planetary PS-18-11: Complete Juno mission
magnetic fields. Cassini’s final images will allow sci- success criteria.
entists to better characterize atmospheric conditions
on Saturn, while the New Horizons mission enabled 2013 2014 2015 2016 2017 2018
scientists to create global and topographic maps of No API No API No API Green No API Green
Pluto and its largest moon, Charon.
The Planetary Science Advisory Committee deter- PS-18-3: As determined by the Planetary
mined in September 2018 that NASA has remained Science Advisory Committee (PAC),
on track toward achievement of this performance goal.
Below are examples of the scientific progress reported
demonstrate planned progress in
in FY 2018. exploring and finding locations where life
could have existed or could exist today.
The Mars 2020 mission will analyze samples in situ
and identify those that could have preserved biosigna-
tures in ancient habitable environments. Samples will 2013 2014 2015 2016 2017 2018
be cached for later return to Earth where detailed bio- Green Green Green Green Green Green
signature analyses will take place. The payload suite
will include a first-time mission instrument for biosig-
nature detection and contextual environment char- Planned Annual Performance Indicators
acterization, the Scanning Habitable Environments PS-19-4: As determined by the Planetary Science Advisory
and Luminescence for Organics and Chemicals Committee (PAC), demonstrate planned progress in exploring
(SHERLOC). and finding locations where life could have existed or could
exist today.
Data from NASA’s Cassini spacecraft revealed
See page 55 for a list of FY 2020 performance measures.
complex organic molecules originating from Saturn’s
icy moon Enceladus, strengthening the idea that
this ocean world hosts conditions suitable for life.
Additional data implied the presence of a global ocean
underneath the icy surface of Enceladus, with a huge
amount of internal heating to avoid freezing.
Explanation of Performance
NASA rated this annual performance indicator yel-
low because NASA identified and catalogued 8,307
NEAs by the end of FY 2018, missing the target
by 93 NEAs. The discovery rate was impacted by
extremely poor weather in spring and summer 2018
over Hawaii, which is the location for two primary NEO
survey systems: the Panoramic Survey Telescope
And Rapid Response System (Pan-STARRS) and the
Asteroid Terrestrial-impact Last Alert System (ATLAS).
The start of operations for Pan-STARRS 2 also was
delayed by two hurricanes.
The Earth Science Advisory Committee determined in ES-18-2: As determined by the Earth
October 2018 that NASA remained on track to achieve Science Advisory Committee (ESAC),
this performance goal. Below are examples of the
scientific progress reported in FY 2018.
demonstrate planned progress in
improving the capability to predict
Over the past year, NASA researchers developed weather and extreme weather events.
a Landslide Hazard Assessment for Situational
Awareness (LHASA) model to indicate potential 2013 2014 2015 2016 2017 2018
landslide activity in near-real time. The researchers
Green Green Green Green Green Green
combined satellite-based precipitation estimates
(based on Tropical Rainfall Measuring Mission and
Global Precipitation Measurement mission data) with Planned Annual Performance Indicators
a landslide susceptibility map derived from informa- ES-19-2: As determined by the Earth Science Advisory
tion on slope, geology, road networks, fault zones, Committee (ESAC), demonstrate planned progress in improv-
and forest loss. When rainfall was considered to be ing the capability to predict weather and extreme weather
extreme and susceptibility values were moderate to events.
very high, the model issued a “nowcast” to indicate
See page 55 for a list of FY 2020 performance measures.
the times and places where landslides were more
probable. LHASA nowcasts agrees with NASA’s
Global Landslide Catalog, with probability of detection
between 8 and 60 percent, depending on the evalua-
tion period, precipitation product used, and the size of
the spatial and temporal window considered around
each landslide point.
Researchers conducted intensive calibration and
validation activities for the Cyclone Global Navigation
Satellite System (CYGNSS) mission during the active
2017 Atlantic hurricane season using “ground truth”
wind speed measurements taken with the NOAA P-3
hurricane hunter aircraft. Results indicate improve-
ments in hurricane forecast skill and in temporal and
spatial sampling of tropical convective systems with
CYGNSS, and most notably, the ability to measure
soil moisture and image flood inundation over land.
This map, focused on the Americas, shows 15 years of nowcasts
of potential landslide activity generated by the LHASA model.
The compilation of nowcasts highlight landslide hotspots, such
as along the coast of Peru. Black and blue indicate the lowest
risk of landslide and orange a red the highest risk. Image credit:
NASA Scientific Visualization Studio
NASA has made substantial progress in furthering the ES-18-7: Advance at least 40 percent of
use of Earth science to inform decisions. Below are Earth science applications projects one
examples from FY 2018:
Applications Readiness Level.
■■ The New York State Department of Health low-
ered the Heat Advisory threshold for alerting the
2013 2014 2015 2016 2017 2018
public of an upcoming heat wave from 100 to 95
Green Green Green Green Green Green
degrees to help prevent heat-related illnesses.
This decision stemmed from a project with the
Department of Health using heat metrics from the Planned Annual Performance Indicators
North American Land Data Assimilation System.
ES-19-7: Advance at least 40 percent of Earth science appli-
■■ The Delaware Division of Fish and Wildlife cations projects one Applications Readiness Level.
used ocean color and sea surface tempera-
ture data from the Aqua and Suomi National See page 55 for the FY 2020 Earth science applications
Polar-orbiting Partnership (NPP) satellites to annual performance indicator.
assess sturgeon occurrence risk and make
decisions on permits and commercial fishing
to avoid unwanted sturgeon encounters.
■■ NASA enabled the use of data from multiple ES-18-8: Maintain high level of customer
Earth observing satellites to measure surface satisfaction, as measured by exceeding
deformation, support sulfur dioxide monitoring the most recently available Federal
for air quality issues, and track lava flow from fis-
sures during the 2018 Kilauea eruption in Hawaii.
Government average rating of the
American Customer Satisfaction Index.
■■ Bureau of Land Management and Forest Service
employed the NASA-sponsored Rehabilitation
Capability Convergence for Ecosystem 2013 2014 2015 2016 2017 2018
Recovery (RECOVER) system on over 40
Green Green Green Green Green Green
wildfire events in 2018, using NASA satellite
data to shorten response and recovery time.
■■ Department of Agriculture’s Crop Explorer made Planned Annual Performance Indicators
NASA soil moisture data available operation- ES-19-8: Maintain high level of customer satisfaction, as
ally, and it now integrates soil moisture into its measured by exceeding the most recently available Federal
monthly global crop production estimates. Government average rating of the American Customer
Satisfaction Index.
See page 55 for the FY 2020 customer satisfaction annual
performance indicator.
ES-18-10: Complete NASA-Indian Space ES-18-13: Launch the Ice, Cloud, and
Research Organisation (ISRO) Synthetic Land Elevation Satellite (ICESat)-2.
Aperture Radar (NISAR) L-Band SAR
Instrument Critical Design Review (CDR). 2013 2014 2015 2016 2017 2018
Yellow Yellow Green Green Yellow Green
2013 2014 2015 2016 2017 2018
No APIs before FY 2016 Green Yellow Green
Planned Annual Performance Indicators
Above: NASA astronaut Joe Acaba conducts operations on the ACME investigation. ACME aims to improve fuel efficiency and reduce pollut-
ant production in practical combustion on Earth, while improving fire prevention efforts aboard spacecraft. Image credit: NASA
Performance Goal 1
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
NASA achieved its biological and physical research ISS-18-3: Enhance the research
planned goals for the ISS Program in FY 2018. In capabilities on the International Space
June, NASA installed the Cold Atom Laboratory, which
will produce ultra-cooled atoms called Bose-Einstein
Station (ISS) by installing and operating
condensates. The laboratory will help NASA conduct the Cold Atom Laboratory, Life Sciences
research related to the physics and applications of Glove Box, additional Express Racks,
quantum gasses identified by the National Research and Bioculture System; and complete
Council decadal survey, Recapturing a Future for operations for Zero Boil Off Tank.
Space Exploration, Life and Physical Sciences
Research for a New Era, as a priority.
In September, the Life Sciences Glovebox, a fully 2013 2014 2015 2016 2017 2018
enclosed workspace with two glove ports, was deliv- No APIs before FY 2018 Green
ered to the ISS. The Japan Aerospace Exploration
Agency built the new facility in partnership with the
Planned Annual Performance Indicators
Dutch commercial firm Bradford Engineering several
years ago. They updated the glovebox and prepared
No APIs after FY 2018
it for the ISS in response to increased demand for
research glovebox space. Two additional EXPRESS
racks, which can hold everything from small facilities
to equipment, also were delivered.
NASA completed the five experiments for the
Advanced Combustion via Microgravity Experiments
(ACME) research series, which began aboard the ISS
in January. ACME is focused on advanced combus-
tion technology. The Advanced Plant Habitat com-
pleted its first science operations in November 2018,
when Astronaut Serena Auñón-Chancellor completed
the final harvest after six-weeks of plant growth.
Additionally, two Vegetable Production System units
are now installed and operational on the ISS.
NASA also returned some research facilities to
Earth. The Bioculture System, a cell biology research
platform that was delivered to the ISS in 2016, was
returned to Earth in January. After 10 weeks of oper-
ation, the Zero Boil-off Tank, which studied storage Above: NASA astronaut Ricky Arnold performs maintenance on
the ACEM on April 16, 2018. Image credit: NASA
of very cold cryogenic fluids, was returned to Earth in
December 2017.
ISS-18-4: Through the Center for the ISS-18-6: Install and conduct the first
Advancement of Science in Space scientific investigation in the new Plant
(CASIS) cooperative agreement, meet Habitat facility, and operate two Vegetable
the goals identified in the annual Production System (Veggie) units aboard
performance plan to completely use the the International Space Station (ISS)
50 percent National Laboratory allocation; to conduct research with the Human
and develop and execute the sponsored Research Program on the nutritional and
research. behavioral aspects of growing plants for
food in space.
2013 2014 2015 2016 2017 2018
No API Green Green Green Green Green 2013 2014 2015 2016 2017 2018
Green Green Red Red Green Green
Planned Annual Performance Indicators
Planned Annual Performance Indicators
ISS-19-1: Through the Center for the Advancement of
Science in Space (CASIS) cooperative agreement, meet the ISS-19-2: Conduct experiments across the range of space
goals identified in the annual performance plan to completely biology, including research on rodents, an investigation using
use the 50 percent National Laboratory allocation and es- the Advanced Plant Habitat, an investigation in cell biology,
tablish a robust innovation cycle to develop and execute the and an investigation on the microbiome of the International
sponsored research. Space Station (ISS), to sustain progress in a balanced re-
search portfolio.
ISS-20-1: Through the Center for the Advancement of
Science in Space (CASIS) cooperative agreement, meet the ISS-20-2: Successfully conduct four research investigations
goals identified in the annual performance plan to completely aboard the International Space Station (ISS) on the high-
use the 50 percent National Laboratory allocation and es- est-priority recommendations for plant and microbial science
tablish a robust innovation cycle to develop and execute the from the 2011 Space Life and Physical Sciences Decadal
sponsored research. Survey in the areas of responses and adaptations to space-
flight and long-term life support.
Strategic Goal 2
Extend human presence deeper into space
and to the Moon for sustainable long-term
exploration and utilization.
A structural test version of the intertank for NASA’s new deep-space rocket, the Space Launch System, arrives at NASA’s
Marshall Space Flight Center on March 4, 2018, aboard the barge Pegasus. Image credit: NASA/MSFC/Tyler Martin
Part 2—Strategic Goal 2 Explore
Lead Office NASA is enabling a space-based low Earth orbit economy by transition-
Human Exploration and Operations ing the International Space Station (ISS) operations and maintenance to
Mission Directorate (HEOMD) commercial and international partners, while continuing to leverage ISS
for research, technology development, and to extend human presence in
Goal Leader
space.
Altonell Mumford, Deputy Associate
Administrator, HEOMD
2018 Strategic Review Summary of
Progress
Budget The Human Exploration and Operations Mission Directorate leads
and manages NASA space operations related to human exploration in
and beyond low Earth orbit. HEOMD oversees requirements develop-
FY $M
ment, policy, and programmatic oversight across its numerous programs.
Actual 2018 2,027.9 HEOMD’s activities include the ISS, commercial space transportation,
Enacted 2019 2,155.0 low Earth orbit spaceflight operations, deep space exploration systems,
launch services, and space communications. Efforts that supported the
Requested 2020 2,104.4 assessment included:
2021 2,146.7 ■■ The ISS has been continually crewed with six crew members, and
2022 2,194.4 only for 16 days with three crew members during Soyuz vehicle
Outyear exchange. The ISS also accommodated commercial resupply mis-
2023 2,144.3
sions OA-8 and SpX-13 during the first quarter of FY 2018, bringing
2024 2,122.6 supplies and research to the crew.
Above: At Johnson Space Center, engineers help Canadian Space Agency astronaut Jeremey Hansen train for future spacewalks. Image
credit: NASA/Josh Valcarcel
■■ NASA completed the ISS Transition Report, Plan Update, which NASA considers final for FY 2019,
which was delivered to Congress and posted and the initial FY 2020 Performance Plan. Below are
online in March 2018. ISS has begun communi- charts summarizing the FY 2018 performance ratings
cating with international partners regarding the for the performance goals and annual performance
transition. indicators supporting Strategic Objective 2.1.
■■ At the time of the Strategic Review, which was As NASA conducts its 2019 Strategic Review, to be
completed in spring 2018, the ISS program was completed in spring 2019, it will conduct a retrospec-
on track to achieve all of its annual performance tive and prospective analyses to determine if the pro-
indicators. grams supporting this strategic objective are healthy
and can address potential or realized risks. Part of the
Performance Measures for retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Strategic Objective 2.1 pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
The following pages provide the performance goals mance indicators. The results of this early assessment
and annual performance indicators supporting will inform planning for the FY 2021 Performance
Strategic Objective 2.1. They include the final perfor- Plan, which will begin in spring 2019.
mance results for FY 2018, the FY 2019 Performance
Summary of Strategic Objective 2.1: Lay the foundation for America to maintain a
constant human presense in low Earth orbit enabled by a commercial market.
Performance Goal 3
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
Performance Goal 2.1.1: Increase the crew time for research and
development beyond the three U.S. Orbital Segment crew baseline.
Crew Rotations
Performance Goal 2.1.2: Ensure vital assets are ready, available, and
appropriately sized to conduct NASA’s Mission.
NASA met this performance goal by achieving all but ISS-18-9: Issue an Announcement for
one of the supporting annual performance indicators. Proposals (AFP) for the commercial use
The Materials ISS Experiment Flight Facility of low Earth orbit (LEO) for ongoing
(MISSE-FF) arrived on the ISS in April 2018. human spaceflight activities.
MISSE-FF is a continuation of the successful flight
payloads that provides the ability for NASA, the
private sector, and others to test materials, coatings, 2013 2014 2015 2016 2017 2018
and components in the harsh space environment. No API before FY 2018 Green
Unlike previous MISSE units, the MISSE-FF does
not have to be mounted on the exterior of the ISS by
Planned Annual Performance Indicators
an astronaut. The unit’s base structure and avion-
ics stay inside the ISS and the sample carriers are ISS-19-10: Award one or more proposals for the commercial
mounted outside the ISS using the robotically oper- use of low Earth orbit (LEO) for ongoing human spaceflight
activities.
ated Canadarm-2. Also delivered in April 2018 was
the commercially developed and operated Multi-use No API after 2019
Variable-g Platform (MVP), which has two carousels
that can produce up to 2g of artificial gravity.
During FY 2018, the Center for the Advancement
of Science in Space (CASIS), which runs the ISS
National Laboratory, met all of its targets by signing
agreements with 23 new and 27 return customers.
ISS-18-10: Add at least two new in-orbit ISS-18-13: Release a policy document on
commercial International Space Station the commercial use of the International
(ISS) facilities and/or facility managers Space Station (ISS).
during FY 2018.
2013 2014 2015 2016 2017 2018
2013 2014 2015 2016 2017 2018 No APIs before FY 2018 Yellow
No API before FY 2018 Green
Explanation of Performance
Planned Annual Performance Indicators
NASA produced a draft in FY 2018, but work to
ISS-19-12: Add at least two new in-orbit commercial complete the policy document continues to require
International Space Station (ISS) facilities and/or facility man- extensive coordination. NASA expects to complete the
agers during FY 2019.
policy document by mid-FY 2019.
ISS-20-9: Add at least two new in-orbit commercial
International Space Station (ISS) facilities and/or facility man- Planned Annual Performance Indicators
agers during FY 2020.
No APIs after FY 2018
Lead Office NASA is extending human presence into cis-lunar space and the lunar
Human Exploration and Operations surface, with capabilities that allow for sustained operations in deep
Mission Directorate (HEOMD) space and the lunar surface.
Goal Leader
Altonell Mumford, Deputy Associate 2018 Strategic Review Summary of
Administrator, HEOMD
Progress
The Human Exploration and Operations Mission Directorate leads
and manages NASA space operations related to human exploration in
and beyond low Earth orbit. HEOMD oversees requirements develop-
Budget ment, policy, and programmatic oversight across its numerous programs.
HEOMD’s activities include the International Space Station, commercial
FY $M space transportation, low Earth orbit spaceflight operations, deep space
exploration systems, launch services, and space communications. Efforts
Actual 2018 4,790.0
that supported the assessment included:
Enacted 2019 4,698.8
■■ NASA continues to plan for an Exploration Mission (EM)-1 launch in
Requested 2020 5,021.7 December 2019, with six months of schedule reserve to June 2020
2021 5,295.5 to address possible first-time manufacturing and production risks.
2022 5,481.4 ■■ NASA preparations underway for EM-2 include production of
Outyear the Orion EM-2 crew module pressure vessel at the Michoud
2023 6,639.0
Assembly Center and the active launch abort system.
2024 7,042.3
Above: The propulsion system that will give the Orion spacecraft the "in-space push" needed to travel thousands of miles beyond the moon
and back has completed its major assembly at United Launch Alliance in Decatur, Alabama. Image credit: ULA
■■ NASA preparations underway for EM-2 for the performance goals and annual performance
include design reviews for the Space Launch indicators supporting Strategic Objective 2.2.
System Block 1B exploration upper stage
and early manufacturing for the RL-10 As NASA conducts its 2019 Strategic Review, to be
engines for the exploration upper stage. completed in spring 2019, it will conduct a retrospec-
tive and prospective analyses to determine if the pro-
grams supporting this strategic objective are healthy
Performance Measures for and can address potential or realized risks. Part of the
Strategic Objective 2.2 retrospective analyses will take into consideration the
FY 2018 performance results found on the following
pages. Looking forward, NASA will assess whether
The following pages provide the performance goals
it is on track to achieve the FY 2019 annual perfor-
and annual performance indicators supporting
mance indicators. The results of this early assessment
Strategic Objective 2.2. They include the final perfor-
will inform planning for the FY 2021 Performance
mance results for FY 2018, the FY 2019 Performance
Plan, which will begin in spring 2019.
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
Performance Goal 2 2
Span two to five years, and measure the performance of investments towards strategic objectives
and strategic goals. The total number of performance goals is reflected in each rating box and there is
no one-to-one correlation to annual performance indicator ratings.
NASA experienced delays in completing the SLS ESD-18-1: Complete production of the
core stage liquid oxygen tank (Annual Performance Exploration Mission-1 Core Stage liquid
Indicator ESD-18-1) and the Orion EM-1 crew module
(Annual Performance Indicator ESD-18-2). However,
oxygen tank.
neither delay currently does not disrupt the overall
schedule for (EM)-1, which will be the first time NASA 2013 2014 2015 2016 2017 2018
launches SLS and Orion together on an uncrewed test Green Green Green Green Green Yellow
flight.
NASA met its goals for the EGS program for FY 2018 Performance Explanation
by completing the integrated verification and valida-
The completion of the liquid oxygen tank for the SLS
tion testing of the mobile launcher and the Vehicle
core stage, which will be used for EM-1, experienced
Assembly building.
a delay beyond the end of FY 2018 due to first-time
production challenges. NASA does not expect the
delay to affect the overall schedule for the core stage.
NASA has completed application of thermal protection
system foam on the barrel section and is currently
proceeding with the application of the thermal protec-
tion foam on the domes.
Explanation of Performance
See the performance goal explanation for more infor-
mation.
In March 2018, NASA completed industry studies on ERD-18-6: Complete industry studies on
potential synergies for NASA–industry partnership to potential synergies for a NASA-industry
build and flight demonstrate a spacecraft that uses
advanced solar electric propulsion. This power and
partnership to demonstrate a Power and
propulsion element would support NASA’s plans for Propulsion Element using advanced solar
exploration operations in deep space. Based on the electric propulsion.
studies, NASA completed the first major milestone to
solicit proposals from industry to build and demon-
strate a Power and Propulsion Element. 2013 2014 2015 2016 2017 2018
No API before FY 2018 Green
Power and Propulsion Element Moves Ahead
Planned Annual Performance Indicators
■■ June 21, 2018 - Released draft solicitation
for spaceflight demonstration of a Power and ERD-19-4: In partnership with industry, conduct one or more
Propulsion Element seeking industry comments Preliminary Design Reviews for the Power and Propulsion
Element.
■■ July 10, 2018 – Held Industry Day
at Glenn Research Center
AES-20-1: Achieve milestones in the design and development
■■ July 20, 2018 – Received industry com- of a Power and Propulsion Element (PPE) in partnership with
ments on the draft solicitation industry. (NASA will identify a specific milestone to track for
this annual performance indicator in 3rd quarter FY 2019,
■■ September 6, 2018 – Released final following PPE partner selection and contract award.)
broad agency announcement for
the Spaceflight Demonstration of a
Power and Propulsion Element
Strategic Goal 3
Address national challenges and catalyze
economic growth.
NASA’s autonomous testbed called Prototype Technology-Evaluation Research Aircraft, or PTERA, takes off on a flight to test
the ability of shape memory alloy to fold wings in-flight. NASA, in this flight, observed the successful folding of PTERA’s wings
70 degrees upward. Image credit: NASA/Ken Ulbrich
Part 2—Strategic Goal 3 Develop
Lead Office NASA is advancing revolutionary technologies for NASA and the Nation,
Space Technology Mission Directorate involving commercial space products, specifically for utilization of near-
(STMD) [Note: STMD will be reorga- Earth space; efficient transportation through space; access to planetary
nized moving forward as mentioned on surfaces; enabling human space exploration; next generation science
page iv. missions; and growth and utilization of the U.S. industrial and academic
base.
Goal Leader
Prasun Desai, Deputy Associate
Administrator for Management, STMD 2018 Strategic Review Summary of
Progress
The Space Technology Mission Directorate has been responsible for
Budget developing the crosscutting, pioneering, new technologies and capabil-
ities that NASA needs to achieve its current and future missions. STMD
FY $M has sought to mature these technologies for NASA’s science and explo-
ration missions while proving the capabilities and lowering the cost for
Actual 2018 760.0
other government agencies and commercial space activities. Efforts that
Enacted 2019 760.0 supported the assessment included:
Requested 2020 1,014.3 ■■ The Deep Space Atomic Clock, Green Propellant Infusion Mission,
2021 976.1 and CubeSat Proximity Operations Demonstration have completed
development and are currently in storage, and are ready for launch.
2022 995.4
Outyear ■■ The Laser Communications Relay Demonstration flight demon-
2023 964.4
stration has successfully entered the implementation phase.
2024 943.1 Other demonstrations remain on track, including: Mars Oxygen
ISRU Experiment (MOXIE), Terrain Relative Navigation, and Mars
Above: Blue Origin’s New Shepard booster rocket returns to its launch pad on December 12 after completing a flight that tested the Evolved
Medical Microgravity Suction Device technology. NASA funded the microgravity service on the flight. Image credit: Blue Origin
Entry, Descent and Landing Instrumentation As NASA conducts its 2019 Strategic Review, to be
2 (MEDLI2) for the Mars 2020 lander mission; completed in spring 2019, it will conduct retrospective
Deep Space Optical Communication (DSOC); and prospective analyses to determine if the programs
and Solar Electric Propulsion. supporting this strategic objective are healthy and
can address potential or realized risks. Part of the
Performance Measures for retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Strategic Objective 3.1 pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
The following pages provide the performance goals mance indicators. The results of this early assessment
and annual performance indicators supporting will inform planning for the FY 2021 Performance
Strategic Objective 3.1. They include the final perfor- Plan, which will begin in spring 2019. In addition,
mance results for FY 2018, the FY 2019 Performance as parts of these analyses, NASA will factor in any
Plan Update, which NASA considers final for FY 2019, relevant updates and/or changes that arise from the
and the initial FY 2020 Performance Plan. Below are reorganization of STMD as part of the FY 2019-2021
charts summarizing the FY 2018 performance ratings planning.
for the performance goals and annual performance
indicators supporting Strategic Objective 3.1.
Performance Goal 4
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
NASA has met this multi-year performance goal as ST-18-1: Conduct at least 185 new
the Agency continues to advance early stage inno- activities, with appropriate contribution
vation. In FY 2018, NASA selected 56 NASA Space
Technology Research Fellowships, 12 Early Stage
from each underlying early stage
Innovations awards, and 11 Early Career Faculty program, to research, study, or develop
awards. concepts for new technologies.
NASA selected 25 new concept studies in FY 2018,
comprising 16 Phase I projects and 9 Phase II proj- 2013 2014 2015 2016 2017 2018
ects, through NIAC, a program that helps innovators Green Green Green Green Green Green
and entrepreneurs develop innovative, technically
credible, advanced concepts to “change the possible”
in aerospace. The Agency also encouraged creativity Planned Annual Performance Indicators
and innovation within the NASA centers by supporting
emerging technologies and creative initiatives, select- ET-19-1: Invest in at least 185 promising new early stage
ing 125 Center Innovation Fund projects in FY 2018. technologies and concepts, with potential for transformative
impact.
In FY 2018, GCD continued advancement of many NASA is breaking ground in the world of additive
promising technology solutions. NASA and the manufacturing with the Low Cost Upper Stage-Class
National Nuclear Security Administration demon- Propulsion project. The Agency successfully hot-fire
strated a new nuclear fission reactor power system, tested a combustion chamber at NASA’s Marshall
called Kilopower, that could enable long-duration Space Flight Center made using a new combination
crewed missions to the Moon, Mars, and destina- of 3-D printing techniques. This project aims to further
tions beyond. The experiment was conducted at the improve production time and costs for thrust chamber
National Nuclear Security Administration’s Nevada assemblies.
National Security Site from November 2017 through
March 2018.
A team of NASA engineers demonstrated fully
autonomous X-ray navigation in space during the
demonstration that occurred in November 2017. The
Space Exploration for X-ray Timing and Navigation
Technology (SEXTANT) demonstration showed that
millisecond pulsars could be used to accurately deter-
mine the location of an object moving in space.
NASA achieved this multi-year performance goal as ■■ PDR for Restore-L satellite servicing project
it continues to foster and mature new crosscutting ■■ SRR and KDP-B for Low Earth Orbit-based Flight
space technology capabilities for demonstration. In Test demonstration of Inflatable Decelerator
FY 2018, the Small Spacecraft Technology program (LOFTID)
made progress on several projects, including complet-
ing eight major milestones: ■■ A continuation review for eCryo cryogenic fluid
management technologies project
■■ Level-1 Requirements Completion Review for
the Integrated Solar And Reflectarray Antenna ■■ Close-out reviews for In-space Robotic
mission, which will demonstrate a CubeSat com- Manufacturing and Assembly (IRMA)
munications capability
■■ Preliminary Design Review (PDR) and Critical
Design Review in December 2017 for the
Pathfinder Technology Demonstrator (PTD),
which will test CubeSat technologies in low Earth
orbit
■■ Qualification Test Readiness Review for the ST-18-3: Reach at least eight major
Tethers Unlimited, Inc., HYDROS-C thruster pay- milestones, including delivery of small
load, which uses water as propellant, for PTD-1 spacecraft for flight demonstration
■■ Qualification TRR for the Blue Canyon or other milestones, for development
Technologies HyperXACT Attitude Determination and demonstration of transformative
and Control payload for PTD-2
technologies for more affordable science
■■ System Readiness Review and payload PDR for
and exploration missions.
CubeSat Lasercom Infrared Crosslink, which will
demonstrate intersatellite communications for
small spacecraft 2013 2014 2015 2016 2017 2018
■■ Flight Readiness Review for CubeSat Handling Green Green Green Green Green Green
Of Multisystem Precision Time Transfer, which
will demonstrate high-precision time transfer from
Planned Annual Performance Indicators
Earth to low Earth orbiting CubeSat
ET-19-3: Advance development, demonstration, and mission
NASA also completed five major milestones for implementation of new exploration technologies by reaching a
Technology Demonstration Missions projects: key milestone in at least six small spacecraft projects.
ET-20-3: Advance development, demonstration, and mission
■■ SRR/Mission Definition Review, and Key
implementation of new exploration technologies by reaching a
Decision Point (KDP)-B for Deep Space Optical key milestone in at least four small spacecraft projects.
Communications
Lead Office NASA is maintaining and advancing U.S. global leadership in aviation
Aeronautics Research Mission through application of new concepts and technologies pioneered by
Directorate (ARMD) NASA and developed in partnership with U.S. industry, leading to trans-
formative improvements in mobility, efficiency, and safety.
Goal Leader
Robert A. Pearce, Deputy Associate
Administrator for Strategy, ARMD 2018 Strategic Review Summary of
Progress
The Aeronautics Research Mission Directorate designs, develops,
Budget and tests advanced technologies that will make aviation much more
environmentally friendly, maintain safety in more crowded skies, and ulti-
FY $M mately transform the way the United States and the world flies. Research
conducted by ARMD directly benefits today’s air transportation system,
Actual 2018 690.0 the aviation industry, and the passengers and businesses who rely on
Enacted 2019 685.0 aviation every day. Efforts that supported the assessment included:
Requested 2020 666.9 ■■ The Low-Boom Flight Demonstration contract was awarded
April 2, 2018. The Strategic Review was completed in
2021 673.6
spring 2018, and the LBFD project team completed the Key
2022 680.3 Decision Point (KDP)-C in the first quarter of FY 2019.
Outyear
2023 587.1 ■■ ARMD was on track to complete the Airspace Technology
2024 587.0 Demonstration (ATD)-1 and ATD-2 and deliver the
results to the Federal Aviation Administration accord-
ing to the Research Transition Team plan by FY 2020
(i.e., ARMD’s Thrust #1 Critical Commitment).
Above: NASA test pilots Jim Less and Wayne Ringelberg conduct pre-flight safety checks for a F/A-18 before going out on a supersonic
QSF18 flight, part of NASA’s Low-Boom Flight Demonstration. Image credit: NASA/Josh Valcarcel
■■ ARMD was on track to deliver its first As NASA conducts its 2019 Strategic Review, to be
flight validated community response data- completed in spring 2019, it will conduct a retrospec-
base to the International Civil Aviation tive and prospective analyses to determine if the pro-
Organization by end of FY 2024. grams supporting this strategic objective are healthy
and can address potential or realized risks. Part of the
Performance Measures for retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Strategic Objective 3.2 pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
The following pages provide the performance goals mance indicators. The results of this early assessment
and annual performance indicators supporting will inform planning for the FY 2021 Performance
Strategic Objective 3.2. They include the final perfor- Plan, which will begin in spring 2019.
mance results for FY 2018, the FY 2019 Performance
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
for the performance goals and annual performance
indicators supporting Strategic Objective 3.2.
Performance Goal 5 1
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
Phase 1 Benefits
As of September 17, 2018
638,068 pounds of fuel saved Above: NASA Administrator Jim Bridenstine (right) partici-
pates in a FutureFlight Central demonstration of ATD-2 at
Ames Research Center on August 30, 2018. He is looking at
89.1 hours of surface delay avoided the Ramp Traffic Console, a new technology tested through
human-in-the-loop simulation and currently deployed to the
2013 2014 2015 2016 2017 2018 AR-20-2: Conduct an operational assessment of the
No API Green Green Green Green Green Integrated Arrival/Departure/Surface (IADS) metroplex depar-
ture management prototype.
component of aircraft noise by at least 1.5 AR-19-8: Demonstrate tools and methodologies able to re-
duce the timeline to develop and certify composite structures
decibels (dB). and demonstrate timeline benefit through systems analysis.
No API in FY 2020
2013 2014 2015 2016 2017 2018
No APIs before FY 2017 Green Green
Progress continues in the area of alternative jet AR-18-5: Design, build, and test key
fuel research with the development and testing of ambient-temperature electric aircraft
a small-core fuel-flexible combustor in conjunction
with a United Technologies Research Center. Testing
powertrain components that achieve
in that area will be completed in the first quarter of specific performance parameters
FY 2019. The X-57 Maxwell Scaled Convergent necessary for large commercial
Electric Propulsion Technology Operations Research applications.
(SCEPTOR) sub-project successfully completed a
re-plan effort to ensure a viable path to successful 2013 2014 2015 2016 2017 2018
completion of the flight demonstration.
No API Green Green Green Red Green
Progress also continues in the area of hybrid
gas-electric propulsion by moving forward in design- Planned Annual Performance Indicators
ing a full-scale, 1-megawatt (MW) power inverter AR-19-5: Design, assemble, and initiate testing of a megawatt
and electric motor. General Electric’s Silicon-Carbide (MW)-scale electrified aircraft powertrain.
Lightweight Inverter for Megawatt-Power inverter and AR-20-7: Complete Preliminary Design Review (PDR) of a
the University of Illinois high-speed, high-frequency air full-scale powertrain for hybrid gas-electric aircraft.
core machine have shown full-scale, 1-MW designs
that meet the requirements of the associated annual
performance indicator, AR-18-5. Going even further
than the requirements of the annual performance indi-
cator, full-scale builds and sub-scale tests to establish
the feasibility of the designs are planned for the first AR-19-12 [Begins in FY 2019]
quarter of FY 2019.
Planned Annual Performance Indicators
No API in FY 2020
As the National Airspace System expands and active learning method that learns from domain expert
becomes more complex, it has become more chal- feedback on whether the statistical anomalies are
lenging to maintain the current high level of safety. safety issues or false alarms, with the goal of reducing
NASA is developing tools for real-time safety monitor- the false alarm rate on future data.
ing and prediction to improve safety in the NAS and
support envisioned operational growth. NASA has significantly sped up data pre-process-
ing to improve data usability. Additionally, NASA will
NASA completed a real-time safety monitoring frame- begin work with MITRE on identifying additional work
work with a set of safety monitoring metrics and infor- needed to make its data-driven methods more useful
mation about current potentially adverse conditions, to safety analysts. NASA, in collaboration with the
which are automatically monitored in real-time. The Federal Aviation Administration, has demonstrated
real-time safety monitoring framework supports a vari- success in identifying operationally significant anom-
ety of users, from those who need a broad overview of alies in Threaded Track data, a compilation of sur-
a day’s flight operations to those who need to decide veillance sources into a representation of an aircraft’s
on a control tactic to employ within the next few optimal end-to-end trajectory. Threaded Track data
minutes. Using an intelligent interface, the real-time also allows a wide range of safety, efficiency, and
safety monitoring framework predicts conditions within security analyses. NASA is working with Booz Allen
a specified prediction horizon. The real-time safety Hamilton on extracting data from Aviation Safety
monitoring framework gives users access to informa- Reporting System reports and will also explore the
tion about adverse conditions in time to make efficient possible use of additional data sources with the goal
preemptive decisions without sacrificing safety. The of identifying leading and lagging indicators of safety
real-time safety monitoring framework was integrated issues.
with the NASA test-bed and demonstrated using live
data from the National Airspace System.
NASA, in collaboration with the MITRE Corporation,
demonstrated progress in identifying operationally
significant anomalies in flight operations quality assur-
ance data. NASA developed an anomaly detection
algorithm, Multiple Kernel Anomaly Detection. For this
project, it identifies anomalies in Flight Operations
Quality Assurance data, which are data collected
onboard commercial aircraft. Like most anomaly
detection methods, Multiple Kernel Anomaly Detection
identifies data points that are statistically anomalous,
some of which may be safety issues, but the remain-
ing of which are false alarms. NASA has developed an
Lead Offices NASA is inspiring, engaging, educating, and employing the next genera-
Missions Support Directorate (MSD) and tion of explorers through NASA-unique science, technology, engineering
Office of Communications (OCOM) and mathematics (STEM) learning opportunities
Goal Leader
Bettina Inclãn, Associate Administrator, 2018 Strategic Review Summary of
OCOM
Progress
The Mission Support Directorate enables the Agency’s missions by
Budget managing institutional services and capabilities. MSD is actively reduc-
ing institutional risk to NASA’s current and future missions by improv-
FY $M ing processes, stimulating efficiency, and providing consistency and
Actual 2018 108.4 uniformity across institutional standards and practices. The Office of
Communications develops and implements outreach strategies to
Enacted 2019 118.1 communicate NASA’s activities to a wide audience. OCOM ensures that
Requested 2020 8.3 NASA uses consistent messaging across the Agency and that communi-
cations activities are consistent with the priorities identified in the NASA
2021 8.3
2018 Strategic Plan. Efforts that supported the assessment included:
2022 8.3
Outyear ■■ OCOM was on track to realign the communication campaigns to
2023 8.3 reflect NASA’s current policy direction.
2024 8.3
Above: Students run the robot they designed and built through an obstacle course at the NASA Community College Aerospace Scholars
Program (NCAS) Robotics competition in June 2018. Image credit: NASA
■■ NASA’s Office of Diversity and Equal The FY 2020 Budget proposes the termination of
Opportunity (ODEO) continued to conduct more NASA’s traditional education portfolio of domestic
than the required number of compliance reviews assistance awards (grants and cooperative agree-
of grantee institutions annually. ments) that are fully funded in the year of the award
■■ Significant progress had been made to define or annually funded with a performance period of
and establish the Agency’s STEM engagement three to five years. Therefore, the Office of STEM
function, guiding policies, and governance model [science, technology, engineering, and mathematics]
for operations. Engagement performance areas presented in the
following pages do not include a performance plan for
FY 2020.
Performance Measures for
As NASA conducts its 2019 Strategic Review, to be
Strategic Objective 3.3 completed in spring 2019, it will conduct a retrospec-
tive and prospective analyses to determine if the pro-
The following pages provide the performance goals grams supporting this strategic objective are healthy
and annual performance indicators supporting and can address potential or realized risks. Part of the
Strategic Objective 3.3. They include the final perfor- retrospective analyses will take into consideration the
mance results for FY 2018, the FY 2019 Performance FY 2018 performance results found on the following
Plan Update, which NASA considers final for FY 2019, pages. Looking forward, NASA will assess whether
and the initial FY 2020 Performance Plan. Below are it is on track to achieve the FY 2019 annual perfor-
charts summarizing the FY 2018 performance ratings mance indicators. The results of this early assessment
for the performance goals and annual performance will inform planning for the FY 2021 Performance
indicators supporting Strategic Objective 3.3. Plan, which will begin in spring 2019.
Summary of Strategic Objective 3.3: Inspire and engage the public in aeronautics,
space, and science.
Performance Goal 5
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
During FY 2018, NASA launched its official presence The Office of Communications (OCOM) conducted
on Reddit, allowing their large and diverse audience to an analysis of stories on NASA’s Snapchat and
directly engage NASA subject matter experts. NASA Instagram accounts and determined that each story
also distributed regularly scheduled video series should be less than 10 slides in length. By slightly
through the Facebook Watch feature. tweaking how much content is added to Instagram,
Snapchat, or Facebook stories on any given day,
NASA partnered with American Girl on the 2018 Girl the social media team has decreased user drop-off
of the Year, Luciana Vega, an ambitious 11-year-old as more followers are watching the entire story. For
girl who aspires to be an astronaut and the first girl example, a four-slide story posted during the Mars
to put footprints on Mars. The partnership resulted Close Approach on July 30, 2018, had a 62 percent
in a three-book series and NASA-inspired products, completion rate, as compared with previously pub-
including an extravehicular activity spacesuit, space lished 10-slide stories that garner anywhere between
habitat, robotics workbench, and other features. NASA a 40 percent and 50 percent completion rate.
also continued its collaboration with LEGO, including
merchandise approvals for the following LEGO sets:
NASA Apollo Saturn V and Women of NASA.
AMO-20-1: Add at least one new communications technology, AMO-20-2: Add at least one new communications technology,
platform, tool, or method to make more effective operations platform, tool or method to achieve more systematic mea-
and use of resources in alignment with the communications surement and evaluation of reach, outcomes, and value of
priorities. Agency communications investments.
Explore Flight
NASA’s with you when
AMO 18-17: Strengthen strategic you fly.
communications planning by
improving alignment of Agency-
wide communications activities with
both Office of Communications and Explore Humans
in Space
NASA strategic goals and objectives,
Leading discovery,
including established processes of improving life on Earth.
communications activities prioritization
and campaign teams for execution.
NASA launched and began conducting equal oppor- AMO-18-4: Continue to conduct civil
tunity reviews on three recipients of NASA financial rights compliance assessments at a
assistance in FY 2018, including two university
science, technology, engineering, and mathematics
minimum of two STEM or STEM-related
(STEM) programs and one science museum/center. In programs that receive NASA funding; and
all, NASA has conducted over 70 compliance reviews broaden the scope of civil rights technical
since 2006 to better ensure equal opportunities and assistance to NASA grantees through
promote diversity and inclusion in both formal and the MissionSTEM website, focused
informal STEM education.
on grantee civil rights requirements
The MissionSTEM website is the Agency’s center- and promising practices for grantee
piece for technical assistance on diversity and equal compliance and diversity and inclusion.
opportunity for its grant recipient institutions and
their participants. NASA has established a vigorous
civil rights compliance review program for its grantee 2013 2014 2015 2016 2017 2018
institutions and a robust technical assistance effort Green Green Green Green Green Green
centered on its MissionSTEM website. These efforts
are designed to better ensure equal opportunity in
programs receiving NASA grants and cooperative or
Planned Annual Performance Indicators
Space Act Agreement funding. Analytics show that
the site had at least 4,200 new visitors every month in AMO-19-4: Continue to conduct civil rights compliance
2018. assessments at a minimum of two STEM or STEM-related
programs that receive NASA funding; and broaden the scope
of civil rights technical assistance to NASA grantees through
Equal Opportunity in Programs Receiving the MissionSTEM website, focused on grantee civil rights
NASA Cooperative and Space Act requirements and promising practices for grantee compliance
Agreement Funds and diversity and inclusion.
ODEO ensures programs and activities have a broad AMO-20-4: Conduct civil rights compliance assessments at
impact on the larger STEM community. a minimum of two NASA-funded STEM or STEM-related pro-
grams, and broaden the scope of civil rights technical assis-
tance to NASA grantees through the MissionSTEM website,
focusing on grantee civil rights requirements and promising
750 science centers, museums, and
research institutes practices for grantee compliance and diversity and inclusion.
Moving forward, NASA will reassess annual perfor- Higher Education Significant Awards
mance indicators used for this goal, to better reflect
Percentage That Meet or Exceed National Average
agency-wide efforts to support a diverse aerospace
workforce. NASA will also review its existing STEM Category NASA National
efforts to ensure alignment with the Federal STEM Actual Average**
strategic plan, Charting a Course for Success:
Racially or ethnically underrep-
America’s Strategy for STEM Education, which seeks resented student participants
30.7 24.5
to increase diversity, equity, and inclusion in STEM.
Higher education interns and
The Office of STEM Engagement exceeded the fellows identified as Hispanic 15.9 14.4
or Latino
national average of participation of STEM higher
education students self-reporting as being of under- Racial categories tradition-
ally underrepresented in 17.6 9.6
represented race or ethnicity. NASA’s performance in STEM fields
diversity is examined across ethnicity, race, gender,
Women 36.4 40.6
and disability status of higher education students who
received significant awards. In FY 2017,* OSTEM Persons with disabilities 2.12 10.5
provided 7,409 higher education significant awards ** National averages were obtained from the U.S. Department of
(e.g., internships, fellowships, scholarships, and other Education’s National Center for Education Statistics Integrated
significant engagement opportunities such as engi- Postsecondary Education Database
neering design challenges with greater than 160 hours
of participation) to higher education students across
all institutional categories and levels.
Above: NASA’s summer 2018 Headquarters interns pose for a photo with NASA Administrator Jim Bridenstine. Image credit: NASA/Aubrey
Gemignani
Completed Action Items and Milestones 2013 2014 2015 2016 2017 2018
■■ Established the STEM Engagement Council to No APIs before FY 2018 Green
provide strategic direction, planning, operational
integration and oversight, assessment, and
Planned Annual Performance Indicator
stakeholder management of NASA’s compre-
hensive set of STEM engagement functions and STEM-19-2: Design a comprehensive data management
system aligned to performance assessment and evaluation
activities.
strategy to collect, analyze, and report data for STEM en-
■■ Completed an assessment of infrastructure, gagement investments.
tools, and systems.
No API in FY 2020
■■ Created a new performance measurement and
assessment strategy, framework, and learning
agenda.
■■ Refined evaluation business processes.
■■ Developed an Agency wide STEM engagement
strategy.
No API in FY 2020
No API in FY 2020
The 2020 Budget proposes to terminate funding for Planned Annual Performance Indicator
the Office of STEM Engagement, including Space
STEM-19-3: Conduct a multiple case study focused on NASA
Grant, EPSCoR, and MUREP. The Budget continues
STEM engagement higher education challenges, competi-
to support other STEM-related activities, such as tions, and internships to build knowledge about how these
internships funded outside of OSTEM, in support of activities: a) contribute to NASA’s aeronautics, space, and
Performance Goal 3.3.5. science missions; b) align to evidence-based effective practic-
es for STEM learning; and c) recruit and retain participants
from groups historically underrepresented and/or underserved
in STEM fields.
Strategic Goal 4
Optimize capabilities and operations.
On May 3, 2018, a crane lifts the InSight mission, which is enclosed in the payload fairing shown here, onto an Atlas-V rocket
at Space Launch Complex-3 at Vandenberg Air Force Base, California. The InSight mission was delivered by flatbed trailer to
Vandenberg on April 23, and teams worked to mate the fairing to rocket for the May 5 mission launch. Image credit: NASA/Bill
Ingalls
Part 2—Strategic Goal 4 Enable
Above: NASA astronauts Peggy Whitson and Jack Fischer move a payload on to the NanoRacks External Platform (NREP) to prepare them
for deployment via an airlock in the Japanese Experiment Module on the International Space Station. NREP is a commercial platform that
gives customers access to the extreme space environment. Image credit: NASA
■■ NASA will continue to evaluate utilization and As NASA conducts its 2019 Strategic Review, to be
benefits of the best-in-class, strategic sourcing completed in spring 2019, it will conduct a retrospec-
solution(s), Agency-level managed contracts tive and prospective analyses to determine if the pro-
(Tier 1), and increased competition through grams supporting this strategic objective are healthy
open market purchase for the best value for the and can address potential or realized risks. Part of the
Government. retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Performance Measures for pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
Strategic Objective 4.1 mance indicators. The results of this early assessment
will inform planning for the FY 2021 Performance
The following pages provide the performance goals Plan, which will begin in spring 2019.
and annual performance indicators supporting
Strategic Objective 4.1. They include the final perfor-
mance results for FY 2018, the FY 2019 Performance
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
for the performance goals and annual performance
indicators supporting Strategic Objective 4.1.
Performance Goal 3
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
FY 2020 - TBD
Overall NASA has achieved savings for both the and provides the Government with the flexi-
Agency and Federal strategic sourcing initiatives bility to evaluate both actual performance and
through increased contract efficiencies and reduced the conditions under which it was achieved.
transaction cost in procurement. These initiatives and For FY 2018, the dollar value of CPAF con-
the cost savings/avoidance have generated efficien- tracts remain consistent compared to FY 2017
cies and savings across the Agency and are expected ($6.8 billion in FY 2018 versus $6.8 billion in
to continue and, in some cases, increase in coming FY 2017).
years. »» For FY 2018, the number of new delivery and
The Office of Procurement has achieved cost savings/ task orders issued steadily decreased, with
avoidance for NASA by reducing the cost of getting a decrease of about 6 percent compared to
the contract work done (i.e., transaction costs). Of FY 2017 (2,891 in FY 2018 versus 2,986 in
the eight contract efficiencies initiatives NASA iden- FY 2017).
tified for FY 2018, six (or 75 percent) were effective, ■■ NASA Shared Services Center (NSSC) Next
with a slight increase in the total dollars awarded of Generation. The NSSC contract’s primary objec-
non-competed actions compared with FY 2017. The tive is to enable the NSSC to continue to provide
Office of Procurement is focusing on the following over 50 business, technical, and administra-
areas to achieve efficiencies and savings across the tive services to customers across the Agency,
Agency: reduce contract lead times, use of less com- utilizing a shared services business model. The
plex evaluation procedures when appropriate, reduce NSSC Transactional savings resulting from the
the number of task orders, consolidate software consolidations achieved an approximate cost
licenses, reduce the use of award fee contracts and avoidance in FY 2018 of $6.55 million.
reduce the number of incremental funding/de-obliga-
tion actions. Some significant examples are below: NASA also continues to make strides and achieve
savings for the Agency through effective use of
■■ Reducing and Managing High Risk Contract strategic sourcing strategies, both at the Federal and
Actions. NASA continues to make significant Agency level. Of the 10 strategic sourcing initiatives
progress in the reduction and the management NASA identified for FY 2018, 10 (or 100 percent)
of high-risk contract actions. achieved cost avoidance. Significant examples of
»» Cost-plus-award fee (CPAF) contracts pay efforts resulting in savings and usage of strategic
a fee based on the contractor’s work per- sourcing efforts are summarized below:
formance, determined subjectively by a fee ■■ Solutions for Enterprise-Wide Procurement
determination official. A cost-plus contract is (SEWP) V is a multi-award, government-wide
often used when the work to be performed is acquisition contract that negotiates cost avoid-
such that it is neither feasible nor effective to ance/savings through leveraged purchases,
devise predetermined objective incentive tar- reduced fees for utilization (fee avoidance), and
gets applicable to cost, schedule, and techni- decreased price per unit compared to current
cal performance; and the likelihood of meeting higher market prices (cost avoidance). For
acquisition objectives will be enhanced by FY 2018, the total SEWP V fee cost avoidance
using a contract that effectively motivates the and the total negotiated cost avoidance/saving
contractor toward exceptional performance combined was approximately $6.7 million, an
amount that reflects an adjustment to account for AMO-18-9: Achieve savings in at least
the administrative cost of running the program. 70 percent of identified procurement
■■ Enterprise License Management Team (ELMT) initiatives through effective use of both
is an Agency-based, strategic sourcing effort to Federal-level and Agency-level strategic
consolidate software license across the Agency.
ELMT continues to identify and add additional
sourcing approaches.
software to its inventory. This increases NASA’s
buying power by lowering the price per unit, 2013 2014 2015 2016 2017 2018
resulting in increased savings. The ELMT pro- Green Green Green Green Green Green
gram has achieved an estimated $64.9 million in
savings (cost avoidance) in FY 2018. Planned Annual Performance Indicators
■■ Synergy Achieving Consolidated Operations AMO-19-10: Achieve savings in at least 70 percent of
and Maintenance (SACOM) contract consoli- identified procurement initiatives through effective use of
dates base operations support for the Michoud both Federal-level and Agency-level strategic sourcing
Assembly Facility and the Stennis Space Center. approaches.
The SACOM procurement achieved an estimated
$27.3 million in cost avoidance in FY 2018 by TBD
providing business at a reduced cost, based on
previous prices paid.
■■ Continuation of NASA’s Infrastructure Technology
(IT) Infrastructure Integration Program (I3P)
Activities have achieved an estimated $15.49
million in savings in FY 2018. These Agency- AMO-18-10: Achieve savings in at least
based strategic sourcing efforts represent negoti-
70 percent of identified procurement
ated cost avoidance/savings and fee avoidance.
initiatives through increased contract
efficiencies and reduced transaction
IT Infrastructure Integration Program costs in NASA procurements.
Contracts FY 2018 Cost Avoidance
Millions of Dollars 2013 2014 2015 2016 2017 2018
Green Green Green Green Green Green
I3P Contract Cost Avoidance
EAST2 $2.37
Planned Annual Performance Indicators
ACES $3.29
NICS $8.46 AMO-19-9: Achieve savings in at least 70 percent of identified
Networx $1.37 procurement initiatives through increased contract efficiencies
and reduced transaction costs in NASA procurements.
Total $15.49
TBD
FY 2020 - TBD
Lead Office NASA is supporting the communication, launch service, rocket propulsion
Human Exploration and Operations testing, and strategic capabilities needs of NASA’s programs.
Mission Directorate (HEOMD)
Above: SpaceX’s Dragon spacecraft lifts off on a Falcon 9 rocket from Cape Canaveral Air Force Station in Florida on June 29, 2018, on its
way to the International Space Station. Image credit: SpaceX
■■ On February 8, 2018, Space Communications Plan Update, which NASA considers final for FY 2019,
and Navigation (SCaN) successfully transferred and the initial FY 2020 Performance Plan. Below are
the Tracking and Data Relay Satellite (TDRS)-13 charts summarizing the FY 2018 performance ratings
to the Space Network Project for operations. for the performance goals and annual performance
■■ The Rocket Propulsion Test Program (RPT) indicators supporting Strategic Objective 4.2.
achieved a 99.1 percent facility availability, far As NASA conducts its 2019 Strategic Review, to be
exceeding its target of 90 percent facility readi- completed in spring 2019, it will conduct a retrospec-
ness. tive and prospective analyses to determine if the pro-
■■ The Launch Support Program (LSP) completed grams supporting this strategic objective are healthy
the Falcon 9 Full Thrust Category-2 Certification and can address potential or realized risks. Part of the
in January 2018. retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Performance Measures for pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
Strategic Objective 4.2 mance indicators. The results of this early assessment
will inform planning for the FY 2021 Performance
The following pages provide the performance goals Plan, which will begin in spring 2019.
and annual performance indicators supporting
Strategic Objective 4.2. They include the final perfor-
mance results for FY 2018, the FY 2019 Performance
Performance Goal 7 1
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
U.S. commercial providers exceeded the target ISS-18-7: Complete at least three flights,
of three commercial cargo launches for this per- delivering research and logistics
formance goal to be rated green. There were five
commercial cargo launches by U.S. providers in
hardware to the International Space
FY 2018, delivering research and logistics hardware Station (ISS), by U.S.-developed cargo
to the International Space Station. Two deliveries, delivery systems.
in November 2017 and May 2018, were provided by
Orbital ATK.1 Three deliveries, in December 2017,
2013 2014 2015 2016 2017 2018
April 2018, and July 2018, were provided by Space
Explorations Technologies Corporation (SpaceX). Green Green Yellow Green Green Green
The Commercial Crew Program and its industry CS-18-1: Continue monitoring partner
partners, the Boeing Company (Boeing) and SpaceX, milestone progress toward identifying
continue to make measurable technical and program-
matic progress toward the certification of commer-
and closing certification products, in
cial crew transportation systems. However, in late alignment with negotiated contract
June 2018, Boeing experienced an anomaly while milestones, including the completion
conducting a hot fire test of its test service module’s by the Boeing Company of its planned
abort engines. As a result of the anomaly, Boeing was Service Module hot fire, launch abort test.
unable to complete the pad abort test during the fiscal
year.
During the static pad abort test, conducted at NASA’s 2013 2014 2015 2016 2017 2018
White Sands Test Facility, Boeing tested engines that No PG Green Green Green Yellow Yellow
would propel the service module away from its launch
vehicle if an emergency is detected on the pad or
during ascent. The test is an important step in certi- Planned Annual Performance Indicators
fying the spacecraft for flight. Boeing is analyzing the CS-19-1: Continue monitoring partner milestone progress
test data to identify the root causes, and will provide toward identifying and closing certification products, in
NASA an updated schedule for this milestone. alignment with negotiated contract milestones, including the
completion by at least one of NASA’s industry partners of its
SpaceX completed its milestones, including comple- Certification Review.
tion of the qualification testing program of its Merlin CS-20-1: Continue monitoring partner progress toward negoti-
1D engine for use in the Falcon 9 rocket, which will ated contract milestones, to include at least one industry part-
carry the SpaceX crew module. ner having a certified crew transportation system and making
demonstrable progress toward its post-certification missions.
Above: The upper and lower domes of the Boeing CST-100 Above: The SpaceX Crew Dragon spacecraft that will be used
Starliner Spacecraft 2 Crew Flight Test Vehicle were mated June for the company’s uncrewed flight test, known as Demonstration
19, 2018, inside the Commercial Crew and Cargo Processing Mission 1, arrived at Cape Canaveral Air Force Station in Florida
Facility (C3PF) at Kennedy Space Center in Florida. The Starliner on Tuesday, July 10, 2018. The spacecraft recently underwent
will launch astronauts on a United Launch Alliance Atlas V rocket thermal vacuum and acoustic testing at NASA’s Plum Brook Station
to the International Space Station enabled by NASA’s Commercial in Ohio. The Demonstration Mission 1 flight test is part of NASA’s
Crew Program. Image credit: Boeing Commercial Crew Transportation Capability contract with the goal
of returning human spaceflight launch capabilities to the United
States. Image credit: SpaceX
No PG in FY 2020
Performance Goal 4.2.4: Review the current state of the NASA test
capabilities, known test requirements, and test requests, and ensure
their availability to meet the Nation’s needs.
The RPT Program continually monitors the state of SFS-18-2: Sustain 90 percent availability
NASA’s test capabilities, known test requirements, of test facilities to support NASA
and test requests. NASA uses weekly Rocket
Propulsion Test Management Board teleconferences
and other customers’ planned test
and semi-annual Program Manager Reviews to mon- requirements.
itor the condition and operational state of all facilities
and to work solutions as needed. The board tracks
current test activities, requirements for upcoming 2013 2014 2015 2016 2017 2018
tests, and requests for future testing. Green Green Green Green Green Green
LSP sustained a 100 percent success rate for SFS-18-3: Sustain a 100 percent success
FY 2018, with the successful launch of seven mis- rate with the successful launch of
sions aboard seven different launch vehicle configu-
rations supporting missions from both the east coast
NASA-managed expendable launches as
and west coast launch bases. LSP also successfully identified each fiscal year on the Launch
completed all acquisitions scheduled for award in Services Flight Planning Board manifest.
FY 2018. Each acquisition was awarded on-time,
and met customer requirements. In October 2017,
2013 2014 2015 2016 2017 2018
launch service task orders were awarded for both the
Sentinel-6A and Landsat 9 missions. Launch services Green Green Green Green Green Green
task order acquisitions are in work for the GOES-T,
Imaging X-ray Polarimetry Explorer (IXPE), Lucy, and Planned Annual Performance Indicators
the Double Asteroid Redirection Test (DART) mis- SFS-19-3: Sustain a 100 percent success rate with the
sions. successful launch of NASA-managed expendable launches
as identified each fiscal year on the Launch Services Flight
FY 2018 Launches Planning Board manifest.
■■ November 18, 2017 - Joint Polar Satellite System SFS-20-3: Sustain a 100 percent success rate with the
(JPSS)-1 successful launch of NASA-managed expendable launches
as identified each fiscal year on the Launch Services Flight
■■ March 1, 2018 - Geostationary Operational Planning Board Manifest.
Environmental Satellite (GOES)-S
■■ May 22, 2018 - Gravity Recovery and Climate
Experiment Follow-on (GRACE-FO)
■■ April 18, 2018 - Transiting Exoplanet Survey SFS-18-4: Complete acquisitions on time
Satellite (TESS) for NASA-managed expendable launches.
■■ May 5, 2018 - Interior Exploration using Seismic
Investigations, Geodesy and Heat Transport 2013 2014 2015 2016 2017 2018
(InSight) No API Green Green Green Green Green
■■ August 12, 2018 - Parker Solar Probe (PSP)
■■ September 15, 2018 - Ice, Cloud, and land Planned Annual Performance Indicators
Elevation Satellite (ICESat)-2
SFS-19-4: Complete acquisitions on time for NASA-managed
expendable launches.
SFS-20-4: Complete acquisitions on time for NASA-managed
expendable launches.
Performance Goal 4.2.7: Replace the aging Deep Space Network (DSN)
infrastructure.
In FY 2018, SCaN continued construction of its two SFS-18-6: Continue the Deep Space
new antennas, Deep Space Station (DSS)-53 and Network Aperture Enhancement Project
DSS-56 at the Madrid Deep Space Communications
Complex in FY 2018. SCaN completed construction
(DAEP) at the Madrid Deep Space
on the dishes’ pedestals, which support the 34-meter Communications Complex (MDSCC) by
antenna structures and house the electronic and radio completing the pedestal construction of
frequency equipment critical to their operation. The both Deep Space Station (DSS)-56 and
antenna structures are being erected on top of the DSS-53 by the end of FY 2018.
pedestals, and the electronics work is on schedule.
The Madrid Deep Space Communications Complex,
located in Spain, is part of NASA’s Deep Space 2013 2014 2015 2016 2017 2018
Network and provides communications to and from Green Green Green Green Green Green
interplanetary spacecraft.
Planned Annual Performance Indicators
SFS-19-6: Continue the Deep Space Network Aperture
Enhancement Project (DAEP) at the Madrid Deep Space
Communications Complex (MDSCC) by completing the
construction milestones to lift the antenna reflector for Deep
Space Station (DSS)-56 and to deliver the 20-kilowatt trans-
mitter for DSS-53 by the end of FY 2019.
Lead Office NASA is assuring effective management of NASA programs and opera-
Technical Authorities: Office of the Chief tions to complete the mission safely and successfully.
Engineer (OCE), Office of the Chief
Health and Medical Officer (OCHMO),
and Office of Safety and Mission 2018 Strategic Review Summary of
Assurance (OSMA)
Progress
Goal Leader
Harold Bell, Deputy Chief, OSMA NASA’s Safety and Mission Success programs incorporate the work
of multiple offices and facilities to protect the health and safety of the
NASA workforce and improve the likelihood that the Agency’s programs,
projects, and operations will be completed safely and successfully. These
offices and facilities include the Office of the Chief Engineer, Office of
Budget the Chief Health and Medical Officer, Office of Safety and Mission
Assurance, the NASA Safety Center, and NASA’s Independent
FY $M Verification and Validation Facility. Efforts that supported the assess-
Actual 2018 175.7 ment included:
Enacted 2019 175.1 ■■ Zero fatalities or permanent disabling injuries to the public resulting
from NASA activities.
Requested 2020 192.0
■■ Active engagement with NASA programs and institutions in order to
2021 192.0 advise, advocate, and ensure safety and mission success.
2022 194.2
Outyear ■■ Robust knowledge management and communities of practice that
2023 186.2 capture and integrate lessons learned into future missions.
2024 186.2
Above: Engineers use fake smoke to imitate a scenario in which astronauts must exit the Orion capsule when their vision is obscured. The
simulation was part of safety evaluations conducted in late October 2017. Image credit: NASA/Rad Sinyak
Performance Measures for and can address potential or realized risks. Part of the
retrospective analyses will take into consideration the
Strategic Objective 4.3 FY 2018 performance results found on the following
pages. Looking forward, NASA will assess whether
The following pages provide the performance goals it is on track to achieve the FY 2019 annual perfor-
and annual performance indicators supporting mance indicators. The results of this early assessment
Strategic Objective 4.3. They include the final perfor- will inform planning for the FY 2021 Performance
mance results for FY 2018, the FY 2019 Performance Plan, which will begin in spring 2019.
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
for the performance goals and annual performance
indicators supporting Strategic Objective 4.3.
As NASA conducts its 2019 Strategic Review, to be
completed in spring 2019, it will conduct a retrospec-
tive and prospective analyses to determine if the pro-
grams supporting this strategic objective are healthy
Performance Goal 2
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
In FY 2018, NASA continued to ensure the safety AMO-18-25: Achieve zero fatalities or
and health of its activities and minimized the damage permanent disabling injuries to the public
to its assets. There were no fatalities or permanent
disabling injuries to the public from NASA activities in
resulting from NASA activities during
FY 2018. Health issues that have impacted an astro- FY 2018.
naut’s medical certification have been reviewed and
dispositioned within one month of the time of diagno- 2013 2014 2015 2016 2017 2018
sis. Employees filing workers’ compensation claims Green Green Green Green Green Green
have been contacted within three days of receiving a
request for assistance with documentation, and these
Planned Annual Performance Indicators
requests have been dispositioned within 30 days.
AMO-19-13: Achieve zero fatalities or permanent disabling
NASA has achieved a Total Case Rate and Lost Time injuries to the public resulting from NASA activities during
Case Rate beyond the injury and illness goals of the FY 2019.
Administration. Specifically, an agency must have total
and lost time injury rates at least one percent below its AMO-20-8: Achieve zero fatalities or permanent disabling
prior year rates. If an agency has a rate of one injury injuries to the public resulting from NASA activities during
FY 2020.
or illness per 100 employees per year or less, no fur-
ther reductions are required. NASA’s Total Case Rate
is currently significantly under one injury or illness
per 100 employees per year; at the end of FY 2018, AMO-18-26: Maintain a Total Case Rate
NASA’s FY 2018 Total Case Rate is 0.19 and NASA’s and Lost Time Case Rate below 1.0 cases
Lost Time Case Rate is only 0.03.
per 100 employees.
NASA continued implementing policies, procedures, The Academy of Program/Project and Engineering
and oversight necessary to improve the probability of Leadership (APPEL) maintains and funds remote
technical and programmatic mission success. NASA database and reference material access capabilities
assigns projects to category 1,2, or 3 based on the to allow 100 percent of the program and project man-
estimated lifecycle costs and priority level. During FY agement community access to the materials needed
2018, 100 percent of the category 1 and 2 projects to achieve or maintain their certification requirements.
complied with Safety and Mission success policies The materials required by the workforce are main-
and procedures. All projects that conducted lifecycle tained on an Agency-accessible community of practice
reviews had independent reviews scheduled. All cate- knowledge website. During FY 2018, the website did
gory 1 and 2 projects were executing to an approved not experience non-scheduled outages. Furthermore,
plan or were in an approved re-baseline planning the NASA Engineering Network availability was 99.7
cycle. The NASA Engineering and Safety Center sup- percent, exceeding the requirement of greater than 98
ported all requested assessments for category 1 and percent. The NASA Engineering Network provides an
2 projects meeting the NASA Engineering and Safety online forum for engineering and programmatic work-
Center’s established acceptance criteria. force to share lessons learned, interact with subject
matter experts, find useful tools and resources, and
In addition, the entire engineering and programmatic keep up with current events.
workforce had access to the standards and knowl-
edge base necessary to maintain and build their skills.
Lead Office NASA is cultivating a diverse and innovative workforce with the right bal-
Mission Support Directorate (MSD) ance of skills and experience to provide an inclusive work environment
and Office of the Chief Human Capital in which employees that possess varying perspectives, education levels,
Officer (OCHCO) life experiences, and backgrounds can work together and remain fully
engaged in the Agency’s Mission.
Goal Leader
Daniel Tenney, Associate Administrator,
MSD 2018 Strategic Review Summary of
Progress
Budget The Mission Support Directorate enables the Agency’s missions by
managing institutional services and capabilities. MSD is actively reduc-
ing institutional risk to NASA’s current and future missions by improving
FY $M
processes, stimulating efficiency, and providing consistency and uni-
Actual 2018 38.4 formity across institutional standards and practices. The Office of the
Enacted 2019 68.5 Chief Human Capital Officer, part of MSD, helps NASA maintain an
adaptable and skilled workforce. OCHCO is responsible for building and
Requested 2020 69.2 maintaining an integrated talent management model that addresses the
2021 68.6 entire employee lifecycle. It also provides workforce analytics that deliver
strategic insight and measures success through integrated human capital
2022 68.8
Outyear systems. Efforts that supported the rating included:
2023 67.8
■■ NASA will fully implement human capital at NASA as a line of busi-
2024 67.4 ness focused on people, process, operations, and technology with
established leadership, budget, full-time equivalent authority, and
delegations of authority in place.
Above: Program team members cheered the end of a successful mission after operators deliberately plunged the Cassini spacecraft into
Saturn on September 15, 2017. Image credit: NASA/Joel Kowsky
■■ NASA will fully develop effectiveness and As NASA conducts its 2019 Strategic Review, to be
accountability metrics and tracking mechanisms completed in spring 2019, it will conduct a retrospec-
to monitor progress towards performance goals. tive and prospective analyses to determine if the pro-
■■ NASA will continue to attract and sustain a grams supporting this strategic objective are healthy
diverse workforce that is flexible and agile, with and can address potential or realized risks. Part of the
the skills and competencies needed for the retrospective analyses will take into consideration the
Agency’s Mission. FY 2018 performance results found on the following
pages. Looking forward, NASA will assess whether
it is on track to achieve the FY 2019 annual perfor-
Performance Measures for mance indicators. The results of this early assessment
Strategic Objective 4.4 will inform planning for the FY 2021 Performance
Plan, which will begin in spring 2019.
The following pages provide the performance goals
and annual performance indicators supporting
Strategic Objective 4.4. They include the final perfor-
mance results for FY 2018, the FY 2019 Performance
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
for the performance goals and annual performance
indicators supporting Strategic Objective 4.4.
Performance Goal 2
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
Performance Goal 4.4.1: Define and build diverse workforce skills and
competencies needed for the Agency’s Mission.
Above: Charles Spern, project manager on the Engineering Services Contract, uplinks Veggie System instructions to astronaut Joe Acaba on
the ISS. Image credit: NASA/Amanda Griffin
■■ NASA is developing and implementing policies mance results for FY 2018, the FY 2019 Performance
and strategies to strengthen NASA’s cybersecu- Plan Update, which NASA considers final for FY 2019,
rity capabilities across its mission, corporate, and and the initial FY 2020 Performance Plan. Below are
physical domains. charts summarizing the FY 2018 performance ratings
■■ NASA is actively working on protecting its critical for the performance goals and annual performance
space systems and supporting infrastructure. indicators supporting Strategic Objective 4.5.
The Agency needs to implement risk manage- As NASA conducts its 2019 Strategic Review, to be
ment for system protection of its aeronautics and completed in spring 2019, it will conduct a retrospec-
science capabilities. tive and prospective analyses to determine if the pro-
■■ NASA is enhancing its Center Protective grams supporting this strategic objective are healthy
Services operations by maintaining existing and and can address potential or realized risks. Part of the
pursuing new federal law enforcement training retrospective analyses will take into consideration the
accreditations. FY 2018 performance results found on the following
pages. Looking forward, NASA will assess whether
Performance Measures for it is on track to achieve the FY 2019 annual perfor-
mance indicators. The results of this early assessment
Strategic Objective 4.5 will inform planning for the FY 2021 Performance
Plan, which will begin in spring 2019.
The following pages provide the performance goals
and annual performance indicators supporting
Strategic Objective 4.5. They include the final perfor-
Performance Goal 1 2
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
No API in FY 2019
2013 2014 2015 2016 2017 2018
No APIs before FY 2018 Yellow AMO-20-17: Ensure at least 95 percent of hardware assets
are covered by a capability to detect and alert upon the
NASA attained 100 percent for hardware asset man- connection of an unauthorized hardware asset per the IT
Modernization cross-agency priority goals on Performance.
agement and 87 percent for software asset manage- gov for NASA.
ment in FY 2018. The Agency’s substantial progress
was driven by an increase in CDM Phase 1 deploy-
ment in the corporate and mission environments
in accordance with Federal Information Security
Modernization Act (FISMA) requirements and OMB’s AMO-20-18 [Begins in FY 2020]
CyberStat effort.
Planned Annual Performance Indicators
NASA has not obtained the complete system inven-
tory for the mission and physical environments No API in FY 2019
required to fully enable the deployment of CDM tools
AMO-20-18: Ensure at least 95 percent of software as-
into these environments. NASA will improve its soft- sets are covered by a whitelisting capability per the IT
ware asset management capabilities as CDM Phase 1 Modernization cross-agency priority Goals on Performance.
tools continue to deploy in FY 2019. NASA’s timeline gov for NASA.
for implementing hardware and software asset man-
agement in the mission and physical environments
depends on the award and implementation of the
next phase of the Department of Homeland Security’s
CDM capabilities. The Agency will closely monitor the
contract status for the next phase of CDM, which will
drive availability of the required capabilities. AMO-20-19 [Begins in FY 2020]
This annual performance indicator supports the Planned Annual Performance Indicators
cross-agency priority goal “Modernize IT to Increase
Productivity and Security.” No API in FY 2019
During FY 2018, the Enterprise Protection Program AMO-18-36: Establish the Enterprise
made progress in establishing an enterprise protec- Protection Board to drive integrated
tions structure across NASA and its partners. NASA
established the Enterprise Protection Board and
enterprise protection risk management
finalized board’s charter. The Enterprise Protection and Agency-level direction regarding
Board held five meetings in FY 2018 to collaboratively protection risk.
address cross-Agency protection issues. NASA incor-
porated the new Enterprise Protection Program, the
Enterprise Protection Board, and the Principal Advisor 2013 2014 2015 2016 2017 2018
for Enterprise Protection into NASA Policy Directive No APIs before FY 2018 Green
(NPD) 1000.3, which defines and establishes NASA’s
organization. Planned Annual Performance Indicators
NASA made significant progress toward cross-Agency
No APIs after FY 2018
enterprise protection. NASA has been consolidating
threat information into a classified, user-friendly web-
based portal, which depends on information shar-
ing across NASA organizations. NASA’s Enterprise
AMO-19-23 [Begins in FY 2019]
Protection Program established an Enterprise
Protection Community Forum of cross-Agency partici-
pants and held its first meeting to discuss and resolve Planned Annual Performance Indicators
issues at a working level.
AMO-19-23: Enforce a 30-minute inactivity time-out for re-
mote access security.
No API in FY 2020
Lead Office NASA is enabling its mission by providing the facilities, tools, and ser-
Mission Support Directorate (MSD) vices required to efficiently manage, operate and sustain the infrastruc-
ture necessary to meet mission objectives.
Goal Leader
Daniel Tenney, Associate Administrator,
MSD 2018 Strategic Review Summary of
Progress
The Mission Support Directorate enables the Agency’s missions by
Budget managing institutional services and capabilities. MSD is actively reducing
institutional risk to NASA’s current and future missions by improving pro-
FY $M cesses, stimulating efficiency, and providing consistency and uniformity
across institutional standards and practices. Efforts that supported the
Actual 2018 2,714.1 assessment included:
Enacted 2019 2,452.0 ■■ Six of NASA’s 10 centers reduced unscheduled maintenance this
Requested 2020 2,940.7 past year, and the Agency reduced overall unscheduled main-
tenance by three percent over the last two years. All of NASA’s
2021 2,812.6
new buildings are constructed to Leadership in Energy and
2022 2,826.1 Environmental Design (LEED) sustainable standards.
Outyear
2023 2,618.8 ■■ As of January 2018, NASA constructed 3.2 million square feet of
2024 2,551.1 sustainable buildings.
Above: Nithin Abraham, a coatings engineer at NASA’s Goddard Space Flight Center, adds a protective coating to the support area beneath
the Johnson Space Center’s Chamber A. She was part of a team that ensured that the chamber was as clean as possible before cryogenic
testing began on the James Webb Space Telescope. Image credit: NASA/Chris Gunn
■■ NASA reduced energy intensity, utilized renew- for the performance goals and annual performance
able energy, increased clean energy, and indicators supporting Strategic Objective 4.6.
decreased water intensity. The re-commissioning
program will have the goals of short return on As NASA conducts its 2019 Strategic Review, to be
investment, improving the sustainability of the completed in May, it will conduct a retrospective and
facilities, and reducing out-year maintenance prospective analyses to determine if the programs
costs by integrating technology to improve main- supporting this strategic objective are healthy and
tenance efficiency. can address potential or realized risks. Part of the
retrospective analyses will take into consideration the
FY 2018 performance results found on the following
Performance Measures for pages. Looking forward, NASA will assess whether
Strategic Objective 4.6 it is on track to achieve the FY 2019 annual perfor-
mance indicators. The results of this early assessment
will inform planning for the FY 2021 Performance
The following pages provide the performance goals
Plan, which will begin in spring 2019.
and annual performance indicators supporting
Strategic Objective 4.6. They include the final perfor-
mance results for FY 2018, the FY 2019 Performance
Plan Update, which NASA considers final for FY 2019,
and the initial FY 2020 Performance Plan. Below are
charts summarizing the FY 2018 performance ratings
Performance Goal 3
Span two to five years, and measure the performance of investments towards strategic objectives and
strategic goals. The total number of performance goals is reflected in each rating box and there is no
one-to-one correlation to annual performance indicator ratings.
NASA achieved all three Sustainability Plan targets AMO-18-5: Reduce energy intensity
in FY 2018. OSI chose the three targets to track— (energy consumption per gross square
energy intensity, sustainable buildings, and facility
efficiency—from the Office of Management and
feet, or Btu/gsf) to meet the target set by
Budget’s Scorecard for Efficient Federal Operations/ the Office of Management and Budget for
Management. The data reflects NASA’s actual perfor- FY 2018 in the Sustainability and Energy
mance from FY 2017 and is available from the Office Scorecard.
of Federal Sustainability.
NASA continued to reduce the amount of energy 2013 2014 2015 2016 2017 2018
consumed by its buildings and facilities, measured per No API Yellow Yellow Yellow Green Green
gross square foot. The federal target was to reduce
consumption 30 percent from the FY 2003 baseline,
and NASA achieved 40 percent reduction. Twenty one Planned Annual Performance Indicators
percent of NASA-owned gross square footage met the
guiding principles for sustainable buildings, exceeding AMO-19-27: Reduce energy intensity (energy consumption
per gross square feet, or Btu/gsf) to meet the target set by the
the federal target of 15 percent. NASA’s renewable Office of Management and Budget (OMB) for FY 2019 in the
electricity use reached 13 percent, greatly exceeding OMB Scorecard for Efficient Federal Operations/Management.
the federal target of 7.5 percent and NASA’s FY 2008
baseline of 3.6 percent.
AMO-20-25: Reduce energy intensity (energy consumption
per gross square feet, or Btu/gsf) to meet the target set by the
Office of Management and Budget (OMB) for FY 2020 in the
OMB Scorecard for Efficient Federal Operations/Management.
NASA’s 380-foot-tall mobile launcher, atop crawler-transporter 2, approaches Launch Pad 39B on August 31, 2018, at Kennedy
Space Center. NASA’s Exploration Ground Systems is preparing the ground systems necessary to launch the Space Launch
System and Orion on Exploration Mission-1. Image credit: NASA/Cory Huston
Appendix A—Changes to the FY 2019 Performance Plan
Appendix A
Changes to the FY 2019 Performance Plan
Each fiscal year, NASA’s budget request to Congress contains an annual performance plan (APP) that aligns with
the funds requested. However, all of the program and project plans described in the President’s budget request
and annual performance plan may not be realized as anticipated. When this happens, the Agency revises its per-
formance measures and provides it as an APP update accompanying the budget request for the upcoming fiscal
year. NASA revises its performance measures when the final appropriation differs from the amount requested,
or if congressional or executive direction places a different emphasis on programs relative to what was initially
requested. Additionally, the dynamic nature of research and development can lead to shifting priorities. This may
result in NASA no longer pursuing activities originally identified in the annual performance plan or placing greater
emphasis on other activities.
NASA’s policy has been to allow one of the following actions if programs are impacted by congressional budget
action via an appropriations or authorization law or executive direction places a different emphasis on programs:
■■ Add new performance measures;
■■ Remove old performance measure (do not rate the performance measure);
■■ Update the targeted performance (rate at the new target);
■■ Renumber the performance measure; or
■■ Move the performance measure to the following year’s annual performance plan (do not rate until the follow-
ing year).
Once the APP update is released, the performance measures are considered final. If a final performance measure
cannot be achieved due the reasons described above, NASA generally will retain the measure and the target, but
rate it white, indicating that the measure is canceled or postponed.
Above: At NASA Earth Day 2018, a visitor uses virtual reality to explore the solar system. Image credit: NASA/Aubrey Gemignani
1.1.2: Demonstrate progress in advancing understanding of the connections that link the Sun, Earth and planetary space environ-
ments, and the outer reaches of the solar system.
Moved to FY 2020:HE-19-5: Achieve the Ionospheric Connection Explorer (ICON) mission success criteria.
1.1.5: Conduct on-orbit commissioning of the James Webb Space Telescope after launch. (Agency Priority Goal)
Revised:JWST-19-1: Complete spacecraft element thermal vacuum testing.
1.1.14: Demonstrate progress in identifying and characterizing objects in the solar system that pose threats to Earth or offer
resources for human exploration.
Revised:PS-19-13: Identify and catalog a cumulative 8,900 of the estimated 25,000 near-Earth asteroids (NEAs) 140 meters or larger.
1.1.16: By December 2017, launch at least two missions in support of Planetary Science.
Added:PS-19-15: Conduct close-orbit global mapping for sample site identification and evaluation for the Origins, Spectral Interpreta-
tion, Resource Identification, and Security-Regolith Explorer (OSIRIS-REx) mission asteroid sample collection.
Added: 3.1.1: Invest across the U.S. innovation community to explore and advance promising early stage solutions to space tech-
nology challenges.
Added:ET-19-1: Invest in at least 185 promising new early stage technologies and concepts, with potential for transformative impact.
Added: 3.1.2: Mature technologies that offer significant improvement to existing solutions or enable space exploration capabilities.
Added:ET-19-2: Mature state of the art technologies by completing at least 70 percent of Technology Maturation program milestones.
Added: 3.1.3: Demonstrate new technologies and capabilities for space exploration.
Added:ET-19-3: Advance development, demonstration, and mission implementation of new exploration technologies by reaching a key
milestone in at least six small spacecraft projects.
Added:ET-19-4: Advance Technology Demonstration Mission (TDM) capabilities by completing at least six key decision points towards
technology demonstration.
Added: 3.1.4: Engage and partner with the commercial aerospace sector, to leverage technology advancements and grow the
national economy.
Added:ET-19-5: Conduct at least four prize competitions to encourage innovation and address technology challenges through engaging
non-traditional NASA partners.
Added:ET-19-6: Create 10 opportunities for advancement of SBIR/STTR technologies beyond Phase II, leveraging non-SBIR/STTR
NASA investment or external investment.
Added:ET-19-7: Competitively select at least 16 payloads from NASA centers, other government agencies, industry, or academia for
flight on commercial vehicles to advance lunar exploration and commercial development in Earth orbit.
3.2.1: Develop solutions that will advance decision-making ability for improving air traffic management to accommodate future
growth in air travel, and for increasing aviation safety under hazardous conditions.
Revised:AR-19-1: Assess and document capacity of future air traffic services that increase Urban Air Mobility (UAM) capacity over
current-day operations.
3.2.4: Facilitate significant environmental and efficiency improvements through research on alternative jet fuel use, and on hybrid
gas-electric propulsion system concepts.
Revised: AR-19-12: Demonstrate integrated electrical system functionality of the X-57 aircraft through assembling components with a
power delivery system and conducting an Integrated Electrical End-to-End Test.
3.2.5: Significantly increase the ability to anticipate and resolve potential safety issues, and to predict the health and robustness of
aviation systems.
Revised:AR-19-4: Identify data architecture and information requirements (i.e., content and quality) for in-time monitoring of selected
operational risks for small Unmanned Aircraft Systems.
3.2.6: Support transformation of civil aircraft operations and air traffic management through the development, application, and vali-
dation of advanced autonomy and automation technologies, including addressing critical barriers to enabling urban on-demand air
mobility and Unmanned Aircraft Systems (UAS) operations in low-altitude airspace.
Revised:AR-19-10: Complete the data collection, analysis, and reporting for the Detect and Avoid and Integrated Test and Evaluation
(IT&E) flight test five (FT5) and for the Command and Control version six (v6) terrestrial communication system flight test.
Added: 3.3.3: Provide opportunities for students to engage with NASA’s aeronautics, space, and science people, content, and facili-
ties in support of a diverse future NASA and aerospace industry workforce.
Added:STEM-19-1: Provide significant, direct student awards in higher education to (1) students across all institutional categories and
levels (as defined by the U.S. Department of Education), (2) racially or ethnically underrepresented students (Hispanics and Latinos,
African Americans, American Indians, Alaska Native, Native Hawaiians and Pacific Islanders), (3) women, and (4) persons with disabili-
ties, at percentages that meet or exceeded at the national percentages for the science and engineering graduates, as determined by the
most recent, publicly available data from the U.S. Department of Education’s National Center for Education Statistics for a minimum of
two of the four categories.
Added: 3.3.4: Enhance the effectiveness of education investments using performance assessment and evaluation-driven processes.
Added:STEM-19-2: Design a comprehensive data management system aligned to performance assessment and evaluation strategy to
collect, analyze, and report data for STEM engagement investments.
Added: 3.3.5: Provide opportunities for students to contribute to NASA’s aeronautics, space, and science missions and work in
exploration and discovery.
Added:STEM-19-3: Conduct a multiple case study focused on NASA STEM engagement higher education challenges, competitions,
and internships to build knowledge about how these activities: a) contribute to NASA’s aeronautics, space, and science missions; b)
align to evidence-based effective practices for STEM learning; and c) recruit and retain participants from groups historically underrepre-
sented and/or underserved in STEM fields.
Added:STEM-19-4: Contribute to American technical capability by supporting the release of at least TBD* paper presentations and
peer-reviewed research publications through STEM engagement investments.
Removed: 4.1.1: Efficiently manage the coordination of NASA’s domestic, interagency, and international partnership agreements to
ensure that the partnerships continue to provide value to the Agency, including through the advancement of one or more Agency
institutional or programmatic objectives.
Removed:AMO-19-5: Negotiate and sign at least 300 new partnership agreements with domestic, non-governmental parties.
Removed:AMO-19-6: Negotiate and conclude at least 80 international and interagency agreements with foreign and domestic partners
in support of NASA missions.
4.1.3: Develop and implement the multiyear NASA Small Business Strategic Plan, which will promote and increase small business
programs and outreach through strategic collaborative efforts with internal and external partners and stakeholders.
Revised:AMO-19-11: Strengthen and promote small business awareness and participation by utilizing innovative techniques to benefit
the Agency’s small business program, including through the consolidation of Agency-level small business activities in specific, pre-deter-
mined geographical areas
4.3.1: Assure the safety and health of NASA’s activities and reduce damage to assets through the development, implementation, and
oversight of Agency-wide safety, reliability, maintainability, quality assurance, and health and medical policies and procedures.
Revised:AMO-19-19: During FY 2019, keep the number of variances made in any single human spaceflight program to below five per-
cent of the total number of program requirements derived from Office of the Chief Health and Medical Officer standards and policies.
Removed: 4.3.2: Implement the policies, procedures, and oversight to continuously improve the probability of technical and pro-
grammatic mission success.
Removed:AMO-19-17: Assure 100 percent of Category 1 and 2 projects use Agency Safety and Mission Success policy, procedures
and independent assessments focused on both technical and programmatic mission success.
Removed:AMO-19-18: Assure that 100 percent of the engineering and programmatic workforce has access to the standards and knowl-
edge base needed to maintain and build their skills.
Moved to 4.3.1:AMO-19-19: During FY 2019, keep the number of variances made in any single human spaceflight program to below
five percent of the total number of program requirements derived from Office of the Chief Health and Medical Officer (OCHMO) stan-
dards and policies.
4.4.2: Sustain equal opportunity (EO) and diversity and inclusion (D&I) programs and processes that help to proactively prevent
discrimination, achieve more equitable and inclusive work environments, and more efficiently address EO concerns.
Revised:AMO-19-21: Sustain employee perceptions of the workplace as measured by the Federal Employee Viewpoint Survey Inclu-
sion Index percentages.
Revised:AMO-19-35: Increase efficiency in equal employment opportunity (EEO) programs (such as EEO complaints processing,
anti-harassment, and reasonable accommodations), demonstrated by achieving at least 85 percent timely processing of matters raised
in FY 2020.
4.5.1: Safeguard NASA’s data and IT assets by implementing cybersecurity and privacy capabilities.
Removed:AMO-19-22: At least 45 percent of NASA’s applicable high-value assets (HVAs) require all users to authenticate through the
machine-based or user-based enforcement of a two-factor Personal Identity Verification (PIV) credential or other Identity Assurance Lev-
el 3/Authenticator Assurance Level 3 credential, as applicable based on an HVA assessment of system architecture.
Updated: 4.5.2: Improve the security and resiliency of NASA’s operational technology (OT) systems to ensure safe and secure oper-
ation of NASA’s critical infrastructure in a manner consistent with guidance from the National Institute of Standards and Technology
(NIST).
Revised:AMO-19-24: Identify at least 95 percent of the operational technology systems that are part of the assets on the NASA Critical
Infrastructure list.
Removed: 4.5.3: Achieve improvements in overall Office of Protective Services physical security operations, standardization, effi-
ciencies, and economies of scale.
Removed:AMO-19-25: Maintain Federal Law Enforcement Training Accreditation Federal Arrest Authority programmatic accreditation
and Academy accreditation.
Appendix B
Data Quality Elements
Data quality elements describe how NASA ensures the accuracy and reliability of the data used to measure
progress towards each performance goal for the FY 2018 Annual Performance Report. These elements include
the sources of the data, the means used to verify and validate the results, and any limitations to the data at the
required level of accuracy. If any significant data limitations exist that could impede accurate reporting, this section
will include a discussion of how the Agency compensates for those limitations.
Performance Goal 1.1.2: Demonstrate progress in advancing understanding of the connections that link the Sun, Earth, and plane-
tary space environments, and the outer reaches of the solar system.
Data Source: Review of the ratings and supporting material from the external expert review panel, along with a written explanation of
any other significant factors considered in arriving at the rating, if applicable.
Verification & Validation: On an annual basis, an independent, external expert review panel from HPAC evaluates scientific progress
relative to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://
science.nasa.gov/researchers/nac/science-advisory-committees/. The Heliophysics Division Director recommends a rating for the per-
formance goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy
Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Above: Lockheed Martin engineers assemble Orion’s crew module at NASA Kennedy Space Center Operations and Checkout building. Image
credit: NASA/Rad Sinyak
Performance Goal 1.1.3: Demonstrate progress in developing the knowledge and capability to detect and predict extreme conditions
in space to protect life and society and to safeguard human and robotic explorers beyond Earth.
Data Source: Review of the ratings and supporting material from the external expert review panel, along with a written explanation of
any other significant factors considered in arriving at the rating, if applicable.
Verification & Validation: On an annual basis, an independent, external expert review panel from HPAC evaluates scientific progress
relative to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://
science.nasa.gov/researchers/nac/science-advisory-committees/. The Heliophysics Division Director recommends a rating for the per-
formance goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy
Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.4: By December 2019, launch one mission in support of Heliophysics.
Data Source: Written explanation of the rating and supporting material from the SMD’s Flight Program Review archives. The Deputy
Associate Administrator for SMD recommends a rating based on whether the underlying missions are on track to launch during the goal
period.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.5: Conduct on-orbit commissioning of the James Webb Space Telescope after launch. (Agency Priority Goal)
Data Source: Emails, press releases, and program-internal documents indicating progress NASA’s industry partners make toward the
James Webb Space Telescope integration, test and launch.
Verification & Validation: NASA monitors and tracks its progress towards this goal using various Agency documents and reports, includ-
ing Directorate Program Management Council (DPMC) materials, monthly reports from the project and industry partners, and other
program-internal documents.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.6: Demonstrate progress in probing the origin and destiny of the universe, including the nature of black holes,
dark energy, dark matter, and gravity.
Data Source: On an annual basis, an independent, external expert review panel from the Astrophysics Advisory Committee (AAC)
evaluates scientific progress relative to the current science plan and assigns a rating to the API that supports this PG. Their findings
are available online at https://science.nasa.gov/researchers/nac/science-advisory-committees/apac#meetingdocs. The Astrophysics
Division Director recommends a rating for the performance goal based on the findings of the review panel and other significant factors, if
applicable. Ratings are reviewed by the Deputy Associate Administrator for Research within NASA SMD, with any issues being resolved
by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.7: Demonstrate progress in exploring the origin and evolution of the galaxies, stars, and planets that make up
the universe.
Data Source: On an annual basis, an independent, external expert review panel from AAC evaluates scientific progress relative to the
current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/apac#meetingdocs. The Astrophysics Division Director recommends a rating for the
performance goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Dep-
uty Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.8: Demonstrate progress in discovering and studying planets around other stars and exploring whether they
could harbor life.
Data Source: On an annual basis, an independent, external expert review panel from the AAC evaluates scientific progress relative to
the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/apac#meetingdocs. The Astrophysics Division Director recommends a rating for the
performance goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Dep-
uty Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.9: By December 2021, launch one mission in support of Astrophysics.
Data Source: Written explanation of the rating and supporting material from SMD’s Flight Program Review archives. The Deputy Associ-
ate Administrator for SMD recommends a rating based on whether the underlying mission is on track to launch during the goal period.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.10: Demonstrate progress in advancing the understanding of how the chemical and physical processes in the
solar system operate, interact, and evolve.
Data Source: On an annual basis, an independent, external expert review panel from the Planetary Science Advisory Committee (PAC)
evaluates scientific progress relative to the current science plan and assigns a rating to the API that supports this PG. Their findings are
available online at https://science.nasa.gov/researchers/nac/science-advisory-committees/. The Planetary Science Division Director rec-
ommends a rating for the performance goal based on the findings of the review panel and other significant factors, if applicable. Ratings
are reviewed by the Deputy Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate
Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.11: Demonstrate progress in exploring and observing the objects in the solar system to understand how they
formed and evolve.
Data Source: On an annual basis, an independent, external expert review panel from the PAC evaluates scientific progress relative to
the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/. The Planetary Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.12: Demonstrate progress in exploring and finding locations where life could have existed or could exist
today.
Data Source: On an annual basis, an independent, external expert review panel from PAC evaluates scientific progress relative to the
current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/. The Planetary Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.13: Demonstrate progress in improving understanding of the origin and evolution of life on Earth to guide the
search for life elsewhere.
Data Source: On an annual basis, an independent, external expert review panel from PAC evaluates scientific progress relative to the
current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/. The Planetary Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.14: Demonstrate progress in identifying and characterizing objects in the solar system that pose threats to
Earth or offer resources for human exploration.
Data Source: On an annual basis, an independent, external expert review panel from PAC evaluates scientific progress relative to the
current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.nasa.
gov/researchers/nac/science-advisory-committees/. The Planetary Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.15: Deliver the Mars 2020 instrument payload for spacecraft integration. (Agency Priority Goal)
Data Source: Emails, press releases, and program-internal documents indicating progress toward integration, test, and launch.
Verification & Validation: NASA monitors and tracks its progress towards this goal using various Agency documents and reports, includ-
ing DPMC materials, monthly reports from the project and contributing partners, and other program-internal documents.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.16: By December 2017, launch at least two mission in support of Planetary Science.
Data Source: Written explanation of the rating and supporting material from SMD’s Flight Program Review archives. The Deputy Associ-
ate Administrator for SMD recommends a rating based on whether the underlying missions are on track to launch during the goal period.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.17: Demonstrate progress in advancing the understanding of changes in Earth’s radiation balance, air quality,
and the ozone layer that result from changes in atmospheric composition.
Data Source: On an annual basis, an independent, external expert review panel from the Earth Science Advisory Committee (ESAC)
evaluates scientific progress relative to the current science plan and assigns a rating to the API that supports this PG. Their findings are
available online at https://science.nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recom-
mends a rating for the performance goal based on the findings of the review panel and other significant factors, if applicable. Ratings
are reviewed by the Deputy Associate Administrator for Research within NASA SMD, with any issues being resolved by the Associate
Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.18: Demonstrate progress in improving the capability to predict weather and extreme weather events.
Data Source: On an annual basis, an independent, external expert review panel from the ESAC evaluates scientific progress relative
to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.
nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.19: Demonstrate progress in detecting and predicting changes in Earth’s ecosystems and biogeochemical
cycles, including land cover, biodiversity, and the global carbon cycle.
Data Source: On an annual basis, an independent, external expert review panel from the ESAC evaluates scientific progress relative
to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.
nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.20: Demonstrate progress in enabling better assessment and management of water quality and quantity to
accurately predict how the global water cycle evolves in response to climate change.
Data Source: On an annual basis, an independent, external expert review panel from the ESAC evaluates scientific progress relative
to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.
nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.21: Demonstrate progress in improving the ability to predict climate changes by better understanding the
roles and interactions of the ocean, atmosphere, land, and ice in the climate system.
Data Source: On an annual basis, an independent, external expert review panel from the ESAC evaluates scientific progress relative
to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.
nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.22: Demonstrate progress in characterizing the dynamics of Earth’s surface and interior, improving the capa-
bility to assess and respond to natural hazards and extreme events.
Data Source: On an annual basis, an independent, external expert review panel from the ESAC evaluates scientific progress relative
to the current science plan and assigns a rating to the API that supports this PG. Their findings are available online at https://science.
nasa.gov/researchers/nac/science-advisory-committees/. The Earth Science Division Director recommends a rating for the performance
goal based on the findings of the review panel and other significant factors, if applicable. Ratings are reviewed by the Deputy Associate
Administrator for Research within NASA SMD, with any issues being resolved by the Associate Administrator for SMD.
Verification & Validation: Review of the ratings and supporting material from the external expert review panel, along with a written expla-
nation of any other significant factors considered in arriving at the rating, if applicable.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.23: Further the use of Earth system science research to inform decisions and provide benefits to society.
Data Source: NASA Applied Sciences Program’s Annual Report, CFI Group report, and other documentation, as appropriate. The Direc-
tor of the NASA Applied Sciences Program recommends a rating after reviewing progress toward the performance goal.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.1.24: By December 2021, launch three missions in support of Earth Science.
Data Source: Written explanation of the rating and supporting material from SMD’s Flight Program Review archives. The Deputy Associ-
ate Administrator for SMD recommends a rating based on whether the underlying missions are on track to launch during the goal period.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 1.2.1: Conduct basic and applied biological and physical research to advance and sustain U.S. scientific exper-
tise.
Data Source: Documentation for payloads delivered to the International Space Station (ISS) Program; ISS flight manifests; Standing
Review Board program reports; Center for the Advancement of Science in Space press releases and award documents; project and
investigator internal reporting; and the NASA Task Book bibliographic data, available at https://taskbook.nasaprs.com/Publication/index.
cfm?action=bib_search.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: Potential lag time. For peer-reviewed publications, data are gathered throughout the year, but tend to concentrate at the
end of the year. Intermediate data are of limited significance. Data are sufficiently accurate for their intended use.
Strategic Goal 2: Extend human presence deeper into space and to the Moon for sustainable long-term
exploration and utilization.
Performance Goal 2.1.1: Increase the crew time for research and development beyond the three U.S. Orbital Segment crew baseline.
Data Source: Human Exploration and Operations Mission Directorate (HEOMD) DPMC and the ISS Program Quarterly Reviews.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 2.1.2: Ensure vital assets are ready, available, and appropriately sized to conduct NASA’s Mission.
Data Source: Center level analysis and schedules.
Verification & Validation: The DPMC is the governing body for review of this performance goal.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 2.1.3: Facilitate the commercial development of low Earth orbit (LEO) to transition to a commercial LEO human
spaceflight enterprise where NASA is one of many customers.
Data Source: HEOMD DPMC and the ISS Program Quarterly Reviews.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 2.2.1: Achieve critical milestones in development of new systems for the human exploration of deep space.
(Agency Priority Goal)
Data Source: Schedules and Quarterly Program Status Report packages.
Verification & Validation: Review by the HEOMD DPMC.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 2.2.2: Demonstrate deep space habitat concepts using prototypes developed in partnership with Next Space
Technologies for Exploration Partnerships Phase 2 industry partners.
Data Source: Industry partner-provided data to verify accomplishment of milestones.
Verification & Validation: Review of contractually-binding technical milestones.
Data Limitation: None identified. Data are sufficiently accurate for their intended use. Some of the data developed by NASA’s commer-
cial partners may be protected under Intellectual Property Statutes.
Performance Goal 2.2.3: Use the International Space Station (ISS) as a testbed to demonstrate the critical systems necessary for
long-duration missions. Between October 1, 2017, and September 30, 2019, NASA will initiate at least eight in-space demonstrations
of technology critical to enable human exploration in deep space. (Agency Priority Goal)
Data Source: Press releases and program-internal documents indicating whether or not NASA has initiated its planned inspace technol-
ogy demonstrations.
Verification & Validation: NASA monitors and tracks its progress towards this goal using various Agency documents and reports,
including materials from the Advanced Exploration Systems, and ISS program reviews, project schedules, and other program-internal
documents. NASA also issues press releases for its major technology demonstration experiments.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 2.2.5: Engage industry in developing concepts to satisfy both NASA and commercial goals for a Power and Pro-
pulsion Element for deep space transportation.
Data Source: Link(s) to press releases and Design Review Board documents. See also https://www.nasa.gov/feature/nasa-seeks-indus-
try-studies-for-deep-space-power-propulsion and https://www.fbo.gov/spg/NASA/GRC/OPDC20220/80GRC018R0005/listing.html.
Verification & Validation: Review by HEOMD DPMC.
Data Limitation: Materials provided by NASA’s industry partners may include company-proprietary information. Data are sufficiently
accurate for their intended use.
Performance Goal 3.1.2: Advance technologies that offer significant improvement to existing solutions or enable new space science
and exploration capabilities.
Data Source: Evidence will include the list of planned fiscal year milestones, along with completion status.
Verification & Validation: Within STMD, SPI coordinates and integrates PG/API review and evaluation, working closely with portfolio
executives, program executives and program managers responsible for individual PGs/APIs. For this PG, this process includes monthly
assessment of milestone progress by Game Changing Development, including presentation of status to STMD leadership. Final ratings
and justifications are approved by the SPI Director. During annual program performance status reviews, each program reports applica-
ble PG/API ratings and justification to the STMD PMC.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.1.3: Mature new crosscutting space technology capabilities for demonstration.
Data Source: Review reports, Key Decision Points (KDP) decision memoranda, or other relevant milestone documentation.
Verification & Validation: Within STMD, SPI coordinates and integrates PG/API review and evaluation, working closely with portfolio ex-
ecutives, program executives, and program managers responsible for individual PGs/APIs. For this PG, this process includes quarterly
verification of completion of project KDPs or key associated reviews (e.g., Preliminary Design Reviews, Critical Design Reviews), as
defined in governing NASA Procedural Requirements; launches; and significant ground tests or flight operations. Final ratings and justifi-
cations are approved by the SPI Director. During annual program performance status reviews, each program reports applicable PG/API
ratings and justification to the STMD PMC.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.1.4: Engage the established commercial sector, emerging aerospace markets, and economic regions to lever-
age common interests and grow the national economy.
Data Source: Web articles, NASA news releases, program spreadsheets, and other relevant documentation stored on a document and
records management system.
Verification & Validation: Within STMD, SPI coordinates and integrates PG/API review and evaluation, working closely with portfolio
executives, program executives and program managers responsible for individual PGs/APIs. For this PG, this process includes review
of NASA news releases, Web articles, and other relevant internal and external program documentation for the Small Business Innova-
tion Research/Small Business Technology Transfer, Centennial Challenges, Prizes and Challenges, Flight Opportunities, and NASA
Technology Transfer activities. During annual program performance status reviews, each program reports applicable PG/API ratings and
justification to the STMD PMC.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.1: Develop solutions that will advance decision-making ability for improving air traffic management to accom-
modate future growth in air travel, and for increasing aviation safety under hazardous conditions.
Data Source: Execution of a series of demonstrations of NASA-developed concepts and technologies; demonstration data, including
available aircraft and system performance metrics, and controller and pilot workload and acceptance data; and demonstration reports
and technical publications that include data analyses, conclusions, and any recommendations from the demonstration participants.
Verification & Validation: Measure rating reviewed and approved quarterly by the Program Director and Aeronautics Research Mission
Directorate (ARMD) Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.2: Demonstrate the ability to reduce sonic booms, enabling future industry innovation in commercial
supersonic aircraft.
Data Source: Successful completion and reports for Project key decision points and lifecycle reviews. Plans and approvals for Initial
Community Response.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.3: Advance airframe and engine technologies to enable the development of future generations of ultra-effi-
cient air vehicles that minimize environmental impact.
Data Source: NASA publications (e.g., technical memoranda, contractor reports) and/or presentations and test reports.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.4: Facilitate significant environmental and efficiency improvements through research on alternative jet fuel
use, and on hybrid gas-electric propulsion system concepts.
Data Source: NASA publications (e.g., technical memoranda, contractor reports) and/or presentations and test reports.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.5: Significantly increase the ability to anticipate and resolve potential safety issues, and to predict the health
and robustness of aviation systems.
Data Source: Assured tools that improve the accuracy of real-time detection, diagnosis, and prediction of hazardous states and the
impact of these states on system safety. Demonstration, benefits analysis, and transition of new real-time system-wide safety technolo-
gies.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.2.6: Support transformation of civil aircraft operations and air traffic management through the development,
application, and validation of advanced autonomy and automation technologies, including addressing critical barriers to enabling
urban on-demand air mobility and unmanned aircraft systems (UAS) operations in low-altitude airspace.
Data Source: UAS Traffic Management Technology Capability Level research assessment and related documentation.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.3.1: Enhance reach and effectiveness of programs and projects that engage the public.
Data Source: Specific to each platform or communications tool, with contributions from programs, mission directorates, functional offic-
es, and field centers. Includes after-event reports, lessons-learned documentation, media monitoring, and/or media metrics.
Verification & Validation: Measure rating reviewed and approved semi-annually and annual reviews by the Program Director and ARMD
Associate Administrator.
Data Limitation: Constrained by legal limitations on collecting information on the public. Data are sufficiently accurate for their intended
use.
Performance Goal 3.3.2: Promote equal opportunity compliance and encourage best practices among NASA grant recipient institu-
tions.
Data Source: Office of Diversity and Equal Opportunity (ODEO) Compliance Tracking System; MissionSTEM Analytics.
Verification & Validation: Review compliance with NASA Policy Directive 2081.1A and NASA Procedural Requirements 2081.1A. Ensure
signature by grant recipient institutions of NASA Form 1206 (i.e., the Assurance of Compliance form).
Data Limitation: Quantifying compliance actions in percentages is subject to some level or interpretation. In addition, there can be a lag
time in reporting, because the purpose of the program is to assess grantee institution compliance with federal civil rights requirements,
and if there is non-compliance, it can take months or years to achieve compliance.
Performance Goal 3.3.3: Provide opportunities for students to engage with NASA’s aeronautics, space, and science people, content,
and facilities in support of a diverse future NASA and aerospace industry workforce.
Data Source: Project activity data from the Office of Education Performance Measurement (OEPM) System.
Verification & Validation: NASA’s Office of STEM Engagement reviews the data collected using the OEPM System to determine whether
goals have been met. The measure is reviewed and approved by the Associate Administrator for the NASA Office of STEM Engage-
ment.
Data Limitation: There is a data lag. Academic calendars do not coincide with the federal fiscal year calendar. In order to ensure accu-
rate data collection and reporting, NASA’s Office of STEM Engagement uses prior year data (e.g., in FY 2019, NASA’s Office of STEM
Engagement reports on 2017-2018 academic calendar year data) to meet performance reporting requirements. Data are sufficiently
accurate for their intended use.
Performance Goal 3.3.4: Enhance the effectiveness of education investments using performance assessment and evaluation-driven
processes.
Data Source: STEM Engagement Council working group’s deliverables and grant/cooperative agreement solicitations released by the
Office of Education.
Verification & Validation: Documents serving as the deliverables for each milestone will be obtained and reviewed by the Office of STEM
Engagement Performance Assessment, Evaluation and Information Management Team to assess achievements of each milestone. A
written assessment will be reviewed by the Deputy Associate Administrator for STEM Engagement to verify and validate findings.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 3.3.5: Provide opportunities for students to contribute to NASA’s aeronautics, space, and science missions and
work in exploration and discovery.
Data Source: Project activity data from the OEPM System.
Verification & Validation: NASA’s Office STEM Engagement staff review the data collected using the OEPM System to determine
whether goals have been met. The measure rating is reviewed and approved by the Associate Administrator for NASA’s Office of STEM
Engagement.
Data Limitation: There is a data lag. Academic calendars do not coincide with the federal fiscal year calendar. In order to ensure accu-
rate data collection and reporting, NASA’s Office of STEM Engagement uses prior year data (e.g., in FY 2018, NASA education reports
on FY 2017 data) to meet performance reporting requirements. Data are sufficiently accurate for their intended use.
Performance Goal 4.1.2: Achieve savings for the Agency through acquisition reforms.
Data Source: NASA Strategic Sourcing Plan, Master Buy Plan Database, and Federal Procurement Data System.
Verification & Validation: Review compliance with the Office of Management and Budget (OMB) Strategic Sourcing Policy, NASA Policy
Directive 1000.5B, Federal Acquisition Regulation (FAR), and the NASA FAR Supplement.
Data Limitation: Contract data availability from the Federal Procurement Data System and Federal Strategic Sourcing Initiative data
collection system lags in the reporting cycle. Data are sufficiently accurate for their intended use.
Performance Goal 4.1.3: Develop and implement the multiyear NASA Small Business Strategic Plan, which will promote and
increase small business programs and outreach through strategic collaborative efforts with internal and external partners and
stakeholders.
Data Source: NASA’s Office of Small Business Programs website, NASA Vendor Database, press releases, and NASA-internal docu-
mentation.
Verification & Validation: Review of the documentation listed under Data Sources. Final rating is determined by the Associate Adminis-
trator of OSBP.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.1: Provide cargo transportation to support on-orbit crew members and utilization.
Data Source: HEOMD DPMC and the ISS Program Quarterly Reviews.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.2: Facilitate the development of and certify U.S. industry-based crew transportation systems while maintain-
ing competition, returning International Space Station (ISS) crew transportation to the United States. (Agency Priority Goal)
Data Source: Email(s) and press releases indicating industry partners continue to make progress maturing their transportation system
technical and certification/verification efforts.
Verification & Validation: Review by NASA’s PMC and HEOMD DPMC.
Data Limitation: Materials provided by NASA’s industry partners may include company-proprietary information. Data are sufficiently
accurate for their intended use.
Performance Goal 4.2.3: Invest financial and technical resources to stimulate efforts within the private sector to develop and demon-
strate safe, reliable, and cost-effective space capabilities.
Data Source: Email(s) and press releases indicating industry partners continue to make progress maturing their transportation system
technical and certification/verification efforts.
Verification & Validation: Review by NASA’s PMC and the HEOMD DPMC.
Data Limitation: Materials provided by NASA’s industry partners may include company-proprietary information. Data are sufficiently
accurate for their intended use.
Performance Goal 4.2.4: Review the current state of the NASA test capabilities, known test requirements, and test requests, and
ensure their availability to meet the Nation’s needs.
Data Source: Rocket Propulsion Test staff presentations at quarterly DPMC and program management review meetings.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.5: Complete Launch Services Program (LSP) objectives for all NASA-managed expendable launches.
Data Source: LSP Mission Success Metric 0773, which is updated at the end of each fiscal year; and link(s) to mission press release(s).
Verification & Validation: Review of the documentation listed under Data Sources by the HEOMD Launch Services Office Director, and
Launch Services Program Program Planning Office.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.6: Maintain a minimum of 95 percent delivery of the Space Communications network services that support
NASA and other customers’ mission success.
Data Source: NASA-internal presentation charts and link(s) to external press releases.
Verification & Validation: Review of the documentation listed under Data Sources by the HEOMD DPMC and at the Baseline Perfor-
mance Review.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.7: Replace the aging Deep Space Network infrastructure.
Data Source: NASA-internal presentation charts and link(s) to external press releases.
Verfication & Validation: Review of the documentation listed under Data Sources by the HEOMD DPMC and at the Baseline Perfor-
mance Review.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.2.8: Ensure the strategic availability and maintenance of facilities that are necessary to meet the long-term
needs and requirements of the Agency.
Data Source: Quarterly program reviews by the Space Environments Testing Management Office (SETMO).
Verification & Validation: Assessment SETMO by staff at the quarterly program reviews.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.3.1: Assure the safety and health of NASA’s activities and reduce damage to assets through the development,
implementation, and oversight of Agency-wide safety, reliability, maintainability, quality assurance, and health and medical policies
and procedures.
Data Source: NASA Mishap Information System.
Verification & Validation: Quarterly review of the data listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.3.2: Implement the policies, procedure and oversight to continuously improve the probability of technical and
programmatic mission success.
Data Source: Baseline Performance Review.
Verfication & Validation: Quarterly reviews noted under Data Source.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.4.1: Define and build diverse workforce skills and competencies needed for the Agency’s Mission.
Data Source: Federal Employee Viewpoint Survey (FEVS) Innovation Index. Publicly available from the Office of Personnel Manage-
ment (OPM) and Partnership for Public Service.
Verification & Validation: Review trends from the 2011 baseline. Monitor focus areas that drive innovation, including recognizing/reward-
ing innovative performance, engaging/connecting the workforce, and building model supervisors and leaders, through additional indices
in the FEVS.
Data Limitation: None identified. Data are sufficiently accurate for their intended use and are generally available late in the 4th quarter of
the fiscal year.
Performance Goal 4.4.2: Sustain equal opportunity (EO) and diversity and inclusion programs and processes that help to proactively
prevent discrimination, achieve more equitable and inclusive work environments, and more efficiently address EO concerns.
Data Source: NASA Model Equal Employment Opportunity Agency Plan, Strategic Management Council, Diversity and Inclusion Strate-
gic Partnership meetings, and Baseline Performance Review reporting.
Verification & Validation: Assessment of the NASA Model Equal Employment Opportunity Agency Plan and NASA Diversity and Inclu-
sion Strategic Implementation Plan.
Data Limitation: Some lag time in reporting of data, particularly at the end of the fiscal year. The OPM, which administers the FEVS, re-
leases an FEVS technical report to accompany the survey each year. The FEVS technical report includes detailed information on FEVS
sample design and selection; the survey instrument; and data collection, cleaning, weighting and analysis. OPM posts the survey results
and FEVS technical reports to its http://www.fedview.opm.gov/ website.
Performance Goal 4.5.1: Safeguard NASA’s data and IT assets by implementing cybersecurity and privacy capabilities.
Data Source: Quarterly President’s Management Council cybersecurity assessments for the maturity of specific cybersecurity capabili-
ties.
Verification & Validation: Review of quarterly President’s Management Council’s cybersecurity assessments.
Data Limitation: Data regarding specific protections may be sensitive. Data are sufficiently accurate for their intended use.
Performance Goal 4.5.3: Achieve improvements in overall Office of Protective Services physical security operations, standardiza-
tion, efficiencies, and economies of scale.
Data Source: Integrated Security Functional Review functional review report(s), formal Federal Law Enforcement Training Accreditation
certificates, and NASA-internal reports.
Verification & Validation: Review of the documentation listed under Data Sources.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.6.1: Between 2012 and 2018, support the demolition and elimination of obsolete and unneeded facilities.
Data Source: Quarterly budget and excess property reports.
Verification & Validation: Review of the documentation listed under Data Source.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.
Performance Goal 4.6.2: Ensure that NASA continues progress towards implementing the targets and goals reflected in its annual
Sustainability Plan
Data Source: Annual external reporting to the Department of Energy, OMB, and Council on Environmental Quality via the Ener-
gy-Greenhouse Gas Workbook; OMB Scorecard on Sustainability/Energy; and Strategic Sustainability Performance Plan.
Verification & Validation: Review of the documentation listed under Data Source.
Data Limitation: Lag time. Preliminary data are available in October or November after the end of each fiscal year, but final data typically
are not available until January. Data are sufficiently accurate for their intended use.
Performance Goal 4.6.3: Between 2018 and 2019, demonstrate increased facility reliability by reducing spending on unscheduled
maintenance by one percent annually.
Data Source: Systems application products and NASA center work plans.
Verification & Validation: Review of the documentation listed under Data Source.
Data Limitation: None identified. Data are sufficiently accurate for their intended use.