SWForum MTRL Webinar 26.05.2021
SWForum MTRL Webinar 26.05.2021
SWForum MTRL Webinar 26.05.2021
European forum of the software research community - SWForum.eu project has received funding from the
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.
Overview
15:00 – Introduction to SWForum.eu & aims of this webinar
15:55 – Q&A
2
Introduction to SWForum.eu and
aims of this webinar
European forum of the software research community - SWForum.eu project has received funding from the
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.
Overview
• MTRL within SWForum.eu
• Background to the development of MTRL
• What is MTRL?
• Why use MTRL?
4
SWForum.eu …
• …will create a self-sustainable online forum that facilitates and encourages both researchers and
practitioners as well as projects in software, digital infrastructure and cybersecurity to create
intersections of expertise and a multidisciplinary approach to research and innovation. This
forum seeks to set in place the European research roadmap and offer cross-fertilisation of
competencies to all other research and innovation areas.
• …works to enhance the visibility and increase the competitiveness of research and innovation in
the field of software technologies, digital infrastructure and cybersecurity, especially European
funded Research and Innovation Action (RIA) projects. Moreover, the project aims to introduce
best practices and technology transfer opportunities to cross-synergise European excellence.
• …runs from 1 October 2020 through 31 March 2023.
5
Objectives
6
Develop an effective way to map R&I project
7
Market and Technology Readiness Levels in
SWForum.eu
• Objective 4: Provide guidance for increasing the competitiveness of
European initiatives through the definition of a methodological approach
to the improvement of their MTRL, Mentoring, Technology Transfer & Best
Practices guiding towards Policy Innovation.
• Key Result
• MTRL methodology customized for the complex problem domain of software
engineering, digital infrastructures and cybersecurity.
• Supporting means for projects to perform a self-assessment.
• Webinars will be offered to guide software engineering projects through their MTRL
self-assessment journey
• Quantification criteria (KPI 4.1a):Public availability of the methodology.
• Quantification criteria (KPI 4.1b):At least one third of all active projects running at the same
time as SWForum.eu will apply the MTRL methodology and run regular MTRL self-
assessments.
8
Development of MTRL
9
What is MTRL?
The “Market & Technology Readiness Level” is a methodology used to
evaluate how close to the market project outputs/products are.
A numerical combination of;
TRL MRL
Technological Readiness Level Market Readiness Level
Measuring the maturity of a Measuring the commercial readiness of a
technology being developed by technology for market.
a project.
10
Why is MTRL useful for your project or product?
• Product Managers
• Demonstrate current status of products for market launch and demonstration
of understanding of barriers to exploitation/sustainability,
• Project Funders
• Do you really understand ROI on investments into projects, what reduces
possible exploitation on funded activities outputs?
12
Questions?
13
What is MTRL and an
MTRL analysis?
European forum of the software research community - SWForum.eu project has received funding from the
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.
Overview
• Why?
• TRL – Background
• Summarising TRL
• MRL - Background
• Summarising MRL
• Sum is greater than its parts, MTRL
15
Aims
• By adopting the MTRL framework R&I projects can benefit;
• Quickly assess the maturity of a group of projects in a cluster/portfolio,
• Provide targeted support to project leaders with exploitable outputs,
• Communicate clearly the current and desired future state of a project,
• Rapidly improve the quality of sustainability and exploitation planning,
• Reduce the risk of project failure by intervening before crisis points,
• Understand roadblocks and dependencies between TRL and MRL.
• Provide decision makers with
• a holistic view of a project’s maturity in a simple way - with a trackable single score.
• a faster way to assess, measure and support technology projects.
16
Requirements
• Key measure of success for R&I initiatives,
• Impact, Exploitation, Sustainability, Reuse….
• Why do these occur?
• Fitness for purpose
• Readiness for exploitation
• Technical maturity
17
Technical Evaluation
• Technical Readiness Level
• Measurement of technical maturity
• NASA, 1980s
• Defined range
• Fundamental research Operationally proven system
• Widely used inc. by EC H2020 program
18
TRL Definitions
19
Simplification
20
Market Evaluation
• Technically best product can still fail…
21
Business planning and modelling
22
Business planning and modelling
Problem/Solution fit
“Does the problem exist? Can we solve it? Are we
‘improving’ or ‘creating new’?”
Vision/Team Fit
“Do we have the right team to solve the problem?”
Product/Market Fit
“ Have we identified our target customer segment(s)?”
23
Marketing Readiness Levels
24
Combining TRL and MRL, the MTRL
25
Questions?
26
How to complete an
MTRL self-assessment
European forum of the software research community - SWForum.eu project has received funding from the
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.
• Self Assessment
• Questionnaire
• Periodic Re-assessment?
28
Self-Assessment
• Assessment methodology developed during development from CloudWatch2, via
Cyberwatching and now into SWForum.eu
29
Automated generation of MTRL via
Questionaire
• Easier to reach and evaluate a larger number of projects.
• Provides a standardized, repeatable process for evaluating the project under
analysis.
• Quickly provides a snapshot of the status of a project at a given time.
• Collects
• General project information
• Project details
• Contacts and Authorizations
• 9 substantive questions
• 2 TRL (Project Maturity and Product Development)
• 7 MRL (Product Definition/Design, Competitive Landscape, Team, Documentation, IP management, Go-
To-Market and Supply Chain)
• Automated calculation of TRL, MRL & MTRL
30
1. PROJECT MATURITY
1. Project work is beyond basic research and technology concept has been defined. Principles
postulated and observed but no experimental proof available.
2. Applied research has begun and practical applications have been formulated.
4. Initial testing of integrated product has been completed in a laboratory environment. Early
prototype.
5. Integrated product demonstrates performance in the intended environment. Large scale prototype.
31
2. PRODUCT DEVELOPMENT
1. Initial product/market fit has been defined.
2. Pilot scale product has been tested in the intended environment close to the expected
performance. Prototype System.
3. Demonstration of a full scale product prototype has been completed in operation environment
at pre-commercial scale.
4. The manufacturing issues has been solved and you have a first commercial product/service.
32
3. PRODUCT DEFINITION/DESIGN
1. One or more initial product hypotheses have been defined.
2. Mapping product attributes against customer needs has highlighted a clear value proposition.
3. The product has been scaled from laboratory to pilot scale and issues that may affect achieving
full scale have been identified.
4. Comprehensive customer value proposition model has been developed, including a detailed
understanding of product design specifications, required certifications, and trade-offs.
5. Product final design optimization has been completed, required certifications have been
obtained and product has incorporated detailed customer and product requirements.
33
4. COMPETITIVE LANDSCAPE
1. Market research has been performed and basic knowledge of potential applications and
competitive landscape have been identified.
2. Primary market research to prove the product commercial feasibility has been completed and
basic understanding of competitive products has been demonstrated.
3. Comprehensive market research to prove the product commercial feasibility has been
completed and intermediate understanding of competitive products has been demonstrated.
4. Competitive analysis to illustrate unique features and advantages of the product compared to
competitive products has been completed.
5. Full and complete understanding of the competitive landscape, target applications, competitive
products and market has been achieved.
34
5. TEAM
1. No team or organization (single individual, no legal entity).
2. Solely technical or non-technical founders running the organization with no outside assistance.
3. Solely technical or non-technical founders running the organization with assistance from outside
(advisors, mentors, incubator, accelerator, etc.).
4. Balanced team with technical and business experience running the organization.
5. Balanced team with all capabilities onboard (technical, sales, marketing, customer service,
operations, etc.) running the organization.
35
6. DOCUMENTATION
1. Solely technical descriptions have been elaborated, i.e., software documentation, architecture
diagrams, etc.
2. User-oriented documentation has been created, such as user manual, installation guides, reference
manual, etc.
3. Live demonstration resources have been developed (recorded videos, website with link to demo, etc.).
4. Position papers, press releases, posters, etc. have been elaborated for the dissemination of the project.
5. Marketing documentation has been created, such as a Business Model Canvas, etc.
36
7. INTELLECTUAL PROPERTY MANAGEMENT
1. No IPR have been defined.
37
8. GO-TO-MARKET
1. Initial business model and value proposition have been defined.
2. Customers have been interviewed to understand their needs and business model and value
proposition have been redefined based on customer feedback.
3. Market and customer needs and how those translate to product requirements have been
defined, and initial relationships have been developed with key stakeholders across the value
chain.
4. Partnerships have been formed with key stakeholders across the value chain (suppliers,
partners, service providers, customers).
5. Supply agreements with suppliers and partners are in place and initial purchase orders from
customers have been received.
38
9. MANUFACTURING/SUPPLY CHAIN
1. Potential suppliers, partners and customers have been identified and mapped in an initial value
chain analysis.
2. Relationships have been established with potential suppliers, partners, service providers and
customers and the have provided input on product and manufacturability requirements.
5. Full scale manufacturing and widespread deployment of product to customers has been
achieved.
39
Analysis - TRL
1. PROJECT MATURITY 2. PRODUCT DEVELOPMENT TRL
- 5 9
- 4 8
- 3 7
- 2 6
5 1 5
4 1 4
3 1 3
2 1 2
1 1 1
40
Analysis - MRL
QUESTION WEIGHT
3. PRODUCT DEFINITION/DESIGN 4
4. COMPETITIVE LANDSCAPE 3
5. TEAM 7
6. DOCUMENTATION 2
7. INTELLECTUAL PROPERTY MANAGEMENT 1
8. GO-TO-MARKET 5
9. MANUFACTURING/SUPPLY CHAIN 6
41
MTRL
• Outcome as product of MRL & TRL to recognise equal contribution
42
Questions?
43
Visualisation of MTRL
Results
European forum of the software research community - SWForum.eu project has received funding from the44
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.
Aim
• Provide a simple method by which the product/project can view and
understand MTRL assessment with preliminary suggestions about
next steps.
45
Output from self-assessment spreadsheet
Calculated TRL, MRL
and MTRL Values
Graphical representation
47
Simplified scales for MRL and TRL
48
Linking visualisation technologies
Tools &
techniques
49
What’s next for you and MTRL?
• Contact SWForum.eu to request self-evaluation questionnaire
50
Q&A
51
MTRL Webinar Series
• Introduction to MTRL (Today)
52
Thank You!
European forum of the software research community - SWForum.eu project has received funding from the53
European Union’s Horizon 2020 - Research and Innovation program - under grant agreement no. 957044.