Composable-LLM-Use-Case-Guide
Composable-LLM-Use-Case-Guide
Composable-LLM-Use-Case-Guide
Analyst Recommendations 13
© Composable 2
Introduction
Enterprise business leaders are increasingly Value is defined by the efficiency gains of the
exploring the potential of Large Language task being completed with the help of LLMs
Models (LLMs) to transform their operations, vs without. Effort is the amount of time and
enhance efficiency, and drive innovation. resources needed to complete the task with the
help of LLMs vs without.
However, selecting the first use case can be
daunting given the myriad of possibilities and Additionally, we explore the considerations of
considerations involved, including if the use people and skills, risk, and revenue vs costs on
case is even suitable for LLMs or if the required use case prioritization.
data is easy enough to collect.
And finally, we review implementation best
This guide provides eight LLM use case practices and why leading organizations are
examples to help you discover the many opting for LLM software platforms to accelerate
possibilities of LLM-powered tasks and the efficiency gains, enhance outcome accuracy,
impact they can have on your business with the and support data-driven decision-making.
right technology and strategy. The examples
provided are by no means an exhaustive list.
The use cases are truly endless.
© Composable 3
GETTING STARTED
Knowledge Querying
Using LLMs to extract, retrieve, and query information from large sets of mixed structure and unstructured content.
© Composable 5
Generating or Repurposing Content
Using LLMs to create original content, repurpose existing content, or turn unstructured content into a more structured,
personalized format.
With 90% of the world’s content created in the Generating short-form content with LLMs is
last two years, the pace of content production often straightforward, but creating complex
is accelerating. Enterprises rely on content to long-form content that integrates multiple
communicate, and much of this content builds inputs is more challenging.
on existing materials like meeting notes, emails,
and documents. Effective content creation Composable addresses these challenges by
from diverse inputs is essential for empowering offering tools that streamline the most complex
employees and engaging customers. short and long-form content creation.
Content creation requires diverse inputs (e.g. Enterprises can easily integrate their inputs,
ideas, documents, emails) and a clear output which are optimized for LLMs, specify the
structure (e.g., white papers, briefs). output format, and leverage Composable’s
workflow engine and content generation
Enterprises often struggle to process these algorithms to produce high-quality content
inputs efficiently and produce high-quality while overcoming LLM token limits.
content across various formats. Without a
well-defined output format, content creation
can suffer in speed, quality, and consistency, Benefits of a Platform Approach
making the process time-consuming and • Quickly generate scalable content for
challenging. publishing or refinement
• Integrate multiple sources for content
LLMs can generate initial drafts quickly, creation
allowing humans to refine and edit as • Standardize and control input/output
needed. Often, the draft from an LLM is formats
sufficient, streamlining the content creation • Overcome LLM response token limits
process.
© Composable 6
HOW TO EVALUATE LLM USE CASES
RISK 0
LOW COST / HIGH REVENUE MEDIUM COST / MEDIUM REVENUE HIGH COST / LOW REVENUE
�1 �0�5 �1
COST VS
REVENUE
0
LOW
EFFORT EFFORT HIGH EFFORT
�10 �9 �8 �7 �6 �5 �4 �3 �2 �1 0 1 2 3 4 5 6 7 8 9 10
COMPLEXITY,
RESOURCES & 0
TIME
© Composable 7
NO ADDITIONAL PEOPLE OR TRAINING NEEDED SOME ADDITIONAL PEOPLE OR TRAINING NEEDED MANY ADDITIONAL PEOPLE OR TRAINING NEEDED
Use Case Effort
Effort refers to the ease with which the use case can be implemented. Easy use cases are those
that can be developed and deployed with minimal effort and resources. Keep in mind that LLMs
can produce incredible results, but only when they are given the right context, prompts, and output
schema. Consider the following when assessing effort:
RISK 0
People Knowledge Training Costs
How many people are required Do you need to hire new What are the costs associated
LOW COST / HIGH REVENUE MEDIUM COST / MEDIUM REVENUE HIGH COST / LOW REVENUE
�1 �0�5 �1
COST VS
to develop and maintain the use
REVENUE
employees with specific skills? with hiring, training, and retaining
0
LOW
EFFORT EFFORT HIGH EFFORT
�10 �9 �8 �7 �6 �5 �4 �3 �2 �1 0 1 2 3 4 5 6 7 8 9 10
COMPLEXITY,
RESOURCES & 0
TIME
NO ADDITIONAL PEOPLE OR TRAINING NEEDED SOME ADDITIONAL PEOPLE OR TRAINING NEEDED MANY ADDITIONAL PEOPLE OR TRAINING NEEDED
�1 �0�5 1
If you don’t have the right software in place today, potentially all of your use cases
could require a lot of effort to get them into production. An LLM software platform, like
Composable, significantly reduces the amount of effort needed to design, test, deploy,
operate, and monitor multiple LLM use cases.
© Composable 8
A Real World Example
A leading philanthropic organization receives thousands of grant proposal applications multiple
times per year. They rely on a team of volunteers to manually review and score each proposal. This
evaluation process takes months, is prone to human errors, and produces inconsistent results.
The organization assessed the expected benefits The organization assessed the amount of effort
of automating these tasks and agreed they were required to complete these tasks manually vs if they
high (+8) given the importance of grant evaluation were automated by LLMs. By leveraging an LLM
and scoring to the organization’s grant funding software platform with integrated tooling to support
process. This process however was a critical part the use case, the effort would be dramatically
of their business making it high risk (-1) but it had reduced (-9) and there would be minimal training
the potential to significantly improve operational required (+0.5).
efficiencies and reduce costs (+1).
RISK �1
LOW COST / HIGH REVENUE MEDIUM COST / MEDIUM REVENUE HIGH COST / LOW REVENUE
�1 �0�5 �1
COST VS
REVENUE
�1
LOW
EFFORT EFFORT HIGH EFFORT
�10 �9 �8 �7 �6 �5 �4 �3 �2 �1 0 1 2 3 4 5 6 7 8 9 10
COMPLEXITY,
RESOURCES & �9
TIME
NO ADDITIONAL PEOPLE OR TRAINING NEEDED SOME ADDITIONAL PEOPLE OR TRAINING NEEDED MANY ADDITIONAL PEOPLE OR TRAINING NEEDED
�1 �0�5 1
�8�5
8
2
Grant Proposal Evaluation Use Case
VALUE
-2
-4
-6
-8
Figure 1
LOW
© Composable 9
GET YOUR LLM PROJECTS INTO PRODUCTION
END-TO-END ENTERPRISE-READY
LLM software platforms enable organizations to streamline the GenAI development process, allowing
them to move more quickly, build on successes, correct failures, reuse results, and broaden how and
where GenAI can be implemented.
© Composable 10
Benefits of an LLM Software Platform
Analyst research firm, IDC, recommends that organizations quickly identify, procure, and deploy
technologies that improve the efficacy, speed, repeatability, control, cost, and use of GenAI1. LLM
software platforms remain an essential puzzle piece to help organizations think beyond just the
model, including helping deliver:
Expanded GenAI use case and As organizations move through the continuum
of deploying GenAI across more and more use
user reach cases, they will need to integrate and utilize
critical, often sensitive, data sources.
LLM software platforms enable organizations
to streamline the GenAI development process,
allowing them to move more quickly, build Comprehensive data privacy
on successes, correct failures, reuse results, and security compliance,
and broaden how and where GenAI can be
implemented.
auditing, and data controls
LLM software platforms have designed
“
sufficient guard rails, data controls, and auditing
capabilities to ensure an organization can limit
and manage how and where their data is
LLM software platforms allow being used, maintain adequate access control,
organizations to target multiple and perform version control.
use cases in parallel, reducing
the need to serialize each use
case individually while providing a Embedded life-cycle monitoring
seamless UI and UX that reduces and management capabilities
the need for users to understand
the nuances of today’s disjointed AI Organizations spend so much time building,
testing, validating, and deploying their AI-
ecosystem’s tooling.
powered solutions that anything else becomes
an afterthought. LLM software platforms give
Matt Arcaro
DIRECTOR, COMPUTER VISION & AI organizations vital visibility into their solutions,
IDC offering real-time performance insights,
recommended optimizations, and the ability
to implement updates remotely.
1. “Moving Beyond the Model to Maximize the Effectiveness & Reach of GenAI Deployments,” written by: Matt Arcaro, Director of
Computer Vision and AI at IDC. Published July 2024.
© Composable 11
Tooling to build complex Improved solution accuracy
workflows that include the and coherence across varying
extension and integration of models and providers
third-party data sources
Organizations pursuing GenAI often follow the
GenAI applications are only as effective as their pathway of going deep into (i.e., fine-tuning)
ability to access and integrate sufficient relevant a single model or utilizing a multimodel and/or
contextual information and data. provider approach.
“
optimize the relationship between
structured and unstructured data sources
and LLMs across various documents, chatbots,
and emerging assistant/agent use cases. LLM software platforms help
organizations streamline the
These platforms include capabilities that creation of training data sets,
help with indexing/vectorization, retrieval- benchmarking model performance,
augmented generation (RAG), and usage within normalizing prompt formats
a workflow pipeline. across models, creating complex
orchestration pipelines,
seamlessly transitioning to
Seamless future proofing to new foundation models, and
accelerate the incorporation of monitoring solution performance
new models and capabilities to helping with cost and access
controls.
GenAI model providers (OpenAI, Cohere, IBM,
etc.) continuously release new models with Matt Arcaro
DIRECTOR, COMPUTER VISION & AI
improved accuracy, efficiency, coherence, IDC
and applicability to additional use cases.
Organizations should be able to leverage these
new models without considerable refactoring,
retraining, or constant reconfiguration. LLM software platforms are outcome oriented
to help organizations build GenAI applications
LLM software platforms are designed to ensure that maximize their business requirements and
that customers have the flexibility to adapt to objectives.
new and emerging capabilities and models in
a lightweight, often zero-touch way.
© Composable 12
ANALYST RECOMMENDATIONS
IDC has identified several strategic and technological attributes that organizations should consider
when pursuing an LLM software platform1. These attributes include:
1. “Moving Beyond the Model to Maximize the Effectiveness & Reach of GenAI Deployments,” written by: Matt Arcaro, Director of
Computer Vision and AI at IDC. Published July 2024.
© Composable 13
FROM IDEATION TO PRODUCTION
Organizations have realized that the potential value of GenAI is too big to ignore yet the challenges of
deploying LLM use cases have left many teams stuck in experimentation. Luckily, you have this guide.
By using the evaluation framework and scoring template provided, you can easily evaluate and select
LLM use cases. And with an LLM software platform like Composable, you can deploy LLM use cases
in days instead of weeks or months.
To learn more about Composable, visit becomposable.com and schedule a free, one-hour workshop
with one of our LLM experts where you’ll show you how easy it is to build and deploy your first LLM
use case.
© Composable 14
Appendix
The following section contains a blank use case scoring template you can print out and seven
additional use case examples that are well suited for LLMs.
© Composable 15
HOW TO EVALUATE LLM USE CASES
RISK 0
LOW COST / HIGH REVENUE MEDIUM COST / MEDIUM REVENUE HIGH COST / LOW REVENUE
�1 �0�5 �1
COST VS
REVENUE
0
LOW
EFFORT EFFORT HIGH EFFORT
�10 �9 �8 �7 �6 �5 �4 �3 �2 �1 0 1 2 3 4 5 6 7 8 9 10
COMPLEXITY,
RESOURCES & 0
TIME
NO ADDITIONAL PEOPLE OR TRAINING NEEDED SOME ADDITIONAL PEOPLE OR TRAINING NEEDED MANY ADDITIONAL PEOPLE OR TRAINING NEEDED
�1 �0�5 1
10 0
NO BRAINER BIG BET
HIGH
2
VALUE
-2
-4
-6
-8
LOW
© Composable 16
A REAL LIFE EXAMPLE
The organization evaluated the use case using the Effort vs Value scoring criteria and determined that
while the value was fairly high, the amount of effort required to complete these tasks without an LLM
software platform was significant.
© Composable 17
A PLATFORM APPROACH
© Composable 18
SOLUTION
Scalability Efficiency
The platform can easily handle the growing By automating large portions of the
volume of documentation as the company documentation process, the platform
continues to expand its product offerings. significantly reduced the workload on the
documentation team, alleviating burnout and
Consistency allowing them to focus on more strategic tasks.
The LLM platform ensured that all
documentation was uniform, eliminating the Improved User Experience
inconsistencies that plagued the company’s With accurate, up-to-date documentation
previous efforts. readily available, users could find the
information they needed without resorting to
Improved Collaboration support tickets, leading to higher customer
By integrating with VCSs and offering satisfaction.
collaboration tools, the platform facilitates
better coordination among teams, ensuring
that documentation updates are reviewed and
approved efficiently.
© Composable 19
USE CASE SCORE
RISK �0�5
LOW COST / HIGH REVENUE MEDIUM COST / MEDIUM REVENUE HIGH COST / LOW REVENUE
�1 �0�5 �1
COST VS
REVENUE
�0�5
LOW
EFFORT EFFORT HIGH EFFORT
�10 �9 �8 �7 �6 �5 �4 �3 �2 �1 0 1 2 3 4 5 6 7 8 9 10
COMPLEXITY,
RESOURCES & �3
TIME
NO ADDITIONAL PEOPLE OR TRAINING NEEDED SOME ADDITIONAL PEOPLE OR TRAINING NEEDED MANY ADDITIONAL PEOPLE OR TRAINING NEEDED
�1 �0�5 1
�4
2
VALUE
0
With an LLM software platform
Without an LLM software platform
-2
-4
-6
-8
LOW
Conclusion
In summary, the LLM software platform transformed the company’s documentation process,
delivering substantial business value and reducing the effort required to maintain high-quality,
consistent, and up-to-date technical documentation.
© Composable 21
KNOWLEDGE QUERYING
© Composable 22
CONTENT ANALYSIS & REASONING
© Composable 23
CONTENT ANALYSIS & REASONING
KEY BENEFITS
• Better management of liabilities, with
less breaches and crises
• Significant reduction in risk
• Improved brand image
© Composable 24
GENERATING CONTENT
© Composable 25
CONTENT ANALYSIS & REASONING + CONTENT GENERATION
KEY BENEFITS
• Instant processing, homogeneity of
produced results and more sophisticated
analysis
• Content analysis and subsequent
content generation are efficiently
articulated to constitute a full process
• Time savings can be spent on value
added tasks
© Composable 26
CONTENT ANALYSIS & REASONING + CONTENT GENERATION
© Composable 27