SAP BTP GenAI Hub

SAP Business AI Reference Architecture

T h u 8. Au g 08: 42

TThhuu 82.. ASuegp 0088::4422

MH

0 8 :4 2

Raja Gupta, SAP

© 2024 SAP SE @AI_Advocacy | Internal

 Agenda

1. Overview of Generative AI Hub

2. Example Use cases
3. Features and Capabilities
4. Roadmap
5. Reference Architecture

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Overview

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 SAP Business AI
A comprehensive AI portfolio focused on your SAP applications

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Our Business AI is embedded across the portfolio
Relevant Reliable Responsible

Joule
A copilot that truly understands your business

Embedded AI capabilities

SAP Supply Chain Human Capital

Spend Management SAP Customer
SAP Business Customized AI
SAP Cloud ERP and SAP Business Relationship
Management Management Technology Platform
Network Management

AI Foundation
on SAP Business Technology Platform

AI ecosystem partnerships and investments

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 AI Foundation is a complete set of services for AI developers on SAP BTP

Joule
A copilot that truly understands your business

Customized AI

AI Foundation
on SAP Business Technology Platform

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 AI Foundation is a complete set of services for AI developers on SAP BTP
to build powerful AI-driven extensions and applications, leveraging the
same robust and responsible technology that powers SAP applications.

AI Foundation
on SAP Business Technology Platform

AI Services

AI Lifecycle Management

Business Data & Context

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 AI Foundation is a complete set of services for AI developers on SAP BTP

AI Foundation
on SAP Business Technology Platform

AI Services
Tabular Data Processing Document Processing Text Processing

AI Lifecycle Management
Access Exploration & Development Deployment & Delivery Orchestration
Governance Trust & Security

Business Data & Context

Database AI Engine Vector Engine Knowledge Graph Engine
Data Management

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Generative AI Hub
Develop, deploy, and manage custom-built AI solutions
and AI-powered extensions of SAP applications.

Adaptability

AI Lifecycle Management
Access Exploration & Development Deployment & Delivery Orchestration
Governance Trust & Security

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Leverage customized AI
with AI Foundation

Document Information
Extraction

Data Attribute Recommendation

Personalized Recommendation

consume AI SAP Translation Hub

BTP capabilities
Enterprise AI Foundation SAP AI Launchpad

Customers Agreement*
purchase SAP AI Core

Generative AI hub
(via SAP AI Core)
*also applicable HANA Vector Engine
for CPEA (via SAP HANA Cloud)

HANA Machine Learning

(via SAP HANA Cloud)

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC Customers can check the cost of AI services in SAP Discovery Center
SAP BTP Advantages
for generative AI.

Avoid potential lock in.

Avoid manual integration with

SAP processes & data.

Provide secure
access and business
authorization.
Procure and
operate hardware.

Host and optimize LLMs.

+3
Ensure secure access.

Hyperscalers
+3

© 2024 SAP SE @AI_Advocacy | Internal

LLMs LLMs
 How our customers & partners create value and

bring out the best in their business

10.400 90% 3.120

Orders analyzed each year with Reduction in time and cost spent Hours of headcount productivity
GenAI Supply Chain Troubleshooter on root cause analysis projected to be saved each year

learn more

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 As-Is vs. New Flow with Generative AI
Leveraging Generative AI could make this process 10X more efficient*
Total estimated savings could be 120h / month*

Process Request Supply Chain Checks Conclusion Total Effort

ALLOCATION CHECKS SUPPLY CHECKS ORDER CHECKS AVAILABILITY CHECK

Check Wildcard Record No or limited supply

Header level delivery

Request to clarify block. No scheduling
sales orders
Available allocation is zero ABC disabled on sales order
possible Issues are
20 minutes
As-Is commitment issues identified per request
Flow Negative allocation Supply available at excluded area Material not set
Partial delivery on to “Z1” - ATP not
line-item prevents ABC applied
Sales order listed with excluded
Misalignment on order
location
Fixed Date/Quantity
Segment check. Supply available check box enabled
CAPA constraining
at NCH or CHI

To Be Flow Request to clarify Enter a prompt in Artificial Intelligence Generative AI 2 minutes

with sales orders the new
Tool identifies
Generative commitment issues Generative AI
tool Supply Chain Checks the issues per request
AI
1 min <1 min

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

* Considering 100 requests per week and 20 minutes per request
Generative AI Supply Chain Troubleshooter

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Features & Capabilities

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Joule Applications & Extensions

Generative AI Hub

SAP AI Prompt Editor & Chat

Playground Libraries
Libraries & SDKs & SDKs
Launchpad Toolset
Toolset
Prompt Engineering
Prompt Engineering Prompt
Prompt Management
Management Prompt Prompt
Registry* Registry

Trust
Trust & & Inference
Inference Engine
Engine Agents*
Agents* Multi-tenancy
Multi-tenancy SecuritySecurity
Control
Control Content
Content Moderation
Moderation* Grounding*
Grounding Plugins*Plugins* Data Privacy
Data Privacy
SAP AI
Core
Foundation
Foundation AVAILABLE
Built byBuilt by•• Microsoft Azure OpenAI •UPCOMING
Anthropic Claude 3
Model Built by SAP*
Built by SAP* Custom Custom Google •Gemini
Azure OpenAI •Additional
Meta Llamafoundation
3
Model
Access Access
PartnersPartners •
• AWS Bedrock
Falcon
•models
Mistralbeing added

SAP
Business
Business DataData • Embeddings • Embeddings
HANA Vector•Engine
Vector Engine
Similarity Functions
• Similarity Functions
Application Data Application Data
and
andContext
Context
Cloud

*upcoming

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Foundational Model Access

T h u 8. Au g 08: 42

Connect easily and seamlessly to any supported

foundation model or bring your own model.

Switch easily between models to find and upgrade

to the best suited technology for your needs.
No need for individual contracts and no lock-in
to ultimately boost the ROI of your AI projects.

Learn more.

25 models available

Managed by SAP Built by Partners Built by SAP

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 25 models available
Generative AI Hub

Managed by SAP Built by Partners Built by SAP

soon
ABAP Code
Mixtral 8x7b GPT-4 GPT-4o GPT-4 Turbo Generation

soon
Text-embedding- Text-embedding- ABAP Code
Llama 3 70b GPT-3.5 Turbo Explain
3-large 3-small

Llama 3.1 70B Text-embedding-ada Titan Text Express Titan Text Lite

soon

Titan Text
Aleph Alpha Pharia-1 Gemini 1.0 Pro Gemini 1.5 Pro
Embeddings

Textembedding-
Mistral Large V2 Gemini 1.5 Flash Claude 3.5 Sonnet
gecko

Textembedding-
Granite v2 Claude 3 Sonnet GPT-4o mini
gecko-multilingual

soon

Claude 3 Haiku Claude 3 Opus DALL-E

soon

Amazon Titan
Image Generator G1

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Playground for Prompt Engineering

Thu 8

Experiment with a prompt engineering

playground and explore different models,
meta data and parameter changes or
generative AI capabilities.

All in a secure and safe environment to

interact with cutting-edge technology. Thu 8 . Aug 0 8 :42

Find out more and see it in action.

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Prompt Management and Registry

Thu 8

Effectively manage prompt lifecycles,

save prompts and use prompt templates
to kick-start the productization of
LLM-centric applications.
Thu 8 . Aug 0 8 :42

Find out more and see it in action.

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 SDKs and Client Libraries

SDKs and client libraries ABAP

Leverage developer focused tooling such

as powerful SDKs and client libraries to
enhance your applications with generative
AI and build new custom AI solutions much
faster and easier. SDKs

Learn more.

Coming soon

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Security & Data Privacy

Develop and deploy with confidence in an enterprise-grade

secure environment. SAP maintains all existing data security and
confidentiality standards, unchanged even with AI integration.
Secure No training for
Securely connect to partner-operated FMs over TLS. SAP via TLS partner FMs
does not share any customer data with partners to training their Your input
FMs.

Protect your innovation journey with robust security measures,

including multi-tenancy isolation, continuous threat monitoring,
and industry-standard logging.

Consume AI technology with ease. SAP unifies the commercial

complexities across all models and vendors to simplify your Data Security Standards
procurement and free up your teams to focus on what matters
most. ISO NIST

SOC2 C5

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Roadmap

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 2024+ roadmap
Q4 Outlook

Automated grounding of prompts, Fine-tuning service

leveraging the RAG pattern

Model Evaluation Service

Prompt Registry

Agents
Java SDK support

Availability of Image Generation Models Feedback service

Clearer view of spending

learn more

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Reference Architecture
with SAP Business Technology Platform

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

Retrieval Augmented Generation with Gen AI on SAP BTP
Link to material: SAP Discovery Center Reference Architecture

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Link to material: SAP Innovation Award
Architecture

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC 35

Reduce your CO2 footprint using a smart Generative AI application
on SAP BTP Link to material: SAP Discovery Center Mission

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC

 Thank you
Raja Gupta
Solution Architect, SAP
[email protected]

Get in touch on

© 2024 SAP SE or an SAP affiliate company. All rights reserved. | PUBLIC