Scribd
Upload
67 views20 pages

(Slide) LangChain

This document outlines a course on building applications with Large Language Models (LLMs) using LangChain. It covers topics such as the production of LLMs, the components of LangChain, and how to deploy APIs and RAG applications. The course aims to provide a comprehensive understanding of LLMs in production and practical applications using LangChain.

Uploaded by

letruong098123
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
67 views20 pages

(Slide) LangChain

This document outlines a course on building applications with Large Language Models (LLMs) using LangChain. It covers topics such as the production of LLMs, the components of LangChain, and how to deploy APIs and RAG applications. The course aims to provide a comprehensive understanding of LLMs in production and practical applications using LangChain.

Uploaded by

letruong098123
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 20

AI VIETNAM

All-in-One Course
(TA Session)

Building LLMs application with


LangChain
Extra Class: LLMs

Dinh-Thang Duong – TA
Nguyen-Thuan Duong – TA

Year 2024
AI VIETNAM
All-in-One Course
(TA Session) Objectives

In this lecture, we will discuss about:


1. What is LLMs in Production?
2. What is Langchain?
3. Basic components of LangChain.
4. How to use LangChain to deploy an
API?
5. How to use LangChain to deploy a
RAG application?

2
AI VIETNAM
All-in-One Course
(TA Session)

Outline
➢ Introduction
➢ LangChain
➢ API with LangChain
➢ RAG with LangChain
➢ Question

3
AI VIETNAM
All-in-One Course
(TA Session)

Introduction

4
AI VIETNAM
All-in-One Course
(TA Session) Introduction
❖ Getting Started

5
AI VIETNAM
All-in-One Course
(TA Session) Introduction
❖ LLMs size over time

6
https://www.reddit.com/r/AILinksandTools/comments/12c4jmk/a_survey_of_all_llms_so_far_2018_to_2022_a/
AI VIETNAM
All-in-One Course
(TA Session) Introduction
❖ LLMs Applications

7
https://markovate.com/blog/applications-and-use-cases-of-llm/
AI VIETNAM
All-in-One Course
(TA Session) Introduction
❖ Getting Started

Overview of LLMs in Production


8
https://blog.dataiku.com/llm-in-production
AI VIETNAM
All-in-One Course
(TA Session)

LangChain

9
AI VIETNAM
All-in-One Course
(TA Session) LangChain
❖ Introduction

LangChain: A framework for developing applications


powered by large language models (LLMs). LangChain
simplifies every stage of the LLM application lifecycle:
Development, Productionization, Deployment.

10
AI VIETNAM
All-in-One Course
(TA Session) LangChain
❖ Introduction

• Development: Build your applications using


LangChain's open-source building blocks
and components. Hit the ground running
using third-party integrations and Templates.

• Productionization: Use LangSmith to inspect,


monitor and evaluate your chains, so that you can
continuously optimize and deploy with
confidence.

• Deployment: Turn any chain into an API


with LangServe.

11
AI VIETNAM
All-in-One Course
(TA Session) LangChain
❖ LangChain components

12
https://pub.dev/packages/langchain
AI VIETNAM
All-in-One Course
(TA Session)

API with LangChain

13
AI VIETNAM
All-in-One Course
(TA Session) API with LangChain
❖ Introduction
Description: Serve a LLMs chat application as an API that receive a simple question and return the response of
the LLMs (pre-trained model).

14
https://blog.streamlit.io/langchain-tutorial-1-build-an-llm-powered-app-in-18-lines-of-code/
AI VIETNAM
All-in-One Course
(TA Session)

Quiz

15
AI VIETNAM
All-in-One Course
(TA Session)

RAG with LangChain

16
AI VIETNAM
All-in-One Course
(TA Session) RAG with LangChain
❖ Introduction
Description: Serve a LLMs RAG application as an API that receive a simple question and return the response of
the LLMs (utilizing context retrieved from a vector database).

17
https://www.determined.ai/blog/rag
AI VIETNAM
All-in-One Course
(TA Session) Summary

In this lecture, we have discussed:


1. What is LLMs in production?
1. How is it differ from LLMs in research?
2. What are some challenges when deploying LLMs in production?
2. Basics of LangChain
1. The key concept of LangChain.
2. Basic components of LangChain: Prompt Template, LLM Chain, Chat History, Document Loader…
3. How to build an API using LangChain.
4. How to build a RAG application using LangChain.
1. Retrieve and answer questions related to Academic Paper.

18
AI VIETNAM
All-in-One Course
(TA Session) Question

?
19
20

You might also like