Scribd
Upload
13 views14 pages

Model Deployment - Slide

The document discusses model deployment, which is the process of publishing a machine learning model from local development to a larger user base. It covers serializing models, exposing models through REST APIs, packaging models for reproducibility, creating ML pipelines, and scaling models. Methods discussed include batch and real-time prediction, model serialization, creating REST APIs with Flask, using Docker for portability, and using Kubernetes for fault tolerance, auto-scaling, load balancing and rolling updates.

Uploaded by

ph8ks7p89g
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
13 views14 pages

Model Deployment - Slide

The document discusses model deployment, which is the process of publishing a machine learning model from local development to a larger user base. It covers serializing models, exposing models through REST APIs, packaging models for reproducibility, creating ML pipelines, and scaling models. Methods discussed include batch and real-time prediction, model serialization, creating REST APIs with Flask, using Docker for portability, and using Kubernetes for fault tolerance, auto-scaling, load balancing and rolling updates.

Uploaded by

ph8ks7p89g
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 14

prajwalarora4@gmail.

com
V8KLJAWU90
Model Deployment
Putting your ML system into production

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Agenda
- Serializing machine learning models
- Exposing the model through Rest APIs
- Packaging for reproducibility
- Create ML pipeline
[email protected]
- Scaling the model
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
What is model deployment?
ML model deployment is the process of publishing your model, which is currently
in your local machine, to a larger user base.

[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
ML Process Overview

[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Modes of training and serving the models

- Train: one off, batch and real-time/online training

[email protected]
V8KLJAWU90

- Serve: batch, real-time (web service, in-app, database trigger)

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Batch prediction

[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Real-time prediction

[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
[email protected]
V8KLJAWU90 Model serialization aka pickling

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
[email protected]
V8KLJAWU90 Create REST API using flask

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Docker - what problem it solves?
- Build once and run anywhere with Docker
- No environment issues
- No OS issues
- Preconfigured environment
[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Kubernetes - why to use?
Kubernetes is an orchestration platform
which enables -
- Fault tolerance
- Auto-Scale
[email protected]
- Load Balancing
V8KLJAWU90

- Rolling service updates

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Deploy and scale docker with kubernetes
[email protected]
V8KLJAWU90

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
[email protected]
V8KLJAWU90
Any Questions?

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
[email protected]
V8KLJAWU90
Thank you!
Happy Learning :)

This file is meant for personal use by [email protected] only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.

You might also like