R Tensorflow API

The document discusses pushing machine learning models built with R and TensorFlow into production at T-Mobile. It describes how the authors built a convolutional neural network model in R to classify customer service messages and deployed it as an API using containers, Docker, and the plumber package. The authors discuss challenges around security, size, and integrating Python for TensorFlow, and lessons around choosing R over Python and the importance of collaboration. The talk concludes by describing how the models are now used in Apple Business Chat to help customers pay bills.

Uploaded by

pichr

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

127 views

R Tensorflow API

Uploaded by

pichr

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 24

Push straight to prod

API development with R and TensorFlow at T-Mobile

rstudio::conf
January 17th, 2019
Heather Nolis, Machine Learning Engineer, T-Mobile – @heatherklus
Jacqueline Nolis, Principal Data Scientist, Nolis LLC – @skyetetra

PAGE 1 | AI @ T-MOBILE
What does it mean to put into production?

ANALYSIS BUILD
Running code once Writing code that is
to produce a result continuously running

Putting code into production is letting customers interact with it

PAGE 2 | AI @ T-MOBILE
The project:

Goal Use machine learning to improve the customer experience

Scope customer care messaging

PAGE 3 | AI @ T-MOBILE
Scenario Customer sends message:
“This high bill shall not pass!”

Goal Prep customer care agent before first response:

Current bill status

Method
• Classify the message with machine learning: [bill breakdown]
• Improve the prediction with customer data:
• Recent account activity
• Signal strength
• Bill status [overdue]

PAGE 4 | AI @ T-MOBILE
Model creation with R

PAGE 5 | AI @ T-MOBILE
Model building workflow

1. rmarkdown for exploratory analysis

2. Save the model to flat files (and log the build with
rmarkdown)

3. Show model off with a shiny demo

PAGE 6 | AI @ T-MOBILE
Neural networks with R, Keras, and TensorFlow
A Convolutional Neural Network (CNN) processes
initial customer message and customer data

“Unlock my phone.” Recent order: YES

CNN

ACCOUNT UNLOCK ORDER

0.05 0.80 0.15

PAGE 7 | AI @ T-MOBILE
PAGE 8 | AI @ T-MOBILE
Model deployment to prod

PAGE 9 | AI @ T-MOBILE
Choosing the language

“If you want machine learning in production you need Python” –literally everyone

Option Analysis Modeling Deployment Verdict

1 ❎

2 ❎

3 ✅

PAGE 10 | AI @ T-MOBILE
Idea! Treat R like a full
programming language
(because it is one)

Commit is Jenkins builds the Marathon Mesos replicates

made to AI image orchestrates container and hosts the
repository deployment containers
PAGE 11 | AI @ T-MOBILE
Turning R into an API: plumber

Create an R file for Start the plumber Now make HTTP

the API endpoints service requests to R!

rest_controller.R main.R
#* @get /sum library(plumber)
function(a, b){ r <- plumb("rest_contoller.R")
as.numeric(a) + as.numeric(b) r$run(host='0.0.0.0',port=80)
}

PAGE 12 | AI @ T-MOBILE
Behold: containers!
Example Dockerfilae
# start from the rocker/r-ver:3.5.0 image
FROM rocker/r-ver:3.5.0