Scribd
Upload
19 views1 page

5 - Transfer - Learning

Transfer learning refers to using the knowledge from a trained neural network for a different task. It is useful when the new task has limited data but similar input to a task with more data. An example is adapting a cat recognition network for radiology diagnosis by retraining just the last layer on medical images.

Uploaded by

Archit Mangrulkar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
19 views1 page

5 - Transfer - Learning

Transfer learning refers to using the knowledge from a trained neural network for a different task. It is useful when the new task has limited data but similar input to a task with more data. An example is adapting a cat recognition network for radiology diagnosis by retraining just the last layer on medical images.

Uploaded by

Archit Mangrulkar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

Transfer Learning

Transfer learning refers to using the neural network knowledge for another application.

When to use transfer learning


• Task A and B have the same input 𝑥
• A lot more data for Task A than Task B
• Low level features from Task A could be helpful for Task B

Example 1: Cat recognition - radiology diagnosis


The following neural network is trained for cat recognition, but we want to adapt it for radiology diagnosis.
The neural network will learn about the structure and the nature of images. This initial phase of training
on image recognition is called pre-training, since it will pre-initialize the weights of the neural network.
Updating all the weights afterwards is called fine-tuning.

For cat recognition


Input 𝑥: image
Output 𝑦 – 1: cat, 0: no cat

Images Image recognition - cat

Radiology diagnosis
Input 𝑥: Radiology images – CT Scan, X-rays
Output 𝑦 :Radiology diagnosis – 1: tumor malign, 0: tumor benign

Radiology images
𝑥

Radiology diagnosis
𝑦ො
Guideline
• Delete last layer of neural network
• Delete weights feeding into the last output layer of the neural network
• Create a new set of randomly initialized weights for the last layer only
• New data set (𝑥, 𝑦)

You might also like