Skip to content

forkestra/Atlanta-Deep-Learning-Meetup

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 

Repository files navigation

Transfer Learning for Natural Language Processing: Rise of the Transformers!

Presented to the Atlanta Deep Learning Meetup group on January 13th 2020

Instructions

The repository contains the powerpoint presentation along with a Google Colab notebook showing how to fine-tune GPT2. You just need to download the file Transformer_Demo and go to colab and upload the notebook. Note, that your own dataset will be required to do the fine-tuning. In Google Colab make sure you set the runtime to GPU by changing the runtime type. Due to the memory constraints of colab it is only possible to fine-tune on small gpt2 model.

About

Transfer Learning for Natural Language Processing: Rise of the Transformers!

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%