Transfer Learning
Pre-training paradigms, BERT, GPT, T5
LLMs, Prompting
- 📄 Stanford Lecture: Pretraining — most relevant
- 📄 NLP Course For You: Transfer Learning — most relevant about transfer learning
- 📄 BERT - about encoders pretraining
- 📄 T5 - paper about encoder-decoder model
- 📄 GPT evolution - guide about main changes
- 📄 BLOOM - good paper
- 📄 Prompting Guide - covers all aspects of current prompring techniques