GPT models

Generative Pre-trained Transformer (GPT) models by OpenAI have taken natural language processing (NLP) community by storm by introducing very powerful language models.

These models can perform various NLP tasks like question answering, textual entailment, text summarisation etc. without any supervised training.

These language models need very few to no examples to understand the tasks and perform equivalent or even better than the state-of-the-art models trained in supervised fashion.

GPT-1 paper (Improving Language Understanding by Generative Pre-training).

GPT-2 paper (Language Models are unsupervised multitask learners) and its subsequent improvements over GPT-1.

GPT-3 paper (Language models are few shot learners) and the improvements which have made it one of the most powerful models NLP has seen till date.