T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Abstract

This paper introduces and evaluates the idea described in “T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer”, and reports empirical results that helped shape subsequent work in nlp, transformers.