GPT-1 achieved state-of-the-art results on 9 out of 12 tasks, including the GLUE benchmark (scoring 72.8, surpassing the previous best of 68.9). Its success stems from the long-range dependencies and world knowledge captured during pre-training, as well as the flexibility of fine-tuning.