GPT 3 is obscoleted by order of magnitudes.
SMIM has achieved 4.6 of perplexity vs 20 for GPT 3 with and with a thousand less parameters
https://arxiv.org/abs/2003.02645
This is the breakthrough of the year and will be silent until the few nerds like me propagate the news to the mainstream