In May 2020, OpenAI announced GPT-3 (Generative Pretrained Transformer 3), a groundbreaking autoregressive language model which contains two orders of magnitude more parameters than GPT-2 (175 billion vs 1.5 billion parameters) and offers a dramatic improvement over GPT-2. GPT-3 is the largest and most advanced language model in the world and is trained on Azure’s […]

The rest of the story...
Microsoft News