OpenAI GPT-3 and Prompt Engineering

Jul 19, 2020 · 13 min read

OpenAI released their GPT-3 language model in June 2020. It was trained on 175 billion parameters, which is 10x more parameters than their previous iteration GPT-2. That in itself is a huge feat of engineering, but this post is dedicated to dig deep into the “prompts” which is a way to get the model to produce text by specifying an instruction in natural language and showing some demonstrations of how to follow the instructions well.

What is GPT3?

GPT-3 is the latest language model created by OpenAI. OpenAI is a for-profit company…