Conversations with GPT-3

My Conversations with GPT-3

What is GPT-3?

The way to interact with OpenAI’s the latest language model, GPT-3 (GPT stands for generative pre-trained transformer), is simple — you send it any text and it returns what it predicts will come next. To build GPT-3, OpenAI fed in every public book ever written, all of Wikipedia (in every language), and a giant dump of the Internet as of October, 2019. They then spent $12 million of compute power having the AI read all of this content and make connections. They ended up with a 700GB model that needs to sit on 48 16GB GPUs in order to process input and return responses. The number of connections the model has is two orders of magnitude away from the number of connections the human brain has.



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store