What does GPT in ChatGPT Mean?

GPT stands for "Generative Pretrained Transformer" which is a type of model developed by OpenAI.

"Generative" refers to these models being designed to generate new content like images, audio, and text. "Pre-trained" refers to the fact that these models are trained on a huge amount of general (not specific) data to learn both language and reasoning patterns. "Transformer" refers to the transformer model architecture used to create these models.

ChatGPT vs. Other GPTs

ChatGPT is OpenAI’s generic all-purpose LLM, which will perform well for a variety of generic tasks. Within ChatGPT other "GPTs" are available. These are customized versions of ChatGPT that can be used for a smaller more specific set of tasks.

How GPTs are Customized

ChatGPT can be customized in a variety of ways.

Custom instructions can be built into a specific GPT and abstracted from users. These instructions can guide the LLM on persona, output format, reasoning instructions, etc.

Customized GPTs might also have access to specific tools such as APIs, databases, and plugins that can be used to personalize interactions.

How memory is used (remembering prior conversations, events, etc.) can also be used to make responses more personalized or generic.

Customized GPTs can be created to better handle tasks like image generation, financial planning, vacation planning, coding, etc.

Are GPTs Customized through Fine Tuning?

No, GPTs aren’t customized through fine tuning of a model (i.e. updating a model through additional training). All customizations are applied through the methods mentioned above.