All Collections
API
General FAQ
What is the difference between prompt tokens and completion tokens?
What is the difference between prompt tokens and completion tokens?

What is the difference between input and output tokens?

Updated over a week ago

Prompt tokens are the tokens that you input into the model. This is the number of tokens in your prompt.

Completion tokens are any tokens that the model generates in response to your input. For a standard request, this is the number of tokens in the completion.

Most models we offer have both limits on the number of tokens that they can take in (prompt tokens) and on the number of tokens they an output (completion or samples tokens).

This also includes any tokens generated when using a higher value of best_of or n. For example, if you are generating 3 candidate completions using best_of = 3, the number of sampled tokens will be at most 3 * max_tokens.

You can read more about managing tokens in our text generation guide.

Did this answer your question?