When you use your fine-tuned model for the first time in a while, it might take a little while for it to load. This sometimes causes the first few requests to fail with a 429 code and an error message that reads "the model is still being loaded".

The amount of time it takes to load a model will depend on the shared traffic and the size of the model. A larger model like davinci, for example, might take up to a few minutes to load, while smaller models might load much faster.

Once the model is loaded, Completion requests should be much faster and you're less likely to experience timeouts.

We highly recommend implementing retry logic with exponential backoff in your request code in order to work around any issues you might experience when the model is loading (see the "Retrying with exponential backoff" section of this notebook for examples).

Did this answer your question?