Describe the bug

This maybe true for other openai python api's as well. We are using openai api's via the python library in a multi threaded application which is always ON, i.e. we do not frequently start/restart the application.

Following is the code:

from embeddings_utils import get_embedding
input = get_embedding("this is a test", engine="text-embedding-ada-002")

When there is a long period of inactivity, intermittently, we get responses for above after 600s. This problem some time resolves itself after some requests/time. But during the time it gives issue, response is received after exact 600-601 seconds. It looks like request goes and there is no response for 600s and then it retries and that works immediately.

Any idea about this issue?

To Reproduce

No particular steps, please see description above.

Code snippets

No response

OS

Linux/Ubuntu

Python version

Python v3.7.5

Library version

open-ai 0.27.2