When doing requests in parallel it's not too hard to hit rate limits: https://platform.openai.com/docs/guides/rate-limits Would be great to have rate limiting support, e.g. across all clients generated from the same Manager.
When doing requests in parallel it's not too hard to hit rate limits:
https://platform.openai.com/docs/guides/rate-limits
Would be great to have rate limiting support, e.g. across all clients generated from the same Manager.