Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notify team admins of rate limits #724

Open
SmittieC opened this issue Oct 14, 2024 · 2 comments
Open

Notify team admins of rate limits #724

SmittieC opened this issue Oct 14, 2024 · 2 comments

Comments

@SmittieC
Copy link
Collaborator

SmittieC commented Oct 14, 2024

Regarding this issue: https://dimagi.sentry.io/issues/5986776238/?alert_rule_id=14063560&alert_type=issue&notification_uuid=571a9dea-ea23-4dc3-bcf1-f9b426f90a76&project=4505001320316928&referrer=issue_alert-slack

I think team admins should know when this happens, because their bots will stop working when it does. See OpenAI's error codes page for the different types of rate limits.

We can use regex to catch specific 429 messages (they seem to be static) and send an email to all users on the team that have super admin or team admin access.

A thought: High utility of a specific provider will increase the chance of it being rate limited, since limits exists on organization and project levels. We can be a bit more proactive and inform users about this potential issue when we detect high utility of a single provider. Maybe. Not sure if this should be a documentation thing or if we should build something into the platform.

@SmittieC
Copy link
Collaborator Author

cc @snopoke

@SmittieC SmittieC changed the title Notify team admins of quota limit Notify team admins of rate limits Oct 14, 2024
@SmittieC
Copy link
Collaborator Author

SmittieC commented Oct 14, 2024

LangChain has a way to handle rate limits

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant