Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support AI Subscription based ratelimit #2480

Closed
Tharsanan1 opened this issue Sep 20, 2024 · 1 comment
Closed

Support AI Subscription based ratelimit #2480

Tharsanan1 opened this issue Sep 20, 2024 · 1 comment
Labels
Type/New Feature
Milestone
1.2.0-alpha

Comments

@Tharsanan1
Copy link
Contributor

Problem

We are introducing AI APIs to apk. In the AI usecases its a common usecase to limit the requests based on the token counts(prompt, completion, total).

Solution

Add a feature to support subscription scoped ratelimiting AI requests based on the token count.

Affected Component

None

Version

No response

Implementation

No response

Related Issues

No response

Suggested Labels

No response
@Tharsanan1 Tharsanan1 mentioned this issue Sep 20, 2024
Merged
@Tharsanan1
Copy link
Contributor Author

Feature added with : #2446

@Tharsanan1 Tharsanan1 moved this from Backlog to ✅ Done/Done in APK Development Sep 20, 2024
@CrowleyRajapakse CrowleyRajapakse added this to the 1.2.0-alpha milestone Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type/New Feature
Projects
APK Development
Status: ✅ Done/Done
Milestone
1.2.0-alpha
Development

No branches or pull requests
2 participants
@CrowleyRajapakse @Tharsanan1