Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

APK config ds should support AI backend based ratelimit #2481

Closed
Tharsanan1 opened this issue Sep 20, 2024 · 1 comment
Closed

APK config ds should support AI backend based ratelimit #2481

Tharsanan1 opened this issue Sep 20, 2024 · 1 comment

Comments

@Tharsanan1
Copy link
Contributor

Problem

We have added feature to support backend based ratelimiting(#2479). User should be able to apply the backend based AI ratelimit using apk conf.

Solution

Improve the apk conf to support AI backend based ratelimit

Affected Component

Config-DS

Version

No response

Implementation

No response

Related Issues

No response

Suggested Labels

No response

@Tharsanan1
Copy link
Contributor Author

Added the support with : #2478

@Tharsanan1 Tharsanan1 moved this from Backlog to ✅ Done/Done in APK Development Sep 20, 2024
@CrowleyRajapakse CrowleyRajapakse added this to the 1.2.0-alpha milestone Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done/Done
Development

No branches or pull requests

2 participants