smarter multiple keys #1
thabeta
commented
Owner
- Smart Load Balancing: Track usage and direct traffic to less-used instances
- Health Checking: Detect and skip failed or rate-limited instances
- Priority Weighting: Allow different priorities for different keys
- Key Rotation: Automatically rotate keys based on usage patterns
- Per-Key Rate Limiting: Track and enforce rate limits per key
1. **Smart Load Balancing:** Track usage and direct traffic to less-used instances
2. **Health Checking:** Detect and skip failed or rate-limited instances
3. **Priority Weighting:** Allow different priorities for different keys
4. **Key Rotation:** Automatically rotate keys based on usage patterns
5. **Per-Key Rate Limiting:** Track and enforce rate limits per key
despiegk
added this to the later milestone
Labels
No labels
prio_critical
prio_low
type_bug
type_contact
type_issue
type_lead
type_question
type_story
type_task
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
lhumina_code/hero_aibroker#1
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?