-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
Description
Budget controls would allow customers to:
- Set daily/hourly token usage limits
- Configure different thresholds for prod vs dev environments
- Set company-wide spending limits for end users
For alerts:
- Light LLM has webhook capabilities for budget tracking per key
- Alerts can't happen directly in Drupal, but:
- Dashboard can show usage (e.g. "95% of budget used")
- amazee.ai could send email alerts
- Need to determine how to handle links/CTAs since amazee.ai doesn't know Drupal site URLs
- Would need to build feature to handle webhook data from Light LLM to amazee.ai
Current limitation: Budget features are focused on trial usage limits, need to expand for customer usage control.
We could have
- Have Light LLM send webhooks to amazee.ai
- amazee.ai would then handle the webhook data
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
Icebox