Skip to content

Budget controls and alerts system implementation #22

@bonus414

Description

@bonus414

Budget controls would allow customers to:

  • Set daily/hourly token usage limits
  • Configure different thresholds for prod vs dev environments
  • Set company-wide spending limits for end users

For alerts:

  • Light LLM has webhook capabilities for budget tracking per key
  • Alerts can't happen directly in Drupal, but:
    • Dashboard can show usage (e.g. "95% of budget used")
    • amazee.ai could send email alerts
    • Need to determine how to handle links/CTAs since amazee.ai doesn't know Drupal site URLs
  • Would need to build feature to handle webhook data from Light LLM to amazee.ai

Current limitation: Budget features are focused on trial usage limits, need to expand for customer usage control.

We could have

  • Have Light LLM send webhooks to amazee.ai
  • amazee.ai would then handle the webhook data

Metadata

Metadata

Assignees

No one assigned

    Projects

    Status

    Icebox

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions