Skip to content

aibridge: key pool data structure and provider configuration #1445

Closed
coder/coder
#24701

Description

@ssncferreira

Description

  • KeyPool type with state management (valid, temporary, permanent)
  • Selection strategy abstracted to allow future changes (e.g., round-robin)
  • Concurrency: concurrent reads, mutually exclusive writes, lazy cooldown expiry
  • Config parsing and startup validation in coder
  • Wire key pool through providers to interceptors (no failover yet)
  • Remove 429 from circuit breaker failure conditions (scope separation between key errors and provider errors). Note: we should probably add 429 handling for BYOK cases.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions