Beta self-hosted HTTP and LLM proxy with Redis-backed caching, non-streaming LLM idempotency, and budget guardrails.
Validating, idempotent ingestion gateway for FHIR-shaped healthcare data: cross-field validation at the door (claim totals must equal item sums), Idempotency-Key replay/409 semantics, batch vs transaction bundles, and a requeueable dead-letter queue. ~600 resources/s measured; bad data never 500s.
Drop-in idempotency layer for POST endpoints: atomic Redis claiming, byte-identical replay, in-flight collapsing. Proof asserted in tests: 50 concurrent duplicate payment requests, exactly one charge. Includes the crash-window test middleware demos hide, closed with a DB uniqueness constraint (ADR explains which layer owns which guarantee).
Cost-Aware API Reliability RL Environment using OpenEnv
Production-oriented Python example for retries, backoff, response validation, and multi-model fallback with CometAPI.
Model-serving gateway with dynamic micro-batching (fill-to-32 or 4ms deadline) and load shedding: +54% throughput and p99 cut from 2,289ms to 915ms at 64-way concurrency vs naive serving. Documents, with measurements, when batching is pure loss.
ComtradeBench OpenEnv: execution-grounded benchmark for reliable LLM tool-use under adversarial trade-data API conditions.
Independently observe external API dependencies, confirm failures deterministically, and generate verifiable evidence.
Plataforma determinística e orientada a evidências para diagnóstico e inteligência de APIs, cobrindo arquitetura, contratos, segurança, confiabilidade, runtime, compatibilidade, impacto e análise multi-repositório.
To associate your repository with the api-reliability topic, visit your repo's landing page and select "manage topics."