Beta self-hosted HTTP and LLM proxy with Redis-backed caching, non-streaming LLM idempotency, and budget guardrails.
Wayground is a full-stack AI-powered quiz platform where teachers can create and manage quizzes, generate questions with AI, and track student results. Students can browse quizzes, take timed assessments, review their answers, and see their score history.
Model-serving gateway with dynamic micro-batching (fill-to-32 or 4ms deadline) and load shedding: +54% throughput and p99 cut from 2,289ms to 915ms at 64-way concurrency vs naive serving. Documents, with measurements, when batching is pure loss.
Pinned API Retry-After reliability task for an Agent Bounties child
ComtradeBench OpenEnv: execution-grounded benchmark for reliable LLM tool-use under adversarial trade-data API conditions.
Production-minded Go API reliability lab: idempotency, tenant isolation, retries, circuit breaking, WebSocket replay, Prometheus and Grafana.
可复现的 AI API 中转站测速工具：测试 OpenAI 兼容接口成功率、P50/P95 延迟、错误率和稳定性。
Drop-in idempotency layer for POST endpoints: atomic Redis claiming, byte-identical replay, in-flight collapsing. Proof asserted in tests: 50 concurrent duplicate payment requests, exactly one charge. Includes the crash-window test middleware demos hide, closed with a DB uniqueness constraint (ADR explains which layer owns which guarantee).
Validating, idempotent ingestion gateway for FHIR-shaped healthcare data: cross-field validation at the door (claim totals must equal item sums), Idempotency-Key replay/409 semantics, batch vs transaction bundles, and a requeueable dead-letter queue. ~600 resources/s measured; bad data never 500s.
Cost-Aware API Reliability RL Environment using OpenEnv
Briza helps insurance carriers stop losing premium to slow integrations and submission errors, treating carrier API reliability as a manufacturing discipline. A team of Six Sigma Black Belts, Briza applies Kaizen principles to API connectivity across commercial insurance, focusing on submission integrity and moving premium reliably between…
Add a description, image, and links to the api-reliability topic page so that developers can more easily learn about it.
To associate your repository with the api-reliability topic, visit your repo's landing page and select "manage topics."