DocsReference
Roadmap & Changelog
What's shipped, what's being built, and what's explicitly not there yet.
4 min read
Shipped
- OpenAI-compatible chat completions, streaming included
- 18-provider registry with automatic model discovery
- Deterministic, explainable routing across 9 scoring modes
- Automatic failover, retry, and per-provider circuit breaking
- Exact + semantic (pgvector) response caching
- Shadow / experiment mode
- BYOK, AES-256-GCM envelope-encrypted credentials
- Multi-tenant Postgres RLS isolation
- RBAC — permissions, roles, role assignments
- Audit trail
- Billing, entitlements, and quota enforcement across three plans
- Latency percentile reporting (p50/p95/p99) on the dashboard
Actively being worked on
| Item | Priority | Why it matters |
|---|---|---|
| Published OpenAPI / Swagger spec | P1 | Integrators get a machine-readable contract instead of prose plus source. |
| Full ER diagram of the schema | P1 | The current reference lags a few recently added tables. |
| Migration guides from OpenRouter / LiteLLM | P1 | Named ask from teams switching gateways. |
| SLI/SLO and alerting runbook detail | P1 | Sharper operational guarantees for production operators. |
| Dedicated AI/inference deep-dive | P2 | One page instead of routing/caching/shadow being spread across three. |
Not implemented — said plainly
Listed here so a sales call doesn't surprise you
These are verifiably absent today. Better to know going in than to find out during procurement.
| Capability | Status |
|---|---|
| SSO / SAML / SCIM | Not implemented |
| SOC 2 / ISO 27001 | No certification exists today |
| Full per-token, billing-grade usage metering | Current metering is request/estimate-based |
| OpenTelemetry trace export | Designed for in an ADR, not yet shipped — Prometheus metrics and the audit trail are live today |
| Load / soak / chaos testing | Not part of the automated suite yet |
| Terraform / Helm / Kubernetes manifests | Not applicable — deploys as a single binary plus managed Postgres |
| GraphQL or streaming beyond SSE | REST + SSE only |
| Self-serve free-trial checkout | Not wired yet — contact the team for trial access |
Related