AI Stack Docs
AI Gateway

AI Gateway

A unified proxy for all your LLM providers. Route, load-balance, cache, and monitor every AI call from a single endpoint.

AI Gateway

A unified proxy for all your LLM providers. Route, load-balance, cache, and monitor every AI call from a single endpoint.

Documentation for AI Gateway is coming soon. In the meantime, you can join the waitlist to get early access.

What to Expect

  • Universal API — One endpoint for OpenAI, Anthropic, Google, Mistral, and more
  • Smart routing — Load balance across providers with automatic failover
  • Response caching — Reduce costs and latency with intelligent caching
  • Request logging — Full observability into every AI call
  • Rate limiting — Protect your budget with per-key and per-model limits
  • Prompt management — Version and deploy prompts without code changes