Skip to content
Docs

Settings — Gateway Routes

Navigate to: Settings → Gateway Routes

What it shows: All configured proxy routes — mappings from incoming request paths to upstream LLM providers. Each route defines which provider handles requests, load balancing strategy, and timeout behaviour.

Step-by-step: Create a gateway route

  1. Navigate to Settings → Gateway Routes.
  2. Click Add Route.
  3. Fill in:
    • Route Name — e.g., Production OpenAI
    • Path Pattern — e.g., /v1/chat/completions
    • Target Provider — select from configured providers
    • Timeout — max seconds to wait for upstream response (default 60 s)
    • Retry Count — number of retries on transient failures (default 2)
  4. Click Save.

Load balancing (multi-provider routes):

  1. Toggle Load Balancing on.
  2. Add multiple providers with Weight values (e.g., OpenAI: 70, Anthropic: 30).
  3. Select Strategy: weighted-round-robin, least-connections, or failover.
  4. Click Save.

Step-by-step: Test a route

  1. Open the route.
  2. Click Test Route — opens a test pane.
  3. Enter a sample request payload.
  4. Click Send — the route processes it and returns the upstream response alongside latency metrics.

Cross-reference: Multi-provider configuration details at section 7.3. Header-based routing at section 7.11. Tenant routing rules at section 7.12.

How to test: Create a failover route with a valid primary provider and an invalid secondary. Disable the primary provider’s keys — requests should automatically route to the secondary.