
OpenRouter Live Multi-Model Gateway & Failover Router
A unified multi-model routing gateway connecting DeepSeek Harness with hundreds of global LLM providers via OpenRouter. Features automated failover, latency routing, and unified billing.
Model-Routing · OpenRouter · Failover · Gateway
$ pnpm add @openrouter/dsh-live-gatewayArchitecture
Core Features
Hundreds of LLMs via One Key: Route seamlessly across DeepSeek, Claude, Llama, and GPT
Sub-Second Failover Cascade: Transparent recovery upon upstream 429 rate limits or timeouts
Cost-Optimized Auto-Routing: Matches trivial tasks with ultra-cheap models automatically
Live Telemetry & Latency Dashboard: Real-time insights into TTFT latencies and token pricing
Core Workflow
Request Routing & Quota Check
Inspects outbound inference payloads, matching requirements with optimal providers.
Protocol Normalization
Normalizes prompt, tool calling, and temperature parameters for downstream endpoints.
Latency & Availability Probing
Samples live TTFT latencies across provider regions, steering traffic to healthy nodes.
Automated Cascade Failover
Transparently triggers secondary fallback models upon HTTP 429/500 errors.
Configuration Parameters Reference (YAML / JSON)
| Parameter | Type | Default | Description |
|---|---|---|---|
| primaryModel | string | deepseek/deepseek-chat | Primary model identifier |
| fallbackModels | string | deepseek/deepseek-r1,anthropic/claude-3.5-sonnet | Ordered fallback models comma-separated |
| maxRetryCount | number | 3 | Maximum retry attempts before throwing error |
Recommended Plugins
dsh-our-free-model Keyless Free Model Gateway Plugin
dsh-our-free-model is a keyless model provider plugin for DeepSeek Harness. Requiring no account, sign-up, or API key, it provides instant access to frontier models like DeepSeek V4.1 and Kimi K3. Featuring real token budget thinking control, egress network probing, and a local OpenAI-compatible forward port, it keeps all telemetry safely on your machine.
AGY Dedicated Inference Provider & Connection Pool
Official AGY Cloud dedicated inference driver for DeepSeek Harness. Features HTTP/2 multiplexed persistent connections, binary streaming protocols, and ultra-low latency cluster routing.
DSH Dynamic Router Intelligent Routing & Cost Balancer
An adaptive task-complexity model router for DeepSeek Harness. Automatically routes lightweight tasks to fast small models while escalating deep logical reasoning to DeepSeek-R1, saving costs.