
AGY Dedicated Inference Provider & Connection Pool
Official CoreOfficial AGY Cloud dedicated inference driver for DeepSeek Harness. Features HTTP/2 multiplexed persistent connections, binary streaming protocols, and ultra-low latency cluster routing.
Official-Provider · AGY-Cloud · Connection-Pool · Low-Latency
$ pnpm add @deepseek-ai/dsh-provider-agyArchitecture
Core Features
Multiplexed HTTP/2 Connection Pool: Channels hundreds of concurrent streams over persistent sockets
Ultra-Low Jitter Dedicated Routing: Reduces network latency by up to 50% vs public endpoints
Adaptive Client Backpressure: Throttles high-speed token generation to protect slower consumer sinks
Private Dedicated Cluster Native: Switches seamlessly between public AGY Cloud and on-prem hardware
Core Workflow
Persistent Pool Warmup
Pre-warms multiplexed HTTP/2 sockets with target AGY clusters upon startup.
Zero-Copy Serialization
Serializes prompts and tool schemas into binary frames without memory copies.
Dedicated Pipe Streaming
Streams prompts and receives token chunks over low-jitter enterprise pipes.
Adaptive Backpressure
Dynamically throttles token emission to prevent client-side buffer overflows.
Configuration Parameters Reference (YAML / JSON)
| Parameter | Type | Default | Description |
|---|---|---|---|
| poolSize | number | 16 | Persistent HTTP/2 socket pool capacity |
| connectTimeoutMs | number | 5000 | Socket connection timeout in milliseconds |
| enableCompression | boolean | true | Enable Brotli/Gzip wire payload compression |
Recommended Plugins
dsh-our-free-model Keyless Free Model Gateway Plugin
dsh-our-free-model is a keyless model provider plugin for DeepSeek Harness. Requiring no account, sign-up, or API key, it provides instant access to frontier models like DeepSeek V4.1 and Kimi K3. Featuring real token budget thinking control, egress network probing, and a local OpenAI-compatible forward port, it keeps all telemetry safely on your machine.
OpenRouter Live Multi-Model Gateway & Failover Router
A unified multi-model routing gateway connecting DeepSeek Harness with hundreds of global LLM providers via OpenRouter. Features automated failover, latency routing, and unified billing.
DSH Dynamic Router Intelligent Routing & Cost Balancer
An adaptive task-complexity model router for DeepSeek Harness. Automatically routes lightweight tasks to fast small models while escalating deep logical reasoning to DeepSeek-R1, saving costs.