
EchoBird Token Quota & Traffic Rate-Limiting Router
A token budget and traffic rate-limiting middleware for DeepSeek Harness fleets. Implements sliding-window rate limiting, multi-tenant token quotas, and smooth queue backpressure.
Rate-Limiter · Token-Quota · Budget-Guard · Traffic-Shaper
$ pnpm add @edison7009/echobirdArchitecture
Core Features
Sliding-Window Precision Rate Limiting: Prevents edge-burst exploits typical of fixed windows
Multi-Tenant Quota Hierarchy: Inherits limits across Organization, Department, and User trees
Intelligent Burst Queue Smoothing: Buffers temporary traffic peaks, avoiding sudden HTTP 429 errors
Real-Time Cost Dashboards & Alerts: Configurable 80% soft alerts and 100% hard budget circuit breakers
Core Workflow
Ingress Metering & Auth
Inspects incoming inference calls, extracting tenant ID and estimating token usage.
Token Bucket Evaluation
Checks distributed Redis token buckets to evaluate remaining rate limits.
Queue Buffer & Backpressure
Buffers transient burst traffic in priority queues, smoothing out invocation spikes.
Quota Trip & Alerting
Blocks calls cleanly when budgets deplete, triggering enterprise webhook alerts.
Configuration Parameters Reference (YAML / JSON)
| Parameter | Type | Default | Description |
|---|---|---|---|
| defaultDailyBudgetUsd | number | 50.0 | Default daily spend cap per tenant in USD |
| maxRPM | number | 60 | Default Requests Per Minute (RPM) ceiling |
| redisEndpoint | string | redis://127.0.0.1:6379 | Redis connection URL for distributed state |
Recommended Plugins
DSH Superagent Autonomous Proactive Coding Suite
DSH Superagent is an open-source proactive coding agent prototype engineered by DeepSeek for DeepSeek Harness. Operating under a minimal human attention principle, it continuously monitors GitHub and Feishu event streams, autonomously launching isolated workspace sessions to inspect repositories, execute code modifications, submit pull requests, and deliver concise updates through an interactive human-in-the-loop dashboard.
DSH Proactive Heartbeat & Autonomous Daemon
A production-grade asynchronous heartbeat and persistent daemon runtime for DeepSeek Harness agents. Features declarative cron scheduling, session state persistence, and event-driven wakeups for autonomous background workflows.
Ruflo Swarm Distributed Agent Mesh
A high-performance multi-agent swarm orchestration framework for DeepSeek Harness. Features dynamic DAG task distribution, shared episodic memory pools, and deterministic consensus protocols.