
DeepWiki Rust High-Performance Markdown Engine
A blazing-fast native Rust documentation compiler and BM25 indexer for DeepSeek Harness. Delivers millisecond Markdown parsing, bidirectional wikilink graphs, and zero-GC memory safety.
Rust-Engine · Markdown-Compiler · BM25-Search · Wikilinks
$ pnpm add @sopaco/deepwiki-rsArchitecture
Core Features
Native Rust Raw Throughput: 50x-80x faster than pure JS parsers, handling millions of words
Zero Garbage-Collection Overhead: Completely eliminates V8 GC pauses and memory spikes
Bidirectional Wikilink Graph: Native support for Obsidian-style networked thought associative links
SIMD-Accelerated BM25 Indexer: Blends keyword precision with extreme single-node search performance
Core Workflow
Parallel Native Parsing
Loads Markdown files concurrently with Rayon, building compact AST nodes.
Bidirectional Link Graph
Extracts `[[wikilink]]` references, constructing a bidirectional graph matrix.
SIMD BM25 Indexing
Indexes text with SIMD CPU instructions for sub-millisecond BM25 keyword recall.
Zero-Copy Data Delivery
Transfers search results directly into agent context via shared memory buffers.
Configuration Parameters Reference (YAML / JSON)
| Parameter | Type | Default | Description |
|---|---|---|---|
| workerThreads | number | 4 | Number of native Rayon worker threads |
| enableWikilinks | boolean | true | Enable `[[wikilink]]` syntax parsing |
| maxSearchMatches | number | 10 | Maximum BM25 candidate results returned |
Recommended Plugins
Weknora Graph RAG & Hybrid Retrieval Engine
An enterprise hybrid RAG engine combining dynamic Knowledge Graphs with dense vector retrieval. Delivers multi-hop reasoning, relationship mining, and chunk deduplication for zero-hallucination Q&A.
PicGo Cloud Asset Pipeline & Storage Driver
A unified cloud asset pipeline bridging autonomous agents with AWS S3, Cloudflare R2, Aliyun OSS, and Tencent COS. Features automated deduplication, CDN cache warmup, and signed URLs.
NocoBase Headless Data Engine & Dynamic Schema Driver
A headless relational database and dynamic schema middleware for DeepSeek Harness agents. Integrates NocoBase metadata APIs to automate database modeling, dynamic CRUD synthesis, and RBAC control.