
Open Viking Headless Scraper & Content Extractor
A resilient headless web scraping and markdown distillation kernel for DeepSeek Harness. Features automated bot-defense evasion, dynamic SPA rendering, and token-efficient content distillation.
Scraper · Headless · Extraction · Readability
$ pnpm add @open-viking/scraperArchitecture
Core Features
Adaptive Bot Evasion: Circumvents bot challenges and TLS fingerprint tracking transparently
Full SPA Hydration: Accurately renders dynamic React, Vue, and Angular client-rendered data
Aggressive Token Pruning: Eliminates up to 75% of noisy DOM tags, saving valuable context
Table & Math Preservation: Accurately serializes complex data tables and formulas into Markdown
Core Workflow
Fingerprint Masquerade
Initializes randomized TLS fingerprints and user-agent rotations before fetching.
Headless DOM Hydration
Executes dynamic JS scripts and waits for main content nodes to hydrate.
Noise Pruning & Heuristics
Strips navbars, cookie banners, tracking iframes, and promotional artifacts.
Markdown Serialization
Converts clean content into token-compact Markdown, preserving tables and code.
Configuration Parameters Reference (YAML / JSON)
| Parameter | Type | Default | Description |
|---|---|---|---|
| renderTimeout | number | 15000 | Page hydration timeout in milliseconds |
| extractImages | boolean | false | Preserve image links and captions in output |
| blockResources | string | font,media | Resource types blocked to accelerate throughput |
Recommended Plugins
DSH Context Full-Spectrum Context Visualizer & Multi-Agent Dashboard
dsh-context is an all-in-one context inspection and visualization suite for DeepSeek Harness. Featuring a standalone Context dashboard, browser, sidebar integration, and /context commands, it breaks down token footprints, tracks turn-by-turn evolution and pruning history, and aggregates multi-agent team session logs.
Open Design Component Synthesizer & Canvas Engine
A generative UI compilation engine translating developer prompts and wireframes into clean React components. Powered by Tailwind CSS, Figma AST parser, and automated design token validation.
Archify Software Topology & Architecture Visualizer
An automated architecture reverse-engineering engine transforming source code and schemas into clean Mermaid, PlantUML, and C4 model diagrams with drift detection.