Raw documents (Markdown, HTML, plain text) → structured bridge format <D>?<H><B> — with adaptive compression that keeps you under token budget.
Table of Contents
Why
LLMs perform better when context is clean and dense. This library handles the mechanical work:
| Feature | Why it matters |
|---|
| 🏗️ | Structural parsing | Markdown/HTML/plain text → typed IR nodes (headings, paragraphs, tables, lists, code blocks) |
| 📉 | Adaptive compression | Automatically escalates through 4 stages as token budget fills up |
| 🔣 | Symbol substitution | Repeated domain terms → Unicode PUA characters, decoded by <D> dictionary header |
| 📊 | Table linearization | Markdown tables → compact Key:Val (≤5 rows) or pipe-separated rows for larger tables |
| 🌊 | Streaming output | Tokio stream delivers the first chunk immediately, minimizing TTFT |
Benchmarks
37 documents, 4 formats, 5 languages — Apple M-series, --release build. Full report: eval/EVAL_REPORT.md
| Format | Semantic reduction | Compressed reduction | Lossless word coverage | Throughput |
|---|
| Markdown (EN) | 29.8% | 42.0% | 99.7% | 895 tok/ms |
| Markdown (ML) | 43.1% | 43.9% | 97.3% | 3,483 tok/ms |
| HTML | 97.7% | 97.7% | 93.0% | 5,879 tok/ms |
| PlainText | 17.7% | 47.7% | 100.0% | 189 tok/ms |
| Overall | 79.2% | 81.1% | 98.4% | 2,258 tok/ms |
HTML reduction reflects markup overhead removal (nav, scripts, styles), not prose compression alone.
Installation
Claude Code
/plugin marketplace add epicsagas/plugins
/plugin install transpile@epicsagas
Auto-installs the binary and seeds the PostToolUse hook on next session start — no additional setup required.
Codex CLI
codex plugin marketplace add epicsagas/plugins
The PostToolUse hook is registered automatically — no further steps needed.
macOS / Linux
