https://github.com/yuchen20/context-crumb
Save Token Usage on Unstructured Document 😎. Let agent read docs, memories, prompts with in ultra-compressed mode through a tiny local model.
https://github.com/yuchen20/context-crumb
agent ai context-compaction context-compression skills token token-optimization
Last synced: 10 days ago
JSON representation
Save Token Usage on Unstructured Document 😎. Let agent read docs, memories, prompts with in ultra-compressed mode through a tiny local model.
- Host: GitHub
- URL: https://github.com/yuchen20/context-crumb
- Owner: Yuchen20
- License: mit
- Created: 2026-05-25T18:25:27.000Z (16 days ago)
- Default Branch: main
- Last Pushed: 2026-05-30T22:31:55.000Z (11 days ago)
- Last Synced: 2026-05-31T00:20:27.728Z (11 days ago)
- Topics: agent, ai, context-compaction, context-compression, skills, token, token-optimization
- Language: Python
- Homepage: https://context-crumb.vercel.app/docs/overview
- Size: 3.9 MB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
ContextCrumb
Shake the crumbs out of bloated context.
Before / After -
Quickstart -
Playground -
Install -
CLI -
Agent + MCP -
Model
---
LLM context gets messy fast: notes, logs, issue threads, docs, research dumps, and tool descriptions all pile up until the useful signal is buried under filler.
**ContextCrumb** is a token-level compressor for LLM and agent workflows. It looks at text word by word and removes low-signal tokens while keeping the surviving text in the original order.
That is the idea behind the name: the context is still there, but the loose crumbs are shaken off before they reach your model. Less bloat in the prompt. More room for the parts that matter. Less wasted usage when Codex, Claude Code, or another agent processes long files repeatedly.
No install needed. Paste text, compare the kept context, and see what gets shaken off.
Before / After
ContextCrumb is not a summarizer. It does not rewrite your document into a new explanation. It keeps the source sequence and deletes expendable words. This example uses `target_keep_ratio=0.72`.
**Original**
```text
Agents spend context on notes, logs, tickets, docs, and tool descriptions. Those files contain useful facts, but they also carry filler phrases and repeated wording. ContextCrumb compresses the text before it reaches the model. It keeps the original order, removes low-value tokens, and leaves a shorter version with the names, actions, constraints, and sequence still intact.
```
**Compressed**
```text
Agents spend context notes, logs, tickets, docs tool descriptions. Those files useful facts, carry filler phrases repeated wording. ContextCrumb compresses text before reaches model. keeps original order, removes low-value tokens, leaves shorter version names, actions, constraints sequence intact.
```
Same order. Less padding. More room for the next file. On prose-heavy agent inputs, ContextCrumb often saves around **30-70% of the context** depending on how aggressively you compress and how much filler is in the source.
| Metric | Original | Compressed | Saved |
| --- | ---: | ---: | ---: |
| Model tokens | 72 | 52 | 20 tokens |
| Token budget | 100% | 72% | 28% fewer input tokens |
**What that feels like over a month**
Assume your agent reads 8k-token notes, logs, tickets, research dumps, or docs before answering. This helps with API token bills, but also with subscription-based coding agents where heavy context reads can burn through usage faster.
| Workflow | Files read / day | Context saved / month | API cost avoided at $5 / 1M input tokens | Subscription usage feel |
| --- | ---: | ---: | ---: | --- |
| Solo agent helper | 20 | ~1.4M-3.4M tokens | ~$7-$17 | Fewer bulky reads in Codex or Claude Code |
| Busy project workspace | 200 | ~14M-34M tokens | ~$72-$168 | More room for actual reasoning and edits |
| Agent-heavy team or eval loop | 2,000 | ~144M-336M tokens | ~$720-$1,680 | Less usage spent processing padded files |
The bigger win is usually not only the bill. It is keeping long-running agents from filling their context, turns, and subscription usage with words they did not need to carry in the first place.
Quickstart (30-second setup)
Teach your agent a small habit: compress the bloat before it enters context. ContextCrumb is meant to sit in the background as a skill, stepping in whenever a long note, doc, issue thread, research dump, or log would otherwise flood the context window and eat into your Codex or Claude Code usage.
1. Add the skill.
```bash
npx skills add Yuchen20/Context-Crumb
```
2. Select the agent you want to install it on.
The skill tells your agent when to compress text, how to preserve the useful sequence, and when exact raw text is required for things like code, configs, or direct quotes.
3. Use ContextCrumb to compress long files instead of dropping the whole thing into context.
```text
Use ContextCrumb to compress this long project note before you work from it.
```
4. Voila: every long note, log, ticket, research dump, or doc enters context already trimmed, saving tokens and preserving more of your agent subscription for the work that matters.
## Why ContextCrumb?
| Use case | What changes |
| --- | --- |
| Agent file loading | Compress long notes, docs, research dumps, and logs before they hit the context window. |
| Prompt pipelines | Shrink natural-language inputs without hand-writing summarizers. |
| MCP catalogs | Compress verbose tool/resource descriptions while preserving names and schemas. |
| Local workflows | Run ONNX inference by default, with cached model files after first download. |
| Subscription-aware agents | Spend less Codex or Claude Code usage on repeatedly loading padded prose. |
| Inspection and tuning | Use `diff` and `inspect` to see what was kept, deleted, and saved. |
Best fit: docs, notes, issue threads, logs, research context, and other natural-language files. For source code where exact syntax matters, prefer raw file loading or use a conservative keep ratio.
Install
```bash
pip install contextcrumb
```
Optional extras:
```bash
pip install "contextcrumb[mcp]"
pip install "contextcrumb[serve]"
pip install "contextcrumb[torch]"
```
ContextCrumb uses the ONNX backend by default, so normal users do not need PyTorch or Transformers installed. Model files are cached locally after the first download.
CLI
The main agent-friendly command is `load`:
```bash
contextcrumb load notes.txt
```
It prints only compressed text by default, which makes it easy for agents, hooks, shell scripts, and prompt pipelines to capture stdout and move on. For subscription tools like Codex or Claude Code, that means fewer bulky file reads before the agent gets to the useful part.
Useful commands:
```bash
contextcrumb load notes.txt --json
contextcrumb load notes.txt --receipt
contextcrumb diff notes.txt
contextcrumb inspect notes.txt
contextcrumb stats
```
`--receipt` leaves compressed text on stdout and writes a compact savings receipt
to stderr. ContextCrumb also refuses syntax-sensitive file types such as code,
diffs, configs, lockfiles, scripts, SQL, and `.env` files unless you pass
`--force`; forced output is only for exploratory reading, not exact edits or
copy-paste commands.
`diff` marks deleted tokens like this:
```text
kept words [-deleted words-] kept words
```
Agent + MCP
ContextCrumb includes an optional MCP stdio adapter for agent clients that can run Python tools through `uvx`.
```bash
pip install "contextcrumb[mcp]"
```
Published-package MCP config:
```json
{
"mcpServers": {
"contextcrumb": {
"command": "uvx",
"args": [
"--from",
"contextcrumb[mcp]",
"contextcrumb-mcp"
]
}
}
}
```
The MCP server exposes:
```text
compress_text
compress_file
```
ContextCrumb also ships `contextcrumb-shrink`, an MCP proxy that compresses verbose catalog descriptions before an agent sees them while forwarding tool names, schemas, calls, results, and resource contents unchanged. This is useful when an agent client repeatedly spends context and subscription usage just looking at long tool descriptions.
Model
Model weights and a hosted demo are public on Hugging Face:
- Model: [ymao20/contextcrumb-32m](https://huggingface.co/ymao20/contextcrumb-32m)
- Playground: [contextcrumb-32m-demo](https://huggingface.co/spaces/ymao20/contextcrumb-32m-demo)
## Roadmap
Planned for later:
- Public docs for advanced compression modes and service deployment.
- JavaScript or TypeScript client.
- Hosted API experiments.
- npm publishing.
## Development
```powershell
uv pip install --python .\.venv\Scripts\python.exe -e ".[dev,mcp]"
.\.venv\Scripts\python.exe -m pytest
.\.venv\Scripts\python.exe -m build
```
Release notes are tracked in [CHANGELOG.md](CHANGELOG.md).
## License
MIT. See [LICENSE](LICENSE).