https://github.com/prosdevlab/doc-agent
Document extraction and semantic search CLI with MCP integration. Extract structured data from invoices, receipts, and bank statements using Vision AI.
https://github.com/prosdevlab/doc-agent
Last synced: 4 months ago
JSON representation
Document extraction and semantic search CLI with MCP integration. Extract structured data from invoices, receipts, and bank statements using Vision AI.
- Host: GitHub
- URL: https://github.com/prosdevlab/doc-agent
- Owner: prosdevlab
- License: mit
- Created: 2025-12-06T23:21:17.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2025-12-09T13:20:24.000Z (6 months ago)
- Last Synced: 2025-12-26T11:50:03.289Z (6 months ago)
- Language: TypeScript
- Size: 714 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Roadmap: ROADMAP.md
- Agents: AGENTS.md
Awesome Lists containing this project
README
# doc-agent
Document extraction and semantic search CLI with MCP integration. Extract structured data from invoices, receipts, and bank statements using Vision AI.
## Features
- 🔍 **Document Extraction**: Extract structured data from PDFs and images using Vision AI
- 🦙 **Ollama-First**: Privacy-first default using local `llama3.2-vision` model
- 🔧 **Zero Setup**: Auto-installs Ollama via Homebrew if needed, auto-pulls models
- 📄 **Multi-Format**: Supports PDFs and images (PNG, JPEG, WebP)
- 🔬 **OCR-Enhanced**: Uses Tesseract.js for accurate text extraction from receipts
- 💾 **Local Storage**: All data persists to local SQLite database
- 🔎 **Semantic Search**: Natural language search over indexed documents (coming soon)
- 🤖 **MCP Integration**: Use via Claude Desktop or any MCP-compatible assistant
- 🔒 **Privacy-First**: Data stays on your machine (unless you opt for cloud AI)
## Quick Start
### Installation
```bash
npm install -g doc-agent
```
### Usage
**Extract document data (uses Ollama by default):**
```bash
doc extract invoice.pdf
```
> 💡 Don't have Ollama? No problem! The CLI will offer to install it for you via Homebrew.
**With Gemini (cloud, higher accuracy):**
```bash
export GEMINI_API_KEY=your_key_here
doc extract invoice.pdf --provider gemini
```
**Start MCP server:**
```bash
doc mcp
```
### Claude Desktop Integration
Add to your `claude_desktop_config.json`:
```json
{
"mcpServers": {
"doc-agent": {
"command": "npx",
"args": ["-y", "doc-agent", "mcp"],
"env": {
"GEMINI_API_KEY": "your_key_here"
}
}
}
}
```
Then in Claude Desktop:
> "Extract data from ~/Downloads/invoice.pdf"
## Development
```bash
# Clone and install dependencies
git clone https://github.com/prosdevlab/doc-agent
cd doc-agent
pnpm install
# Build the project
pnpm build
# Run CLI locally
pnpm dev extract examples/invoice.pdf
# Run tests
pnpm test
# Start MCP server
pnpm mcp
```
### Architecture
The CLI is built with [Ink](https://github.com/vadimdemedes/ink) (React for CLIs) for rich interactive output:
```
packages/
├── cli/ # Ink-based CLI with services, hooks, and components
├── core/ # Shared types and interfaces
├── extract/ # Document extraction (Gemini, Ollama) + OCR
├── storage/ # SQLite persistence (Drizzle ORM)
└── vector-store/ # Vector database for semantic search
```
## Roadmap
See [ROADMAP.md](./ROADMAP.md) for the project plan.
## License
MIT