{"id":35180954,"url":"https://github.com/nicolasestrem/screensearch","last_synced_at":"2026-01-12T13:16:45.588Z","repository":{"id":328234163,"uuid":"1114739918","full_name":"nicolasestrem/screensearch","owner":"nicolasestrem","description":"Your screen history, searchable and automated - Windows OCR + REST API + AI + RAG","archived":false,"fork":false,"pushed_at":"2026-01-09T01:12:25.000Z","size":13871,"stargazers_count":2,"open_issues_count":6,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-01-09T08:49:04.884Z","etag":null,"topics":["ai","automation","memory","ocr","rag","rest-api","rust","windows-desktop"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nicolasestrem.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"docs/security.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-12-11T20:18:07.000Z","updated_at":"2026-01-08T22:02:45.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/nicolasestrem/screensearch","commit_stats":null,"previous_names":["nicolasestrem/screensearch"],"tags_count":10,"template":false,"template_full_name":null,"purl":"pkg:github/nicolasestrem/screensearch","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolasestrem%2Fscreensearch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolasestrem%2Fscreensearch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolasestrem%2Fscreensearch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolasestrem%2Fscreensearch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nicolasestrem","download_url":"https://codeload.github.com/nicolasestrem/screensearch/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolasestrem%2Fscreensearch/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28338996,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-12T12:22:26.515Z","status":"ssl_error","status_checked_at":"2026-01-12T12:22:10.856Z","response_time":98,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","automation","memory","ocr","rag","rest-api","rust","windows-desktop"],"created_at":"2025-12-29T01:49:27.264Z","updated_at":"2026-01-12T13:16:45.561Z","avatar_url":"https://github.com/nicolasestrem.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\r\n\r\n```\r\n   _____                           _____                     _     \r\n  / ____|                         / ____|                   | |    \r\n | (___   ___ _ __ ___  ___ _ __ | (___   ___  __ _ _ __ ___| |__  \r\n  \\___ \\ / __| '__/ _ \\/ _ \\ '_ \\ \\___ \\ / _ \\/ _` | '__/ __| '_ \\ \r\n  ____) | (__| | |  __/  __/ | | |____) |  __/ (_| | | | (__| | | |\r\n |_____/ \\___|_|  \\___|\\___|_| |_|_____/ \\___|\\__,_|_|  \\___|_| |_|\r\n                                                                   \r\n                                                                   \r\n```\r\n\r\n#### Ever wish you could Ctrl+F your entire digital life?\r\n\r\n### Your screen history, searchable and automated\r\n\r\n*Continuously capture your Windows screen, extract text with OCR, and query it all through a powerful REST API*\r\n\r\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\r\n[![Rust](https://img.shields.io/badge/Rust-1.70%2B-orange.svg)](https://www.rust-lang.org)\r\n[![Windows](https://img.shields.io/badge/Platform-Windows%2010%2F11-0078D4.svg)](https://www.microsoft.com)\r\n\r\n\u003cbr/\u003e\r\n\r\n### [\u003e] [**Download Latest Release (v0.4.1)**](https://github.com/nicolasestrem/screensearch/releases/latest)\r\n\r\n**Windows 10/11** • **11MB** • **No installation required** • **Just extract and run**\r\n\r\n\u003e **Note for Linux Users:** This project now supports Linux for **UI development and backend logic**, with Windows-specific features (OCR, Automation) stubbed out. See [Developer Guide](docs/developer-guide.md) for details.\r\n\r\n\u003c/div\u003e\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                      SEE IT IN ACTION                           │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003ch3\u003eLight Theme — Premium Glassmorphism Design\u003c/h3\u003e\r\n  \u003cimg src=\"screenshots/dashboard-light.png\" width=\"85%\" alt=\"ScreenSearch Dashboard Light Theme - AI-powered Intel Dash with Daily Digest, Memory Status gauge, and Productivity Pulse chart\"\u003e\r\n  \u003cp\u003e\u003cem\u003eModern glass-and-neon aesthetic with atmospheric radial gradients and fluid animations\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n\u003cbr/\u003e\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003ch3\u003eDark Theme — Comfortable Night Mode\u003c/h3\u003e\r\n  \u003cimg src=\"screenshots/dashboard-dark.png\" width=\"85%\" alt=\"ScreenSearch Dashboard Dark Theme - AI-First interface with glassmorphism cards and neon accents\"\u003e\r\n  \u003cp\u003e\u003cem\u003eBeautiful dark mode for late-night productivity tracking and focus sessions\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                        KEY FEATURES                             │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n- [*] **Sci-Fi Concept UI** — Premium \"Glass \u0026 Neon\" aesthetic with atmospheric depth and fluid animations\r\n- [*] **AI-First Dashboard** — \"Intel Dash\" with Daily Digest, Memory Status gauge, and Productivity Pulse charts\r\n- [*] **Continuous Screen Capture** — Configurable intervals (2-5 seconds) with multi-monitor support\r\n- [*] **OCR Text Extraction** — Windows OCR API with bounding box coordinates and confidence scores\r\n- [*] **AI-Powered Intelligence** — Generate insights from your screen history using local LLMs (Ollama, LM Studio) or cloud providers (OpenAI)\r\n- [*] **Hybrid Search** — Combines FTS5 (Sparse) and Vector Embeddings (Dense) for semantic understanding\r\n- [*] **Smart Search** — Conversational AI answers with context from your screen history\r\n- [*] **REST API** — 27 endpoints for search, automation, and tag management on localhost:3131\r\n- [*] **UI Automation** — Programmatic control of Windows applications via accessibility APIs\r\n- [*] **System Tray** — unobtrusive background operation with quick access menu\r\n- [*] **Privacy Controls** — Exclude sensitive applications, pause on screen lock\r\n- [*] **High Performance** — Optimized for modern multi-core processors with \u003c 100ms API response times\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                    PROJECT INFORMATION                          │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n- **Website**: [screensearch.app](https://screensearch.app)\r\n- **Repository**: [github.com/nicolasestrem/screensearch](https://github.com/nicolasestrem/screensearch)\r\n- **Author**: Nicolas Estrem\r\n- **License**: MIT\r\n- **Platform**: Windows 10/11 only\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                     FEATURE HIGHLIGHTS                          │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n### [\u003e] AI-First Dashboard — Your Intelligent Command Center\r\n\r\nThe new **\"Intel Dash\"** puts AI-powered insights front and center with a beautiful glassmorphism design. See your day at a glance with auto-generated summaries, RAG indexing progress, and hourly activity charts.\r\n\r\n**Dashboard Features:**\r\n- [*] **Daily Digest** — Auto-generated AI summaries of your screen activity\r\n- [*] **Memory Status** — Circular gauge showing semantic search readiness\r\n- [*] **Productivity Pulse** — Interactive hourly activity chart with smooth curves\r\n- [*] **Smart Answers** — Get AI-powered context from your screen history\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/dashboard-dark.png\" width=\"80%\" alt=\"Dashboard with Daily Digest, Memory Status gauge, and Productivity Pulse\"\u003e\r\n  \u003cp\u003e\u003cem\u003eYour day at a glance: Auto-generated AI summaries, RAG indexing progress, and hourly activity charts\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n### [\u003e] Smart Search — AI That Understands Context\r\n\r\nAsk natural language questions and get AI-powered answers grounded in your actual screen activity.\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/search-smart-answer.png\" width=\"75%\" alt=\"Smart Answer Card with AI-generated response and activity breakdown\"\u003e\r\n  \u003cp\u003e\u003cem\u003eConversational AI answers with application breakdown and confidence scoring\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/search-antigravity-example.png\" width=\"80%\" alt=\"Search example showing semantic understanding of 'Antigravity' query\"\u003e\r\n  \u003cp\u003e\u003cem\u003eSemantic search understands context—searching for 'Antigravity' finds related workflow automation projects\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n**Search Features:**\r\n- [*] Natural language queries (e.g., \"What was I working on at 3pm yesterday?\")\r\n- [*] Hybrid search combining FTS5 keyword matching + vector semantic similarity\r\n- [*] Activity breakdown by application with visual distribution\r\n- [*] Smart Answer Card with AI-generated summaries\r\n\r\n### [\u003e] Intelligence Dashboard — AI That Understands Your Work\r\n\r\nTransform raw screen captures into actionable insights. The Intelligence dashboard connects to your choice of AI provider—local models like Ollama and LM Studio for privacy, or cloud services like OpenAI for power.\r\n\r\n**What It Does:**\r\n- [*] **Daily \u0026 Weekly Reports** — Automatic summaries of your work patterns and productivity\r\n- [*] **Custom Queries** — Ask specific questions about your activity history\r\n- [*] **Provider Flexibility** — Works with any OpenAI-compatible API endpoint\r\n- [*] **Privacy First** — Local LLMs keep all analysis on your machine\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/intelligence-generator.png\" width=\"75%\" alt=\"Intelligence Report Generator - Configure AI provider, select time range, generate reports\"\u003e\r\n  \u003cp\u003e\u003cem\u003eConnect to any OpenAI-compatible API, validate connection, and customize report prompts\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/intelligence-report-full.png\" width=\"80%\" alt=\"AI-generated intelligence report showing productivity metrics and focus areas\"\u003e\r\n  \u003cp\u003e\u003cem\u003eComprehensive AI analysis with daily summaries, productivity patterns, and actionable recommendations\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n### [\u003e] Settings \u0026 Privacy — Complete Control\r\n\r\nFine-tune every aspect of ScreenSearch with comprehensive, intuitive settings panels.\r\n\r\n#### General Settings\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-general.png\" width=\"65%\" alt=\"General settings - Theme selection and application preferences\"\u003e\r\n  \u003cp\u003e\u003cem\u003eChoose your theme, configure startup behavior, and manage general preferences\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n#### Capture Configuration\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-capture.png\" width=\"65%\" alt=\"Capture settings - Intervals, monitor selection, frame differencing\"\u003e\r\n  \u003cp\u003e\u003cem\u003eSet capture intervals (2-5 seconds), enable intelligent frame differencing, optimize storage with JPEG compression\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n#### Privacy Controls\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-privacy.png\" width=\"65%\" alt=\"Privacy settings - App exclusions, auto-pause on lock\"\u003e\r\n  \u003cp\u003e\u003cem\u003eExclude sensitive apps (1Password, KeePass, banking), auto-pause on screen lock, configure data retention\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n#### AI Provider Configuration\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-ai-provider.png\" width=\"65%\" alt=\"AI provider settings - Ollama configuration with validation\"\u003e\r\n  \u003cp\u003e\u003cem\u003eConnect to local LLMs (Ollama, LM Studio) or cloud providers (OpenAI) with real-time API validation\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n#### Embeddings \u0026 Semantic Search\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-embeddings.png\" width=\"65%\" alt=\"Embeddings settings - Enable semantic search, batch processing\"\u003e\r\n  \u003cp\u003e\u003cem\u003eEnable AI-powered semantic search with local ONNX models, configure batch sizes, tune hybrid search weighting\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n#### Data Management\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/settings-data-ai.png\" width=\"65%\" alt=\"Data management - Database size, auto-cleanup, storage monitoring\"\u003e\r\n  \u003cp\u003e\u003cem\u003eMonitor database size, configure automatic cleanup (retention days), manage storage usage\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n### [\u003e] See It In Action — Dashboard Demo\r\n\r\nWatch the new Intel Dash come to life with smooth animations, real-time updates, and beautiful glassmorphism effects.\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n  \u003cimg src=\"screenshots/demo-dashboard.gif\" width=\"85%\" alt=\"Animated demo of ScreenSearch dashboard with Daily Digest and charts\"\u003e\r\n  \u003cp\u003e\u003cem\u003eLive dashboard with AI summaries, Memory Status gauge, and Productivity Pulse animations\u003c/em\u003e\u003c/p\u003e\r\n\u003c/div\u003e\r\n\r\n\u003e **Note**: GIF optimized for GitHub (10fps, 1280px). [Download full HD video](screenshots/demo-dashboard.mp4) for best quality.\r\n\r\n### [\u003e] Terminal Integration\r\n\r\nPowerful logging and diagnostics. Watch ScreenSearch initialize, start capture loops, and process OCR in real-time with detailed performance metrics and system health checks.\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                        QUICK START                              │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n### Prerequisites\r\n\r\n- **Windows 10/11** — Ensure Windows OCR Language Pack is installed (Settings → Language → English)\r\n- **Rust 1.70+** — Install from [rustup.rs](https://rustup.rs/)\r\n- **Visual Studio Build Tools** — Required for native compilation ([download](https://visualstudio.microsoft.com/downloads/))\r\n- **Node.js 18+** — For the web UI (optional, only if using the dashboard)\r\n\r\n### Installation \u0026 Setup\r\n\r\n#### Native Windows Build\r\n\r\n```bash\r\n# Clone the repository\r\ngit clone https://github.com/nicolasestrem/screensearch.git\r\ncd screensearch\r\n\r\n# Build the project\r\ncargo build --release\r\n\r\n# Run ScreenSearch (starts API on localhost:3131)\r\ncargo run --release\r\n```\r\n\r\n#### Cross-Compilation from Linux\r\n\r\nYou can build Windows binaries from Linux using `cargo-xwin`:\r\n\r\n```bash\r\n# Install cross-compilation tools (one-time setup)\r\ncargo install cargo-xwin\r\nrustup target add x86_64-pc-windows-msvc\r\nsudo apt-get install -y clang lld llvm  # Ubuntu/Debian\r\n\r\n# Build Windows executable from Linux\r\ncargo xwin build --release --target x86_64-pc-windows-msvc\r\n\r\n# Binary will be at: target/x86_64-pc-windows-msvc/release/screensearch.exe\r\n```\r\n\r\n**Note**: Cross-compiled binaries require Windows to run. This is for building on Linux, not running on Linux. See [docs/cross-compilation.md](docs/cross-compilation.md) for detailed instructions.\r\n\r\n### [\u003e] Web Dashboard\r\n\r\nLaunch the beautiful web interface to visualize and manage your captures:\r\n\r\n```bash\r\ncd screen-ui\r\nnpm install\r\nnpm run dev\r\n# Open http://localhost:5173 in your browser\r\n```\r\n\r\n**Dashboard Features**:\r\n- [*] **Sci-Fi Visuals**: Atmospheric radial gradients, neon accents, and glassmorphism interface\r\n- [*] Timeline view of captured frames with real-time thumbnails\r\n- [*] Full-text search across all OCR content\r\n- [*] Intelligence tab with AI-powered report generation\r\n- [*] Frame details with OCR text, tags, and metadata\r\n- [*] Live settings configuration and privacy controls\r\n- [*] Dark mode for comfortable late-night browsing\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                      SECURITY \u0026 TRUST                           │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n### Windows SmartScreen Warning\r\n\r\nOn first launch, Windows may display a SmartScreen warning:\r\n\u003e \"Windows protected your PC - Unknown publisher\"\r\n\r\n**This is expected behavior** because the executable is not code-signed with a certificate (which requires an expensive annual subscription).\r\n\r\n**To run the application:**\r\n1. Click **\"More info\"**\r\n2. Click **\"Run anyway\"**\r\n\r\n### Binary Verification\r\n\r\nYou can verify the safety of the binary:\r\n\r\n- **VirusTotal Scans:**\r\n  - [EXE Scan Results](https://www.virustotal.com/gui/file/807707d80a0886dd635e8cfbcb96d8670c2531176d248206decd248c00961eb0/detection) - 0/72 detections [OK]\r\n  - [ZIP Scan Results](https://www.virustotal.com/gui/file/6b3c93398cf3c720da3e9c88a58bce93e9a9ee016819a9ab26005ef6bde90003) - 0/68 detections [OK]\r\n- **Open Source:** All source code is available in this repository for review\r\n- **Build From Source:** Follow the [Developer Guide](docs/developer-guide.md) to compile yourself\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                       DOCUMENTATION                             │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n| Document | Purpose |\r\n|----------|---------|\r\n| [User Guide](docs/user-guide.md) | Installation, configuration, and everyday usage |\r\n| [Developer Guide](docs/developer-guide.md) | Development setup, workflow, and contribution guidelines |\r\n| [Architecture](docs/architecture.md) | System design, data flow, and technical decisions |\r\n| [API Reference](docs/api-reference.md) | Complete REST API endpoint documentation with examples |\r\n| [Commands Summary](docs/commands-summary.md) | Quick reference for CLI commands and workflows |\r\n| [Testing](docs/testing.md) | Test protocols, coverage reports, and CI/CD pipelines |\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                     PROJECT STRUCTURE                           │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n```\r\nscreensearch/\r\n├── src/main.rs                 # Application entry point and orchestration\r\n├── screen-capture/             # Screen capture engine and OCR pipeline\r\n│   ├── src/capture.rs         # Frame capture with ffmpeg-sidecar\r\n│   ├── src/ocr.rs             # Windows OCR API integration\r\n│   └── src/frame_diff.rs       # Zero-copy frame differencing\r\n├── screen-db/                  # SQLite database with FTS5 search\r\n│   ├── src/queries.rs         # SQL queries and migrations\r\n│   └── src/migrations/        # Schema versioning\r\n├── screen-api/                 # REST API server (Axum framework)\r\n│   ├── src/routes.rs          # API endpoint definitions\r\n│   ├── src/handlers/          # Request handlers\r\n│   │   ├── ai.rs              # AI intelligence endpoints\r\n│   │   └── ...                # Other handlers\r\n├── screen-automation/          # Windows UI automation engine\r\n│   ├── src/engine.rs          # Automation orchestration\r\n│   └── src/element.rs         # Element detection and interaction\r\n├── screen-ui/                  # Modern React web dashboard\r\n│   ├── src/components/        # UI components (Timeline, Search, Settings)\r\n│   ├── src/pages/             # Main pages (Intelligence, Timeline)\r\n│   └── src/api/               # Frontend API client (including AI endpoints)\r\n├── screenshots/                # README screenshots\r\n├── docs/                       # Complete documentation\r\n└── config.toml                 # Configuration and build settings\r\n```\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                    PERFORMANCE METRICS                          │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\nScreenSearch is optimized for efficiency and speed:\r\n\r\n| Metric | Target | Actual | Status |\r\n|--------|--------|--------|--------|\r\n| **OCR Processing** | \u003c 100 ms | **70-80 ms** | [OK] Fast |\r\n| **API Response** | \u003c 100 ms | ~50 ms | [OK] 2x faster |\r\n| **Vector Search** | \u003c 200 ms | **150 ms** | [OK] In-Memory Optimized |\r\n| **Test Coverage** | 100% | 59/59 passing | [OK] Complete |\r\n\r\n### Recent Performance Optimizations\r\n\r\n**[+] Zero-Copy OCR Pipeline** — Direct `SoftwareBitmap` creation eliminates PNG encoding/decoding overhead, saving **60-93ms per frame** (53% faster). Enables 1-second capture intervals.\r\n\r\n**[+] Memory Efficiency** — Arc-based frame differencing eliminates redundant allocations, reducing memory pressure from **39GB/8hr → \u003c1GB/8hr**.\r\n\r\n**[+] Storage Optimization** — 50x reducution in storage usage via smart JPEG compression and resizing. Automatic 24h cleanup loop enforces retention policies.\r\n\r\n**[+] Search Security** — FTS5 query sanitization prevents injection attacks while correctly handling special characters (`C++`, `$100`, etc.).\r\n\r\n**[+] In-Memory Vector Search** — Bypasses SQLite extension limitations by effectively managing embeddings in Rust memory, enabling robust semantic search on Windows.\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                    API QUICK EXAMPLES                           │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n### Search Your Screen History\r\n\r\n```bash\r\n# Search for any text captured on your screen\r\ncurl \"http://localhost:3131/search?q=meeting\u0026limit=10\"\r\n\r\n# Search with filters (timestamp, application name, etc.)\r\ncurl \"http://localhost:3131/search?q=meeting\u0026app=Chrome\u0026start=2025-12-10\"\r\n```\r\n\r\n### Generate AI Intelligence Reports\r\n\r\n```bash\r\n# Test your AI provider connection\r\ncurl -X POST http://localhost:3131/ai/validate \\\r\n  -H \"Content-Type: application/json\" \\\r\n  -d '{\"provider_url\":\"http://localhost:11434/v1\",\"model\":\"llama3\"}'\r\n\r\n# Generate a daily activity summary\r\ncurl -X POST http://localhost:3131/ai/generate \\\r\n  -H \"Content-Type: application/json\" \\\r\n  -d '{\r\n    \"provider_url\": \"http://localhost:11434/v1\",\r\n    \"model\": \"llama3\",\r\n    \"start_time\": \"2025-12-10T00:00:00Z\",\r\n    \"end_time\": \"2025-12-11T00:00:00Z\",\r\n    \"prompt\": \"Summarize my work activity\"\r\n  }'\r\n```\r\n\r\n### Automate Desktop Interactions\r\n\r\n```bash\r\n# Click at specific coordinates\r\ncurl -X POST http://localhost:3131/automation/click \\\r\n  -H \"Content-Type: application/json\" \\\r\n  -d '{\"x\":100,\"y\":200,\"button\":\"left\"}'\r\n\r\n# Type text programmatically\r\ncurl -X POST http://localhost:3131/automation/type \\\r\n  -H \"Content-Type: application/json\" \\\r\n  -d '{\"text\":\"Hello, World!\"}'\r\n\r\n# Find UI elements by accessibility patterns\r\ncurl -X POST http://localhost:3131/automation/find-elements \\\r\n  -H \"Content-Type: application/json\" \\\r\n  -d '{\"role\":\"Button\",\"name\":\"Submit\"}'\r\n```\r\n\r\nSee the [API Reference](docs/api-reference.md) for all 27 endpoints.\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                     PRIVACY \u0026 SECURITY                          │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\n- [*] **Local-Only Storage** — All data stays on your machine in a local SQLite database\r\n- [*] **Exclude Sensitive Apps** — Automatically skip password managers, banking apps, and any app you specify\r\n- [*] **Pause Anytime** — Pause capture with a single click (pauses on screen lock by default)\r\n- [*] **Auto-Cleanup** — Configurable data retention (set automatic deletion of old captures)\r\n- [*] **FTS5 Security** — Query sanitization prevents operator injection attacks\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                       CONTRIBUTING                              │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\nWe welcome contributions! Here's how to get started:\r\n\r\n1. Fork the repository\r\n2. Create a feature branch (`git checkout -b feature/amazing-feature`)\r\n3. Make your changes and add tests\r\n4. Push to the branch (`git push origin feature/amazing-feature`)\r\n5. Open a Pull Request\r\n\r\nSee [DEVELOPMENT.md](docs/developer-guide.md) for detailed setup instructions.\r\n\r\n---\r\n\r\n```\r\n┌─────────────────────────────────────────────────────────────────┐\r\n│                          LICENSE                                │\r\n└─────────────────────────────────────────────────────────────────┘\r\n```\r\n\r\nThis project is licensed under the **MIT License** — see the [LICENSE](LICENSE) file for details.\r\n\r\n---\r\n\r\n\u003cdiv align=\"center\"\u003e\r\n\r\n**Made with care for Windows users who want to remember everything**\r\n\r\n[^ Back to top](#screensearch)\r\n\r\n\u003c/div\u003e\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnicolasestrem%2Fscreensearch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnicolasestrem%2Fscreensearch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnicolasestrem%2Fscreensearch/lists"}