{"id":50691981,"url":"https://github.com/marmutapp/superbased-copilot-plugin","last_synced_at":"2026-06-09T03:45:42.614Z","repository":{"id":350942826,"uuid":"1208867709","full_name":"marmutapp/superbased-copilot-plugin","owner":"marmutapp","description":"SuperBased plugin for GitHub Copilot CLI — screenshot capture, AI vision, OCR, screen recording, visual regression testing, token compression, voice dictation, and proactive monitoring via 28 MCP tools","archived":false,"fork":false,"pushed_at":"2026-04-26T11:39:01.000Z","size":139,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-04-26T13:22:46.001Z","etag":null,"topics":["ai-vision","copilot","copilot-cli","copilot-plugin","github-copilot","mcp","ocr","screenshot","visual-testing"],"latest_commit_sha":null,"homepage":"https://superbased.app","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/marmutapp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-04-12T21:02:48.000Z","updated_at":"2026-04-26T11:39:04.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/marmutapp/superbased-copilot-plugin","commit_stats":null,"previous_names":["marmutapp/superbased-copilot-plugin"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/marmutapp/superbased-copilot-plugin","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marmutapp%2Fsuperbased-copilot-plugin","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marmutapp%2Fsuperbased-copilot-plugin/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marmutapp%2Fsuperbased-copilot-plugin/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marmutapp%2Fsuperbased-copilot-plugin/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/marmutapp","download_url":"https://codeload.github.com/marmutapp/superbased-copilot-plugin/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marmutapp%2Fsuperbased-copilot-plugin/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34090751,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-09T02:00:06.510Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai-vision","copilot","copilot-cli","copilot-plugin","github-copilot","mcp","ocr","screenshot","visual-testing"],"created_at":"2026-06-09T03:45:41.774Z","updated_at":"2026-06-09T03:45:42.608Z","avatar_url":"https://github.com/marmutapp.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# SuperBased — Eyes AND Hands for Copilot\n\nScreenshot capture, AI vision, OCR, screen recording, visual regression testing, token compression, voice dictation, proactive screen monitoring, **and full GUI automation with humanization v2** — all via 72 MCP tools, directly inside GitHub Copilot CLI.\n\n## Install\n\n```bash\ncopilot plugin marketplace add marmutapp/superbased-copilot-plugin\ncopilot plugin install superbased@superbased-tools\n```\n\nOr install directly from the repo:\n\n```bash\ncopilot plugin install marmutapp/superbased-copilot-plugin\n```\n\n## Prerequisites\n\n- **SuperBased desktop app** running (Windows or macOS), OR\n- **SuperBased CLI** installed globally: `npm install -g superbased`\n- Node.js 20+\n\n## Skills (11)\n\n| Skill | When Copilot Uses It |\n|-------|-------------------|\n| **screenshot** | Copilot needs to see the screen to answer a question or verify a UI change |\n| **visual-qa** | Visual regression testing: record baseline, make changes, record again, diff |\n| **monitor** | Proactive screen watching during deploys, tests, or builds |\n| **compress** | Large text content (\u003e500 tokens) that would be cheaper as an image |\n| **redact** | Screenshots that may contain API keys, tokens, or PII before sharing |\n| **dictation** | User wants voice input, audio transcription, or speech-to-text |\n| **annotate** | Highlighting areas, marking regressions, creating annotated screenshots |\n| **walkthrough** | Multi-frame product walkthrough: capture, narrate, export |\n| **gui-automation** | \"Click that\", \"type into this\", \"fill the form\" — drives the desktop with click/type/hotkey/scroll/drag/form-fill/sequence |\n| **captcha-solving** | reCAPTCHA / Cloudflare Turnstile / drag puzzles / rotation puzzles / image grids |\n| **humanization** | Sites with bot detection — picks the right humanization profile (off/light/human/paranoid) |\n\n## Slash Commands (26)\n\n| Command | Description |\n|---------|-------------|\n| `/superbased:capture` | Take a screenshot (fullscreen, window, or region) |\n| `/superbased:window` | List open windows or capture a specific window |\n| `/superbased:extract` | Capture + OCR to extract text from screen |\n| `/superbased:explain` | Capture + AI analysis of what's on screen |\n| `/superbased:ocr` | Extract text from screenshot or image file (local Tesseract) |\n| `/superbased:clipboard` | Read or write system clipboard (text or image) |\n| `/superbased:annotate` | Add rectangles, arrows, text labels, blur to captures |\n| `/superbased:redact` | Auto-redact secrets and PII from screenshots |\n| `/superbased:record` | Start, stop, or manage screen recording sessions |\n| `/superbased:monitor` | Start proactive AI screen monitoring |\n| `/superbased:sessions` | List recording sessions and view frames |\n| `/superbased:diff` | Compare two recording sessions for visual regressions |\n| `/superbased:baseline` | Manage visual regression testing baselines |\n| `/superbased:export` | Export sessions as zip, markdown, PDF, HTML, or GIF |\n| `/superbased:gallery` | Browse, search, and manage capture gallery |\n| `/superbased:compress` | Compress text into token-efficient images |\n| `/superbased:dictate` | Record from microphone and transcribe |\n| `/superbased:transcribe` | Transcribe audio file to text (raw Whisper) |\n| `/superbased:settings` | View or update app settings |\n| `/superbased:presets` | Manage AI instruction presets |\n| `/superbased:status` | Health, auth, and AI usage check |\n| `/superbased:auth` | Authentication management |\n| `/superbased:click` | Click an on-screen element by label or coordinates |\n| `/superbased:form` | Fill a form by label/value pairs (`superbased_form_fill`) |\n| `/superbased:record-gui` | Record a multi-step GUI workflow for replay |\n| `/superbased:captcha` | Open the CAPTCHA-solving guidance (rotation puzzles, drag puzzles, image grids) |\n\n## Agents (3)\n\n| Agent | Description |\n|-------|-------------|\n| **visual-qa** | Record baselines, capture after changes, diff, annotate regressions, export reports |\n| **monitor** | Watch screen for errors during deploys/tests, flag issues proactively, summarize findings |\n| **gui-automation** | Orchestrate multi-step GUI workflows with `superbased_sequence` + the click/type/drag/scroll/form-fill primitives, with the safety checklist baked in |\n\n## Humanization v2\n\nGUI automation actions (`click`, `type`, `drag`, `hover`) ship with a humanization layer to reduce the bot-detection signal: sin-shaped velocity envelope on cursor walks, gaussian click-target jitter, gamma-distributed pre-click settle dwell, 50–110 ms click hold variation, 45–95 ms key hold, wired typo simulation with QWERTY same-row neighbors, pre-click tremor on the target element, occasional 2–4× micro-pauses, per-process cross-session salt mixed into seeds, inter-action catch-up pause, and opt-in idle cursor drift.\n\nFour profiles selectable per call: `humanize: 'off' | 'light' | 'human' | 'paranoid'`. Default `light`. Bump to `human` or `paranoid` for sites with active bot detection — see the **humanization** skill.\n\n## CAPTCHA solving\n\nPlugin ships proactive guidance for the four CAPTCHA classes: image grids (vision identifies, batched click sequence), drag puzzles (one-motion drag with `humanize: 'light'`), rotation puzzles (calibrate-then-execute), and checkbox-only Turnstile. Plus the honest \"what humanization can't defeat\" list (server-side fingerprinting, audio CAPTCHAs, hCaptcha enterprise mode). See the **captcha-solving** skill.\n\n## MCP Tools (72)\n\nThe plugin exposes all 72 SuperBased MCP tools across 9 categories: Capture \u0026 View (5), AI \u0026 OCR (8), Gallery (2), Privacy \u0026 Annotations (2), Dictation \u0026 Voice (2), Recording \u0026 Visual QA (7), Settings/Auth/System (6), and **GUI Automation (40)** — `_ui_dump`, `_scroll_capture`, `_scroll_to`, `_sequence`, `_click`, `_type`, `_hotkey`, `_scroll`, `_drag`, `_drag_file`, `_hover`, `_context_menu_select`, `_form_fill`, `_dialog_handle`, `_open_url`, `_find_in_page`, `_tab_management`, `_tray_click`, `_virtual_desktop`, `_window_state`, `_resize_window`, `_focus_window`, `_window_bounds`, `_find_title_bar_drag_region`, `_display_list`, `_launch_app`, `_find_image`, `_capture_template`, `_pixel_color`, `_ax_invoke`, `_accessibility_tree`, `_locate`, `_wait`, `_wait_for`, `_mouse_position`, `_dry_run`, `_replay`, `_doctor_gui_automation`, `_undo_last`, `_tools`.\n\nSee [the source-of-truth Claude Code plugin README](https://github.com/marmutapp/superbased-claude-code-plugin#mcp-tools-72) for the full categorized list with collapsibles.\n\n## Links\n\n- [SuperBased](https://superbased.app) — Desktop app download\n- [npm package](https://www.npmjs.com/package/superbased) — Headless CLI\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarmutapp%2Fsuperbased-copilot-plugin","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmarmutapp%2Fsuperbased-copilot-plugin","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarmutapp%2Fsuperbased-copilot-plugin/lists"}