{"id":29360030,"url":"https://github.com/inkbytefo/screenmonitormcp","last_synced_at":"2025-07-09T07:09:55.961Z","repository":{"id":303699718,"uuid":"1016377388","full_name":"inkbytefo/ScreenMonitorMCP","owner":"inkbytefo","description":"🚀 Revolutionary MCP Server: AI'ya gerçek zamanlı görme yetisi, UI zekası ve öngörülü davranış öğrenme gücü kazandırır. Real-time screen monitoring, smart UI interaction, and predictive AI assistance.","archived":false,"fork":false,"pushed_at":"2025-07-09T00:54:51.000Z","size":54,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-07-09T01:23:48.444Z","etag":null,"topics":["ai","artificial-intelligence","automation","computer-vision","mcp","model-context-protocol","openai","predictive-ai","python","real-time","revolutionary","screen-monitoring","turkish","ui-automation"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/inkbytefo.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-07-08T23:35:29.000Z","updated_at":"2025-07-09T00:54:55.000Z","dependencies_parsed_at":"2025-07-09T01:23:52.253Z","dependency_job_id":"c61f0c3a-540e-4cc0-b037-10e5e5c84af1","html_url":"https://github.com/inkbytefo/ScreenMonitorMCP","commit_stats":null,"previous_names":["inkbytefo/screenmonitormcp"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/inkbytefo/ScreenMonitorMCP","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/inkbytefo%2FScreenMonitorMCP","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/inkbytefo%2FScreenMonitorMCP/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/inkbytefo%2FScreenMonitorMCP/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/inkbytefo%2FScreenMonitorMCP/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/inkbytefo","download_url":"https://codeload.github.com/inkbytefo/ScreenMonitorMCP/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/inkbytefo%2FScreenMonitorMCP/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264411163,"owners_count":23603804,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","artificial-intelligence","automation","computer-vision","mcp","model-context-protocol","openai","predictive-ai","python","real-time","revolutionary","screen-monitoring","turkish","ui-automation"],"created_at":"2025-07-09T07:09:13.294Z","updated_at":"2025-07-09T07:09:55.953Z","avatar_url":"https://github.com/inkbytefo.png","language":"Python","funding_links":[],"categories":["پیاده‌سازی‌های سرور","📦 Other","カテゴリ"],"sub_categories":["🛠️ \u003ca name=\"other-tools-and-integrations\"\u003e\u003c/a\u003eسایر ابزارها و یکپارچه‌سازی‌ها","⚙️ \u003ca name=\"system-administration\"\u003e\u003c/a\u003eシステム管理"],"readme":"# 🚀 Revolutionary Screen Monitor MCP Server\n\n[![CI](https://github.com/yourusername/ScreenMonitorMCP/workflows/ScreenMonitorMCP%20CI/badge.svg)](https://github.com/yourusername/ScreenMonitorMCP/actions)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![Python 3.9+](https://img.shields.io/badge/python-3.9+-blue.svg)](https://www.python.org/downloads/)\n[![MCP Compatible](https://img.shields.io/badge/MCP-Compatible-green.svg)](https://modelcontextprotocol.io/)\n\nA **REVOLUTIONARY** Model Context Protocol (MCP) server! Gives AI **real-time vision capabilities**, **UI intelligence**, and **predictive behavior learning** power. This isn't just screen capture - it gives AI the power to truly \"see\" and understand your digital world!\n\n## 🌟 **WHY ScreenMonitorMCP?**\n\n- 🔥 **First \u0026 Only**: Real-time continuous screen monitoring feature\n- 🧠 **AI Intelligence**: AI that understands UI elements and can interact with them\n- 🔮 **Predictive**: System that learns and predicts user behaviors\n- ⚡ **Proactive**: Assistant that offers help before you need it\n- 🎯 **Natural**: AI that understands commands like \"Click the save button\"\n\n## 🔥 **REVOLUTIONARY FEATURES**\n\n### 🔄 **Real-Time Continuous Monitoring**\n- **AI's Eyes Never Close**: 2-5 FPS continuous screen monitoring\n- **Smart Change Detection**: Distinguishes between small, major, and critical changes\n- **Proactive Analysis**: AI automatically analyzes important changes\n- **Adaptive Performance**: Smart frame rate adjustment\n\n### 🎯 **UI Element Intelligence**\n- **Computer Vision UI Detection**: Automatically recognizes buttons, forms, menus\n- **OCR Text Extraction**: Reads text from anywhere on the screen\n- **Smart Click System**: Natural language commands like \"Click the save button\"\n- **Interaction Mapping**: AI knows exactly where and how to interact\n\n### 🧠 **Predictive Intelligence**\n- **Behavior Learning**: AI learns your usage patterns and habits\n- **Intent Prediction**: Predicts what you'll do next based on context\n- **Proactive Help**: Offers help before you ask\n- **Workflow Optimization**: Suggests improvements in your work patterns\n\n## 🛠️ **REVOLUTIONARY MCP TOOLS**\n\n### 🔄 **Real-Time Monitoring Tools**\n- `start_continuous_monitoring()` - Starts AI's continuous vision capability\n- `stop_continuous_monitoring()` - Stops continuous monitoring\n- `get_monitoring_status()` - Real-time status information and statistics\n- `get_recent_changes()` - Recently detected screen changes\n\n### 🎯 **UI Intelligence Tools**\n- `analyze_ui_elements()` - Recognizes and maps all UI elements on screen\n- `smart_click()` - Smart clicking with natural language commands (\"Click the save button\")\n- `extract_text_from_screen()` - OCR text extraction from screen\n\n### 🧠 **Predictive AI Tools**\n- `learn_user_patterns()` - Learns and analyzes user behavior patterns\n- `predict_user_intent()` - Predicts user intent based on current context\n- `proactive_assistance()` - Offers proactive help before user requests\n- `record_user_action()` - Records user actions and feeds learning system\n\n### 📸 **Traditional Tools**\n- `capture_and_analyze()` - Screen capture and AI analysis (enhanced)\n- `list_tools()` - **MCP standard compliant** lists all tools (categorized, detailed information)\n\n## 🎯 **USAGE SCENARIOS**\n\n### 🔍 **Real-Time Monitoring**\n```python\n# Start AI's continuous vision capability\nawait start_continuous_monitoring(fps=3, change_threshold=0.1)\n\n# Check monitoring status\nstatus = await get_monitoring_status()\n\n# View recent changes\nchanges = await get_recent_changes(limit=5)\n```\n\n### 🎯 **UI Intelligence**\n```python\n# Analyze all UI elements on screen\nui_analysis = await analyze_ui_elements()\n\n# Smart clicking with natural language\nawait smart_click(\"Click the save button\")\n\n# Extract text from screen\ntext_data = await extract_text_from_screen()\n```\n\n### 🧠 **Predictive AI**\n```python\n# Learn user behavior patterns\npatterns = await learn_user_patterns()\n\n# Predict user intent\nintent = await predict_user_intent()\n\n# Get proactive assistance\nassistance = await proactive_assistance()\n```\n\n## 🚀 **INSTALLATION**\n\n### **1. Prepare Project Files**\n```bash\n# Navigate to project directory\ncd ScreenMonitorMCP\n\n# Install required libraries\npip install -r requirements.txt\n```\n\n### **2. Configure Environment Variables**\nEdit the `.env` file:\n```env\n# Server Configuration\nHOST=127.0.0.1\nPORT=7777\nAPI_KEY=your_secret_key\n\n# AI Configuration\nOPENAI_API_KEY=your_openai_api_key\nOPENAI_BASE_URL=https://api.openai.com/v1\nDEFAULT_OPENAI_MODEL=gpt-4o\n```\n\n### **3. Standalone Testing (Optional)**\n```bash\n# Test the server\npython main.py\n\n# Test revolutionary features\npython test_revolutionary_features.py\n```\n\n## 🔧 **MCP CLIENT SETUP**\n\n### **Claude Desktop / MCP Client Configuration**\n\nAdd the following JSON to your MCP client's configuration file:\n\n#### **🎯 Simple Configuration (Recommended)**\n```json\n{\n  \"mcpServers\": {\n    \"screenMonitorMCP\": {\n      \"command\": \"python\",\n      \"args\": [\"/path/to/ScreenMonitorMCP/main.py\"],\n      \"cwd\": \"/path/to/ScreenMonitorMCP\"\n    }\n  }\n}\n```\n\n#### **🔧 Advanced Configuration**\n```json\n{\n  \"mcpServers\": {\n    \"screenMonitorMCP\": {\n      \"command\": \"python\",\n      \"args\": [\n        \"/path/to/ScreenMonitorMCP/main.py\"\n      ],\n      \"cwd\": \"/path/to/ScreenMonitorMCP\",\n      \"env\": {\n        \"OPENAI_API_KEY\": \"your-api-key-here\"\n      }\n    }\n  }\n}\n```\n\n#### **🛡️ Secure Configuration**\n```json\n{\n  \"mcpServers\": {\n    \"screenMonitorMCP\": {\n      \"command\": \"python\",\n      \"args\": [\n        \"/path/to/ScreenMonitorMCP/main.py\",\n        \"--api-key\", \"your-secret-key\"\n      ],\n      \"cwd\": \"/path/to/ScreenMonitorMCP\"\n    }\n  }\n}\n```\n\n#### **🪟 Windows Example**\n```json\n{\n  \"mcpServers\": {\n    \"screenMonitorMCP\": {\n      \"command\": \"python\",\n      \"args\": [\"C:/path/to/ScreenMonitorMCP/main.py\"],\n      \"cwd\": \"C:/path/to/ScreenMonitorMCP\"\n    }\n  }\n}\n```\n\n### **⚠️ Important Notes**\n\n1. **File Path**: Update `/path/to/ScreenMonitorMCP/main.py` path according to your project directory\n2. **Python Path**: Make sure Python is in PATH or use full path: `\"C:/Python311/python.exe\"`\n3. **Working Directory**: `cwd` parameter is important for proper `.env` file reading\n4. **API Keys**: All settings are automatically read from `.env` file\n\n## 🧪 **USAGE EXAMPLES**\n\n### **🔄 Starting Real-Time Monitoring**\n```python\n# Start AI's continuous vision capability\nresult = await start_continuous_monitoring(\n    fps=3,\n    change_threshold=0.1,\n    smart_detection=True\n)\n\n# Check monitoring status\nstatus = await get_monitoring_status()\n\n# View recent changes\nchanges = await get_recent_changes(limit=10)\n\n# Stop monitoring\nawait stop_continuous_monitoring()\n```\n\n### **🎯 Using UI Intelligence**\n```python\n# Analyze all UI elements on screen\nui_elements = await analyze_ui_elements(\n    detect_buttons=True,\n    extract_text=True,\n    confidence_threshold=0.7\n)\n\n# Smart clicking with natural language\nawait smart_click(\"Click the save button\", dry_run=False)\n\n# Extract text from specific region\ntext_data = await extract_text_from_screen(\n    region={\"x\": 100, \"y\": 100, \"width\": 500, \"height\": 300}\n)\n```\n\n### **🧠 Predictive Intelligence**\n```python\n# Learn user behavior patterns\npatterns = await learn_user_patterns()\n\n# Predict user intent\nintent = await predict_user_intent(\n    current_context={\"current_app\": \"VSCode\"}\n)\n\n# Get proactive assistance\nassistance = await proactive_assistance()\n\n# Record user action\nawait record_user_action(\n    action_type=\"click\",\n    target=\"save_button\",\n    app_context=\"VSCode\"\n)\n```\n\n### **📸 Traditional Screen Capture**\n```python\n# Enhanced screen capture and analysis\nresult = await capture_and_analyze(\n    capture_mode=\"all\",\n    analysis_prompt=\"What do you see on this screen?\",\n    max_tokens=500\n)\n\n# List all tools\ntools = await list_tools()\n```\n\n## 🚀 **REVOLUTIONARY CAPABILITIES**\n\nThis MCP server gives AI the following capabilities:\n\n- 👁️ **Continuous Vision**: AI can monitor the screen non-stop\n- 🧠 **Smart Understanding**: Recognizes UI elements and interacts with them\n- 🔮 **Future Prediction**: Learns and predicts user behaviors\n- ⚡ **Proactive Help**: Offers help before you need it\n- 🎯 **Natural Interaction**: Understands commands like \"Click the save button\"\n\n## 🔧 **TROUBLESHOOTING**\n\n### **Common Issues and Solutions**\n\n1. **Unicode/Encoding Error (Windows)**\n   ```\n   UnicodeEncodeError: 'charmap' codec can't encode character\n   ```\n   **Solution:** ✅ This error is fixed! Server automatically uses UTF-8 encoding.\n\n2. **JSON Configuration Error**\n   ```json\n   // ❌ Wrong\n   {\n     \"command\": \"python\",\n     \"args\": [\"path/to/main.py\",]  // Trailing comma is wrong\n   }\n\n   // ✅ Correct\n   {\n     \"command\": \"python\",\n     \"args\": [\"path/to/main.py\"]\n   }\n   ```\n\n3. **Python Path Issue**\n   ```json\n   {\n     \"command\": \"C:/Python311/python.exe\",  // Use full path\n     \"args\": [\"C:/path/to/ScreenMonitorMCP/main.py\"]\n   }\n   ```\n\n4. **Missing Dependencies**\n   ```bash\n   cd ScreenMonitorMCP\n   pip install -r requirements.txt\n   ```\n\n5. **OCR Issues**\n   ```bash\n   # Install Tesseract (optional)\n   # EasyOCR installs automatically\n   ```\n\n6. **MCP Connection Closed Error**\n   ```\n   MCP error -32000: Connection closed\n   ```\n   **Solution:** Check file paths and add `cwd` parameter.\n\n## 📝 **LICENSE**\n\nThis project is licensed under the MIT License.\n\n---\n\n**🚀 Revolutionary MCP server that gives AI real \"eyes\"!**\n**🔥 Next-generation AI-human interaction starts here!**\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finkbytefo%2Fscreenmonitormcp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finkbytefo%2Fscreenmonitormcp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finkbytefo%2Fscreenmonitormcp/lists"}