{"id":30110587,"url":"https://github.com/monoscope-tech/monoscope","last_synced_at":"2025-10-11T03:07:33.309Z","repository":{"id":303887542,"uuid":"445620962","full_name":"monoscope-tech/monoscope","owner":"monoscope-tech","description":"Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.","archived":false,"fork":false,"pushed_at":"2025-10-07T09:29:42.000Z","size":22789,"stargazers_count":202,"open_issues_count":6,"forks_count":2,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-10-07T11:25:31.999Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://app.monoscope.tech/p/00000000-0000-0000-0000-000000000000/log_explorer","language":"Haskell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/monoscope-tech.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2022-01-07T18:46:04.000Z","updated_at":"2025-10-07T09:29:46.000Z","dependencies_parsed_at":"2025-09-22T19:15:59.750Z","dependency_job_id":"d49e2d92-04a1-444b-97b0-b0475f26d04d","html_url":"https://github.com/monoscope-tech/monoscope","commit_stats":null,"previous_names":["monoscope-tech/monoscope"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/monoscope-tech/monoscope","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monoscope-tech%2Fmonoscope","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monoscope-tech%2Fmonoscope/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monoscope-tech%2Fmonoscope/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monoscope-tech%2Fmonoscope/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/monoscope-tech","download_url":"https://codeload.github.com/monoscope-tech/monoscope/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monoscope-tech%2Fmonoscope/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279006060,"owners_count":26084026,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-11T02:00:06.511Z","response_time":55,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-08-10T04:47:41.672Z","updated_at":"2025-10-11T03:07:33.303Z","avatar_url":"https://github.com/monoscope-tech.png","language":"Haskell","funding_links":[],"categories":["Haskell"],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cpicture\u003e\n  \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"/static/public/assets/svgs/logo_white.svg\"\u003e\n  \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"/static/public/assets/svgs/logo_black.svg\"\u003e\n  \u003cimg src=\"/static/public/assets/svgs/logo_black.svg\" alt=\"Monoscope Logo\" width=\"400\" /\u003e\n\u003c/picture\u003e\n\n### Open-source monitoring and observability platform that understands your systems\n\nMonoscope lets you ingest and explore your logs, traces and metrics in S3 buckets. Query in natural language via LLMs. Monoscope also let's you create AI agents that run at an interval to automatically detect anomalies in your logs, metrics, and traces. The most important actions and logs and insight are sent as reports to your email every day or week.\n\n[![GitHub Release](https://img.shields.io/github/v/release/monoscope-tech/monoscope)](https://github.com/monoscope-tech/monoscope/releases)\n[![License](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)\n[![Haskell](https://img.shields.io/badge/Built%20with-Haskell-5e5086?logo=haskell)](https://www.haskell.org/)\n[![Discord](https://img.shields.io/discord/123456789?color=7289da\u0026logo=discord\u0026logoColor=white)](https://discord.gg/monoscope)\n\n\u003c/div\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://monoscope.tech\"\u003e\u003cb\u003eWebsite\u003c/b\u003e\u003c/a\u003e •\n    \u003ca href=\"https://discord.gg/monoscope\"\u003e\u003cb\u003eDiscord\u003c/b\u003e\u003c/a\u003e •\n    \u003ca href=\"https://twitter.com/monoscope\"\u003e\u003cb\u003eTwitter\u003c/b\u003e\u003c/a\u003e •\n    \u003ca href=\"https://github.com/monoscope-tech/monoscope/releases\"\u003e\u003cb\u003eChangelog\u003c/b\u003e\u003c/a\u003e •\n    \u003ca href=\"https://docs.monoscope.tech\"\u003e\u003cb\u003eDocumentation\u003c/b\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\" style=\"margin-top: 1em; margin-bottom: 1em;\"\u003e\n\u003ca href=\"#-what-is-monoscope\"\u003e🚀 What is Monoscope?\u003c/a\u003e • \u003ca href=\"#-quick-start-installation\"\u003e🛠️ Quick Start Installation\u003c/a\u003e • \u003ca href=\"#-ingesting-logs-metrics--traces\"\u003e📊 Ingesting Logs, Metrics \u0026 Traces\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"#-ai-anomaly-detection\"\u003e🤖 AI Anomaly Detection\u003c/a\u003e • \u003ca href=\"#-natural-language-search\"\u003e💬 Natural Language Search\u003c/a\u003e • \u003ca href=\"https://github.com/monoscope-tech/monoscope\"\u003e⭐ Star Us\u003c/a\u003e • \u003ca href=\"#-contributing\"\u003e🤝 Contributing\u003c/a\u003e\n\u003c/div\u003e\n\n\u003cbr /\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg width=\"100%\" src=\"https://github.com/user-attachments/assets/6175c23b-f3ac-450a-9ae3-4b86371f4f54\" alt=\"Monoscope Dashboard\" /\u003e\n  \u003cp\u003e\u003ci\u003eMonoscope automatically detects anomalies in your logs, metrics, and traces using AI — no configuration required.\u003c/i\u003e\u003c/p\u003e\n\u003c/div\u003e\n\n## 🚀 What is Monoscope?\n\nMonoscope is an open-source observability platform that uses artificial intelligence to understand and monitor your systems automatically. Unlike traditional monitoring tools that require extensive configuration and generate overwhelming alerts, Monoscope learns your system's normal behavior and only alerts you when something is genuinely wrong.\n\n### Key Capabilities\n\n- **Universal Data Ingestion**: Native support for OpenTelemetry means compatibility with 750+ integrations out of the box\n- **AI-Powered Understanding**: Our LLM engine understands context, not just thresholds\n- **Natural Language Interface**: Query your data in plain English\n- **Cost-Effective Storage**: Store years of data affordably with S3-compatible object storage\n- **Zero Configuration**: Start getting insights immediately without complex setup\n\n## 🛠️ Quick Start Installation\n\n```bash\n# Run with Docker (recommended)\ndocker run -p 8080:8080 monoscope/monoscope:latest\n\n# Or clone and run locally\ngit clone https://github.com/monoscope-tech/monoscope.git\ncd monoscope\ndocker-compose up\n```\n\nVisit `http://localhost:8080` to access Monoscope. [Full installation guide →](docs/installation.md)\n\n## 📊 Ingesting Logs, Metrics \u0026 Traces\n\nMonoscope is built on **OpenTelemetry**, the industry-standard observability framework. This means you get instant compatibility with **750+ integrations** including all major languages, frameworks, and infrastructure components.\n\n### Supported Data Types\n\n- **Logs**: Application logs, system logs, audit trails\n- **Metrics**: Performance counters, business KPIs, custom metrics\n- **Traces**: Distributed request flows, latency tracking, dependency mapping\n\n### Quick Integration Examples\n\n```bash\n# For Python applications\npip install opentelemetry-api opentelemetry-sdk\nexport OTEL_EXPORTER_OTLP_ENDPOINT=\"http://localhost:8080\"\n\n# For Node.js applications\nnpm install @opentelemetry/api @opentelemetry/sdk-node\nexport OTEL_EXPORTER_OTLP_ENDPOINT=\"http://localhost:8080\"\n\n# For Kubernetes clusters\nhelm install opentelemetry-collector open-telemetry/opentelemetry-collector \\\n  --set config.exporters.otlp.endpoint=\"monoscope:8080\"\n```\n\nMonoscope automatically correlates logs, metrics, and traces from the same service, giving you a complete picture of your system's behavior. No manual correlation or configuration required.\n\n## 🤖 AI Anomaly Detection\n\nMonoscope's AI engine continuously learns your system's normal behavior patterns and automatically alerts you to genuine issues:\n\n- **Context-Aware Detection**: Understands that high CPU during deployments is normal, but high CPU at 3 AM is not\n- **Seasonal Pattern Recognition**: Learns daily, weekly, and monthly patterns in your data\n- **Cross-Signal Correlation**: Detects anomalies by analyzing logs, metrics, and traces together\n- **Noise Reduction**: Reduces alert fatigue by 90% compared to threshold-based monitoring\n\nThe AI runs continuously in the background, requiring no configuration or training from you.\n\n## 💬 Natural Language Search\n\nQuery your observability data using plain English instead of complex query languages:\n\n### Example Queries\n\n- \"Show me all errors in the payment service in the last hour\"\n- \"What caused the spike in response time yesterday at 3 PM?\"\n- \"Which services are consuming the most memory?\"\n- \"Find all database queries taking longer than 1 second\"\n\nMonoscope translates your natural language into optimized queries across logs, metrics, and traces, returning relevant results with explanations.\n\n## 🎯 Key Features\n\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ch4\u003e🤖 AI-Powered Anomaly Detection\u003c/h4\u003e\n      \u003cp\u003eLLM-based engine that understands context and identifies real issues, not just threshold violations\u003c/p\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ch4\u003e💬 Natural Language Queries\u003c/h4\u003e\n      \u003cp\u003eSearch logs and metrics using plain English - no complex query languages required\u003c/p\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ch4\u003e⚡ Built for Scale\u003c/h4\u003e\n      \u003cp\u003eHandle millions of events/sec with our custom TimeFusion storage engine\u003c/p\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ch4\u003e💰 Cost-Effective Storage\u003c/h4\u003e\n      \u003cp\u003eStore years of data affordably with S3-compatible object storage\u003c/p\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n## 📸 Screenshots\n\n\u003cdiv align=\"center\"\u003e\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003cimg src=\"https://github.com/user-attachments/assets/6175c23b-f3ac-450a-9ae3-4b86371f4f54\" alt=\"Log Explorer View 1\" /\u003e\n      \u003cp align=\"center\"\u003e\u003ci\u003eLog Explorer - Main View\u003c/i\u003e\u003c/p\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003cimg src=\"https://github.com/user-attachments/assets/baf78e6f-2b75-4b6f-be56-94a0b3da9f31\" alt=\"Log Explorer View 2\" /\u003e\n      \u003cp align=\"center\"\u003e\u003ci\u003eLog Explorer - Detailed View\u003c/i\u003e\u003c/p\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003cimg src=\"https://github.com/user-attachments/assets/3dae136a-e627-4278-91a1-81c5af5f8cd6\" alt=\"Dashboard View\" /\u003e\n      \u003cp align=\"center\"\u003e\u003ci\u003eDashboard Analytics\u003c/i\u003e\u003c/p\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003cpicture\u003e\n        \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"/static/public/assets/svgs/logo_white.svg\"\u003e\n        \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"/static/public/assets/svgs/logo_black.svg\"\u003e\n        \u003cimg src=\"/static/public/assets/svgs/logo_black.svg\" alt=\"Monoscope Logo\" /\u003e\n      \u003c/picture\u003e\n      \u003cp align=\"center\"\u003e\u003ci\u003eMonoscope - Open Source Observability\u003c/i\u003e\u003c/p\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n## 🏗️ Architecture Overview\n\nMonoscope combines high-performance data ingestion with intelligent AI analysis:\n\n```mermaid\ngraph LR\n    A[Your Apps] --\u003e|Logs/Metrics| B[Ingestion API]\n    B --\u003e C[TimeFusion Engine]\n    C --\u003e D[S3 Storage]\n    C --\u003e E[LLM Pipeline]\n    E --\u003e F[Anomaly Detection]\n    F --\u003e G[Alerts \u0026 Dashboard]\n```\n\n- **Language**: Built in Haskell for reliability and performance\n- **Storage**: S3-compatible object storage for cost-effective retention\n- **AI Engine**: State-of-the-art LLMs for intelligent analysis\n- **Scale**: Horizontally scalable architecture\n\n## 🌟 Why Monoscope?\n\n### The Problem\n\nTraditional monitoring tools require extensive configuration, generate overwhelming alerts, and still miss critical issues. You spend more time managing your monitoring than actually using it.\n\n### Our Solution\n\nMonoscope uses AI to understand your system's behavior, automatically detect anomalies, and provide actionable insights - all without complex configuration.\n\n### Who Uses Monoscope?\n\n- **DevOps Teams** reducing alert fatigue by 90%\n- **SREs** catching issues before they impact users\n- **Engineering Leaders** getting visibility across complex systems\n- **Startups** implementing enterprise-grade observability on a budget\n\n## 📚 Documentation\n\n- [Features](#features)\n- [Getting Started](#getting-started)\n- [Prerequisites](#prerequisites)\n- [Installation](#installation)\n- [Development Setup](#development-setup)\n- [Testing](#testing)\n- [Useful Links](#useful-links)\n- [Contributing](#contributing)\n- [License](#license)\n\n---\n\n## Features\n\n- 🤖 **AI-Powered Anomaly Detection**: Leverages LLMs to automatically identify and alert on unusual patterns\n- ☁️ **S3-Compatible Storage**: Store logs, metrics and traces in any S3-compatible object storage\n- 🚀 **High Performance**: Written in Haskell and rust for reliability and performance\n- 📈 **Real-Time Analytics**: Monitor your systems with minimal latency\n- 🔌 **Extensible**: Easy to integrate with existing monitoring infrastructure\n\n### Getting Started\n\n- [Installation Guide](docs/installation.md)\n- [Configuration](docs/configuration.md)\n- [API Reference](docs/api.md)\n- [Architecture Deep Dive](docs/architecture.md)\n\n### Tutorials\n\n- [5-Minute Quick Start](docs/quickstart.md)\n- [Monitoring Kubernetes](docs/kubernetes.md)\n- [Custom Dashboards](docs/dashboards.md)\n- [Alert Configuration](docs/alerts.md)\n\n## 🛠️ Installation\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003ePrerequisites\u003c/strong\u003e\u003c/summary\u003e\n\n### Prerequisites\n\nBefore installing Monoscope, ensure you have the following dependencies:\n\n- **Haskell**: Install via GHCup\n- **PostgreSQL with TimescaleDB**: For time-series data storage\n- **LLVM**: Required for compilation\n- **Google Cloud SDK**: For GCP integration (if using GCP)\n\n### Installation\n\n1. **Install Haskell via GHCup**\n\n```bash\ncurl --proto '=https' --tlsv1.2 -sSf https://get-ghcup.haskell.org | sh\n```\n\n2. **Clone the Repository**\n\n```bash\ngit clone https://github.com/monoscope-tech/monoscope.git\ncd monoscope\n```\n\n3. **Install System Dependencies**\n\n**For macOS:**\n\n```bash\n# Install LLVM\nbrew install llvm\n\n# Install PostgreSQL with TimescaleDB\nbrew install postgresql\nbrew install timescaledb\n\n# Install libpq\nbrew install libpq\n```\n\n**For Linux (Ubuntu/Debian):**\n\n```bash\n# Install LLVM\nsudo apt-get install llvm\n\n# Install PostgreSQL and TimescaleDB\n# Follow instructions at: https://docs.timescale.com/install/latest/\n\n# Install libpq\nsudo apt-get install libpq-dev\n```\n\n4. **Configure Google Cloud (Optional)**\n\nIf using Google Cloud integration:\n\n```bash\ngcloud auth application-default login\n```\n\n5. **Run Monoscope**\n\n```bash\nstack run\n```\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003eDevelopment Setup\u003c/strong\u003e\u003c/summary\u003e\n\n## Development Setup\n\n### Database Setup with Docker\n\n1. **Create a Docker volume for PostgreSQL data:**\n\n```bash\ndocker volume create pgdata\n```\n\n2. **Run TimescaleDB in Docker:**\n\n```bash\nmake timescaledb-docker\n```\n\n3. **Configure pg_cron extension:**\n\nAdd the following to your PostgreSQL configuration:\n\n```sql\nALTER system SET cron.database_name = 'monoscope';\nALTER system SET shared_preload_libraries = 'pg_cron';\n```\n\nThen restart the TimescaleDB Docker container.\n\n### Development Tools\n\n**Install code formatting and linting tools:**\n\n```bash\n# Code formatter\nbrew install ormolu\n\n# Linter\nbrew install hlint\n```\n\n**Useful commands:**\n\n```bash\n# Format code\nmake fmt\n\n# Run linter\nmake lint\n```\n\n💡 **Tip**: For better IDE support, compile Haskell Language Server locally to avoid crashes, especially on macOS. See [issue #2391](https://github.com/haskell/haskell-language-server/issues/2391).\n\n### Service Worker\n\nTo build the service worker:\n\n```bash\nworkbox generateSW workbox-config.js\n```\n\n\u003c/details\u003e\n\n## 🧪 Testing\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003eRunning Tests\u003c/strong\u003e\u003c/summary\u003e\n\n### Run all tests\n\n```haskell\nmake test\n# OR\nstack test --ghc-options=-w\n```\n\n### Run only unit tests\n\nUnit tests don't require a database connection and run much faster. They include doctests and pure function tests.\n\n```haskell\nmake test-unit\n# OR\nstack test monoscope-server:unit-tests --ghc-options=-w\n```\n\n### Run unit tests with file watching for development\n\n```haskell\nmake live-test-unit\n# OR\nstack test monoscope-server:unit-tests --ghc-options=-w --file-watch\n```\n\n### Run a specific individual test\n\n```haskell\nstack test --test-arguments \"--match=SeedingConfig\" monoscope-server:tests\n# OR\nstack test --ta \"--match=SeedingConfig\" monoscope-server:tests\n```\n\n\u003c/details\u003e\n\n## 🤝 Community\n\n- 💬 [Discord](https://discord.gg/monoscope) - Chat with users and contributors\n- 🐛 [Issues](https://github.com/monoscope-tech/monoscope/issues) - Report bugs or request features\n- 🐦 [Twitter](https://twitter.com/monoscope) - Follow for updates\n- 📝 [Blog](https://blog.monoscope.tech) - Tutorials and case studies\n\n## 🌍 Contributing\n\nWe welcome contributions to Monoscope! Please feel free to:\n\n- Report bugs and request features via [GitHub Issues](https://github.com/monoscope-tech/monoscope/issues)\n- Submit pull requests for bug fixes and new features\n- Improve documentation and examples\n- Share your use cases and feedback\n\nBefore contributing, please read our contributing guidelines and ensure your code passes all tests and linting checks.\n\n## 📄 License\n\nMonoscope is open source software. Please see the LICENSE file for details.\n\n## 🚀 Roadmap\n\n- [ ] Kubernetes Operator\n- [ ] Terraform Provider\n- [ ] Mobile App\n- [ ] Distributed Tracing Support\n- [ ] Custom ML Model Training\n\nSee our [public roadmap](https://github.com/monoscope-tech/monoscope/projects) for more details.\n\n## 🏆 Comparisons\n\n| Feature                 | Monoscope   | Datadog        | Elastic | Prometheus |\n| ----------------------- | ----------- | -------------- | ------- | ---------- |\n| AI Anomaly Detection    | ✅ Built-in | ❌ Add-on      | ❌      | ❌         |\n| Natural Language Search | ✅          | ❌             | ❌      | ❌         |\n| Cost-Effective Storage  | ✅ S3       | ❌ Proprietary | ✅      | ✅         |\n| No Configuration Alerts | ✅          | ❌             | ❌      | ❌         |\n| Open Source             | ✅          | ❌             | ✅      | ✅         |\n\n---\n\n\u003cdiv align=\"center\"\u003e\n  \u003ch3\u003eReady to transform your observability?\u003c/h3\u003e\n  \u003ca href=\"https://github.com/monoscope-tech/monoscope\"\u003e\u003cimg src=\"https://img.shields.io/github/stars/monoscope-tech/monoscope?style=social\" alt=\"Star on GitHub\" /\u003e\u003c/a\u003e\n  \u003cbr /\u003e\n  \u003csub\u003eBuilt with ❤️ by the \u003ca href=\"https://monoscope.tech\"\u003eMonoscope\u003c/a\u003e team\u003c/sub\u003e\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonoscope-tech%2Fmonoscope","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmonoscope-tech%2Fmonoscope","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonoscope-tech%2Fmonoscope/lists"}