An open API service indexing awesome lists of open source software.

awesome-observability

Awesome observability page
https://github.com/adriannovegil/awesome-observability

Last synced: 9 days ago
JSON representation

  • 15. License

    • Anomalies Detection

  • 7. Storage

    • NoSQL Database (The Others :-P)

      • MongoDB - MongoDB is a document database with the scalability and flexibility that you want with the querying and indexing that you need.
      • SQLite - C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.
      • RethinkDB - RethinkDB pushes JSON to your apps in realtime.
      • CouchDB - Seamless multi-master sync, that scales from Big Data to Mobile, with an Intuitive HTTP/JSON API and designed for Reliability.
    • SQL Database

      • PostgreSQL - Open source relational database.
      • MySQL - Relational database management system.
      • CockroachDB - CockroachDB delivers Distributed SQL, combining the familiarity of relational data with limitless, elastic cloud scale, bulletproof resilience… and more.
      • MariaDB - Open source relational database.
      • ClickHouse - ClickHouse is a fast open-source OLAP database management system.
      • Apache Lucene - Java library providing powerful indexing and search features.
      • Apache Solr - Solr is the popular, blazing-fast, open source enterprise search platform built on Apache Lucene.
      • Elasticsearch - Free and Open, Distributed, RESTful Search Engine.
    • "Meta Projects" (data storage, multi-tenant, aggregation, high availability, etc)

      • Thanos - Highly available Prometheus setup with long term storage capabilities.
      • Apache HBase - Apache HBase is the Hadoop database, a distributed, scalable, big data store.
      • qryn - Polyglot monitoring and observability.
      • Opstrace - The Opstrace Distribution is a secure, horizontally-scalable, open source observability platform that you can install in your cloud account.
      • M3 - Distributed TSDB and Query Engine, Prometheus Sidecar, Metrics Aggregator, and more such as Graphite storage and query engine.
      • Cortex - Horizontally scalable, highly available, multi-tenant, long term storage for Prometheus.
      • Promscale - Unified metric and trace observability backend for Prometheus, Jaeger and OpenTelemetry built on PostgreSQL and TimescaleDB.
      • Observatorium - This system will allow you to ingest, store and use common observability signals like metrics, logging and tracing.
    • Time Series Database

      • OpenTSDB - OpenTSDB, written in java.
      • QuestDB - QuestDB is the fastest open source time series database.
      • kairosDB - Fast Time Series Database on Cassandra.
      • VictoriaMetrics - VictoriaMetrics is a fast, cost-effective and scalable monitoring solution and time series database.
      • Graphite - Store numeric time-series data and render graphs of this data on demand.
      • M3DB - Fully open source metrics platform built on M3DB, a distributed timeseries database.
      • Netflix Atlas - Atlas features in-memory data storage, allowing it to gather and report very large numbers of metrics, very quickly.
      • Metric Tank - Provides high availability and efficient long-term storage, retrieval, and processing for large-scale environments.
      • OpenTSDB - OpenTSDB, written in java.
      • TimescaleDB - PostgreSQL for time‑series.
    • Graph Database

      • neo4j - Graphs for Everyone.
    • Tracing

      • Grafana Tempo - Open source, easy-to-use and high-scale distributed tracing backend.
      • Zipkin - A distributed tracing system.
      • Haystack - A resilient, scalable tracing and analysis system.
  • 4. Load Generators and Synthetic Traffic

    • Events & Problems

      • Gatling - Load test as code.
      • JMeter - Java application designed to load test functional behavior and measure performance. It was originally designed for testing Web Applications but has since expanded to other test functions.
      • K6 - k6 is a developer-centric, free and open-source load testing tool built for making performance testing a productive and enjoyable experience.
      • phantom - Evgeniy Mamchits' phantom is a very fast (100 000+ RPS) shooter written in C++ (default).
      • GoReplay - Open-source tool for capturing and replaying live HTTP traffic into a test environment in order to continuously test your system with real data.
      • Locust - Locust is an easy-to-use, distributed, user load testing tool. It is intended for load-testing web sites (or other systems) and figuring out how many concurrent users a system can handle.
      • Vegeta - HTTP load testing tool built out of a need to drill HTTP services with a constant request rate. It can be used both as a command line utility and a library.
      • Yandex Tank - Yandex.Tank is an extensible open source load testing tool for advanced linux users which is especially good as a part of an automated load testing suite.
      • Taurus - Taurus relies on JMeter, Gatling, Locust.io, Grinder and Selenium WebDriver as its underlying tools. Free and open source under Apache 2.0 License.
      • Trunks - Trunks, like every son, is derived from the father Vegeta with some enhanced skills.
      • ghz - Simple gRPC benchmarking and load testing tool inspired by hey and grpcurl.
      • Pandora - Pandora is a high-performance load generator in Go language. It has built-in HTTP(S) and HTTP/2 support and you can write your own load scenarios in Go, compiling them just before your test.
      • BFG - A modular tool and framework for load generation that supports HTTP/2.
      • Bender - Bender makes it easy to build load testing applications for services using protocols like HTTP, Thrift, Protocol Buffers and many more. Bender provides a library of flexible, powerful primitives that can be combined (with plain Go code) to build load testers customized to any use case and that evolve with your service over time.
  • 8. Visualization

    • General & Tools

      • Flame Graph - Visualization of profiled software, allowing the most frequent code-paths to be identified quickly and accurately.
      • ExplorViz - Live trace visualization for large software landscapes.
      • Flame Scope - FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.
    • Dashboarding

      • Prometheus - The Prometheus monitoring system and time series database.
      • Uchiwa - Uchiwa is a simple dashboard for the Sensu monitoring framework, built with Go and AngularJS.
      • Grafana - The first really good dashboard for displaying metrics.
      • Kibana - Elastic stack.
      • Skooner - Simple Kubernetes real-time dashboard and management.
      • Chronograf - Chronograf is the user interface and administrative component of the InfluxDB platform.
      • Grafterm - Visualize metrics dashboards on the terminal, like a simplified and minimalist version of Grafana for terminal.
      • Grizzly - A utility for managing various observability resources with Jsonnet.
      • PromViz - Promviz is an application that helps you visualize the traffic of your cluster from Prometheus data.
      • SLO-Tracker - A simple but effective way to track SLO's and Error budgets. SLO-tracker can be integrated with few alerting tools via webhook integration to receive SLO voilating incidents.
    • Tracing

      • Jaeger - Monitor and troubleshoot transactions in complex distributed systems.
    • Graph of Nodes

      • Vizceral - Vizceral is a component for displaying traffic data on a webgl canvas. If a graph of nodes and edges with data about traffic volume is provided, it will render a traffic graph animating the connection volume between nodes.
      • Novatec Service Dependency Graph Panel - A Grafana panel for visualizing a Service Dependency Graph.
    • Uptime

      • BlueWave Uptime - Open-source, self-hosted monitoring tool built with React.js, Node.js, and MongoDB, designed to track server uptime, response times, and incidents in real-time with beautiful visualizations.
      • Freshping - Free for 50 monitors, checked every 1 minutes. Status pages, monitoring of HTTP (and DNS, ICMP, TCP/UDP), select region of monitoring.
  • 3. Collect

    • Metrics

      • Opentracing - Vendor-neutral APIs and instrumentation for distributed tracing.
      • Opentelemetry - OpenTelemetry is made up of an integrated set of APIs and libraries as well as a collection mechanism via an agent and collector.
      • Performance Co-Pilot - Performance Co-Pilot is a system performance analysis toolkit.
      • top - Allows users to monitor processes and system resource usage on Linux. It is one of the most useful tools in a sysadmin's toolbox, and it comes pre-installed on every distribution.
      • htop - Command line utility that allows you to interactively monitor your system's vital resources or server's processes in real time.
      • OpenCensus - OpenCensus is a set of libraries for various languages that allow you to collect application metrics and distributed traces, then transfer the data to a backend of your choice in real time.
      • Openmetrics - An effort to create an open standard for transmitting metrics at scale, with support for both text representation and Protocol Buffers.
      • Micrometer - Micrometer provides a simple facade over the instrumentation clients for the most popular monitoring systems, allowing you to instrument your JVM-based application code without vendor lock-in. Think SLF4J, but for metrics.
      • Kamon - Monitoring applications running on the JVM.
      • MyScale Telemetry - Tool designed to enhance the observability of LLM applications by capturing trace data from LangChain-based applications and storing it in MyScaleDB or ClickHouse.
      • cAdvisor - cAdvisor (Container Advisor) provides container users an understanding of the resource usage and performance characteristics of their running containers.
      • ctop - Top-like interface for container metrics.
      • Kuberhealthy - Kubernetes operator for synthetic monitoring and continuous process verification.
      • Node-exporter - Prometheus stack, Exporter for machine metrics.
      • SkyAPM-dotnet - SkyAPM-dotnet provides the native support agent in C# and .NETStandard platform, with the helps from Apache SkyWalking committer team.
      • Kube State Metrics - The kube-state-metrics is a simple service that listens to the Kubernetes API server and generates metrics about the state of the objects.
      • Tcollector - Data collection framework for OpenTSDB.
      • Netflix Vector - An on-host performance monitoring framework which exposes hand picked high resolution metrics to every engineer's browser.
      • Express State Metrics - Simple, self-hosted module based on Socket.io and Chart.js to report realtime server metrics for Express-based node servers.
      • MyPerf4J - High performance Java APM. Powered by ASM. Try it. Test it. If you feel its better, use it.
      • OpenLLMetry - Open-source observability for your LLM application, based on OpenTelemetry.
      • OpenLLMetry for Javascript - Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry.
      • OpenLLMetry for Go - Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry.
      • ingraind - Security monitoring agent built around RedBPF for complex containerized environments and endpoints.
      • htop - Command line utility that allows you to interactively monitor your system's vital resources or server's processes in real time.
      • sls-dev-tools - The Developer Tools for the Serverless World - think Chrome Dev Tools but for Serverless.
      • Collectd - The system statistics collection daemon.
      • pktvisor - Observability agent for summarizing high volume, information dense data streams down to lightweight, immediately actionable observability data directly at the edge.
    • Tracing

      • inspectIT Ocelot - Java agent for collecting performance, tracing and business data.
      • Sleuth - Spring Cloud Sleuth implements a distributed tracing solution for Spring Cloud, borrowing heavily from Dapper, Zipkin and HTrace.
      • Sleuth - Spring Cloud Sleuth implements a distributed tracing solution for Spring Cloud, borrowing heavily from Dapper, Zipkin and HTrace.
    • Logging

      • mTAIL - Windows program that extract internal monitoring data from application logs for collection in a timeseries database.
      • Elastic Beats - Lightweight shippers for Elasticsearch & Logstash, Elastic stack.
      • mTAIL - Windows program that extract internal monitoring data from application logs for collection in a timeseries database.
    • Events & Problems

      • KubeEye - KubeEye aims to find various problems on Kubernetes, such as application misconfiguration(using Polaris), cluster components unhealthy and node problems(using Node-Problem-Detector).
      • kubernetes-event-exporter - This tool allows exporting the often missed Kubernetes events to various outputs so that they can be used for observability or alerting purposes.
      • kspan - Turning Kubernetes Events into spans.
  • 5. Transport

    • Events & Problems

      • Redis - Redis is an open source, in-memory data structure store, used as a database, cache and message broker. It supports many different data structures such as stringes, hashes, list, etc.
      • Pulsar - Distributed pub-sub messaging system.
      • Qpid - Cross-platform messaging components built on AMQP.
      • NATS - Open source, high-performance, lightweight cloud messaging system.
      • Vector - Collect, transform, and route all your logs and metrics with one simple tool.
      • Zenoh - A low overhead, low latency, high throughput open-source protocol that blends traditional pub/sub with geo distributed storage, queries and computations for unifying data in motion, data at rest and computations.
      • Mosca - MQTT broker as a module.
      • RabbitMQ - Open source Erlang-based message broker that just works.
      • VerneMQ - Open source software, extendable, and enterprise support is available.
      • Rsyslog - RSYSLOG is the rocket-fast system for log processing.
      • Eventuate - A platform for developing asynchronous microservices solving the distributed data management problems.
      • Nanomsg - Socket library that provides several common communication patterns for building distributed systems.
      • Disque - Distributed message broker.
      • Mist - A distributed, tag-based pub/sub service.
      • Malamute - ZeroMQ enterprise messaging broker.
      • Aeron - Efficient reliable UDP unicast, UDP multicast, and IPC message transport.
      • Beanstalk - Simple, fast work queue.
      • Mosca - MQTT broker as a module.
      • Stanza - Fast and lightweight log transport and processing agent. It's designed as a modern replacement for Fluentd, Fluent Bit, and Logstash.
      • Beanstalk - Simple, fast work queue.
      • RocketMQ - A low latency, reliable, scalable, easy to use message oriented middleware born from alibaba massive messaging business.
  • 10. Application Performance Monitoring Solutions (APM)

    • Anomalies Detection

      • NewRelic - Complete view of your applications and operating environment.
      • SkyWalking - Application performance monitor tool for distributed systems, especially designed for microservices, cloud native and container-based (Docker, K8s, Mesos) architectures.
      • Checkmk Server - Monitor your entire hybrid IT infrastructure.
      • Sensu - The Observability Pipeline that delivers monitoring as code on any cloud.
      • DataDog - Unified Monitoring For Metrics, Traces, & Logs.
      • catchpoint - From the edge to the cloud, our proactive observability platform gives you the power to fix problems before your users notice.
      • Nagios - Computer system, network and infrastructure monitoring software application.
      • Netdata - Troubleshoot slowdowns and anomalies in your infrastructure with thousands of per-second metrics, meaningful visualizations, and insightful health alarms with zero configuration.
      • Icinga - The Icinga stack spans six core strengths that cover all aspects of monitoring.
      • robusta - Unified Kubernetes monitoring, observability, and operations.
      • coroot - Open-source eBPF-based observability tool that turns telemetry data into actionable insights, helping you identify and resolve application issues quickly.
      • Kloudfuse - Single unified observability platform for metrics, events, logs and traces.
      • Lightstep - Monitoring, observability, and incident response for the world's most reliable systems.
      • chronosphere - Chronosphere develops a scalable, reliable, and customizable monitoring solution built for cloud-native applications.
      • Blue Matador - Easiest and fastest way to monitor your cloud environments on the market.
      • Aternity - Simplified high-definition APM visibility leveraging Real User Monitoring, Synthetic Monitoring, and OpenTelemetry, that is scalable, easy to use and deploy, and unifies insights across end users, applications, networks, and the cloud-native ecosystem.
      • AppOptics - Continuous monitoring built to scale with your applications for less downtime and lower resource usage.
      • Pixie - Open source observability tool for Kubernetes applications. Pixie uses eBPF to automatically capture telemetry data without the need for manual instrumentation.
      • swagger-stats - API Telemetry and APM.
      • dynatrace APM - Best-in-class APM from the category leader. Ensure application performance, innovate faster, collaborate efficiently, and deliver more value with dramatically less effort.
      • Elastic APM - Application performance monitoring system built on the Elastic Stack.
      • Honeycomb - Give all software engineering teams the observability they need to eliminate toil and delight their users.
      • Kamon apm - Point and click to find the endpoints, database queries, and API calls that affect your user's experience.
      • Stagemonitor - An open source solution to application performance monitoring for java server applications.
      • Kieker - Monitoring, analysis and tool integration.
      • servicenow - Cloud Observability - Gain AI-powered insights to detect and quickly respond to changes in cloud-native and monolithic applications.
      • SigNoz - Monitor your applications and troubleshoot problems in your deployed applications, an open-source alternative to DataDog, New Relic, etc.
      • Cloudprober - An active monitoring software to detect failures before your customers do.
      • Zabbix - Real-time monitoring of IT components and services, such as networks, servers, VMs, applications and the cloud.
      • Pinpoint - Pinpoint is an APM (Application Performance Management) tool for large-scale distributed systems written in Java / PHP/PYTHON.
      • DeepFlow - Implemented Zero Code data collection with eBPF for metrics, distributed tracing, request logs and function profiling, and is further integrated with SmartEncoding to achieve Full Stack correlation and efficient access to all observability data.
      • Falcon Plus - An open-source and enterprise-level monitoring system.
      • Hubble - Network, Service & Security Observability for Kubernetes.
      • Scouter - Scouter is an open source APM (Application Performance Management) tool.
      • OpenLIT - OTel-native Observability and Evals for LLMs & GPUs.
      • Soda Sql - Data profiling, testing, and monitoring for SQL accessible data.
      • Langtrace - Open Source & Open Telemetry(OTEL) Observability for LLM applications.
      • Sentry - From error tracking to performance monitoring, developers can see what actually matters, solve quicker, and learn continuously about their applications - from the frontend to the backend.
      • Aspecto - Troubleshoot performance bottlenecks and errors within your microservices.
      • Centreon - Business-aware and AIOps-ready IT Monitoring.
      • AppOptics - Continuous monitoring built to scale with your applications for less downtime and lower resource usage.
      • Odigos - Observability Control Plane.
      • circonus - Circonus provides a unified platform for monitoring and analyzing all of your metrics, infrastructure, applications.
      • Aternity - Simplified high-definition APM visibility leveraging Real User Monitoring, Synthetic Monitoring, and OpenTelemetry, that is scalable, easy to use and deploy, and unifies insights across end users, applications, networks, and the cloud-native ecosystem.
      • Datav - A modern apm solution for enterprise, an open-source alternative to DataDog, New Relic, etc.
      • dynatrace APM - Best-in-class APM from the category leader. Ensure application performance, innovate faster, collaborate efficiently, and deliver more value with dramatically less effort.
      • Elastic APM - Application performance monitoring system built on the Elastic Stack.
  • 9. Processing and Analyze and Act

    • Processing

      • Fluentd - Fluentd is an open source data collector for unified logging layer.
      • Kapacitor - Kapacitor is a real-time streaming data processing engine.
      • Logstash - Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite "stash".
      • Vector - Vector is a high-performance observability data router. It makes collecting, transforming, and sending logs, metrics, and events easy. It decouples data collection & routing from your services, giving you control and data ownership, among many other benefits.
      • Logstash - Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite "stash".
    • Alerts

      • Cabot - Get alerted when services go down or metrics go crazy.
      • Alerta - Tool used to consolidate and de-duplicate alerts from multiple sources for quick ‘at-a-glance’ visualisation.
      • Bosun - Time Series Alerting Framework.
      • Moira - Most powerful alerting system, backed by Graphite.
      • Seyren - An alerting dashboard for Graphite.
      • ElastAlert - Easy & Flexible Alerting With Elasticsearch.
      • Prometheus Alertmanager - Prometheus stack, Prometheus Alertmanager, written in go.
      • Kapacitor - TICK stack, written in go.
      • Sloth - Easy and simple Prometheus SLO (service level objectives) generator.
      • Flapjack - Monitoring notification routing & event processing system.
      • X-Pack - Elastic stack.
    • Anomalies Detection

      • Failure Mode and Effects Analysis (FMEA) - Documents current knowledge and actions about the risks of failures, for use in continuous improvement.
      • Anomaly Detection Toolkit (ADTK) - Python package for unsupervised / rule-based time series anomaly detection.
      • Prophet - Prophet is a forecasting procedure implemented in R and Python. It is fast and provides completely automated forecasts that can be tuned by hand by data scientists and analysts.
      • Chaos Genius - ML powered analytics engine for anomaly/outlier detection and root cause analysis.
      • Project Scorpio - Log Anomaly Detector.
      • Anomaly Detection in Prometheus Metrics - Prototype for a Prometheus Anomaly Detector (PAD) which can be deployed on OpenShift. The PAD is a framework to deploy a metric prediction model to detect anomalies in prometheus metrics.
      • Banshee - Real-time anomalies(outliers) detection system for periodic metrics.
    • Triggers

      • prometheus-am-executor - HTTP server that receives alerts from the Prometheus Alertmanager and executes a given command with alert details set as environment variables.
      • Odin - A programmable, observable and distributed job orchestration system.
  • 12. Observability as a Service

    • Anomalies Detection

      • splunk - Extensible data platform powers unified security, full-stack observability and limitless custom applications.
      • sumo logic - Reduce downtime with real-time alerting, dashboards, and machine-learning-powered analytics for all three types of telemetry — logs, metrics, and traces.
      • loggly - See it all in one place. Dozens of log sources, no proprietary agents.
      • Sematext Cloud - Infrastructure and log monitoring with service and log auto-discovery. Basic plan is free. Website uptime, API, and SSL certificate monitoring. Includes status pages and scriptable multi-page user transaction monitoring, etc.
      • Sysdig Prometheus - Cloud scale monitoring solution with full Prometheus compatibility.
      • Epsagon - Application Monitoring Built for Containers and Serverless.
      • servicepilot - Modern monitoring platform.
      • Instana - IBM® Instana® Observability is the gold standard of incident prevention with automated full-stack visibility, 1-second granularity and 3 seconds to notify.
      • Mackerel - A SaaS server monitoring service with an intuitive UI, optimized for the cloud era, that fosters a culture of team-based system monitoring/operation.
      • Grafana Cloud - Composable observability platform, integrating metrics, traces and logs with Grafana.
      • NexClipper - Full stack visibility and intelligence for cloud native applications.
      • CloudWatch - Observability of your AWS resources and applications on AWS and on-premises.
      • Google Cloud Monitoring - Gain visibility into the performance, availability, and health of your applications and infrastructure.
      • Azure Monitor - Full observability into your applications, infrastructure, and network.
      • Guance - China local "All in one" observability platform, it can integrate any open source collecting method.
      • Alibaba Cloud Logs Service - Complete real-time data logging service that has been developed by Alibaba Group.
      • logiq.ai - Platform to connect observability data from any source to any destination.
      • Tencent Cloud Log Service - Tencent is an internet service portal offering value-added internet, mobile, telecom, and online advertising services.
      • WhaTap - Provides an integrated monitoring service for DevOps that analyzes application performance issue running on kubernetes in real time.
      • humio - Modern log management with streaming observability and affordable Unlimited Plans.
      • humio - Modern log management with streaming observability and affordable Unlimited Plans.
      • logiq.ai - Platform to connect observability data from any source to any destination.
      • Dash0 - Dash0 is modern OpenTelemetry Native Observability, built on CNCF Open Standards such as PromQL, Perses and OLTP with full cost control. Supports monitoring metrics, logs and traces. With dashboarding and alerting capabilities.
      • logdna - A comprehensive log solution to control all of your log data.
  • 6. Collector

    • Metrics

      • Grafana Mimir - Mimir is an open source, horizontally scalable, highly available, multi-tenant TSDB for long-term storage for Prometheus.
      • statsd - A network daemon that runs on the Node.js platform and listens for statistics, like counters and timers, sent over UDP or TCP and sends aggregates to one or more pluggable backend services.
      • Telegraf - TICK stack, The plugin-driven server agent for collecting & reporting metrics.
    • Logging

      • GoAccess - GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal in \*nix systems or through your browser. It provides fast and valuable HTTP statistics for system administrators that require a visual server report on the fly.
      • Loki - Horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus.
      • logdy - Supercharge terminal logs with web browser UI and low-code. It's like jq, tail, less, grep and awk merged together and available in a clean UI. Self-hosted, single binary.
      • Logbook - Extensible Java library to enable complete request and response logging for different client- and server-side technologies.
      • Brubeck - Statsd-compatible stats aggregator written in C.
      • Graylog - Simply great centralized log management.
  • 1. Best Practices

  • 11. Service Mesh

    • Anomalies Detection

      • Istio - Istio generates detailed telemetry for all service communications within a mesh.
      • Kiali - Observability console for Istio with service mesh configuration capabilities. It helps you to understand the structure of your service mesh by inferring the topology, and also provides the health of your mesh.
  • 13. Examples and Sandbox's