An open API service indexing awesome lists of open source software.

https://github.com/aws-solutions/centralized-logging-with-opensearch

Build your own log analytics platform on OpenSearch in 20 minutes
https://github.com/aws-solutions/centralized-logging-with-opensearch

centralized-logging log-analysis log-analytics opensearch

Last synced: 3 months ago
JSON representation

Build your own log analytics platform on OpenSearch in 20 minutes

Awesome Lists containing this project

README

          

# Centralized Logging with OpenSearch

The Centralized Logging with OpenSearch solution provides comprehensive log management and analysis functions to help you simplify the build of log analytics pipelines. Built on top of Amazon OpenSearch Service, the solution allows you to streamline log ingestion, log processing, and log visualization. You can leverage the solution in multiple use cases, such as to abide by security and compliance regulations, achieve refined business operations, and enhance IT troubleshooting and maintenance.

## Table of content

- [Centralized Logging with OpenSearch](#centralized-logging-with-opensearch)
- [Table of content](#table-of-content)
- [Solution Overview](#solution-overview)
- [Architecture](#architecture)
- [Deployment](#deployment)
- [Customization](#customization)

## Solution Overview

The solution has the following features:

- **All-in-one log ingestion**: provides a single web console to ingest both application logs and AWS service logs into the Amazon OpenSearch (AOS) domains.

- **Codeless log processor**: supports log processor plugins developed by AWS. You are allowed to enrich the raw log data through a few clicks on the web console.

- **Out-of-box dashboard template**: offers a collection of reference designs of visualization templates, for both commonly used software such as Nginx and Apache HTTP Server, and AWS services such as Amazon S3 and Amazon CloudTrail.

## Architecture

Deploying this solution with the default parameters builds the following environment in the AWS Cloud. For more details about the architecture description, please refer to [architecture overview](https://docs.aws.amazon.com/solutions/latest/centralized-logging-with-opensearch/architecture-overview.html), and [architecture details](https://docs.aws.amazon.com/solutions/latest/centralized-logging-with-opensearch/architecture-details.html).

![Architecture](arch.png)

## Deployment

Please follow the [Implementation Guide](https://docs.aws.amazon.com/solutions/latest/centralized-logging-with-opensearch/) to deploy the solution in your AWS account.

## Customization

Please follow the [Customization Guide](CUSTOM_BUILD.md) for custom build.

## Collection of operational metrics

This solution collects anonymized operational metrics to help AWS improve the quality and features of the solution. For more information, including how to disable this capability, please see the [Implementation Guide](https://docs.aws.amazon.com/solutions/latest/centralized-logging-with-opensearch/reference.html).