{"id":16961052,"url":"https://github.com/ricsanfre/fluentd-aggregator","last_synced_at":"2025-04-11T22:10:54.030Z","repository":{"id":39492603,"uuid":"505454610","full_name":"ricsanfre/fluentd-aggregator","owner":"ricsanfre","description":"Fluentd docker image for aggregation layer. Build with plugins to forward logs to elasticsearch, kafka, etc.","archived":false,"fork":false,"pushed_at":"2024-09-13T09:40:13.000Z","size":24,"stargazers_count":2,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-25T18:08:24.457Z","etag":null,"topics":["aggregator","docker-image","fluentd"],"latest_commit_sha":null,"homepage":"https://hub.docker.com/r/ricsanfre/fluentd-aggregator","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ricsanfre.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-06-20T13:32:39.000Z","updated_at":"2024-09-13T09:40:17.000Z","dependencies_parsed_at":"2024-09-13T21:36:48.515Z","dependency_job_id":null,"html_url":"https://github.com/ricsanfre/fluentd-aggregator","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ricsanfre%2Ffluentd-aggregator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ricsanfre%2Ffluentd-aggregator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ricsanfre%2Ffluentd-aggregator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ricsanfre%2Ffluentd-aggregator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ricsanfre","download_url":"https://codeload.github.com/ricsanfre/fluentd-aggregator/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248487695,"owners_count":21112191,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aggregator","docker-image","fluentd"],"created_at":"2024-10-13T22:50:51.881Z","updated_at":"2025-04-11T22:10:54.001Z","avatar_url":"https://github.com/ricsanfre.png","language":"Dockerfile","funding_links":[],"categories":[],"sub_categories":[],"readme":"Fluentd log aggregator\n=========\n\nFluentd customized docker image for being deployed as log aggregator in Fluentbit/Fluentd forwarder/aggregation architecture pattern.\n\nBased on official [fluentd docker image](https://github.com/fluent/fluentd-docker-image), plugins have been added and default configuration has been included.\n\n\nPlugins Added\n------------\n\nThe following plugins has been added to the default fluentd image\n- fluent-plugin-elasticsearch: ES as backend for routing the logs\n  \u003e elasticsearch-xpack gem need to be installaed as a dependency when using elasticsearch ILM policies.\n- fluent-plugin-prometheus: Enabling prometheus monitoring\n- fluent-plugin-record-modifier: record_modifier filter faster and lightweight than embedded transform_record filter.\n- fluent-plugin-grafana-loki: Loki as backend for routing the logs\n\n## Elasticsearh plugin\n\n When configuring fluent-plugin-elasticsearch, a specific sniffer class need to be configured for implementing reconnection logic to ES(`sniffer_class_name Fluent::Plugin::ElasticsearchSimpleSniffer`). See plugin documentation [fluent-plugin-elasticsearh: Sniffer Class Name](https://github.com/uken/fluent-plugin-elasticsearch#sniffer-class-name).\n\n The path to the sniffer class need to be passed as parameter to `fluentd` command (-r option). Docker's `entrypoint.sh` has been updated to automatically provide the path to the sniffer class.\n\n\nDefault Fluentd Configuration\n--------------\n\nFluentd is configured:\n\n - to export Prometheus metrics. See [fluentd documentation] (https://docs.fluentd.org/monitoring-fluentd/monitoring-prometheus)\n\n - to collect logs from forwarders (Fluentbit/Fluentd in forwarding mode)\n\n - to route all logs to Elasticsearch backend\n\n\nMulti-architecture build\n--------------\nGithub actions have been configured to automatically build amd64 and arm64 docker images.\n\nThis images are available in docker hub https://hub.docker.com/r/ricsanfre/fluentd-aggregator\n\nHow to use this image\n--------------\n\nTo create an aggregator that collects logs from other forwarders\n\ndocker run -d -p 24224:24224 -p 24224:24224/udp ricsanfre/fluentd-aggregator:latest\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fricsanfre%2Ffluentd-aggregator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fricsanfre%2Ffluentd-aggregator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fricsanfre%2Ffluentd-aggregator/lists"}