{"id":16822339,"url":"https://github.com/okushchenko/fluent-plugin-docker-journald-concat","last_synced_at":"2025-07-12T17:37:02.442Z","repository":{"id":56846914,"uuid":"105542347","full_name":"okushchenko/fluent-plugin-docker-journald-concat","owner":"okushchenko","description":"Fluentd Filter plugin to concatenate partial log messages generated by Docker daemon with Journald logging driver","archived":false,"fork":false,"pushed_at":"2017-10-02T20:48:53.000Z","size":15,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-06-15T22:31:12.610Z","etag":null,"topics":["docker","fluentd","fluentd-filter-plugin","fluentd-plugin","journald","systemd"],"latest_commit_sha":null,"homepage":null,"language":"Ruby","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/okushchenko.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-10-02T14:12:15.000Z","updated_at":"2024-04-21T13:18:31.000Z","dependencies_parsed_at":"2022-08-31T07:51:27.378Z","dependency_job_id":null,"html_url":"https://github.com/okushchenko/fluent-plugin-docker-journald-concat","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/okushchenko/fluent-plugin-docker-journald-concat","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/okushchenko%2Ffluent-plugin-docker-journald-concat","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/okushchenko%2Ffluent-plugin-docker-journald-concat/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/okushchenko%2Ffluent-plugin-docker-journald-concat/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/okushchenko%2Ffluent-plugin-docker-journald-concat/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/okushchenko","download_url":"https://codeload.github.com/okushchenko/fluent-plugin-docker-journald-concat/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/okushchenko%2Ffluent-plugin-docker-journald-concat/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265026139,"owners_count":23699896,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","fluentd","fluentd-filter-plugin","fluentd-plugin","journald","systemd"],"created_at":"2024-10-13T11:03:30.577Z","updated_at":"2025-07-12T17:37:02.414Z","avatar_url":"https://github.com/okushchenko.png","language":"Ruby","funding_links":[],"categories":[],"sub_categories":[],"readme":"# fluent-plugin-docker-journald-concat\n\n[![Gem Version](https://badge.fury.io/rb/fluent-plugin-docker-journald-concat.svg)](https://badge.fury.io/rb/fluent-plugin-docker-journald-concat)\n\nFluentd Filter plugin to concatenate partial log messages generated by Docker daemon with Journald logging driver\n\n## Requirements\n\n| fluent-plugin-docker-journald-concat | fluentd    | ruby   |\n|--------------------------------------|------------|--------|\n| \u003e= 0.1.3                             | \u003e= v0.14.0 | \u003e= 2.1 |\n\n## Installation\n\nAdd this line to your application's Gemfile:\n\n```ruby\ngem 'fluent-plugin-docker-journald-concat'\n```\n\nAnd then execute:\n\n    $ bundle\n\nOr install it yourself as:\n\n    $ gem install fluent-plugin-docker-journald-concat\n\n## Configuration\n\n**key**\n\nThe key to be concatenated for partial events.\nDefault value is `\"message\"`.\n\n**match\\_key**\n\nThe key which indicates a partial event.\nDefault value is `\"container_partial_message\"`.\n\n**stream\\_identity\\_key**\n\nThe key to determine which stream an event belongs to.\nDefault value is `\"container_id\"`.\n\n**flush\\_interval**\n\nThe number of seconds after which the last received event will be flushed.\nIf specified 0, wait for next line forever.\nDefault value is `\"60\"`.\n\n**timeout\\_label**\n\nThe label assigned to timed out events.\nDefault value is `\"nil\"`.\n\n## Usage\n\nInsert this into your Fluentd config to get started.\n\n```aconf\n\u003cfilter docker.**\u003e\n  @type docker_journald_concat\n\u003c/filter\u003e\n```\n\nThe full Fluentd config example with Systemd Journal input.\n\n```aconf\n\u003csource\u003e\n  @type systemd\n  tag docker\n  path /var/log/journal\n  read_from_head true\n  filters [{ \"_TRANSPORT\": \"journal\", \"_COMM\": \"dockerd\" }]\n  \u003cstorage\u003e\n    @type local\n    persistent true\n    path /tmp/journal.pos\n  \u003c/storage\u003e\n  \u003centry\u003e\n    field_map {\n      \"_SOURCE_REALTIME_TIMESTAMP\": \"timestamp\",\n      \"_HOSTNAME\": \"hostname\",\n      \"PRIORITY\": \"priority\",\n      \"MESSAGE\": \"message\",\n      \"CONTAINER_NAME\": \"container_name\",\n      \"CONTAINER_ID\": \"container_id\",\n      \"CONTAINER_PARTIAL_MESSAGE\": \"container_partial_message\"\n    }\n    field_map_strict true\n  \u003c/entry\u003e\n\u003c/source\u003e\n\n\u003cfilter docker.**\u003e\n  @type record_modifier\n  \u003crecord\u003e\n    # {\"6\" =\u003e \"stdout\", \"3\" =\u003e \"stderr\"}\n    source ${record[\"priority\"] == \"6\" ? \"stdout\" : \"stderr\"}\n    timestamp ${record[\"timestamp\"].to_i / 1000}\n  \u003c/record\u003e\n  remove_keys priority\n\u003c/filter\u003e\n\n\u003cfilter docker.**\u003e\n  @type docker_journald_concat\n\u003c/filter\u003e\n\n\u003cmatch docker.**\u003e\n  @type stdout\n\u003c/match\u003e\n```\n\nYou can handle timeout events and remaining buffers on shutdown of this plugin.\n\n```aconf\n\u003clabel @ERROR\u003e\n  \u003cmatch docker.log\u003e\n    @type file\n    path /path/to/error.log\n  \u003c/match\u003e\n\u003c/label\u003e\n```\n\nHandle timed out log lines the same as normal logs.\n\n```aconf\n\u003cfilter **\u003e\n  @type docker_journald_concat\n  timeout_label @NORMAL\n\u003c/filter\u003e\n\n\u003cmatch **\u003e\n  @type relabel\n  @label @NORMAL\n\u003c/match\u003e\n\n\u003clabel @NORMAL\u003e\n  \u003cmatch **\u003e\n    @type stdout\n  \u003c/match\u003e\n\u003c/label\u003e\n```\n\n## Contributing\n\n1. Fork it\n2. Create your feature branch (`git checkout -b my-new-feature`)\n3. Commit your changes (`git commit -am 'Add some feature'`)\n4. Push to the branch (`git push origin my-new-feature`)\n5. Create new Pull Request\n\n## License\n\nThe gem is available as open source under the terms of the [MIT License](http://opensource.org/licenses/MIT).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fokushchenko%2Ffluent-plugin-docker-journald-concat","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fokushchenko%2Ffluent-plugin-docker-journald-concat","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fokushchenko%2Ffluent-plugin-docker-journald-concat/lists"}