{"id":18521834,"url":"https://github.com/gjbae1212/fluent-bit-pubsub","last_synced_at":"2025-04-09T09:33:34.904Z","repository":{"id":57534908,"uuid":"180966761","full_name":"gjbae1212/fluent-bit-pubsub","owner":"gjbae1212","description":"FluentBit output plugin for google pubsub.","archived":false,"fork":false,"pushed_at":"2024-07-12T04:39:45.000Z","size":34860,"stargazers_count":7,"open_issues_count":3,"forks_count":19,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-24T04:50:53.313Z","etag":null,"topics":["fluent-bit","fluentd","golang","google-pubsub"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gjbae1212.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-04-12T08:38:45.000Z","updated_at":"2025-02-24T10:59:50.000Z","dependencies_parsed_at":"2024-06-20T08:29:26.787Z","dependency_job_id":null,"html_url":"https://github.com/gjbae1212/fluent-bit-pubsub","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gjbae1212%2Ffluent-bit-pubsub","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gjbae1212%2Ffluent-bit-pubsub/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gjbae1212%2Ffluent-bit-pubsub/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gjbae1212%2Ffluent-bit-pubsub/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gjbae1212","download_url":"https://codeload.github.com/gjbae1212/fluent-bit-pubsub/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248012871,"owners_count":21033256,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fluent-bit","fluentd","golang","google-pubsub"],"created_at":"2024-11-06T17:27:53.874Z","updated_at":"2025-04-09T09:33:29.887Z","avatar_url":"https://github.com/gjbae1212.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# fluent-bit output plugin for google pubsub\n\n\u003cp align=\"left\"\u003e    \n  \u003ca href=\"https://circleci.com/gh/gjbae1212/fluent-bit-pubsub/tree/master\"\u003e\u003cimg src=\"https://circleci.com/gh/gjbae1212/fluent-bit-pubsub/tree/master.svg?style=svg\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://hits.seeyoufarm.com\"/\u003e\u003cimg src=\"https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2Fgjbae1212%2Ffluent-bit-pubsub\"/\u003e\u003c/a\u003e\n  \u003ca href=\"/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/badge/license-MIT-GREEN.svg\" alt=\"license\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://goreportcard.com/report/github.com/gjbae1212/fluent-bit-pubsub\"\u003e\u003cimg src=\"https://goreportcard.com/badge/github.com/gjbae1212/fluent-bit-pubsub\" alt=\"Go Report Card\" /\u003e\u003c/a\u003e\n  \u003ca href=\"https://codecov.io/gh/gjbae1212/fluent-bit-pubsub\"\u003e\u003cimg src=\"https://codecov.io/gh/gjbae1212/fluent-bit-pubsub/branch/master/graph/badge.svg\"/\u003e\u003c/a\u003e        \n\u003c/p\u003e\n\nThis plugin is used to publish data to queue in google pubsub. \n\nYou could easily use it.\n\n## Build\nA bin directory already has been made binaries for mac, linux.\n\nIf you should directly make binaries for mac, linux\n```bash\n# local machine binary\n$ bash make.sh build\n\n# Your machine is mac, and if you should do to retry cross compiling for linux.\n# A command in below is required a docker.  \n$ bash make.sh build_linux\n```\n\n## Usage\n### configuration options for fluent-bit.conf\n| Key           | Description                                    | Default        |\n| ----------------|------------------------------------------------|----------------|\n| Project         | google cloud project id | NONE(required) |\n| Topic           | google pubsub topic name | NONE(required) |\n| JwtPath         | jwt file path for accessible google cloud project | NONE(required) |\n| Debug           | print debug log | false(optional) |\n| Timeout         | the maximum time that the client will attempt to publish a bundle of messages. (millsecond) | 60000 (optional)|\n| DelayThreshold  | publish a non-empty batch after this delay has passed. (millsecond) | 1  |\n| ByteThreshold   | publish a batch when its size in bytes reaches this value. | 1000000 |\n| CountThreshold  | publish a batch when it has been reached count of messages. | 100  |\n\n### Example fluent-bit.conf\n```conf\n[Output]\n    Name pubsub\n    Match *\n    Project your-project(custom)\n    Topic your-topic-name(custom)\n    Jwtpath your-jwtpath(custom)    \n```\n\n### Example exec\n```bash\n$ fluent-bit -c [your config file] -e pubsub.so \n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgjbae1212%2Ffluent-bit-pubsub","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgjbae1212%2Ffluent-bit-pubsub","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgjbae1212%2Ffluent-bit-pubsub/lists"}