{"id":37107913,"url":"https://github.com/nosinovacao/floki","last_synced_at":"2026-01-14T12:57:42.072Z","repository":{"id":57555332,"uuid":"203976720","full_name":"nosinovacao/floki","owner":"nosinovacao","description":"Tails logs from Kafka and pushes to Grafana Loki in an ordered manner","archived":false,"fork":false,"pushed_at":"2023-03-07T10:06:48.000Z","size":161,"stargazers_count":22,"open_issues_count":0,"forks_count":1,"subscribers_count":5,"default_branch":"master","last_synced_at":"2024-11-15T21:47:11.159Z","etag":null,"topics":["golang","grafana","kafka","kubernetes","logging","loki"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nosinovacao.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-08-23T10:23:05.000Z","updated_at":"2024-04-05T08:59:26.000Z","dependencies_parsed_at":"2024-06-20T05:46:07.952Z","dependency_job_id":"ef0ce145-21d4-4bbc-adc8-c2466cfb1090","html_url":"https://github.com/nosinovacao/floki","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/nosinovacao/floki","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nosinovacao%2Ffloki","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nosinovacao%2Ffloki/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nosinovacao%2Ffloki/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nosinovacao%2Ffloki/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nosinovacao","download_url":"https://codeload.github.com/nosinovacao/floki/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nosinovacao%2Ffloki/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28420815,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T10:47:48.104Z","status":"ssl_error","status_checked_at":"2026-01-14T10:46:19.031Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["golang","grafana","kafka","kubernetes","logging","loki"],"created_at":"2026-01-14T12:57:41.510Z","updated_at":"2026-01-14T12:57:42.060Z","avatar_url":"https://github.com/nosinovacao.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Floki\n[![](https://dockerbuildbadges.quelltext.eu/status.svg?organization=niccokunzmann\u0026repository=dockerhub-build-status-image)](https://hub.docker.com/r/nosinovacao/floki/builds/)  \n\n\u003e `tail -f \u003e loki = floki`\n\nFloki is a simple micro-service that aggregates [Kafka](https://kafka.apache.org/) logs, sorts them and pushes them to [Grafana Loki](https://github.com/grafana/loki). \n\n\u003c!-- TABLE OF CONTENTS --\u003e\n## Table of Contents\n\n* [About the Project](#about-the-project)\n* [Getting Started](#getting-started)\n  * [Usage](#usage)\n* [Roadmap](#roadmap)\n* [Contributing](#contributing)\n* [License](#license)\n\n\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n## About The Project\n![Floki Diagram](images/floki.png)\n\n[Loki](https://github.com/grafana/loki) has [Promtail](https://github.com/grafana/loki/tree/master/pkg/promtail) which is an agent that installs itself in every k8s cluster nodes and collects the pods logs and sends them to Loki. Since we use the [ELK Stack](https://www.elastic.co/pt/products/) in our infrastructure, each k8s node has the [Filebeat](https://www.elastic.co/pt/products/beats/filebeat) agent running for log collection, so by using Promtail, we are \neffectively duplicating the functionality. To avoid this, we have created Floki, which subscribes to our Kafka logging topics, orders the logs and sends them to Loki.\n\n\u003c!-- GETTING STARTED --\u003e\n## Getting Started\nTo run Floki, you need to have the [ELK Stack](https://www.elastic.co/pt/what-is/elk-stack) or other distributed logging system compatible with Kafka and also Loki installed in your infrastructure.\n\n### Usage\n```sh\ndocker run nosinovacao/floki \\\n   -lokiurl=\"http://\u003cloki_base_url\u003e/api/prom/push\" \\\n   -brokerList=\"\u003ckafka_broker_list\u003e\" \\\n   -topicPattern=\"^logging-*\"\n```\n\n\u003c!-- ROADMAP --\u003e\n## Roadmap\n\nSee the [open issues](https://github.com/nosinovacao/floki/issues) for a list of proposed features (and known issues).\n\n\n\n\u003c!-- CONTRIBUTING --\u003e\n## Contributing\n\nContributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are **greatly appreciated**.\n\n1. Fork the Project\n2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)\n3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)\n4. Push to the Branch (`git push origin feature/AmazingFeature`)\n5. Open a Pull Request\n\n\n\n\u003c!-- LICENSE --\u003e\n## License\n\nDistributed under the BSD-3-Clause License. See `LICENSE` for more information.\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnosinovacao%2Ffloki","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnosinovacao%2Ffloki","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnosinovacao%2Ffloki/lists"}