{"id":15661175,"url":"https://github.com/nanmu42/k8s-eck-logging","last_synced_at":"2025-08-21T10:13:02.782Z","repository":{"id":70181207,"uuid":"220967415","full_name":"nanmu42/k8s-eck-logging","owner":"nanmu42","description":"Kubernetes cluster level logging solution, utilizing Elasticseach, Kibana and Fluent Bit.","archived":false,"fork":false,"pushed_at":"2020-02-15T09:04:08.000Z","size":14,"stargazers_count":19,"open_issues_count":0,"forks_count":7,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-30T23:51:11.383Z","etag":null,"topics":["eck","elasticsearch","fluentbit","k8s","kibana","kubernetes","logging","yaml"],"latest_commit_sha":null,"homepage":"https://nanmu.me/en/posts/2020/k8s-eck-logging/","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nanmu42.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-11-11T11:34:43.000Z","updated_at":"2024-04-12T02:45:41.000Z","dependencies_parsed_at":"2023-02-21T11:46:10.135Z","dependency_job_id":null,"html_url":"https://github.com/nanmu42/k8s-eck-logging","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nanmu42%2Fk8s-eck-logging","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nanmu42%2Fk8s-eck-logging/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nanmu42%2Fk8s-eck-logging/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nanmu42%2Fk8s-eck-logging/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nanmu42","download_url":"https://codeload.github.com/nanmu42/k8s-eck-logging/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252580112,"owners_count":21771265,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["eck","elasticsearch","fluentbit","k8s","kibana","kubernetes","logging","yaml"],"created_at":"2024-10-03T13:26:14.869Z","updated_at":"2025-05-05T21:34:01.267Z","avatar_url":"https://github.com/nanmu42.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# K8S ECK Logging\n\nThis walk-through guides you to setup an in-cluster Elasticsearch and Kibana suite, with cluster-level logging data gathered by Fluent Bit. You may access and search logs from every pod in cluster, as long as the workload in pod writes log to `stdout` or `stderr`.\n\n# Prerequisites\n\n* Kubernetes 1.11 or higher (minikube not working)\n* Predefined storage class called `hdd-ssd` (you may change it in `eck.yaml`)\n\n# Deployment Steps\n\nClone [this repo](https://github.com/nanmu42/k8s-eck-logging) to get necessary yaml files.\n\n## Elasticsearch and Kibana\n\n[Elastic Cloud on Kubernetes(ECK)](https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-overview.html) is now generally available. ECK makes it easy to deploy Elasticsearch and Kibana on k8s with various topology.\n\n* Deploy ECK\n\n```bash\nkubectl apply -f https://download.elastic.co/downloads/eck/1.0.1/all-in-one.yaml\n```\n\n* Create Namespace `logging`\n\n```bash\nkubectl create -f ./namespace.yml\n```\n\n* Deploy Elasticsearch and Kibana\n\n```bash\nkubectl create -f ./eck.yml\n```\n\n## Fluent Bit\n\nFluentBit runs as DaemonSet on every node in cluster, gathering logs from every workload. FluentBit attach metadata like pod name and label to logs delivered to Elasticsearch.\n\nWell-structured log(in JSON) can be searched/filtered by term in Elasticsearch.\n\n```bash\nkubectl create -f fluent-bit-service-account.yaml\nkubectl create -f fluent-bit-role.yaml\nkubectl create -f fluent-bit-role-binding.yaml\nkubectl create -f fluent-bit-configmap.yaml\nkubectl create -f fluent-bit-ds.yaml\n```\n\nAnd off you go.\n\n# Reference\n\n* [Elastic Cloud on Kubernetes](https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-quickstart.html)\n* [Kubernetes Logging with Fluent Bit](https://github.com/fluent/fluent-bit-kubernetes-logging)\n* [Fluent Bit Manual](https://docs.fluentbit.io/manual/output/elasticsearch)\n* [Enabling Native Realms on ECK](https://github.com/elastic/cloud-on-k8s/issues/2036#issuecomment-544838578)\n* [Fluent Bit: Elasticsearch output should probably not use a type (flb_type) ](https://github.com/fluent/fluent-bit/issues/1359#issuecomment-553228448)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnanmu42%2Fk8s-eck-logging","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnanmu42%2Fk8s-eck-logging","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnanmu42%2Fk8s-eck-logging/lists"}