{"id":13562063,"url":"https://github.com/2-alchemists/krossboard-data-processor","last_synced_at":"2025-04-03T18:32:10.004Z","repository":{"id":37082098,"uuid":"255989125","full_name":"2-alchemists/krossboard-data-processor","owner":"2-alchemists","description":"Data Collector \u0026 Processing for Krossboard - A Leading Multi-Cluster, Cross-Cloud \u0026 Cross-Distribution Kubernetes Usage Accounting \u0026 Analytics. Actively tested against Amazon EKS, Microsoft AKS, Google GKE, Red Hat OpenShift, \u0026 vanilla distros.","archived":false,"fork":false,"pushed_at":"2023-03-06T16:58:44.000Z","size":66162,"stargazers_count":3,"open_issues_count":16,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-11-04T14:42:35.135Z","etag":null,"topics":["cloud","cost-optimization","kubernetes"],"latest_commit_sha":null,"homepage":"https://krossboard.app/","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/2-alchemists.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":"CODE-OF-CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2020-04-15T17:26:27.000Z","updated_at":"2023-06-14T21:58:26.000Z","dependencies_parsed_at":"2024-01-14T03:45:06.883Z","dependency_job_id":"4dfa1ee9-8123-49a4-95ec-5947b9d8d8ef","html_url":"https://github.com/2-alchemists/krossboard-data-processor","commit_stats":{"total_commits":421,"total_committers":5,"mean_commits":84.2,"dds":"0.27078384798099764","last_synced_commit":"778af610c382254aec55a351f8791f2bf207a801"},"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/2-alchemists%2Fkrossboard-data-processor","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/2-alchemists%2Fkrossboard-data-processor/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/2-alchemists%2Fkrossboard-data-processor/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/2-alchemists%2Fkrossboard-data-processor/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/2-alchemists","download_url":"https://codeload.github.com/2-alchemists/krossboard-data-processor/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247056769,"owners_count":20876457,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloud","cost-optimization","kubernetes"],"created_at":"2024-08-01T13:01:04.149Z","updated_at":"2025-04-03T18:32:09.415Z","avatar_url":"https://github.com/2-alchemists.png","language":"Go","funding_links":[],"categories":["Go"],"sub_categories":[],"readme":"![](krossboard-architecture-thumbnail.png)\n\n![license](https://img.shields.io/github/license/2-alchemists/krossboard-data-processor.svg?label=License\u0026style=for-the-badge)\n[![lint-test-build](\u003chttps://img.shields.io/github/actions/workflow/status/2-alchemists/krossboard-data-processor/build.yml?label=lint-test-build\u0026logo=GitHub\u0026style=for-the-badge\u003e)](https://github.com/2-alchemists/krossboard-data-processor/actions/workflows/build.yml)\n\n\u003c!--- \n![Build AWS images](https://github.com/2-alchemists/krossboard-data-processor/workflows/build-aws-images/badge.svg)\n![Build GCP images](https://github.com/2-alchemists/krossboard-data-processor/workflows/build-gcp-images/badge.svg)\n![Build Azure images](https://github.com/2-alchemists/krossboard-data-processor/workflows/build-azure-images/badge.svg)\n--\u003e \n\n\n---\n\n# Overview\n`krossboard-data-processor` is the backend component of [Krossboard](https://github.com/2-alchemists/krossboard).\n\nKey features of Krossboard:\n\n * **Multi-Kubernetes Data Collection**: Periodically collecting raw metrics related to containers, pods and nodes from several Kubernetes source clusters. By design, the data collection period is 5 minutes.\n * **Powerful Analytics Processing**: Internally process raw metrics to produce insightful Kubernetes usage accounting and analytics metrics. By design, these analytics metrics are handled on a hourly-basis, for every namespace, cluster, and also globally.\n * **Insightful Usage Accounting**: Periodically process usage accounting, for each cluster and cluster's namespace. In the current implementation, the accounting is handled by design for the following period:  daily for the 14 last days, monthly for the 12 last months.\n * **REST API**: Exposes the generated analytics data to third-party systems. For example, [Krossboard UI](https://github.com/2-alchemists/krossboard-ui) consumes this API to produce its charts and dashboards. \n * **Easy to deploy**: Krossboard can be easily deployed through a virtual machine on-premises or on public clouds. In a close future, it's expected to be deployed through a Kubernetes operator. It can be set up to automatically discover and handle Kubernetes clusters backed by Amazon EKS, Google GKE, Microsoft AKS.  \n\n![](krossboard-architecture-overview.png)\n\n\n# Getting Started\n\n* [Setup Krossboard for Multi-Cloud or Cross-Kubernetes Distributions](https://krossboard.app/docs/60_deploy-for-cross-cloud-and-on-premises-kubernetes/)\n* [Setup Krossboard for Amazon EKS](https://krossboard.app/docs/50_deploy-for-amazon-eks/)\n* [Setup Krossboard for Azure AKS](https://krossboard.app/docs/30_deploy-for-azure-aks/)\n* [Setup Krossboard for Google GKE](https://krossboard.app/docs/20_deploy-for-google-gke/)\n\n# Open to Contributions\nWe encourage feedback and always make our best to handle any issues as fast as possible. \n\nDon't hesitate to submit a issue or make a feature request.\n\nAll contributions, including, code and documentation, are accepted under the terms of [GNU Affero General Public License](LICENSE.md).\n\nRead the [code of conduct](CODE-OF-CONDUCT.md) to learn more about our contribution guideline. \n\n[![StackShare](http://img.shields.io/badge/tech-stack-0690fa.svg?style=flat)](https://stackshare.io/2alchemists/krossboard)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F2-alchemists%2Fkrossboard-data-processor","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F2-alchemists%2Fkrossboard-data-processor","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F2-alchemists%2Fkrossboard-data-processor/lists"}