{"id":18336026,"url":"https://github.com/zicat/tributary","last_synced_at":"2025-04-06T04:34:50.063Z","repository":{"id":166236594,"uuid":"621336251","full_name":"zicat/tributary","owner":"zicat","description":"tributary","archived":false,"fork":false,"pushed_at":"2024-10-17T05:57:30.000Z","size":2600,"stargazers_count":5,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-10-19T06:30:38.515Z","etag":null,"topics":["big-data","flume","java","kafka"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zicat.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-30T13:10:54.000Z","updated_at":"2024-10-17T05:57:22.000Z","dependencies_parsed_at":"2024-06-03T05:12:19.828Z","dependency_job_id":"af255981-59a8-4d60-b3bb-607862124378","html_url":"https://github.com/zicat/tributary","commit_stats":null,"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zicat%2Ftributary","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zicat%2Ftributary/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zicat%2Ftributary/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zicat%2Ftributary/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zicat","download_url":"https://codeload.github.com/zicat/tributary/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223238121,"owners_count":17111359,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["big-data","flume","java","kafka"],"created_at":"2024-11-05T20:05:37.298Z","updated_at":"2024-11-05T20:05:37.870Z","avatar_url":"https://github.com/zicat.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Welcome to Tributary\n\nTributary is a reliable, stateless, fault-tolerance service for efficiently collecting and moving\nhuge amounts of\nrecords. It has a simple and flexible architecture based on streaming records flows.\n\n![image](doc/picture/tributary.png)\n\n# Why Choose Tributary\n\nTributary is designed to solve the reliability and isolation with multiple sinks consuming one\nchannel.\nFor example, sink data to HDFS and Kafka from the same source for batching and\nstreaming computing requirement.\n\nPersistently receiving and forwarding data to external systems while\nachieving mutual fault isolation is a highly challenging task.\n\nThe current mainstream solution, such as [Apache Flume](https://flume.apache.org/), adopts a write\namplification strategy to address isolation issues. Specifically, the received data is stored in\nmultiple channels, and each sink consumes a separate channel.\n\nTributary adopts a read amplification to address isolation issues and supports multiple sinks\nconsuming the same channel based on GroupOffset.\n\nThe benefits of reading amplification not only ensure fault isolation, but also greatly reduce the\noverhead, especially when the data volume and number of sinks increase.\n\n## Documentation\n\n[Tributary User Guide](doc/user_guide.md)\n\n[Tributary Design Guide](doc/tributary_design_guide.md)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzicat%2Ftributary","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzicat%2Ftributary","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzicat%2Ftributary/lists"}