{"id":19565756,"url":"https://github.com/pravega/flink-connectors","last_synced_at":"2025-04-09T16:20:15.641Z","repository":{"id":20789768,"uuid":"86828501","full_name":"pravega/flink-connectors","owner":"pravega","description":"Apache Flink connectors for Pravega.","archived":false,"fork":false,"pushed_at":"2024-03-04T06:54:16.000Z","size":1928,"stargazers_count":94,"open_issues_count":26,"forks_count":67,"subscribers_count":26,"default_branch":"master","last_synced_at":"2025-04-09T16:20:06.870Z","etag":null,"topics":["flink","pravega","stream-processing"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pravega.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":".github/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-03-31T14:33:11.000Z","updated_at":"2025-02-07T03:38:14.000Z","dependencies_parsed_at":"2023-10-11T12:33:28.308Z","dependency_job_id":"17625a27-65d4-4e75-9b8e-45d7c77401b2","html_url":"https://github.com/pravega/flink-connectors","commit_stats":{"total_commits":302,"total_committers":38,"mean_commits":7.947368421052632,"dds":0.8079470198675497,"last_synced_commit":"8ff86aaf760638b057b39a4b34025c4f642a2f45"},"previous_names":[],"tags_count":39,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pravega%2Fflink-connectors","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pravega%2Fflink-connectors/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pravega%2Fflink-connectors/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pravega%2Fflink-connectors/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pravega","download_url":"https://codeload.github.com/pravega/flink-connectors/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248065281,"owners_count":21041872,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["flink","pravega","stream-processing"],"created_at":"2024-11-11T05:28:19.888Z","updated_at":"2025-04-09T16:20:15.617Z","avatar_url":"https://github.com/pravega.png","language":"Java","funding_links":[],"categories":["大数据"],"sub_categories":[],"readme":"\u003c!--\nCopyright Pravega Authors.\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n    http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n--\u003e\n\n# Pravega Flink Connectors\n\n[![Build Status](https://github.com/pravega/flink-connectors/actions/workflows/build.yml/badge.svg)](https://github.com/pravega/flink-connectors/actions/workflows/build.yml?query=branch%3Amaster) [![License](https://img.shields.io/github/license/pravega/flink-connectors)](https://github.com/pravega/flink-connectors/blob/master/LICENSE) [![Downloads](https://img.shields.io/github/downloads/pravega/flink-connectors/total)](https://github.com/pravega/flink-connectors/releases) [![Codecov](https://img.shields.io/codecov/c/github/pravega/flink-connectors)](https://app.codecov.io/gh/pravega/flink-connectors/)\n\nThis repository implements connectors to read and write [Pravega](http://pravega.io/) Streams with [Apache Flink](http://flink.apache.org/) stream processing framework.\n\nThe connectors can be used to build end-to-end stream processing pipelines (see [Samples](https://github.com/pravega/pravega-samples)) that use Pravega as the stream storage and message bus, and Apache Flink for computation over the streams.\n\n## Features \u0026 Highlights\n\n- **Exactly-once processing guarantees** for both Reader and Writer, supporting **end-to-end exactly-once processing pipelines**\n- Seamless integration with Flink's checkpoints and savepoints.\n- Parallel Readers and Writers supporting high throughput and low latency processing.\n- Table API support to access Pravega Streams for both **Batch** and **Streaming** use case.\n\n## Compatibility Matrix\n\nThe [master](https://github.com/pravega/flink-connectors) branch will always have the most recent\nsupported versions of Flink and Pravega.\n\n| Git Branch                                                                          | Pravega Version | Flink Version | Status            | Artifact Link                                                                        |\n|-------------------------------------------------------------------------------------|-----------------|---------------|-------------------|--------------------------------------------------------------------------------------|\n| [master](https://github.com/pravega/flink-connectors)                               | 0.14            | 1.18          | Under Development | https://github.com/pravega/flink-connectors/packages/19676441                        |\n| [r0.14-flink1.17](https://github.com/pravega/flink-connectors/tree/r0.14-flink1.17) | 0.14\t\t| 1.17\t\t| Under Development | https://github.com/pravega/flink-connectors/packages/1441637\t\t\t   |\n| [r0.14-flink1.16](https://github.com/pravega/flink-connectors/tree/r0.14-flink1.16) | 0.14            | 1.16          | Under Development | https://github.com/pravega/flink-connectors/packages/1704300                         |\n| [r0.13](https://github.com/pravega/flink-connectors/tree/r0.13)                     | 0.13            | 1.16          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.16_2.12/0.13.0/ |\n| [r0.13-flink1.15](https://github.com/pravega/flink-connectors/tree/r0.13-flink1.15) | 0.13            | 1.15          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.15_2.12/0.13.0/ |\n| [r0.13-flink1.14](https://github.com/pravega/flink-connectors/tree/r0.13-flink1.14) | 0.13            | 1.14          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.14_2.12/0.13.0/ |\n| [r0.12](https://github.com/pravega/flink-connectors/tree/r0.12)                     | 0.12            | 1.15          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.15_2.12/0.12.0/ |\n| [r0.12-flink1.14](https://github.com/pravega/flink-connectors/tree/r0.12-flink1.14) | 0.12            | 1.14          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.14_2.12/0.12.0/ |\n| [r0.12-flink1.13](https://github.com/pravega/flink-connectors/tree/r0.12-flink1.13) | 0.12            | 1.13          | Released          | https://repo1.maven.org/maven2/io/pravega/pravega-connectors-flink-1.13_2.12/0.12.0/ |\n\n## How to build\n\nBuilding the connectors from the source is only necessary when we want to use or contribute to the latest (unreleased) version of the Pravega Flink connectors.\n\nTo build the project, Java version 11 is required and the repository needs to be checkout via `git clone https://github.com/pravega/flink-connectors.git`.\n\n\u003e The connector project is linked to a specific version of Pravega, based on the `pravegaVersion` field in the `gradle.properties`.\n\nAfter cloning the repository, the project can be built (excluding tests) by running the below command in the project root directory flink-connectors.\n\n```./gradlew clean build -x test```\n\n## How to use\n\nCheck out documents [here](https://github.com/pravega/flink-connectors/blob/master/documentation/src/docs/dev-guide.md) to learn how to build your own applications using Flink connector for Pravega. Also watch out that the Java version required to run the connector is either 8 or 11.\n\nMore examples on how to use the connectors with Flink application can be found in [Pravega Samples](https://github.com/pravega/pravega-samples/tree/master/flink-connector-examples) repository.\n\n## Support\n\nDon't hesitate to ask! Contact the developers and community on [Slack](https://pravega-io.slack.com/) ([signup](https://pravega-slack-invite.herokuapp.com/)) if you need any help. Open an issue if you found a bug on [Github Issues](https://github.com/pravega/flink-connectors/issues).\n\n## About\n\nFlink connectors for Pravega is 100% open source and community-driven. All components are available\nunder [Apache 2 License](https://www.apache.org/licenses/LICENSE-2.0.html) on GitHub.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpravega%2Fflink-connectors","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpravega%2Fflink-connectors","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpravega%2Fflink-connectors/lists"}