https://github.com/j3-signalroom/ccaf-housekeeping-python_lib
The CCAF Housekeeping Python Library is a CI/CD support tool designed to automate the teardown of a Flink table and its associated Kafka resources—such as topics and schemas—along with any long-running statements linked to it.
https://github.com/j3-signalroom/ccaf-housekeeping-python_lib
apache-flink confluent confluent-flink confluent-kafka confluent-schema-registry kafka
Last synced: 10 months ago
JSON representation
The CCAF Housekeeping Python Library is a CI/CD support tool designed to automate the teardown of a Flink table and its associated Kafka resources—such as topics and schemas—along with any long-running statements linked to it.
- Host: GitHub
- URL: https://github.com/j3-signalroom/ccaf-housekeeping-python_lib
- Owner: j3-signalroom
- License: mit
- Created: 2025-02-08T21:14:44.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-05T01:01:18.000Z (over 1 year ago)
- Last Synced: 2025-03-05T01:29:43.415Z (over 1 year ago)
- Topics: apache-flink, confluent, confluent-flink, confluent-kafka, confluent-schema-registry, kafka
- Language: Python
- Homepage: https://linkedin.com/in/jeffreyjonathanjennings
- Size: 199 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Confluent Cloud for Apache Flink (CCAF) Housekeeping Library for Python
The CCAF Housekeeping Python Library is a CI/CD support tool designed to automate the teardown of a Flink table and its associated Kafka resources—such as topics and schemas—along with any long-running statements linked to it. This robust automation guarantees that each deployment and test cycle is executed with exceptional consistency and reliability, paving the way for a dynamic and resilient application infrastructure.
> **Note:** _This library is in active development and is subject to change. It covers only the methods I have needed so far. If you need a method that is not covered, please feel free to open an issue or submit a pull request._
**Table of Contents**
- [**1.0 Architecture**](#10-architecture)
* [**1.1 Architecture Design Records (ADRs)**](#11-architecture-design-records-adrs)
- [**2.0 Installation**](#20-installation)
+ [**3.0 Resources**](#20-resources)
* [**3.1 Managing Flink SQL Statements**](#31-managing-flink-sql-statements)
* [**3.2 Other**](#32-other)
## 1.0 Architecture
### 1.1 Architecture Design Records (ADRs)
* [001 Architectural Design Record (ADR): CCAF Housekeeping Library](https://github.com/j3-signalroom/ccaf-housekeeping-python_lib/blob/main/.blog/adr_001.md)
## **2.0 Installation**
Install the Confluent Cloud for Apache Flink (CCAF) Housekeeping Python Library using **`pip`**:
```bash
pip install ccaf-housekeeping-python-lib
```
Or, using [**`uv`**](https://docs.astral.sh/uv/):
```bash
uv add ccaf-housekeeping-python-lib
```
## 3.0 Resources
### 3.1 Managing Flink SQL Statements
* [Monitor and Manage Flink SQL Statements in Confluent Cloud for Apache Flink](https://docs.confluent.io/cloud/current/flink/operate-and-deploy/monitor-statements.html#)
* [DROP TABLE Statement in Confluent Cloud for Apache Flink](https://docs.confluent.io/cloud/current/flink/reference/statements/drop-table.html#:~:text=Dropping%20a%20table%20permanently%20deletes,will%20transition%20to%20DEGRADED%20status._)
### 3.2 Other
* [Confluent Cloud Clients Python Library](https://github.com/j3-signalroom/cc-clients-python_lib)