Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/politools/airflow-pianka-sh
https://github.com/politools/airflow-pianka-sh
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/politools/airflow-pianka-sh
- Owner: politools
- License: mit
- Created: 2021-02-06T13:01:35.000Z (almost 4 years ago)
- Default Branch: master
- Last Pushed: 2021-02-06T13:01:50.000Z (almost 4 years ago)
- Last Synced: 2024-08-02T02:07:32.857Z (6 months ago)
- Language: Shell
- Size: 10.7 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-apache-airflow - pianka.sh - Missing command in the gcloud tool. This tool facilitates some administrative tasks. (Cloud Composer resources)
README
# pianka.sh
A little script that helps you manage your Cloud Composer instances. This just fills gapps in the [gcloud](https://cloud.google.com/sdk/docs/downloads-versioned-archives) tool.
## Installation
```
curl https://github.com/PolideaInternal/airflow-pianka-sh/blob/master/pianka.sh > ./pianka.sh
chmod +x ./pianka.sh
```
Optionally, you can also install this script globally. This will allow you to use this script from
any location.
```
mv pianka.sh /usr/local/bin/pianka.sh
```
## Feature
* Open shell access to Airflow's worker.
* Run arbitrary command on the Airflow worker.
* Starts the MySQL console.
* More features coming soon
## Known issues
Cloud Composer instances using private IP are not supported
## Usage
````
Usage: pianka.sh [-h] [-C] [-L] [-v]
Help manage Cloud Composer instances
The script is adapted to work properly when added to the PATH variable. This will allow you to use
this script from any location.
Flags:
-h, --help
Shows this help message.
-C, --composer-name
Composer instance used to run the operations on. Defaults to
-L, --composer-location
Composer locations. Defaults to
-v, --verbose
Add even more verbosity when running the script.
These are supported commands used in various situations:
shell
Open shell access to Airflow's worker. This allows you to test commands in the context of
the Airflow instance.
info
Print basic information about the environment.
run
Run arbitrary command on the Airflow worker.
Example:
If you want to list currnet running process, run:
pianka.sh run -- ps -aux
If you want to list DAGs, run:
pianka.sh run -- airflow list_dags
mysql
Starts the MySQL console.
Additional parameters are passed to the mysql client.
Example:
If you want to execute "SELECT 123" query, run:
pianka.sh mysql -- --execute="SELECT 123"
mysqltunnel
Starts the tunnel to MySQL database.
This allows you to connect to the database with any tool, including your IDE.
mysqldump
Dumps database or selected table(s).
Additional parameters are passed to the mysqldump.
To dump "connection" table to "connection.sql" file, run:
pianka.sh mysqldump -- --column-statistics=0 connection > connection.sql
Reference:
https://dev.mysql.com/doc/refman/8.0/en/mysqldump.html
help
Print help
````