https://github.com/chezou/digdaglog2sql

Extract SQLs from digdag log
https://github.com/chezou/digdaglog2sql

Last synced: 3 months ago
JSON representation

Extract SQLs from digdag log

• Host: GitHub
• URL: https://github.com/chezou/digdaglog2sql
• Owner: chezou
• License: apache-2.0
• Created: 2022-05-06T00:58:14.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-04-18T00:00:15.000Z (9 months ago)
• Last Synced: 2024-05-01T23:58:41.741Z (9 months ago)
• Language: Python
• Size: 81.1 KB
• Stars: 4
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# digdaglog2sql

## Install

```sh

pip install --user digdaglog2sql

```

or,

```sh

$ python -m venv .venv

$ source .venv/bin/activate

(.venv)$ pip install digdaglog2sql

```

## Usage

```sh

$ digdaglog2sql --help

Usage: digdaglog2sql [OPTIONS]

Input log by file:

  --input FILENAME               Input file name of a workflow log. Use - for

                                 STDIN.

Download log by Session ID:

  --session-id INTEGER           Session ID of the target workflow.

  --site [us|jp|eu01|ap02|ap03]  Treasure Workflow site name.  [default: us]

  --endpoint TEXT                Digdag server endpoint.

  --http                         Enforce to use http schema.

Output:

  --output FILENAME              Output file name. Use - for STDOUT.  [required]

Other options:

  --drop-cdp-db                  If true, drop cdp_audience_xxx DB name.

  --help                         Show this message and exit.

Constraints:

  {--input, --session-id}  exactly 1 required

  {--site, --endpoint}     exactly 1 required if --session-id is set

  {--site, --http}         mutually exclusive

```

You can use log file on local environment.

```sh

digdaglog2sql --input workflow-log.txt --output output.sql

```

Or, you can use Session ID of Treasure Workflow.

```sh

digdaglog2sql --session-id 12345 --site us --output output.sql

```

Ensure set `TD_API_KEY` into environment variable.