https://github.com/tuancamtbtx/py-datalake

Python Lib to build and process data in Datalake - Cloud Function, Cloud Run, Lambda
https://github.com/tuancamtbtx/py-datalake

mage-ai prefect python

Last synced: 4 months ago
JSON representation

Python Lib to build and process data in Datalake - Cloud Function, Cloud Run, Lambda

• Host: GitHub
• URL: https://github.com/tuancamtbtx/py-datalake
• Owner: tuancamtbtx
• Created: 2024-06-14T03:26:11.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-06-26T14:35:35.000Z (12 months ago)
• Last Synced: 2025-01-02T20:19:18.199Z (5 months ago)
• Topics: mage-ai, prefect, python
• Language: Python
• Homepage:
• Size: 19.5 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: HISTORY.md

Awesome Lists containing this project

README

        
# PyData

A shared python package support Data Engineering Task

## Run Test Locally

**Must Have**

```

export PYTHONPATH=$PYTHONPATH:/pydata

```

**Run Test**

```

make test

```

## Build Lib

```

make dist

```

## Usage This Lib

**Copy pydata-1.0.0.tar.gz in dist folder to your project**

**Configure requirements.txt**

```

./packages/pydata-1.0.0.tar.gz

```

# Mage AI

**Step 1**

```

```

# Prefect