https://github.com/yezz123/awsflowutils
Improve your data workflow with enhanced simplicity and robustness in handling common data tasks ✨
https://github.com/yezz123/awsflowutils
aws data redshift s3 s3-bucket workflow
Last synced: 6 months ago
JSON representation
Improve your data workflow with enhanced simplicity and robustness in handling common data tasks ✨
- Host: GitHub
- URL: https://github.com/yezz123/awsflowutils
- Owner: yezz123
- License: mit
- Created: 2023-05-15T21:44:28.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-05-27T22:47:16.000Z (over 1 year ago)
- Last Synced: 2025-02-03T17:11:22.480Z (8 months ago)
- Topics: aws, data, redshift, s3, s3-bucket, workflow
- Language: Python
- Homepage:
- Size: 45.9 KB
- Stars: 3
- Watchers: 2
- Forks: 0
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
Improve your data workflow with enhanced simplicity and robustness in handling common data tasks ✨
AWSFlowUtils is an invaluable toolkit offering a wide range of utility functions meticulously crafted to facilitate seamless interactions with AWS S3 and AWS Redshift.
With a focus on simplicity, robustness, and efficiency, this package serves as a powerful aid for users engaged in data work-flows.
Designed to streamline common tasks encountered during data operations, AWSFlowUtils empowers users to effortlessly access and manipulate data stored in AWS S3 and AWS Redshift.
Whether it's retrieving, uploading, or deleting files, or executing data transformations, this package provides a comprehensive set of tools that simplify and accelerate data work-flows.
## Installation
You can add AWSFlowUtils in a few easy steps. First of all, install the dependency:
```shell
$ pip install awsflowutils
---> 100%
Successfully installed awsflowutils
```
## Development 🚧
### Setup environment 📦
You should create a virtual environment and activate it:
```bash
python -m venv venv/
```
```bash
source venv/bin/activate
```
And then install the development dependencies:
```bash
# Install dependencies
pip install -e .[test,lint]
```
### Run tests 🌝
You can run all the tests with:
```bash
bash scripts/test.sh
```
### Format the code 🍂
Execute the following command to apply `pre-commit` formatting:
```bash
bash scripts/format.sh
```
Execute the following command to apply `mypy` type checking:
```bash
bash scripts/lint.sh
```
## License
This project is licensed under the terms of the MIT license.