https://github.com/anistark/galactus

Manage your systems better.
https://github.com/anistark/galactus

compress dataframe file filesystem pandas python3 s3 s3-bucket s3-storage sort venv walk

Last synced: 10 days ago
JSON representation

Manage your systems better.

• Host: GitHub
• URL: https://github.com/anistark/galactus
• Owner: anistark
• License: apache-2.0
• Created: 2017-07-17T15:14:42.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-11-28T18:02:33.000Z (about 7 years ago)
• Last Synced: 2024-10-25T15:39:22.950Z (about 2 months ago)
• Topics: compress, dataframe, file, filesystem, pandas, python3, s3, s3-bucket, s3-storage, sort, venv, walk
• Language: Python
• Homepage:
• Size: 7.81 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Galactus

Finds all big files and compresses them.

## Setup

Python version should be same as specificed in `runtime.txt`

Create a virtual environment with `python3 -m venv venv`

Activate the virtual environment created with `source venv/bin/activate`

Install all dependencies with `pip install -r requirements.txt`

## Run

```

python app.py

```

## Todo

- [x] Sort all files with size from a given directory.

- [x] Compress files above a given size. Using gzip.

- [ ] Move the compressed file to s3(or any other place).

- [ ] Delete the big files.

- [ ] Create as a package to be installed and ran with other projects.

- [ ] Create runnable binary for Ubuntu to be run on ubuntu servers.