https://github.com/eleutherai/bucket-cleaner
A small utility to clear out old model checkpoints in Google Cloud Buckets whilst keeping tensorboard event files
https://github.com/eleutherai/bucket-cleaner
Last synced: 10 months ago
JSON representation
A small utility to clear out old model checkpoints in Google Cloud Buckets whilst keeping tensorboard event files
- Host: GitHub
- URL: https://github.com/eleutherai/bucket-cleaner
- Owner: EleutherAI
- Created: 2020-09-02T23:17:04.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2020-09-02T23:51:05.000Z (almost 6 years ago)
- Last Synced: 2025-08-23T10:05:11.982Z (10 months ago)
- Language: Python
- Size: 10.7 KB
- Stars: 3
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Bucket Cleaner
A small utility to clear out old model checkpoints in Google Cloud Buckets whilst keeping tensorboard event files.
## Usage
```
python bucket_cleaner.py [-h] [-y] [--move MOVE] dir [dir ...]
positional arguments:
dir path to cloud bucket directory
optional arguments:
-h, --help show this help message and exit
-y, --yes whether to ignore user prompts
--move MOVE whether to move the events files to a given folder (preserves
folder structure)
```
e.g `python bucket_cleaner.py --move gs://neo-models/archive gs://neo-models/gpt2 `
will move all the events files from `gs://neo-models/gpt2/` to `gs://neo-models/archive` and delete everything else