https://github.com/sueszli/github-lfs-bypass
github storage bills, no more
https://github.com/sueszli/github-lfs-bypass
cloud-storage git-lfs reproducibility
Last synced: 4 months ago
JSON representation
github storage bills, no more
- Host: GitHub
- URL: https://github.com/sueszli/github-lfs-bypass
- Owner: sueszli
- License: agpl-3.0
- Created: 2024-04-19T13:49:47.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2025-12-22T03:35:07.000Z (6 months ago)
- Last Synced: 2025-12-23T14:54:29.806Z (6 months ago)
- Topics: cloud-storage, git-lfs, reproducibility
- Language: Shell
- Homepage:
- Size: 116 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README
- License: LICENSE
Awesome Lists containing this project
README
```
_________________
| : : | chunk files.
| : : | get unlimited free storage on github.
| : : |
| : : |
| :___________: |
| _________ |
| | __ | |
| || | | |
\____||__|_____|__|
```
github commits are restricted to 25-50 MiB, varying based on the push method [^1].
to handle files beyond this limit, git lfs (large file storage) pointers are necessary, referencing an external lfs server [^2].
however, this method incurs a monthly cloud storage fee to github [^3].
the scripts provided in this repository allow you to bypass the file size limit by committing a large file in small chunks.
_usage:_
- **🔺 uploading to github:**
```bash
# compress data outside of repository
tar -czvf merged.tar.gz
# chunk and upload inside the repository
./upload.sh ./../merged.tar.gz
```
- **🔻 downloading from github:**
```bash
# clone
git clone
cd
# merge chunks back together, verify checksum
./download.sh
```
*ethical concerns:* i recognize that this project raises ethical questions surrounding the potential for freeriding on github's generosity. my primary goal is not to exploit the platform, but rather to facilitate more reproducible data-driven research. if the community believes this repository presents a significant ethical issue, i am absolutely willing to take it down immediately. please reach out to me directly with concerns or suggestions for alternative approaches.
[^1]: docs: https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github#file-size-limits
[^2]: nice comment: wokwokwok, 2021 on hackernews, https://news.ycombinator.com/item?id=27134972#:~:text=of%20such%20projects-,wokwokwok,-on%20May%2013
[^3]: https://docs.github.com/en/billing/managing-billing-for-git-large-file-storage/about-billing-for-git-large-file-storage