Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/treebeardtech/whaler
🐳 Visual disk-usage analyser for docker images
https://github.com/treebeardtech/whaler
disk-usage docker python
Last synced: 7 days ago
JSON representation
🐳 Visual disk-usage analyser for docker images
- Host: GitHub
- URL: https://github.com/treebeardtech/whaler
- Owner: treebeardtech
- License: apache-2.0
- Created: 2020-12-22T11:07:22.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2022-05-24T10:33:01.000Z (over 2 years ago)
- Last Synced: 2024-12-27T06:08:21.555Z (14 days ago)
- Topics: disk-usage, docker, python
- Language: Python
- Homepage: https://treebeardtech.github.io/whaler/
- Size: 3.65 MB
- Stars: 197
- Watchers: 7
- Forks: 4
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
# whaler
[](https://pypi.org/project/whaler)
**What?** A command-line tool for visually investigating the disk usage of docker images
**Why?** Large images are slow to move and expensive to store. They cost developer productivity by lengthening devops tasks and often contain unnecessary data
**Who is this for?** Primarily for engineers working with images containing Python packages.
## User Stories
This tool should allow you to answer questions such as:
1. Which file types are occupying the most disk space?
2. Which are my largest Python packages?
3. What are my unknown causes of high disk usage?
## Quick start
```bash
pip install whaler
```
### Run against a local directory
```
➜ whaler .venv
Running bash -c cd .venv && du -a -k
Done. Serving output at http://localhost:8000 (ctrl+c to exit)
Running python3 -m http.server 8000 --directory=_whaler/html
```
### Run against a docker image
The tool will pull the image first if it is not present.
```
whaler --image='hl:latest' /
Running docker run --rm --entrypoint=du --workdir=/ hl:latest -a -k
Ignoring what seems to be non-fatal error(s):
du: cannot access './proc/1/task/1/fd/4': No such file or directory
du: cannot access './proc/1/task/1/fdinfo/4': No such file or directory
du: cannot access './proc/1/fd/3': No such file or directory
du: cannot access './proc/1/fdinfo/3': No such file or directory
Done. Serving output at http://localhost:8000 (ctrl+c to exit)
Running python3 -m http.server 8000 --directory=_whaler/html
```
Play with a [hosted demo](https://treebeardtech.github.io/whaler/)
## Limitations
1. Platform: whaler uses `du` to gather disk usage data. It must be present in your docker image
2. Scale: I have tested the web UI with up to 500,000 file system nodes with `du` output of up to ~100MB.
## Alternatives/Complements to this tool:
1. Whaler can tell you what is taking up space in the final layer of your Docker image, but you may have intermediate layers which are contributing to the image size. For diving through the layers, use [dive](https://github.com/wagoodman/dive)
* **Related**: read up on [multi-stage builds](https://docs.docker.com/develop/develop-images/multistage-build/) to understand how to mitigate the problem of intermediate layers bloating your image.
1. For investigating disk usage in non-docker directories, [Disk Inventory X](http://www.derlien.com/) is a great tool on OS X which I have based whaler on.
1. [GoogleContainerTools/distroless](https://github.com/GoogleContainerTools/distroless) for base images not containing standard linux distro contents
## See also
1. [a good blog post on making small python images](https://pythonspeed.com/articles/alpine-docker-python/)
## Developing
See `.github/workflows/test.yml` for the development platform and setup.
For UI, see [whaler-ui](https://github.com/treebeardtech/whaler-ui)