https://github.com/kaiju/iceberg-puddle
I don't need a whole lake!
https://github.com/kaiju/iceberg-puddle
data data-engineering i-just-want-to-get-some-work-done iceberg iceberg-rest local-development
Last synced: about 13 hours ago
JSON representation
I don't need a whole lake!
- Host: GitHub
- URL: https://github.com/kaiju/iceberg-puddle
- Owner: kaiju
- Created: 2025-12-25T20:03:32.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-12-26T05:38:52.000Z (6 months ago)
- Last Synced: 2025-12-27T17:08:35.284Z (6 months ago)
- Topics: data, data-engineering, i-just-want-to-get-some-work-done, iceberg, iceberg-rest, local-development
- Language: Shell
- Homepage:
- Size: 5.86 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 🧊 iceberg-puddle
For the love of god I don't need an entire lake.
Do you just want to get some development work done? Do you just want to stand up a local Iceberg REST catalog & some S3 compatible object storage? Do you just want to get pyiceberg or duckdb or spark-iceberg working? Yeah, me too.
⚠️ It should go without saying but **do not use this in production**. Do not put this on the public internet. This is explicitly for local/development usage and there's zero security on anything in here. Don't do it!
## Components
- [iceberg-rest-image](https://github.com/databricks/iceberg-rest-image): Iceberg REST catalog
- [Garage](https://garagehq.deuxfleurs.fr/): Object storage
## Usage
`docker compose up` or `podman compose up` depending on what flavor of psycho you are.
The initial bootstrap script will generate the following files in the `configs/` directory:
- `configs/.pyiceberg.yaml`: PyIceberg configuration
- `configs/awscli.env`: AWS environment configuration variables
- `configs/duckdb.sql`: DuckDB Iceberg/S3/REST Catalog configuration