https://github.com/makism/spark-nessie-iceberg
https://github.com/makism/spark-nessie-iceberg
apache-spark lakehouse minio nessie
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/makism/spark-nessie-iceberg
- Owner: makism
- Created: 2023-12-03T08:34:59.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-12-06T20:13:33.000Z (almost 2 years ago)
- Last Synced: 2025-03-08T19:05:59.043Z (8 months ago)
- Topics: apache-spark, lakehouse, minio, nessie
- Language: Jupyter Notebook
- Homepage:
- Size: 32.2 KB
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
[Dremio](http://localhost:9047)
* prompt for registration
Add Source Nessie configuration
General
* Nessie Endpoint URL: `http://nessie:19120/api/v2`
* Nessie Authentication Type: `None`
Storage
* Authentication Type: `AWS Access Key`
* AWS Access Key: `minio`
* AWS Access Secret: `minio123`
* AWS Root Path: `/lake/`
* Properties
1. `fs.s3a.path.style.access` = `true`
2. `fs.s3a.endpoint` = `minio:9000`
3. `dremio.s3.compat` = `true`
* Encrypt connection: `unchecked`
[Nessie](http://localhost:19120)
* no authentication
[MinIO](http://minio:9001)
* minio / minio123