https://github.com/makism/spark-nessie-iceberg

https://github.com/makism/spark-nessie-iceberg

apache-spark lakehouse minio nessie

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/makism/spark-nessie-iceberg
• Owner: makism
• Created: 2023-12-03T08:34:59.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-12-06T20:13:33.000Z (about 1 year ago)
• Last Synced: 2024-04-19T05:44:22.546Z (9 months ago)
• Topics: apache-spark, lakehouse, minio, nessie
• Language: Jupyter Notebook
• Homepage:
• Size: 32.2 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        

[Dremio](http://localhost:9047)

* prompt for registration

Add Source Nessie configuration

General

* Nessie Endpoint URL: `http://nessie:19120/api/v2`

* Nessie Authentication Type: `None`

Storage

* Authentication Type: `AWS Access Key`

* AWS Access Key: `minio`

* AWS Access Secret: `minio123`

* AWS Root Path: `/lake/`

* Properties

1. `fs.s3a.path.style.access` = `true`

2. `fs.s3a.endpoint` = `minio:9000`

3. `dremio.s3.compat` = `true`

* Encrypt connection: `unchecked`

[Nessie](http://localhost:19120)

* no authentication

[MinIO](http://minio:9001)

* minio / minio123