https://github.com/sneaksanddata/arcane-stream-parquet
Parquet stream for Arcane Streaming Service
https://github.com/sneaksanddata/arcane-stream-parquet
arcane data-ingestion parquet reactive scala streaming zio zio-streams
Last synced: 4 months ago
JSON representation
Parquet stream for Arcane Streaming Service
- Host: GitHub
- URL: https://github.com/sneaksanddata/arcane-stream-parquet
- Owner: SneaksAndData
- License: apache-2.0
- Created: 2025-07-02T13:24:49.000Z (12 months ago)
- Default Branch: main
- Last Pushed: 2025-07-14T11:11:59.000Z (11 months ago)
- Last Synced: 2025-07-14T12:06:49.222Z (11 months ago)
- Topics: arcane, data-ingestion, parquet, reactive, scala, streaming, zio, zio-streams
- Language: Scala
- Homepage:
- Size: 47.9 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
## Parquet Stream Plugin for Arcane
This repository contains implementation of a Parquet-Iceberg streaming plugin for Arcane. Use this app to livestream Parquet files to an Iceberg table, backed by [Trino](https://github.com/trinodb/trino) as a streaming batch merge consumer and [Lakekeeper](https://github.com/lakekeeper/lakekeeper) as a data catalog.
### Quickstart
TBD
### Development
Project uses `Scala 3.6.1` and tested on JDK 23.