https://github.com/sneaksanddata/arcane-stream-microsoft-synapse-link

Microsoft Synapse Link stream for Arcane Streaming Service
https://github.com/sneaksanddata/arcane-stream-microsoft-synapse-link

actor arcane data-ingestion reactive scala streaming synapse zio zio-streams

Last synced: 4 months ago
JSON representation

Microsoft Synapse Link stream for Arcane Streaming Service

• Host: GitHub
• URL: https://github.com/sneaksanddata/arcane-stream-microsoft-synapse-link
• Owner: SneaksAndData
• License: apache-2.0
• Created: 2025-01-10T11:43:42.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2026-02-02T13:54:57.000Z (4 months ago)
• Last Synced: 2026-02-03T02:58:42.230Z (4 months ago)
• Topics: actor, arcane, data-ingestion, reactive, scala, streaming, synapse, zio, zio-streams
• Language: Scala
• Homepage:
• Size: 611 KB
• Stars: 1
• Watchers: 0
• Forks: 1
• Open Issues: 9
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

          
## Microsoft Synapse Link Streaming Plugin for Arcane

 

![Static Badge](https://img.shields.io/badge/Scala-3-red)

[![Run tests with coverage](https://github.com/SneaksAndData/arcane-stream-microsoft-synapse-link/actions/workflows/build.yaml/badge.svg)](https://github.com/SneaksAndData/arcane-stream-microsoft-synapse-link/actions/workflows/build.yaml)

This repository contains implementation of Microsoft Synapse Link (Incremental CSV - Append-Only) streaming application. Use this app to livestream your 

Dynamics 365 Finance & Operations entities to Iceberg tables, backed by Trino as streaming batch merge consumer.

### Quickstart

TBD

### Development

Project uses `Scala 3.6.1` and tested on JDK 21. When using GraalVM, use JDK 22 version. 

Plugin supports `GraalVM` native image builds. Each PR must be run with `-agentlib:native-image-agent=config-merge-dir=./configs` on a [GraalVM-CE JDK](https://sdkman.io/jdks/#graalce) in order to capture native image settings updates, if any.