https://github.com/basvdberg/incremental-join

This library implements an efficient join function to join 2 (usually large) incrementally refreshed tables, taking into account the refresh timestamp of each table and the fact that data might arrive late.

big-data databricks delta-lake joining-data joining-tables pyspark python

Last synced: 12 Jun 2026

https://github.com/basvdberg/cursor-config

Last synced: 12 Jun 2026

https://github.com/basvdberg/data-engineering-design-patterns

Commonly used design patterns for data engineering

Last synced: 12 Jun 2026

https://github.com/basvdberg/data-engineering-2026

GenAI way of working for data engineering in 2026

Last synced: 12 Jun 2026

https://github.com/basvdberg/data-solution-2026

Last synced: 12 Jun 2026

https://github.com/basvdberg/incrementaljoin

This python library helps you to join 2 huge incrementally refreshed tables. Major benefits: performance, efficiency and consistency.

Last synced: 09 Mar 2026