An open API service indexing awesome lists of open source software.

https://github.com/caicancai/awesome-ivm-learning

A list of learning materials to understand ivm internals
https://github.com/caicancai/awesome-ivm-learning

List: awesome-ivm-learning

awesome database ivm

Last synced: about 2 months ago
JSON representation

A list of learning materials to understand ivm internals

Awesome Lists containing this project

README

          

# awesome-ivm-learning

A curated list of learning materials to understand incremental materialized views (IVM).

## Table of Contents

- [Projects](#projects)
- [Papers](#papers)
- [Blogs & Documentation](#blogs--documentation)

## Projects

### Production-Ready Systems
- [feldera](https://github.com/feldera/feldera) - Incremental compute engine powered by DBSP
- [risingwave](https://github.com/risingwavelabs/risingwave) - Distributed SQL streaming database
- [Materialize](https://github.com/MaterializeInc/materialize) - Streaming database for real-time analytics
- [differential-dataflow](https://github.com/TimelyDataflow/differential-dataflow) - Incremental data-parallel computation framework
- [timely-dataflow](https://github.com/TimelyDataflow/timely-dataflow) - Timely dataflow is a low-latency cyclic dataflow computational model
- [datafusion-materialized-views](https://github.com/datafusion-contrib/datafusion-materialized-views) - Materialized views for Apache DataFusion

## Papers

### Foundational Work
- [Maintaining views incrementally](https://dl.acm.org/doi/pdf/10.1145/170035.170066) (1993)
- [Naiad: a timely dataflow system](https://dl.acm.org/doi/pdf/10.1145/2517349.2522738) (2013)
- [Differential Dataflow](https://github.com/timelydataflow/differential-dataflow/blob/master/differentialdataflow.pdf) (2013)
- [DBSP: Automatic Incremental View Maintenance for Rich Query Languages](https://docs.feldera.com/vldb23.pdf) (2023)
- [OpenIVM: a SQL-to-SQL Compiler for Incremental Computations](https://arxiv.org/pdf/2404.16486v1#page=0.93) (2024)
- [Incremental Processing with Change Queries in Snowflake](https://dl.acm.org/doi/pdf/10.1145/3589776) (2023)
- [Tempura: A General Cost-Based Optimizer Framework for Incremental Data Processing](https://www.vldb.org/pvldb/vol14/p14-wang.pdf) (2021)
- [Enzyme: Incremental View Maintenance for Data Engineering](https://arxiv.org/pdf/2603.27775) (2026)

## Blogs & Documentation

- [The Feldera Blog](https://www.feldera.com/blog)
- [Postgres IVM](https://wiki.postgresql.org/wiki/Incremental_View_Maintenance)
- [The RisingWave Blog](https://risingwave.com/blog/)

## Contributing

Please submit a pull request if you have materials that should be included in this collection!