https://github.com/lebellig/discrete-fm

Educational implementation of the Discrete Flow Matching paper
https://github.com/lebellig/discrete-fm

flow-matching generative-ai generative-model machine-learning pytorch pytorch-lightning

Last synced: 3 days ago
JSON representation

Educational implementation of the Discrete Flow Matching paper

• Host: GitHub
• URL: https://github.com/lebellig/discrete-fm
• Owner: lebellig
• Created: 2024-08-16T23:00:55.000Z (6 months ago)
• Default Branch: master
• Last Pushed: 2024-08-26T15:26:15.000Z (6 months ago)
• Last Synced: 2025-02-06T15:53:21.491Z (15 days ago)
• Topics: flow-matching, generative-ai, generative-model, machine-learning, pytorch, pytorch-lightning
• Language: Jupyter Notebook
• Homepage:
• Size: 69.3 MB
• Stars: 74
• Watchers: 2
• Forks: 5
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Discrete Flow Matching

[![Open in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1BnGVmUK9hU9HVK42JbQBF2l-7rbAZ0yu?usp=sharing)

_notebook by Georges Le Bellier_  - [Twitter](https://twitter.com/_lebellig), [Website](https://gle-bellier.github.io)

This is an unofficial implementation of the paper made [Discrete Flow Matching](https://arxiv.org/abs/2407.15595#) by Itai Gat et al [1]. This notebook (`notebook/discretefm.ipynb`) has an educational purpose and explores the case of discrete image generation. We strongly encourage the readers to check the whole framework in the original paper and we report the formula with their indexes in the paper.

## References:

📄 [1] **Discrete Flow Matching** by Itai Gat, Tal Remez, Neta Shaul, Felix Kreuk, Ricky T. Q. Chen, Gabriel Synnaeve, Yossi Adi, Yaron Lipman - [Article](https://arxiv.org/abs/2407.15595#)

📄 [2] **Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design** by Andrew Campbell, Jason Yim, Regina Barzilay, Tom Rainforth, Tommi Jaakkola [Article](https://arxiv.org/abs/2402.04997)

📄 [3] **Flow Matching for Generative Modeling** by Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, Matt Le - [Article](https://arxiv.org/abs/2210.02747)

🐍 [4] **Introduction to Flow Matching** by Georges Le Bellier - [Notebook](https://github.com/gle-bellier/flow-matching/tree/main)

![digits](https://github.com/user-attachments/assets/40584c7d-0b1c-45fc-9979-641ee0d22071)