Awesome-Diffusion-Models-for-NLP
📰 Must-read papers on Diffusion Models for Text Generation 🔥
https://github.com/StevenYuan666/Awesome-Diffusion-Models-for-NLP
Last synced: 5 days ago
JSON representation
-
📝 Papers
- **LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?**
- **Diffuwords: A Contrastive Diffusion Model for Lexically Constrained Text Generation**
- **Enforcing Paraphrase Generation via Controllable Latent Diffusion**
- **Empowering Diffusion Models on the Embedding Space for Text Generation**
- **XDLM: Cross-lingual Diffusion Language Model for Machine Translation**
- **Controllable Conversation Generation with Conversation Structures via Diffusion Models**
- **DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation**
- **Likelihood-Based Diffusion Language Models**
- **David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs**
- **TESS: Text-to-Text Self-Conditioned Simplex Diffusion**
- **Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!**
- **Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation** - Rong Wen.* **EACL** 2023 May
- **Simple and Effective Masked Diffusion Language Models**
- **Effective Integration of Text Diffusion and Pre-Trained Language Models with Linguistic Easy-First Schedule**
- **Few-shot Temporal Pruning Accelerates Diffusion Models for Text Generation**
- **DiffusionSL: Sequence Labeling via Tag Diffusion Process**
- **CodeFusion: A Pre-trained Diffusion Model for Code Generation**
- **Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution**
- **A Diffusion Weighted Graph Framework for New Intent Discovery**
- **ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts**
- **DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM**
- **Context-Aware Prompt for Generation-based Event Argument Extraction with Diffusion Models**
- **DiffuCom: A novel diffusion model for comment generation** - Based Systems** 2023 Oct
- **InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation**
- **LADIDA: Latent Diffusion for Document Generation with Sequential Decoding**
- **DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models**
- **DiffusionRet: Diffusion-Enhanced Generative Retriever using Constrained Decoding** - Hoon Na.* **EMNLP** 2023 Oct
- **ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer** - Burch, Zhou Yu, Kathleen McKeown.* **AAAI** 2023 Aug
- **Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning**
- **Enhancing Phrase Representation by Information Bottleneck Guided Text Diffusion Process for Keyphrase Extraction**
- **How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data?**
- **PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generation**
- **DiffuDetox: A Mixed Diffusion Model for Text Detoxification**
- **PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model**
- **Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation**
- **Diffusionner: Boundary diffusion for named entity recognition**
- **Fine-grained Text Style Transfer with Diffusion-Based Language Models**
- **DiffuSIA: A Spiral Interaction Architecture for Encoder-Decoder Text Diffusion** - Hong Tan, Jia-Chen Gu, Zhen-Hua Ling.* **Arxiv** 2023 May
- **Diffusion Language Models Generation Can Be Halted Early**
- **AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation** - Tao Zheng, Juntao Li, Zhongyu Wei, Jian Guo, Nan Duan, Weizhu Chen.* **NeurIPS** 2023 May
- **DiffuSum: Generation Enhanced Extractive Summarization with Diffusion**
- **GlyphDiffusion: Text Generation as Image Generation** - Yun Nie, Ji-Rong Wen.* **Arxiv** 2023 Apr
- **A Cheaper and Better Diffusion Language Model with Soft-Masked Noise**
- **Composable Text Controls in Latent Space with ODEs**
- **Latent Diffusion Energy-Based Model for Interpretable Text Modelling** - Chun Zhu, Ying Nian Wu.* **ICML** 2022 Jun
- **Diffusion-LM Improves Controllable Text Generation**
- **Step-unrolled Denoising Autoencoders for Text Generation**
- **Autoregressive Diffusion Models**
- **Structured Denoising Diffusion Models in Discrete State-Spaces**
- **Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions**
- **DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises**
- **A Reparameterized Discrete Diffusion Model for Text Generation**
- **Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise**
- **SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers**
- **Latent Diffusion for Language Generation**
- **Empowering Diffusion Models on the Embedding Space for Text Generation**
- **DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models**
- **Continuous diffusion for categorical data**
- **Self-conditioned Embedding Diffusion for Text Generation**
- **SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control**
- **DiffusER: Discrete Diffusion via Edit-based Reconstruction**
- **DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models**
- **Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning**
- **DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space**
- **Improving Iteration-based Non-Autoregressive Language Model With Time Step Awareness**
- **Language Rectified Flow: Advancing Diffusion Language Generation with Probabilistic Flows**
- **Flow Matching for Conditional Text Generation in a Few Sampling Steps**
- **Utilizing Latent Diffusion Model to Accelerate Sampling Speed and Enhance Text Generation Quality**
- **LDSeq: Latent Diffusion Models for Sequence to Sequence Text Generation**
- **Benchmarking Diffusion Models for Machine Translation**
- **Generating, Reconstructing, and Representing Discrete and Continuous Data: Generalized Diffusion with Learnable Encoding-Decoding**
- **TEncDM: Understanding the Properties of Diffusion Model in the Space of Language Model Encodings**
- **DiffuCOMET: Contextual Commonsense Knowledge Diffusion**
- **IPED: An Implicit Perspective for Relational Triple Extraction based on Diffusion Model**
- **Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models**
- **Text Diffusion with Reinforced Conditioning**
- **Quantized Embedding Vectors for Controllable Diffusion Language Models**
- **Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models**
- **Transfer Learning for Text Diffusion Models**
- **MDM: Meta diffusion model for hard-constrained text generation** - Based Systems** 2024 Jan
- **ROIC-DM: Robust Text Inference and Classification via Diffusion Model**
- **Diffusion-EXR: Controllable Review Generation for Explainable Recommendation via Diffusion Models**
- **IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition**
- **DiffuVST: Narrating Fictional Scenes with Global-History-Guided Denoising Models**
-
🔗 Surveys
- **An Overview of Diffusion Models for Text Generation**
- **A Survey of Diffusion Models in Natural Language Processing**
- **Diffusion Models in NLP: A Survey**
- **Diffusion Models for Non-autoregressive Text Generation: A Survey** - Rong Wen.* **IJCAI** 2023 Mar
- **Diffusion models in text generation: a survey**
Categories
Sub Categories