Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/luopeixiang/awesome-text-summarization

Text summarization starting from scratch.
https://github.com/luopeixiang/awesome-text-summarization

List: awesome-text-summarization

abstractive-summarization deep-learning extractive-summarization nlp papers-collection sentence-compression text-mining text-summarization

Last synced: about 15 hours ago
JSON representation

Text summarization starting from scratch.

Awesome Lists containing this project

README 

        
# awesome-text-summarization



Text summarization starting from scratch.



This repository will keep updating...



Table of Contents

=================



   * [awesome-text-summarization](#awesome-text-summarization)

      * [Basic Concept](#basic-concept)

         * [Definition](#definition)

         * [Types of summarization](#types-of-summarization)

         * [Summary Informativeness evaluation](#summary-informativeness-evaluation)

      * [DataSet](#dataset)

      * [Papers](#papers)

         * [Survey](#survey)

         * [Abstractive Document summarization](#abstractive-document-summarization)

            * [Based Reinforcement Learning](#based-reinforcement-learning)

         * [Extractive Document summarization](#extractive-document-summarization)

            * [Based Reinforcement Learning](#based-reinforcement-learning-1)

      * [Sentence Summarization](#sentence-summarization)

      * [Unsupervised Abstractive Summarization](#unsupervised-abstractive-summarization)

      * [Multi Document Summarization](#multi-document-summarization)

      * [Evaluation Metrics](#evaluation-metrics)

      * [Other Resources](#other-resources)



## Basic Concept



### Definition



Summarization is the task of producing a shorter version of one or several documents that preserves most of the input's meaning.



### Types of summarization



**Extractive summaries** (extracts) are produced by concatenating

several sentences taken exactly as they appear in the materials being

summarized.



**Abstractive summaries** (abstracts), are written to convey

the main information in the input and may reuse phrases or clauses

from it, but the summaries are overall expressed in the words of the

summary author.



### Summary Informativeness evaluation



* **ROUGE-N**: measures the N-gram units common between a particular summary and a col-

  lection of reference summaries where N determines the N-gram’s length. E.g., **ROUGE-1**

  for unigrams and **ROUGE-2** for bi-grams.

* **ROUGE-L**:  computes Longest Common Subsequence (LCS) metric.

* **BLUE** : BLEU is basically calculated on the n-gram co-occerance between the generated summary and the gold (You don't need to specify the "n" unlike ROUGE).

* **METEOR** : based on the [harmonic mean](https://en.wikipedia.org/wiki/Harmonic_mean) of unigram [precision and recall](https://en.wikipedia.org/wiki/Precision_and_recall), with recall weighted higher than precision.



## DataSet



- [Annotated English Gigaword](https://catalog.ldc.upenn.edu/LDC2012T21)



  - for sentence summarization



- [CNN/Daily Mail dataset](https://cs.nyu.edu/~kcho/DMQA/)



  - for document summatization



- [DUC 2004](http://www.cis.upenn.edu/~nlp/corpora/sumrepo.html)



- [CORNELL NEWSROOM](https://summari.es/)



  - is a large dataset for training and evaluating summarization systems. It contains 1.3 million articles and summaries written by authors and editors in the newsrooms of 38 major publications. The summaries are obtained from search and social metadata between 1998 and 2017 and use a variety of summarization strategies combining *extraction* and *abstraction*.



- [Google Dataset](https://github.com/google-research-datasets/sentence-compression)



  - Large corpus of uncompressed and compressed sentences from news articles.



    ​



## Papers



### Survey



[Recent automatic text summarization techniques:a survey](https://link.springer.com/article/10.1007/s10462-016-9475-9)



[Automatic summarization](https://dl.acm.org/citation.cfm?id=2002468)



### Abstractive Document summarization



**1.words-lvt2k-temp-att (Nallapti et al., 2016)** : [Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond](http://www.aclweb.org/anthology/K16-1028)



**2.Graph-Based Attn** : [Abstractive Document Summarization with a Graph-Based Attentional Neural Model](http://aclweb.org/anthology/P17-1108)



**3.Pointer-generator + coverage (See et al., 2017)** : [Get To The Point: Summarization with Pointer-Generator Networks](http://aclweb.org/anthology/P17-1099)



**4.KIGN+Prediction-guide** : [Guiding Generation for Abstractive Text Summarization based on Key Information Guide Network](http://aclweb.org/anthology/N18-2009)



**5.Explicit Info Selection Modeling(Li et al., 2018a)** : [Improving Neural Abstractive Document Summarization with Explicit Information Selection Modeling](http://aclweb.org/anthology/D18-1205)



**6.Structural Regularization(Li et al., 2018b)** : [Improving Neural Abstractive Document Summarization with Structural Regularization](http://aclweb.org/anthology/D18-1441)



**7.end2end w/ inconsistency loss (Hsu et al., 2018)**: [A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss](http://aclweb.org/anthology/P18-1013)



**8.Pointer + Coverage + EntailmentGen + QuestionGen** (Guo et al., 2018) : [Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation](http://aclweb.org/anthology/P18-1064)



**9. Global semantics + Gating** (Nguyen et al., 2021): [Enriching and Controlling Global Semantics for Text Summarization](https://arxiv.org/abs/2109.10616)



**10. Optimal transport distance + knowledge distillation** (Nguyen et al., 2021): [Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillation](https://arxiv.org/abs/2112.03473)



---



#### Based Reinforcement Learning:



**1.ML+RL ROUGE+Novel, with LM (Kryscinski et al., 2018)**  : [Improving Abstraction in Text Summarization](http://aclweb.org/anthology/D18-1207)



**2.RL + pg + cbdec (Jiang and Bansal, 2018)**: [Closed-Book Training to Improve Summarization Encoder Memory](http://aclweb.org/anthology/D18-1440)



**3.rnn-ext + abs + RL + rerank (Chen and Bansal, 2018)**: [Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting](http://aclweb.org/anthology/P18-1061)



**4.ML+RL, with intra-attention** : [A Deep Reinforced Model for Abstractive Summarization](https://openreview.net/pdf?id=HkAClQgA-)



**5.ML+RL ROUGE+Novel, with LM** : [Improving Abstraction in Text Summarization](http://aclweb.org/anthology/D18-1207)



**6.GAN** : [Generative Adversarial Network for Abstractive Text Summarization](https://aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16238/16492)



**7.DCA (Celikyilmaz et al., 2018)** : [Summarization](http://aclweb.org/anthology/N18-1150)



**8.ROUGESal+Ent RL** (Pasunuru and Bansal, 2018): [Multi-Reward Reinforced Summarization with Saliency and Entailment](http://aclweb.org/anthology/N18-2102)



---



### Extractive Document summarization



**1.TEXTRANK(graph based)**: [TextRank: Bringing Order intoTexts](https://web.eecs.umich.edu/~mihalcea/papers/mihalcea.emnlp04.pdf)



**2.SWAP-NET** : [Extractive Summarization with SWAP-NET: Sentences and Words from Alternating Pointer Networks](http://aclweb.org/anthology/P18-1014)



**3.NN-SE** : [Neural summarization by extracting sentences and words



**4.HSASS** : [A Hierarchical Structured Self-Attentive Model for Extractive Document Summarization (HSSAS)](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8344797)



**5.NeuSUM (Zhou et al., 2018)** : [Neural Document Summarization by Jointly Learning to Score and Select Sentences](http://aclweb.org/anthology/P18-1061)



**6.Latent (Zhang et al., 2018**) : [Neural Latent Extractive Document Summarization](http://aclweb.org/anthology/D18-1088)



#### Based Reinforcement Learning



**1.rnn-ext + RL** (Chen and Bansal, 2018): [Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting](http://aclweb.org/anthology/P18-1061)



**2.Bottom-Up Summarization** (Gehrmann et al., 2018): [Bottom-Up Abstractive Summarization](https://arxiv.org/abs/1808.10792)



**3.BANDITSUM** :[BANDITSUM: Extractive Summarization as a Contextual Bandit](https://arxiv.org/abs/1809.09672)



**4.SummaRuNNer**: [A recurrent neural network based sequence model for extractive summarization of documents](https://arxiv.org/pdf/1611.04230.pdf)



**5.Refrech**: [Ranking sentences for extractive summarization with reinforcement learning](http://www.aclweb.org/anthology/N18-1158)



**6.DQN**: [Deep reinforcement learning for extractive document summarization](https://www.sciencedirect.com/science/article/pii/S0925231218300377):



**7.RNES w/o coherence** :[Learning to Extract Coherent Summary via Deep Reinforcement Learning](https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16838/16118)



## Sentence Summarization



**1.Re^3 Sum (Cao et al., 2018)** : [Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization](http://aclweb.org/anthology/P18-1015)



**2.FTSum_g (Cao et al., 2018)** : [Faithful to the Original: Fact Aware Neural Abstractive Summarization](https://arxiv.org/pdf/1711.04434.pdf)



**3.Seq2seq + E2T_cnn (Amplayo et al., 2018)** : [Abstractive Sentence Summarization with Attentive Recurrent Neural Networks](http://www.aclweb.org/anthology/N16-1012)



**4.EndDec+WFE (Suzuki and Nagata, 2017)** : [Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization](http://aclweb.org/anthology/E17-2047)



**5.DRGD (Li et al., 2017)** : [Deep Recurrent Generative Decoder for Abstractive Text Summarization](http://aclweb.org/anthology/D17-1222)



**6.BiRNN + LM Evaluator (Zhao et al. 2018)** : [A Language Model based Evaluator for Sentence Compression](https://aclweb.org/anthology/P18-2028)



## Unsupervised Abstractive Summarization



**1.MeanSum** : [MeanSum: A Neural Model for Unsupervised Multi-document Abstractive Summarization](https://arxiv.org/abs/1810.05739)



**2.Semantic Abstractive Sum based AMR(2018 Dohare)**: [Unsupervised Semantic Abstractive Summarization](http://aclweb.org/anthology/P18-3011)



**3.Paraphrastic Sentence Fusion Model(2018 Nayeem)**: [Abstractive Unsupervised Multi-Document Summarization using Paraphrastic Sentence Fusion](http://aclweb.org/anthology/C18-1102)



## Multi Document Summarization



**1.(Z Cao 2017)** : [Improving Multi-Document Summarization via Text Classification](https://aaai.org/ocs/index.php/AAAI/AAAI17/paper/download/14525/14077)



**2.Based AMR** : [Abstract Meaning Representation for Multi-Document Summarization.](https://arxiv.org/abs/1806.05655)



**3** [Abstractive Unsupervised Multi-Document Summarization using Paraphrastic Sentence Fusion.](http://aclweb.org/anthology/C18-1102)



**4** [Adapting the Neural Encoder-Decoder Framework from Single to Multi-Document Summarization.](https://arxiv.org/abs/1808.06218)



**5** [Salience Estimation via Variational Auto-Encoders for Multi-Document Summarization.](https://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14613) 



**6** [Supervised Learning of Automatic Pyramid for Optimization-Based Multi-Document Summarization.](https://aclanthology.info/papers/P17-1100/p17-1100)



**7** [Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept  Maps](https://aclweb.org/anthology/D17-1320)



## Evaluation Metrics



**1.ROUGE(2004)** :  [Rouge: A package for automatic evaluation of summaries](https://www.microsoft.com/en-us/research/wp-content/uploads/2016/07/was2004.pdf)



**2.BLUE(2002)** : [BLEU: a Method for Automatic Evaluation of Machine Translation](http://www.aclweb.org/anthology/P02-1040.pdf)



**3.BE(2006)** : [Automated Summarization Evaluation with Basic Elements](https://pdfs.semanticscholar.org/45fc/709a2fb8cd3cc71462c65e3d5e1bcb23c444.pdf?_ga=2.109764549.1171702135.1552302856-592061209.1552302856)



**4.Pyramid Method(2007)** : [Evaluating Content Selection in Summarization: The Pyramid Method](http://www.cs.columbia.edu/~ani/papers/pyramid.pdf)



**5.(2018 Shaflei)** : [Summarization Evaluation in the Absence of Human Model Summaries Using the Compositionality of Word Embeddings](http://aclweb.org/anthology/C18-1077)



**6.(2018 Honda)** : [Pruning Basic Elements for Better Automatic Evaluation of Summaries](http://aclweb.org/anthology/N18-2104)



## Other Resources



**awesome-text-summatization** : 



* [The guide to tackle with the Text Summarization](https://github.com/mathsyouth/awesome-text-summarization)

* [A curated list of resources dedicated to text summarization](https://github.com/mathsyouth/awesome-text-summarization)



**SOTA in summarizaiton** : [The current state-of-the-art](https://github.com/sebastianruder/NLP-progress/blob/master/english/summarization.md)