Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ibm-aur-nlp/PubTabNet


https://github.com/ibm-aur-nlp/PubTabNet

Last synced: 1 day ago
JSON representation

Awesome Lists containing this project

README 

        
# PubTabNet



PubTabNet is a large dataset for image-based table recognition, containing 568k+ images of tabular data annotated with the corresponding HTML representation of the tables. The table images are extracted from the scientific publications included in the [PubMed Central Open Access Subset (commercial use collection)](https://www.ncbi.nlm.nih.gov/pmc/tools/openftlist/). Table regions are identified by matching the PDF format and the XML format of the articles in the PubMed Central Open Access Subset. More details are available in our paper ["Image-based table recognition: data, model, and evaluation"](https://arxiv.org/abs/1911.10683).



## Headlines



`07/Mar/2022` - Test set and ground truth for the ICDAR 2021 Scientific Literature Parsing competition available [here](https://github.com/ajjimeno/icdar-task-b).



`04/May/2021` - Report for the ICDAR 2021 Scientific Literature Parsing competition available [here](https://github.com/ibm-aur-nlp/PubLayNet/blob/master/ICDAR_SLR_competition/ICDAR_2021_Scientific_Literature_Parsing.pdf).



`21/July/2020` - PubTabNet 2.0.0 is released, where the position (bounding box) of non-empty cells is added into the annotation. The annotation file is also changed from `json` format to `jsonl` format to reduce the requirement on large RAM.



`20/Jul/2020` - PubTabNet is used in [ICDAR 2021 Competition on Scientific Literature Parsing](https://github.com/IBM/ICDAR2021-SLP) ([Task B on Table Recognition](https://aieval.draco.res.ibm.com/challenge/40/overview))



`03/July/2020` - `Image-based table recognition: data, model, and evaluation` is accepted by ECCV20.



`01/July/2020` - Code of **T**ree-**Edit**-**D**istance-based **S**imilarity (TEDS) metric is [released](src).



## Updates in progress



### Encoder-dual-decoder model



In our paper, we proposed a new encoder-dual-decoder architecture, which was trained on PubTabNet and can accurately reconstruct the HTML representation of complex tables solely relying on image input. Due to legal constraints, the source code of the model will not be released.



### Ground truth of test set



The ground truth of test will not be release, as we want to keep it for a competition in the future. We will offer a service for people to submit and evaluate their results soon.



## Getting data



Images and annotations can be downloaded [here](https://developer.ibm.com/exchanges/data/all/pubtabnet/). If you want to download the data from the command line, you can use curl or wget to download the data.



```

curl -o /PubTabNet.tar.gz https://dax-cdn.cdn.appdomain.cloud/dax-pubtabnet/2.0.0/pubtabnet.tar.gz

```



```

wget -O /PubTabNet.tar.gz https://dax-cdn.cdn.appdomain.cloud/dax-pubtabnet/2.0.0/pubtabnet.tar.gz

```



Test set and ground truth for the ICDAR 2021 Scientific Literature Parsing competition available [here](https://github.com/ajjimeno/icdar-task-b).



## Annotation structure



The annotation is in the jsonl (jsonlines) format, where each line contains the annotations on a given sample in the following format:

The structure of the annotation jsonl file is:



```

{

   'filename': str,

   'split': str,

   'imgid': int,

   'html': {

     'structure': {'tokens': [str]},

     'cell': [

       {

         'tokens': [str],

         'bbox': [x0, y0, x1, y1]  # only non-empty cells have this attribute

       }

     ]

   }

}

```



## Cite us



```

@article{zhong2019image,

  title={Image-based table recognition: data, model, and evaluation},

  author={Zhong, Xu and ShafieiBavani, Elaheh and Yepes, Antonio Jimeno},

  journal={arXiv preprint arXiv:1911.10683},

  year={2019}

}

```



## Examples



A [Jupyter notebook](./exploring_PubTabNet_dataset.ipynb) is provided to inspect the annotations of 20 sample tables.



## Related links



[PubLayNet](https://github.com/ibm-aur-nlp/PubLayNet) is a large dataset of document images, of which the layout is annotated with both bounding boxes and polygonal segmentations. The source of the documents is [PubMed Central Open Access Subset (commercial use collection)](https://www.ncbi.nlm.nih.gov/pmc/tools/openftlist/). The annotations are automatically generated by matching the PDF format and the XML format of the articles in the PubMed Central Open Access Subset. More details are available in our paper ["PubLayNet: largest dataset ever for document layout analysis."](https://arxiv.org/abs/1908.07836), which was awarded the [best paper at ICDAR 2019](http://icdar2019.org/award/)!