https://github.com/tonytan48/Re-DocRED

https://github.com/tonytan48/Re-DocRED

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/tonytan48/Re-DocRED
• Owner: tonytan48
• License: mit
• Created: 2022-05-22T12:27:09.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-08-21T08:15:07.000Z (over 1 year ago)
• Last Synced: 2024-08-03T09:07:17.246Z (5 months ago)
• Language: Python
• Size: 5.88 MB
• Stars: 45
• Watchers: 2
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• StarryDivineSky - tonytan48/Re-DocRED

README

        
# Re-DocRED Dataset

This repository contains the dataset of our EMNLP 2022 research paper [Revisiting DocRED – Addressing the False Negative Problem

in Relation Extraction](https://arxiv.org/pdf/2205.12696.pdf). 

DocRED is a widely used benchmark for document-level relation extraction. However, the DocRED dataset contains a significant percentage of false negative examples (incomplete annotation). We revised 4,053 documents in the DocRED dataset and resolved its problems. We released this dataset as: Re-DocRED dataset.

The Re-DocRED Dataset resolved the following problems of DocRED:

1. Resolved the incompleteness problem by supplementing large amounts of relation triples.

2. Addressed the logical inconsistencies in DocRED.

3. Corrected the coreferential errors within DocRED.

# Statistics of Re-DocRED

The Re-DocRED dataset is located as ./data directory, the statistics of the dataset are shown below:

|  | Train  | Dev  |  Test  |

| :---:   | :-: | :-: |:-: |

| # Documents | 3,053 | 500 |  500 |

| Avg. # Triples | 28.1 | 34.6 |  34.9 |

| Avg. # Entities | 19.4 | 19.4 | 19.6 |

| Avg. # Sents | 7.9 | 8.2 | 7.9 |

# Citation

If you find our work useful, please cite our work as:

```bibtex

@inproceedings{tan2022revisiting,

  title={Revisiting DocRED – Addressing the False Negative Problem in Relation Extraction},

  author={Tan, Qingyu and Xu, Lu and Bing, Lidong and Ng, Hwee Tou and Aljunied, Sharifah Mahani},

  booktitle={Proceedings of EMNLP},

  url={https://arxiv.org/abs/2205.12696},

  year={2022}

}

```