https://github.com/timoklein/neural_citation
Context aware citation recommendation
https://github.com/timoklein/neural_citation
deep-learning information-retrieval pytorch sequence-to-sequence
Last synced: 8 months ago
JSON representation
Context aware citation recommendation
- Host: GitHub
- URL: https://github.com/timoklein/neural_citation
- Owner: timoklein
- Archived: true
- Created: 2019-05-06T12:53:40.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2021-11-17T08:29:15.000Z (over 4 years ago)
- Last Synced: 2025-02-23T17:34:00.646Z (over 1 year ago)
- Topics: deep-learning, information-retrieval, pytorch, sequence-to-sequence
- Language: Jupyter Notebook
- Homepage:
- Size: 125 MB
- Stars: 4
- Watchers: 2
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Neural Citation Network
PyTorch reimplementation of the neural citation network.
Author's source code:
https://github.com/tebesu/NeuralCitationNetwork.
Travis Ebesu, Yi Fang. Neural Citation Network for Context-Aware Citation Recommendation. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017. PDF
## Requirements
The neural_citation.yml file contains a list of packages used to implement this model. Of particular importance are:
* python==3.7.3
* pytorch==1.1.0
* torchtext==0.3.1
* tensorboard==1.14.0
* spacy==2.1.6
* gensim==3.8.0
* nltk==3.4.4
* pandas==0.25.0
* tqdm==4.32.2
For training the model it is recommended to use the GPU version of Pytorch instead.
## Getting started
Install dependencies and clone the repo. The training notebook contains a training template.
The evaluation notebook shows an example of how model evaluations can be run.
Note that both training and evaluation functions are optimized for use in notebooks as they use
tqdm_notebook progress bars. When running these functions from a script this needs to be changed.
#### spaCy can't find the language model
If you can't fetch the language model with
```python
python -m spacy download en_core_web_sm
```
please try to download and install the model via pip. This has worked for me when reproducing the environment.
```python
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_lg-2.1.0/en_core_web_lg-2.1.0.tar.gz --no-deps
```
## Project structure:
.
├── assets # experiments in the EACL paper
| ├── various images # used for the NCN presentation
│ ├── title_to_aut_cited # pickled dictionary: tokenized title -> cited authors
│ └── title_tokenized_to_full # pickled dictionary: tokenized titles -> full cited paper titles
│
├── docs # documentation for the ncn modules
| └── ncn # doc folder for the module
│ └── xxx.html # doc html files
|
├── ncn # main folder containing the NCN implementation
│ ├── core # contains core data types and constants
│ ├── data # preprocessing pipeline for the dataset
│ ├── evaluation # evaluator class for evaluation and inference
│ ├── model # Neural Citation Network pytorch model
│ └── training # low level pytorch training loops
|
├── runs # Example tensorboard training log
│ └── log folders # Folders containing a training run's logs
| └── train logs # tensorboard log files
|
├── README.md # This file
├── NCN_evaluation.ipynb # notebook for performing evaluation tasks
├── NCN_presentation.ipynb # presentation given about project, contains small inference demo
├── NCN_training.ipynb # training containing the high level training script
├── generate_dicts.ipynb # notebook to generate title_to_aut_cited and title_tokenized_to_full dicts for inference
└── neural_citation.yml # CPU conda environment
## Data
The preprocessed dataset can be found here: https://drive.google.com/open?id=1qwBIXBsWp0ODrm91pVgBOwelJ5baGr-9.
Statistics about the dataset can be found in the NCN_presentation.ipynb file.
## Weights
The model trained with the original settings by Ebesu and Fang can be found here:
https://drive.google.com/open?id=1mT7kUb415wy0i1raXTPMcrXcWSgRC2pk.
The model trained with our best configuration can be found here:
https://drive.google.com/open?id=1xhupsNpSzDSS3_C-IJpMAPnts3kXdg-5.
## Results
Link to the workshop paper:
https://www.aifb.kit.edu/images/8/82/CiteRec_Repro_BIR2020.pdf.
## Use this work
Feel free to use our source code and results.
@inproceedings{FaerberKleinSigloch2020_1000119469,
author = {Färber, M. and Klein, T. and Sigloch, J.},
year = {2020},
title = {Neural citation recommendation: A reproducibility study},
pages = {66-74},
eventtitle = {10th International Workshop on Bibliometric-enhanced Information Retrieval},
eventtitleaddon = {2020},
eventdate = {2020-04-14/},
venue = {Lissabon, Portugal},
booktitle = {Bibliometric-enhanced Information Retrieval : Proceedings of the 10th International Workshop
co-located with 42nd European Conference on Information Retrieval (ECIR 2020), Lisbon, Portugal (online only), April 14th, 2020. Ed.: G. Cabanac},
publisher = {{CEUR-WS}},
issn = {1613-0073},
series = {CEUR Workshop Proceedings},
url = {http://ceur-ws.org/Vol-2591/paper-07.pdf},
language = {english},
volume = {2591}
}