https://github.com/amenra/semantic-query-tagging-dataset
Semantic Query Tagging Dataset
https://github.com/amenra/semantic-query-tagging-dataset
Last synced: 6 months ago
JSON representation
Semantic Query Tagging Dataset
- Host: GitHub
- URL: https://github.com/amenra/semantic-query-tagging-dataset
- Owner: AmenRa
- License: mit
- Created: 2021-04-27T10:10:42.000Z (about 5 years ago)
- Default Branch: main
- Last Pushed: 2022-03-24T11:22:19.000Z (over 4 years ago)
- Last Synced: 2025-09-09T05:18:43.087Z (11 months ago)
- Size: 137 KB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Semantic Query Tagging Dataset
Benchmark dataset for _Semantic Query Tagging_.
It contains a total of 6749 manually-labeled real-world unique queries in the movie domain.
Data are formatted using the [IOB2](https://en.wikipedia.org/wiki/Inside–outside–beginning_(tagging)) labeling format.
## Task 1 - Semantic Query Tagging
_Task 1_ folder contains the dataset used in [[1](#1)].
_Basic_, _Advanced_, and _Hard_ refers to three different scenarios of increasing difficulty built by subsetting the original query set.
The queries come already split into _train_, _dev_, and _test_ sets following a temporal splitting approach.
Please refer to [[1](#1)] for an in-depth description of the dataset and the related design choices.
[[1](#1)] _Bassani et al., Semantic Query Labeling Through Synthetic Query Generation, SIGIR 2021_
## Task 2
Cooming Soon!
## Citations
If you use this dataset in your research, please refer to the following papers:
_Bassani et al., Semantic Query Labeling Through Synthetic Query Generation, SIGIR 2021_
```bibtex
@inproceedings{DBLP:conf/sigir/BassaniP21,
author = {Elias Bassani and Gabriella Pasi},
title = {Semantic Query Labeling Through Synthetic Query Generation},
booktitle = {{SIGIR} '21: The 44th International {ACM} {SIGIR} Conference on Research
and Development in Information Retrieval, Virtual Event, Canada, July
11-15, 2021},
publisher = {{ACM}},
year = {2021},
}
```
_Bassani et al., On Building Benchmark Datasets for Understudied Information Retrieval Tasks: the Case of Semantic Query Labeling, IIR 2021_
```bibtex
@inproceedings{DBLP:conf/iir/BassaniP21,
author = {Elias Bassani and
Gabriella Pasi},
title = {On Building Benchmark Datasets for Understudied Information Retrieval
Tasks: the Case of Semantic Query Labeling},
booktitle = {Proceedings of the 11th Italian Information Retrieval Workshop 2021,
Bari, Italy, September 13-15, 2021},
publisher = {CEUR-WS.org},
year = {2021},
}
```
Also, because this dataset is built using queries from the AOL Query Logs, please cite:
_Pass et al., A Picture of Search, ICPS 2006_
```bibtex
@inproceedings{DBLP:conf/infoscale/PassCT06,
author = {Greg Pass and Abdur Chowdhury and Cayley Torgeson},
title = {A picture of search},
booktitle = {Proceedings of the 1st International Conference on Scalable
Information Systems, Infoscale 2006, Hong Kong, May 30-June 1,
2006},
publisher = {{ACM}},
year = {2006},
}
```