Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/megagonlabs/asdc

Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス)
https://github.com/megagonlabs/asdc

corpus dialog japanese-language

Last synced: 6 days ago
JSON representation

Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス)

Host: GitHub
URL: https://github.com/megagonlabs/asdc
Owner: megagonlabs
License: cc-by-4.0
Created: 2022-06-16T00:17:13.000Z (about 2 years ago)
Default Branch: master
Last Pushed: 2024-01-19T10:09:22.000Z (5 months ago)
Last Synced: 2024-03-01T03:45:16.007Z (4 months ago)
Topics: corpus, dialog, japanese-language
Language: Python
Homepage:
Size: 61.9 MB
Stars: 23
Watchers: 6
Forks: 2
Open Issues: 12
Metadata Files:
- Readme: README.md
- License: LICENSE.APACHE.2.0.txt

Lists

awesome-stars - megagonlabs/asdc - Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス) (Python)

README

        
# Accommodation Search Dialog Corpus (in Japanese)



![Python Versions](https://img.shields.io/badge/python-3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11-blue)

[![CI](https://github.com/megagonlabs/asdc/actions/workflows/ci.yml/badge.svg)](https://github.com/megagonlabs/asdc/actions/workflows/ci.yml)

[![Typos](https://github.com/megagonlabs/asdc/actions/workflows/typos.yml/badge.svg)](https://github.com/megagonlabs/asdc/actions/workflows/typos.yml)

## Main part: [``data/main``](data/main)

The main part of this corpus consists of 210 Japanese dialogs between two people acting as a customer and an operator in a fictitious accommodation consultation service by using [Slack](https://slack.com/).

In a dialog, the customer informed the operator of their situation and needs.

Then based on the information, the operator conducted a search to meet the customer's request.

The dialog was finished once the operator judged that the requirements were specific enough to narrow appropriate accommodations.

Dialogs are in two formats.

- [Text](data/main/dialog/text): ``data/main/dialog/text/*.tsv``

- [JSON](data/main/dialog/json): ``data/main/dialog/json/*.json``

Please read [documents](docs/dialog) for more details.

### Annotations

| Name | Doc | Data |

| --- | --- | --- |

| SCUD | [Doc](docs/scud) | [``data/main/scud_example/main.Example.jsonl``](data/main/scud_example/main.Example.jsonl), [``data/main/scud``](data/main/scud) |

| Dialog act | [Doc](docs/dialog_act) | [``data/main/dialog_act``](data/main/dialog_act) |

| Request spans | [Doc](docs/request_span) | [``data/main/request_span``](data/main/request_span) |

The number of SCUDs is about 3,500.

| Name | Utterance | SCUD | DA | RS |

| --- | --- | --- | --- | ---|

| Agent | さようでございますか。 ||||

| | それでは、駐車場を無料でご利用できるホテルをお探しします。||||

| | 立地ですが、観光地をまわりやすい場所はいかがでしょうか？||||

| User | はい、観光地をまわりやすい場所にあるといいですね。| ホテルが観光地をまわりやすい場所にあると良い。 | はい ||

| | ただ1番の目的は出雲大社なので、そこまでアクセスがよければ助かります。|【customer】の1番の目的が出雲大社だ。
出雲大社までアクセスが良いホテルだと良い。|要求|出雲大社=>立地
アクセスがよければ=>立地|

## Supplemental SCUD part: [``data/supplemental/scud``](data/supplemental/scud): 57,447 examples

Files in ``data/supplemental/scud`` are Supplemental fictitious dialogs with SCUD annotations.

Please read [the documents](docs/supplemental/README.md) for more details.

- Most dialogs consist of a single pair of an agent utterance and a user utterance.

- Dialogs are stored in files in [``data/supplemental/utterances``](data/supplemental/utterances) : 51,390 dialogs

## Supplemental correctness-labeled SCUD part: [``data/supplemental/correctness_labeled_scud``](data/supplemental/correctness_labeled_scud): 8,115 examples

Files in ``data/supplemental/correctness_labeled_scud`` are Supplemental fictitious dialogs with SCUD and its correctness annotations.

If the value ``correct`` of an example is ``false``, the example has incorrect SCUDs.

## Vanilla part: [``data/vanilla``](data/vanilla): 74,799 dialogs

Files in ``data/vanilla`` are fictitious dialogs or queries made by crowd workers with no SCUD annotations.

Please read [the documents](docs/vanilla/README.md) for more details.

| Utterance 1 | Utterance 2 |

| --- | --- |

| あなたが、高級ホテルに泊まるとしたらどのようなホテルに泊まりたいですか? | 食事と景色が美しく、バラ風呂などの工夫があるホテル

| あなたが、1週間の国内旅行ができることになったら、どのような旅行をしたいですか? | ゆっくり読書をたのしむ旅行|

## References

### Dialog collection and SCUDs

1. Yuta Hayashibe.

    Self-Contained Utterance Description Corpus for Japanese Dialog.

    Proc of LREC, pp.1249-1255. (LREC 2022)

    [[PDF]](http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.133.pdf)

2. 林部祐太．

    要約付き宿検索対話コーパス．

    言語処理学会第27回年次大会論文集，pp.340-344. 2021. (NLP 2021)

    [[PDF]](https://www.anlp.jp/proceedings/annual_meeting/2021/pdf_dir/P2-5.pdf)

### Dialog acts and request spans

1. Hongjie Shi.

    A Span Extraction Approach for Dialog State Tracking: A Case Study in Hotel Booking Application.

    言語処理学会第27回年次大会論文集，pp.1593-1598. 2021. (NLP 2021)

    [[PDF]](https://www.anlp.jp/proceedings/annual_meeting/2021/pdf_dir/P8-10.pdf)

2. Hongjie Shi.

    A Sequence-to-sequence Approach for Numerical Slot-filling Dialog Systems.

    Proc of SIGdial, pp.272-277. 2020. (SIGdial 2020)

    [[PDF]](https://aclanthology.org/2020.sigdial-1.34.pdf)

## License

- Corpus, annotations and documents are licensed under [Creative Commons Attribution 4.0 International License](LICENSE.txt)

- Programs are licensed under [Apache License, Version 2.0](LICENSE.APACHE.2.0.txt)