https://github.com/jeremyfix/dstc
Dialog State Tracking Challenge viewer and tracker
https://github.com/jeremyfix/dstc
Last synced: about 2 months ago
JSON representation
Dialog State Tracking Challenge viewer and tracker
- Host: GitHub
- URL: https://github.com/jeremyfix/dstc
- Owner: jeremyfix
- License: lgpl-3.0
- Created: 2014-04-18T14:40:34.000Z (about 11 years ago)
- Default Branch: master
- Last Pushed: 2016-11-19T09:00:17.000Z (over 8 years ago)
- Last Synced: 2025-03-29T05:11:16.888Z (2 months ago)
- Language: C++
- Homepage:
- Size: 964 KB
- Stars: 15
- Watchers: 3
- Forks: 3
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Dialog State Tracking Challenge viewer, statistics and Yarbus baseline
======================================================================
In this repository , you will find various tools in C++:
- a tool for computing statistics on the dialog acts in the Dialog State Tracking challenge datasets (dstc2, dstc3)
- a tool for viewing the data as well as tracker outputs (synchronized to the viewer of the dialog/label files)
- the scripts for running the Yarbus tracker : check out [the dedicated page](http://jeremyfix.github.io/dstc/); The associated paper presenting the tracker is available on [arxiv](http://arxiv.org/abs/1507.06837)
It aims at providing an easy way to play with the JSON data under the format of [Dialog State Tracking Challenge](http://camdial.org/~mh521/dstc/). It has developped while working in the [ANR MaRDi project](http://mardi.metz.supelec.fr)
Install/Usage
-------------
- mkdir build
- cd build
- cmake ..
- make
As the viewer requires Qt, it has been disabled by default. To allow its compilation, you have to activate it while running cmake : [Yarbus](http://jeremyfix.github.io/dstc "Yarbus page")
- cmake .. -DDSTC_Viewer=ON
- make
The project is not aimed to be installed anywhere, so set up your LD_LIBRARY_FLAGS correctly before running the scripts :
- export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:./src
More about the Statistics
-------------------------
To compute the statistics
- cd CLONE_DIR/build
- export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:./src
- ./src/statistics dstc2_test.flist
statistics allows you to compute statistics over the dialogs. It displays the statistics in the console and generate a LaTex file for it as well that you need to compile (calling pdflatex 2 times on it); Below are the computed statistics for DSTC-2 :
- [DSTC-2 training data](./dstc2_train.flist.pdf "DSTC-2 training")
- [DSTC-2 dev data](./dstc2_dev.flist.pdf "DSTC-2 dev")
- [DSTC-2 test data](./dstc2_test.flist.pdf "DSTC-2 test")
More about the GUI
------------------
To run the GUI :
- cd CLONE_DIR/build
- export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:./src
- ./src/viewer
You can view :
- ontology files
- dialog and label files (providing a flist file listing the dialogs)
- tracker output files
All these files must fit the DSTC JSON format.
