https://github.com/piglaker/confusioncluster
An Analysis Tool to Models for Chinese Spell Checking Released on ACL2023.
https://github.com/piglaker/confusioncluster
nature-language-process probe
Last synced: 4 months ago
JSON representation
An Analysis Tool to Models for Chinese Spell Checking Released on ACL2023.
- Host: GitHub
- URL: https://github.com/piglaker/confusioncluster
- Owner: piglaker
- Created: 2022-04-15T09:32:07.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2023-05-11T08:23:04.000Z (about 2 years ago)
- Last Synced: 2024-11-16T03:50:47.473Z (6 months ago)
- Topics: nature-language-process, probe
- Language: Python
- Homepage:
- Size: 1.67 MB
- Stars: 6
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ConfusionCluster
分析及CCCR Probe 指标对于ACL 2023 (Findings): [Investigating Glyph Phonetic Information for Chinese Spell Checking: What Works and What's Next](https://arxiv.org/abs/2212.04068)
训练纠错模型的代码及训练数据见另一github仓库:[SpecialEdition](https://github.com/piglaker/SpecialEdition)
论文中的Probe实验一见github仓库:[]()
## Environment setting
python >= 3.7
`conda create -n ctcSE python=3.7`
`conda activate ctcSE`
```
pip install -r requirements.txt
```
## Quick Start
将main.py中路径设置为你要测试的纠错模型的路径。
`bash run.sh`
⚠️注意最好该模型是huggingface对象输出能够返回logits用于分析，否则请参考本项目中对ReaLiSe的处理，提前运行一次inference将模型logits保存到文件再读入。