https://github.com/taishan1994/bert-sklearn-chinese
像使用sklearn那样来使用bert进行中文文本分类、命名实体识别、句子相似度判别
https://github.com/taishan1994/bert-sklearn-chinese
Last synced: 7 months ago
JSON representation
像使用sklearn那样来使用bert进行中文文本分类、命名实体识别、句子相似度判别
- Host: GitHub
- URL: https://github.com/taishan1994/bert-sklearn-chinese
- Owner: taishan1994
- Created: 2022-03-30T06:38:00.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-12-12T12:00:24.000Z (almost 3 years ago)
- Last Synced: 2023-03-04T13:53:00.194Z (over 2 years ago)
- Language: Python
- Size: 105 KB
- Stars: 4
- Watchers: 1
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# bert-sklearn-chinese
像使用sklearn那样来使用bert进行中文文本分类、命名实体识别、句子相似度判别。数据和预训练语言模型下载地址：
链接：https://pan.baidu.com/s/1iUzWoMIzfIYblyTflETYnA
提取码：y3hb
不同的任务中都有训练验证和预测。要替换成自己的数据只需要将数据整理成实例所需的格式即可。
# 文本分类
```python
python text_classification.py
```
# 命名实体识别
```python
python named_entity_recognition.py
```
# 文本相似度
```python
python text_pair_classification.py
```
# 感谢
> https://github.com/CLUEbenchmark/CLUE
> https://github.com/charles9n/bert-sklearn
> huggingface pytorch-pretrained-BERT github