https://github.com/hiyouga/toxic_detection
BUAA SCSE Autumn 2021 Machine Learning Group Homework
https://github.com/hiyouga/toxic_detection
bert debiasing pytorch toxic-comment-classification transformer transformers
Last synced: about 1 month ago
JSON representation
BUAA SCSE Autumn 2021 Machine Learning Group Homework
- Host: GitHub
- URL: https://github.com/hiyouga/toxic_detection
- Owner: hiyouga
- License: mit
- Created: 2021-12-14T10:17:01.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-12-31T12:49:29.000Z (over 4 years ago)
- Last Synced: 2025-12-23T07:43:46.078Z (5 months ago)
- Topics: bert, debiasing, pytorch, toxic-comment-classification, transformer, transformers
- Language: Python
- Homepage:
- Size: 6.61 MB
- Stars: 3
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Toxic_Detection
The technical report can be found [here](technical_report.pdf).
## Requirement
- Python >= 3.7
- torch >= 1.9.0
- numpy >= 1.17.2
- transformers >= 4.15.0
## Preparation
### Clone
```bash
git clone https://github.com/hiyouga/Toxic_Detection.git
```
### Create an anaconda environment:
```bash
conda create -n toxic python=3.7
conda activate toxic
pip install -r requirements.txt
```
## Usage
### Split data
```sh
python data/split_data.py
```
### Training
```sh
python main.py
```
### Show help message
```sh
python main.py -h
```
## Acknowledgements
This is a group homework for "Machine Learning" in BUAA Graduate School.
## Contact
hiyouga [AT] buaa [DOT] edu [DOT] cn
## License
MIT