https://github.com/jeongukjae/bert-optimization

WIP) Test repository to optimize BERT
https://github.com/jeongukjae/bert-optimization

Last synced: 6 months ago
JSON representation

WIP) Test repository to optimize BERT

• Host: GitHub
• URL: https://github.com/jeongukjae/bert-optimization
• Owner: jeongukjae
• License: mit
• Created: 2020-04-13T17:07:52.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2020-06-05T07:13:52.000Z (over 5 years ago)
• Last Synced: 2025-03-05T01:35:44.949Z (7 months ago)
• Language: Python
• Homepage:
• Size: 170 KB
• Stars: 4
• Watchers: 2
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# bert-optimization

![Test Python Status](https://github.com/jeongukjae/bert-optimization/workflows/Test%20Python/badge.svg)

Test repository to optimize BERT

## TODO

- [x] implement BERT Model

- [ ] implement Fine Tuning Tasks

  - [x] SST 2

  - [x] MNLI-m

  - [ ] MNLI-mm

  - [x] CoLA

  - [x] MRPC

  - [x] QQP

  - [x] RTE

  - [ ] STS-B

  - [ ] WNLI

  - [ ] QNLI

  - [ ] AX

  - [ ] SQuAD

- [x] Adaptive Inferance

  - [x] Training

  - [x] Inference

- [ ] INT8 Quantization

  - [x] Training

  - [ ] Inference

- [ ] Distillation