https://github.com/brightmart/albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
https://github.com/brightmart/albert_zh

albert bert chinese-corpus pre-trained pre-trained-model pytorch roberta tensorflow xlnet

Last synced: 6 days ago
JSON representation

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

• Host: GitHub
• URL: https://github.com/brightmart/albert_zh
• Owner: brightmart
• Created: 2019-09-26T16:45:30.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2022-11-21T08:02:01.000Z (almost 2 years ago)
• Last Synced: 2024-08-02T08:09:48.075Z (3 months ago)
• Topics: albert, bert, chinese-corpus, pre-trained, pre-trained-model, pytorch, roberta, tensorflow, xlnet
• Language: Python
• Homepage: https://arxiv.org/pdf/1909.11942.pdf
• Size: 2 MB
• Stars: 3,916
• Watchers: 103
• Forks: 759
• Open Issues: 100
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• ATPapers - brightmart / albert_zh - 海量中文预训练ALBERT模型 (Pretrained Language Model / Repository)
• awesome-bert - brightmart/albert_zh - SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS https://arxiv.org/pdf/1909.11942.pdf, (improvement over BERT:)
• StarryDivineSky - brightmart/albert_zh