Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

ATPapers

Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
https://github.com/ZhengZixiang/ATPapers

Last synced: 1 day ago
JSON representation

Programming Languages
Python 28 C++ 1 Jupyter Notebook 1
Categories
Pretrained Language Model 271 Transformer 65 Attention 43
Sub Categories
Papers 61 Chinese Blog 56 Models 49 Analysis & Tools 48 English Blog 34 Repository 32 Compression & Accelerating 32 Application 16 Multi-Modal 15 Knowledge 11 Multilingual 11 Repositories 7 Tutorial & Survey 6 Survey & Review 1
Keywords
bert 15 nlp 10 pytorch 10 tensorflow 9 roberta 7 transformer 7 natural-language-processing 6 gpt2 5 chinese 5 pretrained-models 4 language-model 4 albert 4 keras 4 deep-learning 4 transformers 3 xlnet 3 corpus 2 pre-trained 2 pre-trained-model 2 dataset 2 distillation 2 machine-learning 2 gpt-2 2 text-generation 2 text-classification 2 attention-head 1 interpretability 1 text-generator 1 story-telling 1 interpretable-deep-learning 1 implementation 1 transformer-encoder 1 literary-chinese 1 guwenbert 1 classical-chinese 1 lstm 1 pre-trained-language-models 1 rnn 1 attention 1 experiments 1 chinese-corpus 1 hb-experiment 1 translation 1 attention-mechanism 1 artificial-intelligence 1 universal-transformer 1 poetry 1 pretrain 1 semantic-similarity 1 sentence-analysis 1