NLP101
NLP 101: a resource repository for Deep Learning and Natural Language Processing
https://github.com/Huffon/NLP101
Last synced: 29 days ago
JSON representation
AWESOME blogs
Natural Language Processing
- Christopher Olah's Blog - 08-Understanding-LSTMs/) |
- Jay Alammar's Blog - word2vec/) |
- Chris McCormick's Blog - The Skip-Gram Model](http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model/) |
- The Gradient - evaluation-metrics-for-language-models/) |
- Distill.pub - in-rnns/) |
- Thomas Wolf's Blog - word-sentence-embeddings-ce48ddc8fc3a) |
- dair.ai - ai/a-light-introduction-to-transfer-learning-for-nlp-3e2cb56b48c8) |
- Machine Learning Mastery - neural-machine-translation-system-keras/) |
- Sebastian Ruder's Blog
- Chris McCormick's Blog - The Skip-Gram Model](http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model/) |
Deep Learning and Natural Language Processing
Deep Learning
- CS230
- Deep Learning Book
- Dive into Deep Learning
- Grokking Deep Learning - level APIs work under the hood. |
Natural Language Processing
- Neural Network Methods for NLP
- Eisenstein's NLP Note - Language-Processing-Adaptive-Computation/dp/0262042843) was published based on this note. |
- CS224U
- Natural Language Processing with PyTorch - friendly as all the codes are written in PyTorch. |
- Linguistic Fundamentals for Natural Language Processing
- Code-First Intro to Natural Language Processing - first NLP lecture by Rachel Thomas, the co-founder of fast.ai. The motivation that Rachel Thomas gives is mind blowing. |
- CS224N
- CS224U
Libraries related to the Natural Language Processing
Natural Language Processing
- Tensorflow
- PyTorch
- spaCy
- tensor2tensor
- Hugging Face Transformers - trained models. One of the key NLP libraries to not only developers but researchers as well. |
- Hugging Face Tokenizers
- SentencePiece - based vocabulary using subword information. |
- torchtext
- torchtext
- torchtext
Mathematics
Basic mathematics & Overview
- Calculus - 4, 11-13, 15-16 are very worth studying. |
- Mathematics for Machine Learning - brush. |
- Essence of calculus
- Calculus - 4, 11-13, 15-16 are very worth studying. |
Linear Algebra
- Linear Algebra
- Matrix methods in Data Analysis and Machine Learning
- Linear Algebra
- Matrix methods in Data Analysis and Machine Learning
- Statistics 110 - engineering major students. |
- Brandon Foltz's Statistics
NLP Specialists You should remember
Natural Language Processing
- CS224N
- GRU
- Grover
- CNN for NLP
- BiDAF
- Paper implementation & NLP with Korean language
- Various Word Embedding techniques
- Memory Networks
- RoBERTa
- XLM
- XLM-R
- BART
- Transformer
- BERT
- E2E Coref
- ELMo
- GPT-2
- NLP Progress
- ULMFiT
- Speech and Language Processing
- Neural Nets for NLP
- NLI Benchmark
- Reformer
- Transformer-XL
- XLNet
- Pointer Generator
- ELECTRA
- AllenNLP Interpret
- Word2vec
- RoBERTa
- Neural Nets for NLP
- Pointer Generator
- CNN for NLP
- Glove
- XLM
- Various Word Embedding techniques