Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.
Awesome Lists | Featured Topics | Projects
https://github.com/makcedward/nlp

:memo: This repository recorded my NLP journey.
https://github.com/makcedward/nlp
ai data-science deep-learning machine-learning nlp
Last synced: about 8 hours ago
JSON representation
:memo: This repository recorded my NLP journey.
Host: GitHub
URL: https://github.com/makcedward/nlp
Owner: makcedward
Created: 2018-05-18T22:05:56.000Z (over 6 years ago)
Default Branch: master
Last Pushed: 2020-08-29T04:04:59.000Z (about 4 years ago)
Last Synced: 2024-10-30T00:33:39.099Z (14 days ago)
Topics: ai, data-science, deep-learning, machine-learning, nlp
Language: Python
Homepage: https://makcedward.github.io/
Size: 2.19 MB
Stars: 1,073
Watchers: 50
Forks: 326
Open Issues: 10
Metadata Files:
- Readme: README.md
Awesome Lists containing this project

README

        # NLP - Tutorial

Repository to show how NLP can tacke real problem. Including the source code, dataset, state-of-the art in NLP

## Data Augmentation

*   [Data Augmentation in NLP](https://towardsdatascience.com/data-augmentation-in-nlp-2801a34dfc28)

*   [Data Augmentation library for Text](https://towardsdatascience.com/data-augmentation-library-for-text-9661736b13ff)

*   [Does your NLP model able to prevent adversarial attack?](https://medium.com/hackernoon/does-your-nlp-model-able-to-prevent-adversarial-attack-45b5ab75129c)

*   [How does Data Noising Help to Improve your NLP Model?](https://medium.com/towards-artificial-intelligence/how-does-data-noising-help-to-improve-your-nlp-model-480619f9fb10)

*   [Data Augmentation library for Speech Recognition](https://towardsdatascience.com/data-augmentation-for-speech-recognition-e7c607482e78)

*   [Data Augmentation library for Audio](https://towardsdatascience.com/data-augmentation-for-audio-76912b01fdf6)

*   [Unsupervied Data Augmentation](https://medium.com/towards-artificial-intelligence/unsupervised-data-augmentation-6760456db143)

*   [Adversarial Attacks in Textual Deep Neural Networks](https://medium.com/towards-artificial-intelligence/adversarial-attacks-in-textual-deep-neural-networks-245dc90029df)

*	[Back Translation in Text Augmentation by nlpaug](https://medium.com/towards-artificial-intelligence/back-translation-in-text-augmentation-by-nlpaug-d65518dd092f)

## General

*	[Tricks of Building an ML or DNN Model](https://medium.com/towards-artificial-intelligence/tricks-of-building-an-ml-or-dnn-model-b2de54cf440a)

## Text Preprocessing

| Section | Sub-Section | Description | Story |

| --- | --- | --- | --- |

| Tokenization | Subword Tokenization |  | [Medium](https://towardsdatascience.com/how-subword-helps-on-your-nlp-model-83dd1b836f46) |

| Tokenization | Word Tokenization |  | [Medium](https://medium.com/@makcedward/nlp-pipeline-word-tokenization-part-1-4b2b547e6a3) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-word_tokenization.ipynb) |

| Tokenization | Sentence Tokenization |  | [Medium](https://medium.com/@makcedward/nlp-pipeline-sentence-tokenization-part-6-86ed55b185e6) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-sentence_tokenization.ipynb) |

| Part of Speech | | | [Medium](https://medium.com/@makcedward/nlp-pipeline-part-of-speech-part-2-b683c90e327d) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-part_of_speech.ipynb) |

| Lemmatization | | | [Medium](https://medium.com/@makcedward/nlp-pipeline-lemmatization-part-3-4bfd7304957) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp_lemmatization.ipynb) |

| Stemming | | | [Medium](https://medium.com/@makcedward/nlp-pipeline-stemming-part-4-b60a319fd52) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-stemming.ipynb) |

| Stop Words | | | [Medium](https://medium.com/@makcedward/nlp-pipeline-stop-words-part-5-d6770df8a936) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-stop_words.ipynb) |

| Phrase Word Recognition | |  |  |

| Spell Checking | Lexicon-based | Peter Norvig algorithm | [Medium](https://towardsdatascience.com/correcting-your-spelling-error-with-4-operations-50bcfd519bb8) [Github](https://github.com/makcedward/nlp/blob/master/sample/util/nlp-util-spell_corrector.ipynb) |

| | Lexicon-based | Symspell | [Medium](https://towardsdatascience.com/essential-text-correction-process-for-nlp-tasks-f731a025fcc3) [Github](https://github.com/makcedward/nlp/blob/master/sample/util/nlp-util-symspell.ipynb) |

| | Machine Translation | Statistical Machine Translation | [Medium](https://towardsdatascience.com/correcting-text-input-by-machine-translation-and-classification-fa9d82087de1) |

| | Machine Translation | Attention | [Medium](https://towardsdatascience.com/fix-your-text-thought-attention-before-nlp-tasks-7dc074b9744f) |

| String Matching | Fuzzywuzzy | | [Medium](https://towardsdatascience.com/how-fuzzy-matching-improve-your-nlp-model-bc617385ad6b) [Github](https://github.com/makcedward/nlp/blob/master/sample/preprocessing/nlp-preprocessing-string_matching-fuzzywuzzy.ipynb) |

## Text Representation

| Section | Sub-Section | Research Lab | Story | Source |

| --- | --- | --- | --- | --- |

| Traditional Method | Bag-of-words (BoW) |  | [Medium](https://towardsdatascience.com/3-basic-approaches-in-bag-of-words-which-are-better-than-word-embeddings-c2cbc7398016) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-bag_of_words.ipynb) |  |

|  | Latent Semantic Analysis (LSA) and Latent Dirichlet Allocation (LDA) |  | [Medium](https://towardsdatascience.com/2-latent-methods-for-dimension-reduction-and-topic-modeling-20ff6d7d547) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-lsa_lda.ipynb) |  |

| Character Level | Character Embedding | NYU | [Medium](https://medium.com/@makcedward/besides-word-embedding-why-you-need-to-know-character-embedding-6096a34a3b10) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-character_embedding.ipynb) | [Paper](https://arxiv.org/pdf/1502.01710v5.pdf) |

| Word Level | Negative Sampling and Hierarchical Softmax |  | [Medium](https://towardsdatascience.com/how-negative-sampling-work-on-word2vec-7bf8d545b116) |  |

|  | Word2Vec, GloVe, fastText |  | [Medium](https://towardsdatascience.com/3-silver-bullets-of-word-embedding-in-nlp-10fa8f50cc5a) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-word_embedding.ipynb) |  |

|  | Contextualized Word Vectors (CoVe) | Salesforce | [Medium](https://towardsdatascience.com/replacing-your-word-embeddings-by-contextualized-word-vectors-9508877ad65d) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-embeddings-word-cove.ipynb) | [Paper](http://papers.nips.cc/paper/7209-learned-in-translation-contextualized-word-vectors.pdf) [Code](https://github.com/salesforce/cove) |

|  | Misspelling Oblivious (word) Embeddings | Facebook | [Medium](https://medium.com/towards-artificial-intelligence/new-model-for-word-embeddings-which-are-resilient-to-misspellings-moe-9ecfd3ab473e) | [Paper](https://arxiv.org/pdf/1905.09755.pdf) |

|  | Embeddings from Language Models (ELMo) | AI2 | [Medium](https://towardsdatascience.com/elmo-helps-to-further-improve-your-word-embeddings-c6ed2c9df95f) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-embeddings-sentence-elmo.ipynb) | [Paper](https://arxiv.org/pdf/1802.05365.pdf) [Code](https://github.com/allenai/allennlp/) |

|  | Contextual String Embeddings | Zalando Research | [Medium](https://towardsdatascience.com/contextual-embeddings-for-nlp-sequence-labeling-9a92ba5a6cf0) | [Paper](http://aclweb.org/anthology/C18-1139) [Code](https://github.com/zalandoresearch/flair)| 

| Sentence Level | Skip-thoughts |  | [Medium](https://towardsdatascience.com/transforming-text-to-sentence-embeddings-layer-via-some-thoughts-b77bed60822c) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-skip_thoughts.ipynb) | [Paper](https://arxiv.org/pdf/1506.06726) [Code](https://github.com/ryankiros/skip-thoughts) |

|  | InferSent |  | [Medium](https://towardsdatascience.com/learning-sentence-embeddings-by-natural-language-inference-a50b4661a0b8) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-embeddings-sentence-infersent.ipynb) | [Paper](https://arxiv.org/pdf/1705.02364) [Code](https://github.com/facebookresearch/InferSent) |

|  | Quick-Thoughts | Google | [Medium](https://towardsdatascience.com/building-sentence-embeddings-via-quick-thoughts-945484cae273) | [Paper](https://arxiv.org/pdf/1803.02893.pdf) [Code](https://github.com/lajanugen/S2V) |

|  | General Purpose Sentence (GenSen) |  | [Medium](https://towardsdatascience.com/learning-generic-sentence-representation-by-various-nlp-tasks-df39ce4e81d7) | [Paper](https://arxiv.org/pdf/1804.00079.pdf) [Code](https://github.com/Maluuba/gensen) |

|  | Bidirectional Encoder Representations from Transformers (BERT) | Google | [Medium](https://towardsdatascience.com/how-bert-leverage-attention-mechanism-and-transformer-to-learn-word-contextual-relations-5bbee1b6dbdb) | [Paper(2019)](https://arxiv.org/pdf/1810.04805) [Code](https://github.com/google-research/bert)| 

|  | Generative Pre-Training (GPT) | OpenAI | [Medium](https://towardsdatascience.com/combining-supervised-learning-and-unsupervised-learning-to-improve-word-vectors-d4dea84ec36b) | [Paper(2019)](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf) [Code](https://github.com/openai/finetune-transformer-lm)| 

|  | Self-Governing Neural Networks (SGNN) | Google | [Medium](https://towardsdatascience.com/embeddings-free-deep-learning-nlp-model-ce067c7a7c93) | [Paper](https://aclweb.org/anthology/D18-1105) | 

|  | Multi-Task Deep Neural Networks (MT-DNN) | Microsoft | [Medium](https://towardsdatascience.com/when-multi-task-learning-meet-with-bert-d1c49cc40a0c) | [Paper(2019)](https://arxiv.org/pdf/1901.11504.pdf) | 

|  | Generative Pre-Training-2 (GPT-2) | OpenAI | [Medium](https://towardsdatascience.com/too-powerful-nlp-model-generative-pre-training-2-4cc6afb6655) | [Paper(2019)](https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf) [Code](https://github.com/openai/gpt-2)| 

|  | Universal Language Model Fine-tuning (ULMFiT) | OpenAI | [Medium](https://towardsdatascience.com/multi-task-learning-in-language-model-for-text-classification-c3acc1fedd89) | [Paper](https://arxiv.org/pdf/1801.06146.pdf) [Code](https://github.com/fastai/fastai)| 

|  | BERT in Science Domain |  | [Medium](https://towardsdatascience.com/how-to-apply-bert-in-scientific-domain-2d9db0480bd9) | [Paper(2019)](https://arxiv.org/pdf/1903.10676.pdf) [Paper(2019)](https://arxiv.org/pdf/1901.08746.pdf)| 

|  | BERT in Clinical Domain | NYU/PU | [Medium](https://towardsdatascience.com/how-do-they-apply-bert-in-the-clinical-domain-49113a51be50) | [Paper(2019)](https://arxiv.org/pdf/1904.03323.pdf) [Paper(2019)](https://arxiv.org/pdf/1904.05342.pdf)| 

|  | RoBERTa | UW/Facebook | [Medium](https://medium.com/towards-artificial-intelligence/a-robustly-optimized-bert-pretraining-approach-f6b6e537e6a6) | [Paper(2019)](https://arxiv.org/pdf/1904.03323.pdf) [Paper](https://arxiv.org/pdf/1907.11692.pdf)| 

|  | Unified Language Model for NLP and NLU (UNILM) | Microsoft | [Medium](https://medium.com/towards-artificial-intelligence/unified-language-model-pre-training-for-natural-language-understanding-and-generation-f87dc226aa2) | [Paper(2019)](https://arxiv.org/pdf/1905.03197.pdf)| 

|  | Cross-lingual Language Model (XLMs) | Facebook | [Medium](https://medium.com/towards-artificial-intelligence/cross-lingual-language-model-56a65dba9358) | [Paper(2019)](https://arxiv.org/pdf/1901.07291.pdf)| 

|  | Transformer-XL | CMU/Google | [Medium](https://medium.com/towards-artificial-intelligence/address-limitation-of-rnn-in-nlp-problems-by-using-transformer-xl-866d7ce1c8f4) | [Paper(2019)](https://arxiv.org/pdf/1901.02860.pdf)| 

|  | XLNet | CMU/Google | [Medium](https://medium.com/dataseries/why-does-xlnet-outperform-bert-da98a8503d5b) | [Paper(2019)](https://arxiv.org/pdf/1906.08237.pdf)| 

|  | CTRL | Salesforce | [Medium](https://medium.com/dataseries/a-controllable-framework-for-text-generation-8be9e1f2c5db) | [Paper(2019)](https://arxiv.org/pdf/1909.05858.pdf)|z

|  | ALBERT | Google/Toyota | [Medium](https://medium.com/towards-artificial-intelligence/a-lite-bert-for-reducing-inference-time-bed8d990daac) | [Paper(2019)](https://arxiv.org/pdf/1909.11942.pdf)|

|  | T5 | Googles | [Medium](https://medium.com/dataseries/text-to-text-transfer-transformer-e35dc28bae14) | [Paper(2019)](https://arxiv.org/pdf/1910.10683.pdf)|

|  | MultiFiT |   | [Medium](https://medium.com/towards-artificial-intelligence/multi-lingual-language-model-fine-tuning-81922a80438f) | [Paper(2019)](https://arxiv.org/pdf/1909.04761.pdf) |

|  | XTREME |   | [Medium](https://medium.com/towards-artificial-intelligence/new-multilingual-model-xtreme-276bbaa26d79) | [Paper(2020)](https://arxiv.org/pdf/2003.11080.pdf) |

|  | REALM |   | [Medium](https://medium.com/towards-artificial-intelligence/realm-retrieval-augmented-language-model-pre-training-534feae7ab98) | [Paper(2020)](https://arxiv.org/pdf/2002.08909.pdf) |

| Document Level | lda2vec |  | [Medium](https://towardsdatascience.com/combing-lda-and-word-embeddings-for-topic-modeling-fe4a1315a5b4) | [Paper](https://arxiv.org/pdf/1605.02019.pdf) |

|  | doc2vec | Google | [Medium](https://towardsdatascience.com/understand-how-to-transfer-your-paragraph-to-vector-by-doc2vec-1e225ccf102) [Github](https://github.com/makcedward/nlp/blob/master/sample/embeddings/nlp-embeddings-document-doc2vec.ipynb) | [Paper](https://arxiv.org/pdf/1405.4053.pdf) |

## NLP Problem 

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| Named Entity Recognition (NER) | Pattern-based Recognition | | | [Medium](https://towardsdatascience.com/pattern-based-recognition-did-help-in-nlp-5c54b4e7a962)  |  |

| | Lexicon-based Recognition | | | [Medium](https://towardsdatascience.com/step-out-from-regular-expression-for-feature-engineering-134e594f542c) |  |

| | spaCy Pre-trained NER | | | [Medium](https://medium.com/@makcedward/named-entity-recognition-3fad3f53c91e) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-named_entity_recognition.ipynb) |  |

| Optical Character Recognition (OCR) | Printed Text | Google Cloud Vision API | Google | [Medium](https://towardsdatascience.com/secret-of-google-web-based-ocr-service-fe30eecedd01) | [Paper](https://das2018.cvl.tuwien.ac.at/media/filer_public/85/fd/85fd4698-040f-45f4-8fcc-56d66533b82d/das2018_short_papers.pdf) |

| | Handwriting | LSTM | Google | [Medium](https://towardsdatascience.com/lstm-based-handwriting-recognition-by-google-eb99663ca6de) | [Paper](https://arxiv.org/pdf/1902.10525.pdf) | 

| Text Summarization | Extractive Approach | | | [Medium](https://medium.com/@makcedward/text-summarization-extractive-approach-567fe4b85c23) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-text_summarization_extractive.ipynb) | |

| | Abstractive Approach |  |  | [Medium](https://medium.com/dataseries/summarize-document-by-combing-extractive-and-abstractive-steps-40295310526) | 

| Emotion Recognition | Audio, Text, Visual | 3 Multimodals for Emotion Recognition |  | [Medium](https://becominghuman.ai/multimodal-for-emotion-recognition-21df267fddc4) |

## Acoustic Problem

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| Feature Representation | Unsupervised Learning| Introduction to Audio Feature Learning | |  [Medium](https://medium.com/hackernoon/how-can-you-apply-unsupervised-learning-on-audio-data-be95153c5860) | [Paper 1](https://ai.stanford.edu/~ang/papers/nips09-AudioConvolutionalDBN.pdf) [Paper 2](https://arxiv.org/pdf/1607.03681.pdf) [Paper 3](https://arxiv.org/pdf/1712.03835.pdf)

| Feature Representation | Unsupervised Learning| Speech2Vec and Sentence Level Embeddings | |  [Medium](https://medium.com/towards-artificial-intelligence/two-ways-to-learn-audio-embeddings-9dfcaab10ba6) | [Paper 1](https://arxiv.org/pdf/1803.08976.pdf) [Paper 2](https://arxiv.org/pdf/1902.07817.pdf)

| Feature Representation | Unsupervised Learning| Wav2vec | |  [Medium](https://becominghuman.ai/unsupervised-pre-training-for-speech-recognition-wav2vec-aba643824324) | [Paper](https://arxiv.org/pdf/1904.05862.pdf)

| Speech-to-text | | Introduction to Speeh-to-text | |  [Medium](https://becominghuman.ai/how-does-your-assistant-device-work-based-on-text-to-speech-technology-5f31e56eae7e) |

## Text Distance Measurement

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| Euclidean Distance, Cosine Similarity and Jaccard Similarity |  |  |  | [Medium](https://towardsdatascience.com/3-basic-distance-measurement-in-text-mining-5852becff1d7) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-3_basic_distance_measurement_in_text_mining.ipynb) |  |

| Edit Distance | Levenshtein Distance |  |  | [Medium](https://towardsdatascience.com/measure-distance-between-2-words-by-simple-calculation-a97cf4993305) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-distance-edit_distance.ipynb) |  |

| Word Moving Distance (WMD) |  |  |  | [Medium](https://towardsdatascience.com/word-distance-between-word-embeddings-cc3e9cf1d632) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-word_mover_distance.ipynb) |

| Supervised Word Moving Distance (S-WMD) |  |  |  | [Medium](https://towardsdatascience.com/word-distance-between-word-embeddings-with-weight-bf02869c50e1)|

| Manhattan LSTM |  |  |  | [Medium](https://towardsdatascience.com/text-matching-with-deep-learning-e6aa05333399) | [Paper](http://www.mit.edu/~jonasm/info/MuellerThyagarajan_AAAI16.pdf) |

## Model Interpretation

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| ELI5, LIME and Skater |  |  |  | [Medium](https://towardsdatascience.com/3-ways-to-interpretate-your-nlp-model-to-management-and-customer-5428bc07ce15) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-model_interpretation.ipynb) |

| SHapley Additive exPlanations (SHAP) |  |  |  | [Medium](https://towardsdatascience.com/interpreting-your-deep-learning-model-by-shap-e69be2b47893) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-model_interpretation_shap.ipynb) |

| Anchors |  |  |  | [Medium](https://towardsdatascience.com/anchor-your-model-interpretation-by-anchors-aa4ed7104032) [Github](https://github.com/makcedward/nlp/blob/master/sample/nlp-model_interpretation_anchor.ipynb) |

## Graph

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| Embeddings | | TransE, RESCAL, DistMult, ComplEx, PyTorch BigGraph | |  [Medium](https://medium.com/towards-artificial-intelligence/a-gentle-introduction-to-graph-embeddings-c7b3d1db0fa8) | [RESCAL(2011)](https://pdfs.semanticscholar.org/68a3/3a3afac65eb6e0fb3726c1f9c8b727f32a42.pdf?_ga=2.21151099.1397092755.1575835510-317581445.1533093975) [TransE(2013)](https://papers.nips.cc/paper/5071-translating-embeddings-for-modeling-multi-relational-data.pdf) [DistMult(2015)](https://arxiv.org/pdf/1412.6575v4.pdf) [ComplEx(2016)](https://arxiv.org/pdf/1606.06357.pdf) [PyTorch BigGraph(2019)](https://arxiv.org/pdf/1903.12287.pdf)

| Embeddings | | DeepWalk, node2vec, LINE, GraphSAGE | |  [Medium](https://medium.com/towards-artificial-intelligence/random-walk-in-node-embeddings-deepwalk-node2vec-line-and-graphsage-ca23df60e493) | [DeepWalk(2014)](https://arxiv.org/pdf/1403.6652.pdf) [node2vec(2015)](https://cs.stanford.edu/~jure/pubs/node2vec-kdd16.pdf) [LINE(2015)](https://arxiv.org/pdf/1503.03578.pdf) [GraphSAGE(2018)](https://arxiv.org/pdf/1706.02216.pdf)

| Embeddings | | WLG, GCN, GAT, GIN | |  [Medium](https://medium.com/towards-artificial-intelligence/4-graph-neural-networks-you-need-to-know-wlg-gcn-gat-gin-1bf10d29d836) | [WLG(2011)](http://www.jmlr.org/papers/volume12/shervashidze11a/shervashidze11a.pdf) [GCN2017)](https://arxiv.org/pdf/1609.02907.pdf) [GAT(2017)](https://arxiv.org/pdf/1710.10903.pdf) [GraphSAGE(2018)](https://arxiv.org/pdf/1810.00826.pdf)

| Embeddings | | [PinSAGE(2018)](https://arxiv.org/pdf/1806.01973.pdf) | Pinterest | [Medium](https://medium.com/towards-artificial-intelligence/when-graphsage-meets-pinterest-5e82c9a88120)

| Embeddings | | [HoIE(2015)](https://arxiv.org/pdf/1510.04935.pdf), [SimpIE(2018)](https://arxiv.org/pdf/1802.04868.pdf) | | [Medium](https://medium.com/towards-artificial-intelligence/knowledge-graph-embeddings-dc9251bffa80)

| Embeddings | | [ContE(2017)](http://repository.ittelkom-pwt.ac.id/4358/1/Learning%20Contextual%20Embeddings%20for%20Knowledge%20Graph%20Completion.pdf), [ETE(2017)](https://persagen.com/files/misc/Moon2017Learning.pdf) | | [Medium](https://medium.com/towards-artificial-intelligence/from-conte-to-entity-type-embeddings-in-natural-language-processing-19e53db90dd5)

## Meta-Learning

| Section | Sub-Section | Description | Story |

| --- | --- | --- | --- |

| Introduction |  | [Matching Nets(2016)](https://arxiv.org/pdf/1606.04080.pdf) [MANN(2016)](https://arxiv.org/pdf/1605.06065.pdf) [LSTM-based meta-learner(2017)](https://openreview.net/pdf?id=rJY0-Kcll) [Prototypical Networks(2017)](https://arxiv.org/pdf/1703.05175.pdf) [ARC(2017)](https://arxiv.org/pdf/1703.00767.pdf) [MAML(2017)](https://arxiv.org/pdf/1703.03400.pdf) [MetaNet(2017)](https://arxiv.org/pdf/1703.00837.pdf) | [Medium](https://medium.com/towards-artificial-intelligence/a-gentle-introduction-to-meta-learning-8e36f3d93f61)  |

| NLP | Dialog Generation | [DAML(2019)](https://arxiv.org/pdf/1906.03520.pdf), [PAML(2019)](https://arxiv.org/pdf/1905.10033.pdf), [NTMS(2019)](https://arxiv.org/pdf/1910.10487.pdf) | [Medium](https://medium.com/towards-artificial-intelligence/meta-learning-in-dialog-generation-41367e397086)

| | Classification | [Intent Embeddings(2016)](https://www.csie.ntu.edu.tw/~yvchen/doc/ICASSP16_ZeroShot.pdf) [LEOPARD(2019)](https://arxiv.org/pdf/1911.03863.pdf) | [Medium](https://medium.com/towards-artificial-intelligence/meta-learning-in-nlp-classification-db78fbcdf15c)

| CV | Unsupervised Learning | [CACTUs(2018)](https://arxiv.org/pdf/1810.02334.pdf) | [Medium](https://medium.com/dataseries/unsupervised-learning-in-meta-learning-f71c549e2ae2)

| General | | [Siamese Network(1994)](http://papers.nips.cc/paper/769-signature-verification-using-a-siamese-time-delay-neural-network.pdf), [Triplet Network(2015)](https://arxiv.org/pdf/1412.6622.pdf) | [Medium](https://medium.com/towards-artificial-intelligence/how-do-twins-and-triplet-neural-network-work-cfed66d9b829)

| | [MAML+(2018)](https://arxiv.org/pdf/1810.09502.pdf) | [Medium](https://medium.com/towards-artificial-intelligence/from-maml-to-maml-20de07203d59)

## Image

| Section | Sub-Section | Description | Research Lab | Story | Paper & Code |

| --- | --- | --- | --- | --- | --- |

| Object Detection |  | R-CNN | |  [Medium](https://medium.com/towards-artificial-intelligence/how-r-cnn-works-on-object-detection-443679b0187c) | [Paper(2013)](https://arxiv.org/pdf/1311.2524.pdf)

| Object Detection |  | Fast R-CNN | |  [Medium](https://medium.com/dataseries/how-fast-r-cnn-works-on-object-detection-546e4812eaa1) | [Paper(2015)](https://arxiv.org/pdf/1504.08083.pdf)

| Object Detection |  | Faster R-CNN | |  [Medium](https://becominghuman.ai/how-faster-r-cnn-works-on-object-detection-3d92432ce321) | [Paper(2015)](https://arxiv.org/pdf/1506.01497.pdf)

| Object Detection |  | VGGNet | |  [Medium](https://becominghuman.ai/what-is-the-vgg-neural-network-a590caa72643) | [Paper(2014)](https://arxiv.org/pdf/1409.1556.pdf)

| Instance Segmentation | | Mask R-CNN | FAIR | [Medium](https://medium.com/dataseries/mask-r-cnn-for-instance-segmentation-7f0708e3e25b) | [Paper(2017)](https://arxiv.org/pdf/1703.06870.pdf) | 

| Image Classification |  | [ResNet(2015)](https://arxiv.org/pdf/1512.03385.pdf) |Microsoft |  [Medium](https://medium.com/dataseries/how-does-resnet-improve-performance-caaa436f885b)  |

| Image Classification |  | [ResNeXt(2016)](https://arxiv.org/pdf/1611.05431.pdf) | |  [Medium](https://medium.com/dataseries/enhancing-resnet-to-resnext-for-image-classification-3449f62a774c)  |

## Evaluation

| Section | Sub-Section | Description | Story |

| --- | --- | --- | --- |

| Introduction | | | [Medium](https://medium.com/towards-artificial-intelligence/evaluation-metrics-are-what-you-need-to-define-in-the-earlier-stage-99dbfae51472)

| Classification | | Confusion Matrix, ROC, AUC | [Medium](https://medium.com/towards-artificial-intelligence/evaluation-metrics-for-classification-problems-e7442092bc5)

| Regression | | MAE, MSE, RMSE, MAPE, WMAPE | [Medium](https://medium.com/towards-artificial-intelligence/evaluation-metrics-for-regression-problems-fff2ac8e3f43)

| Textual | | Perplexity, BLEU, GER, WER, GLUE | [Medium](https://medium.com/towards-artificial-intelligence/evaluation-metrics-for-textual-problems-6e881feef5ad)

## Source Code 

| Section | Sub-Section | Description | Link |

| --- | --- | --- | --- |

| Spellcheck |  |  | [Github](https://github.com/norvig/pytudes) |

| InferSent |  |  | [Github](https://github.com/facebookresearch/InferSent) |