Articles

General Natural Language Processing

• Neural autocoder for paragraphs and documents - LSTM representation
• LSTM over tree structures
• Teaching Machines to Read and Comprehend - DeepMind paper
• Improving distributional similarity with lessons learned from word embeddings
• Low-Dimensional Embeddings of Logic
• based on this paper
• Markov Logic Networks for Natural Language Question Answering
• Distant Supervision for Cancer Pathway Extraction From Text
• Template-Based Information Extraction without the Templates
• Retrofitting word vectors to semantic lexicons
• Unsupervised Learning of the Morphology of a Natural Language
• Learning the Structure of Biomedical Relation Extractions
• Relation extraction with matrix factorization and universal schemas
• Computational Grounded Cognition: a new alliance between grounded cognition and computational modelling
• Sequence to Sequence Learning - word vectors for machine translation
• A Neural Probabilistic Language Model
• Retrofitting word vectors to semantic lexicons
• Low-Dimensional Embeddings of Logic
• Neural autocoder for paragraphs and documents - LSTM representation
• LSTM over tree structures
• Efficient Estimation of Word Representations in Vector Space
• Markov Logic Networks for Natural Language Question Answering
• Natural Language Processing (Almost) from Scratch
• Learning the Structure of Biomedical Relation Extractions

Machine Translation

• Neural Machine Translation by jointly learning to align and translate
• English to French Demo
• Sequence to Sequence Learning with Neural Networks
• nips presentation
• Cross-lingual Pseudo-Projected Expectation Regularization for Weakly Supervised Learning
• Generating Chinese Named Entity Data from a Parallel Corpus
• IXA pipeline: Efficient and Ready to Use Multilingual NLP tools
• IXA pipeline: Efficient and Ready to Use Multilingual NLP tools
• Neural Machine Translation by jointly learning to align and translate
• Sequence to Sequence Learning with Neural Networks
• Cross-lingual Pseudo-Projected Expectation Regularization for Weakly Supervised Learning
• Neural Machine Translation by jointly learning to align and translate
• Sequence to Sequence Learning with Neural Networks
• Cross-lingual Pseudo-Projected Expectation Regularization for Weakly Supervised Learning
• seq2seq tutorial

Memory and Attention Models (from [DL4NLP](https://github.com/andrewt3000/DL4NLP))

• End-To-End Memory Networks
• Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
• Jason Weston lecture on MemNN
• Neural Turing Machines
• Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
• MemNN
• Stack RNN source code - algorithmic-patterns-with-stack/)
• Memory Networks
• End-To-End Memory Networks
• Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
• Evaluating prerequisite qualities for learning end to end dialog systems
• Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
• End-To-End Memory Networks
• Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
• Evaluating prerequisite qualities for learning end to end dialog systems
• Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
• Stack RNN source code - algorithmic-patterns-with-stack/)

Named Entity Recognition

• SpeedRead: A fast named entity recognition Pipeline
• A survey of named entity recognition and classification
• Benchmarking the extraction and disambiguation of named entities on the semantic web
• Knowledge base population: Successful approaches and challenges
• A survey of named entity recognition and classification
• Benchmarking the extraction and disambiguation of named entities on the semantic web
• Knowledge base population: Successful approaches and challenges

Neural Network

• Statistical Language Models based on Neural Networks
• Slides from Google Talk

Review Articles

• A unified architecture for natural language processing: Deep neural networks with multitask learning
• Deep Learning for Web Search and Natural Language Processing
• A Critical Review of Recurrent Neural Networksfor Sequence Learning
• Deep parsing in Watson
• Natural language processing: an introduction
• A Critical Review of Recurrent Neural Networksfor Sequence Learning
• Natural language processing: an introduction
• Online named entity recognition method for microtexts in social networking services: A case study of twitter
• Online named entity recognition method for microtexts in social networking services: A case study of twitter
• Probabilistic topic models

Single Exchange Dialogs

• Le - respond-to-this-email.html)
• A Neural Network Approach toContext-Sensitive Generation of Conversational Responses
• Neural Responding Machine for Short-Text Conversation
• A Neural Conversation Model
• A Neural Network Approach toContext-Sensitive Generation of Conversational Responses
• Neural Responding Machine for Short-Text Conversation
• A Neural Conversation Model
• A Neural Network Approach toContext-Sensitive Generation of Conversational Responses
• Neural Responding Machine for Short-Text Conversation
• A Neural Conversation Model

Supplementary Materials

• Word2Vec
• Relation Extraction with Matrix Factorization and Universal Schemas
• Presentation slides for MLN tutorial
• Presentation slides for QA applications of MLNs
• Presentation slides
• DrQA: Open Domain Question Answering
• Relation Extraction with Matrix Factorization and Universal Schemas
• Towards a Formal Distributional Semantics: Simulating Logical Calculi with Tensors

Thought Vectors

• Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
• Deep Recursive Neural Networks for Compositionality in Language
• Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
• Semi-supervised Sequence Learning
• Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
• Semi-supervised Sequence Learning
• Semi-supervised Sequence Learning
• gensim - technologies.com/doc2vec-tutorial/)

Word Vectors

• Efficient Estimation of Word Representations in Vector Space
• Mikolov
• Word2Vec tutorial
• GloVe: Global vectors for word representation
• sense2vec - on word sense disambiguation
• Infinite Dimensional Word Embeddings - new
• Skip Thought Vectors - word representation method
• Adaptive skip-gram - similar approach, with adaptive properties
• Word2Vec source code
• Efficient Estimation of Word Representations in Vector Space
• Infinite Dimensional Word Embeddings - new
• Word2Vec tutorial
• Evalutaion section led to controversy
• Mikolov

Blogs

Supplementary Materials

• Deep Learning, NLP, and Representations
• NLP Tutorial
• Understand & Implement Natural Language Processing

Credits

Supplementary Materials

• awesome-spanish-nlp
• awesome-machine-learning
• ai-reading-list
• DL4NLP
• nlp-reading-group
• jjangsangy's awesome-nlp
• awesome-machine-learning

Deep Learning for NLP

videos

• Stanford CS 224D: Deep Learning for NLP class
• Richard Socher
• A Primer on Neural Network Models for Natural Language Processing
• Deep Natural Language Processing
• Stanford CS 224D: Deep Learning for NLP class
• Richard Socher

Packages

Implementations

• Word2vec
• HLBL language model
• Real-valued vector "embeddings"
• Improving Word Representations Via Global Context And Multiple Word Prototypes
• Dependency based word embeddings
• Pre-trained word embeddings for WSJ corpus - Lab

Libraries

• TwitIE: An Open-Source Information Extraction Pipeline for Microblog Text
• Twitter-text - A JavaScript implementation of Twitter's text processing library
• gensim - Python library to conduct unsupervised semantic modelling from plain text
• CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
• Mecab (Korean)
• Practical Natural Language Processing done in Ruby
• Knwl.js - A Natural Language Processor in JS
• Natural - general natural language facilities for node
• fastText by Facebook - for efficient learning of word representations and sentence classification
• YAlign - A sentence aligner, a friendly tool for extracting parallel sentences from comparable corpora.
• jieba - Chinese Words Segmentation Utilities.
• SnowNLP - A library for processing Chinese text.
• Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
• PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python. Also contains some specific modules for parsing common NLP formats, most notably for FoLiA, but also ARPA language models, Moses phrasetables, GIZA++ alignments.
• python-ucto - Python binding to ucto (a unicode-aware rule-based tokenizer for various languages)
• Parserator - A toolkit for making domain-specific probabilistic parsers
• python-frog - Python binding to Frog, an NLP suite for Dutch. (pos tagging, lemmatisation, dependency parsing, NER)
• python-zpar - Python bindings for ZPar, a statistical part-of-speech-tagger, constiuency parser, and dependency parser for English.
• colibri-core - Python binding to C++ library for extracting and working with with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
• textacy - Higher level NLP built on spaCy
• PyStanfordDependencies - Python interface for converting Penn Treebank trees to Stanford Dependencies.
• scattertext - Python library to produce d3 visualizations of how language differs between corpora.
• CogComp-NlPy - Light-weight Python NLP annotators.
• PyThaiNLP - Thai NLP in Python Package.
• jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides pre-trained models for 40+ languages.
• CLTK
• pymorphy2 - a good pos-tagger for Russian
• BigARTM - a fast library for topic modelling
• AllenNLP - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
• MIT Information Extraction Toolkit - C, C++, and Python tools for named entity recognition and relation extraction
• CRF++ - Open source implementation of Conditional Random Fields (CRFs) for segmenting/labeling sequential data & other Natural Language Processing tasks.
• CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
• BLLIP Parser - BLLIP Natural Language Parser (also known as the Charniak-Johnson parser)
• ucto - Unicode-aware regular-expression based tokenizer for various languages. Tool and C++ library. Supports FoLiA format.
• libfolia - C++ library for the FoLiA format
• frog - Memory-based NLP suite developed for Dutch: PoS tagger, lemmatiser, dependency parser, NER, shallow parser, morphological analyzer.
• MeTA - MeTA : ModErn Text Analysis is a C++ Data Sciences Toolkit that facilitates mining big text data.
• Mecab (Japanese)
• Moses
• StarSpace - a library from Facebook for creating embeddings of word-level, paragraph-level, document-level and for text classification
• ClearNLP
• OpenRegex - based regular expression language and engine.
• CogcompNLP - Core libraries developed in the U of Illinois' Cognitive Computation Group.
• RDRPOSTagger - A robust POS tagging toolkit available (in both Java & Python) together with pre-trained models for 40+ languages.
• Saul - Library for developing NLP systems, including built in modules like SRL, POS, etc.
• ATR4S - Toolkit with state-of-the-art automatic term recognition methods.
• tm - Implementation of topic modeling based on regularized multilingual PLSA.
• word2vec-scala - Scala interface to word2vec model; includes operations on vectors like word-distance and word-analogy.
• Epic - Epic is a high performance statistical parser written in Scala, along with a framework for building complex structured prediction models.
• text2vec - Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
• wordVectors - An R package for creating and exploring word2vec and other word embedding models
• RMallet - R package to interface with the Java machine learning tool MALLET
• dfr-browser - Creates d3 visualizations for browsing topic models of text in a web browser.
• dfrtopics - R package for exploring topic models of text.
• sentiment_classifier - Sentiment Classification using Word Sense Disambiguation and WordNet Reader
• jProcessing - Japanese Natural Langauge Processing Libraries, with Japanese sentiment classification
• Clojure-openNLP - Natural Language Processing in Clojure (opennlp)
• Infections-clj - Rails-like inflection library for Clojure and ClojureScript
• postagga - A library to parse natural language in Clojure and ClojureScript
• A collection of Natural Language Processing (NLP) Ruby libraries, tools and software
• whatlang