Libraries

• Pattern - A web mining module for the Python programming language. It has tools for natural language processing, machine learning, among others.
• TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of NLTK and Pattern, and plays nicely with both.
• MALLET - MAchine Learning for LanguagE Toolkit - package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.
• TwitIE: An Open-Source Information Extraction Pipeline for Microblog Text
• Twitter-text - A JavaScript implementation of Twitter's text processing library
• gensim - Python library to conduct unsupervised semantic modelling from plain text
• CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
• Mecab (Korean)
• Practical Natural Language Processing done in Ruby
• Scikit-learn: Machine learning in Python
• Word2vec in Java
• Knwl.js - A Natural Language Processor in JS
• Retext - Extensible system for analyzing and manipulating natural language
• Natural - general natural language facilities for node
• fastText by Facebook - for efficient learning of word representations and sentence classification
• YAlign - A sentence aligner, a friendly tool for extracting parallel sentences from comparable corpora.
• jieba - Chinese Words Segmentation Utilities.
• SnowNLP - A library for processing Chinese text.
• Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
• PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python. Also contains some specific modules for parsing common NLP formats, most notably for [FoLiA](http://proycon.github.io/folia/), but also ARPA language models, Moses phrasetables, GIZA++ alignments.
• python-ucto - Python binding to ucto (a unicode-aware rule-based tokenizer for various languages)
• Parserator - A toolkit for making domain-specific probabilistic parsers
• python-frog - Python binding to Frog, an NLP suite for Dutch. (pos tagging, lemmatisation, dependency parsing, NER)
• python-zpar - Python bindings for [ZPar](https://github.com/frcchang/zpar), a statistical part-of-speech-tagger, constiuency parser, and dependency parser for English.
• colibri-core - Python binding to C++ library for extracting and working with with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
• textacy - Higher level NLP built on spaCy
• PyStanfordDependencies - Python interface for converting Penn Treebank trees to Stanford Dependencies.
• scattertext - Python library to produce d3 visualizations of how language differs between corpora.
• CogComp-NlPy - Light-weight Python NLP annotators.
• PyThaiNLP - Thai NLP in Python Package.
• jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides pre-trained models for 40+ languages.
• CLTK
• pymorphy2 - a good pos-tagger for Russian
• BigARTM - a fast library for topic modelling
• AllenNLP - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
• MIT Information Extraction Toolkit - C, C++, and Python tools for named entity recognition and relation extraction
• CRF++ - Open source implementation of Conditional Random Fields (CRFs) for segmenting/labeling sequential data & other Natural Language Processing tasks.
• CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
• BLLIP Parser - BLLIP Natural Language Parser (also known as the Charniak-Johnson parser)
• ucto - Unicode-aware regular-expression based tokenizer for various languages. Tool and C++ library. Supports FoLiA format.
• libfolia - C++ library for the [FoLiA format](http://proycon.github.io/folia/)
• frog - Memory-based NLP suite developed for Dutch: PoS tagger, lemmatiser, dependency parser, NER, shallow parser, morphological analyzer.
• MeTA - [MeTA : ModErn Text Analysis](https://meta-toolkit.org/) is a C++ Data Sciences Toolkit that facilitates mining big text data.
• Mecab (Japanese)
• Moses
• StarSpace - a library from Facebook for creating embeddings of word-level, paragraph-level, document-level and for text classification
• ClearNLP
• OpenRegex - based regular expression language and engine.
• CogcompNLP - Core libraries developed in the U of Illinois' Cognitive Computation Group.
• RDRPOSTagger - A robust POS tagging toolkit available (in both Java & Python) together with pre-trained models for 40+ languages.
• Saul - Library for developing NLP systems, including built in modules like SRL, POS, etc.
• ATR4S - Toolkit with state-of-the-art [automatic term recognition](https://en.wikipedia.org/wiki/Terminology_extraction) methods.
• tm - Implementation of topic modeling based on regularized multilingual [PLSA](https://en.wikipedia.org/wiki/Probabilistic_latent_semantic_analysis).
• word2vec-scala - Scala interface to word2vec model; includes operations on vectors like word-distance and word-analogy.
• Epic - Epic is a high performance statistical parser written in Scala, along with a framework for building complex structured prediction models.
• text2vec - Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
• wordVectors - An R package for creating and exploring word2vec and other word embedding models
• RMallet - R package to interface with the Java machine learning tool MALLET
• dfr-browser - Creates d3 visualizations for browsing topic models of text in a web browser.
• dfrtopics - R package for exploring topic models of text.
• sentiment_classifier - Sentiment Classification using Word Sense Disambiguation and WordNet Reader
• jProcessing - Japanese Natural Langauge Processing Libraries, with Japanese sentiment classification
• Clojure-openNLP - Natural Language Processing in Clojure (opennlp)
• Infections-clj - Rails-like inflection library for Clojure and ClojureScript
• postagga - A library to parse natural language in Clojure and ClojureScript
• A collection of Natural Language Processing (NLP) Ruby libraries, tools and software
• whatlang

Implementations

• Improving Word Representations Via Global Context And Multiple Word Prototypes
• Word2vec
• HLBL language model
• Real-valued vector "embeddings"
• Dependency based word embeddings
• Pre-trained word embeddings for WSJ corpus - Lab

Services

• Wit-ai - Natural Language Interface for apps and devices
• Natural Language Understanding - developer-cloud/natural-language-classifier-nodejs) and [Machine Translation](https://github.com/watson-developer-cloud/language-translator-nodejs) API Demos

Single Exchange Dialogs

• Le - respond-to-this-email.html)
• A Neural Network Approach toContext-Sensitive Generation of Conversational Responses
• Neural Responding Machine for Short-Text Conversation
• A Neural Conversation Model
• A Neural Network Approach toContext-Sensitive Generation of Conversational Responses
• Neural Responding Machine for Short-Text Conversation
• A Neural Conversation Model

Review Articles

• Deep Learning for Web Search and Natural Language Processing
• A Critical Review of Recurrent Neural Networksfor Sequence Learning
• Deep parsing in Watson
• Natural language processing: an introduction
• Online named entity recognition method for microtexts in social networking services: A case study of twitter
• A unified architecture for natural language processing: Deep neural networks with multitask learning
• A Critical Review of Recurrent Neural Networksfor Sequence Learning
• Natural language processing: an introduction

Word Vectors

• Efficient Estimation of Word Representations in Vector Space
• Mikolov
• Word2Vec tutorial
• GloVe: Global vectors for word representation
• sense2vec - on word sense disambiguation
• Infinite Dimensional Word Embeddings - new
• Skip Thought Vectors - word representation method
• Adaptive skip-gram - similar approach, with adaptive properties
• Efficient Estimation of Word Representations in Vector Space
• Infinite Dimensional Word Embeddings - new
• Word2Vec source code

Thought Vectors

• Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
• Deep Recursive Neural Networks for Compositionality in Language
• Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
• Semi-supervised Sequence Learning
• Semi-supervised Sequence Learning
• Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks

Machine Translation

• Neural Machine Translation by jointly learning to align and translate
• English to French Demo
• Sequence to Sequence Learning with Neural Networks
• nips presentation
• Cross-lingual Pseudo-Projected Expectation Regularization for Weakly Supervised Learning
• Generating Chinese Named Entity Data from a Parallel Corpus
• IXA pipeline: Efficient and Ready to Use Multilingual NLP tools
• Neural Machine Translation by jointly learning to align and translate
• Sequence to Sequence Learning with Neural Networks
• Cross-lingual Pseudo-Projected Expectation Regularization for Weakly Supervised Learning
• IXA pipeline: Efficient and Ready to Use Multilingual NLP tools

Memory and Attention Models (from [DL4NLP](https://github.com/andrewt3000/DL4NLP))

• End-To-End Memory Networks
• Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
• Jason Weston lecture on MemNN
• Neural Turing Machines
• Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
• Memory Networks
• End-To-End Memory Networks
• Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
• Evaluating prerequisite qualities for learning end to end dialog systems
• Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
• MemNN
• Stack RNN source code - algorithmic-patterns-with-stack/)

General Natural Language Processing

• Neural autocoder for paragraphs and documents - LSTM representation
• LSTM over tree structures
• Teaching Machines to Read and Comprehend - DeepMind paper
• Improving distributional similarity with lessons learned from word embeddings
• Low-Dimensional Embeddings of Logic
• based on this paper
• Markov Logic Networks for Natural Language Question Answering
• Distant Supervision for Cancer Pathway Extraction From Text
• Template-Based Information Extraction without the Templates
• Retrofitting word vectors to semantic lexicons
• Unsupervised Learning of the Morphology of a Natural Language
• Learning the Structure of Biomedical Relation Extractions
• Relation extraction with matrix factorization and universal schemas
• Computational Grounded Cognition: a new alliance between grounded cognition and computational modelling
• Neural autocoder for paragraphs and documents - LSTM representation
• LSTM over tree structures
• Efficient Estimation of Word Representations in Vector Space
• Markov Logic Networks for Natural Language Question Answering
• Natural Language Processing (Almost) from Scratch
• Low-Dimensional Embeddings of Logic
• Sequence to Sequence Learning - word vectors for machine translation
• A Neural Probabilistic Language Model
• Retrofitting word vectors to semantic lexicons

Named Entity Recognition

• A survey of named entity recognition and classification
• Benchmarking the extraction and disambiguation of named entities on the semantic web
• Knowledge base population: Successful approaches and challenges
• SpeedRead: A fast named entity recognition Pipeline
• A survey of named entity recognition and classification
• Knowledge base population: Successful approaches and challenges
• Benchmarking the extraction and disambiguation of named entities on the semantic web

Neural Network

• Statistical Language Models based on Neural Networks
• Slides from Google Talk

Supplementary Materials

• Word2Vec
• Relation Extraction with Matrix Factorization and Universal Schemas
• Presentation slides for MLN tutorial
• Presentation slides for QA applications of MLNs
• Presentation slides
• Towards a Formal Distributional Semantics: Simulating Logical Calculi with Tensors
• DrQA: Open Domain Question Answering
• Relation Extraction with Matrix Factorization and Universal Schemas

Supplementary Materials

• AI Playbook
• NLP Tutorial
• Understand & Implement Natural Language Processing
• Deep Learning, NLP, and Representations

• Michael Collins - one of the best NLP teachers. Check out the material on the courses he is teaching.
• Natural Language Processing in Action - A guide to creating machines that understand human language.
• Lecture Note
• Michael Collins - one of the best NLP teachers. Check out the material on the courses he is teaching.

videos

• Intro to Artificial Intelligence
• Deep Learning for Natural Language Processing (2015 classes)
• Natural Language Processing - Stanford - 462-spring-2013)
• Natural Language Processing - Stanford - 462-spring-2013)
• Deep Learning for Natural Language Processing (2015 classes)
• Deep Learning for Natural Language Processing (2016 classes)

videos

• Stanford CS 224D: Deep Learning for NLP class
• Richard Socher
• A Primer on Neural Network Models for Natural Language Processing
• Deep Natural Language Processing
• Stanford CS 224D: Deep Learning for NLP class

Supplementary Materials

• awesome-spanish-nlp
• awesome-machine-learning
• ai-reading-list
• DL4NLP