Table of Contents

• Papers

  • Attention Is All You Need
  • Using Very Deep Autoencoders for Content Based Image Retrieval
  • Learning Deep Architectures for AI
  • Training Recurrent Neural Networks
  • LSTM
  • GFRNN - supp.pdf)
  • LSTM: A Search Space Odyssey
  • A Critical Review of Recurrent Neural Networks for Sequence Learning
  • Visualizing and Understanding Recurrent Networks
  • Recurrent Neural Network based Language Model
  • Deep Neural Networks for Acoustic Modeling in Speech Recognition
  • Speech Recognition with Deep Recurrent Neural Networks
  • Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
  • Batch Normalization
  • Berkeley AI Research (BAIR) Laboratory
  • On Using Very Large Target Vocabulary for Neural Machine Translation
  • Attention Is All You Need
  • CMU’s list of papers
  • Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

• WebSites

  • Deep Learning News
  • deeplearning.net
  • deeplearning.stanford.edu
  • eecs.umich.edu/ai
  • cgi.cse.unsw.edu.au/~aishare
  • isi.edu/AI/isd.htm
  • stat.ucla.edu
  • deeplearning.cs.toronto.edu
  • Guide to Machine Learning
  • cs.brown.edu/research/ai

• Free Online Books

  • Neural Networks and Deep Learning
  • Deep Learning
  • Deep Learning in Neural Networks: An Overview

• Courses

  • Tensorflow for Deep Learning Research
  • Machine Learning - Stanford - 2014)
  • Machine Learning - Carnegie Mellon

• Videos and Lectures

  • Deep Learning, Self-Taught Learning and Unsupervised Feature Learning

• Tutorials

  • Torch7 Tutorials
  • Deep Learning with Python
  • Deep Learning from the Bottom up
  • Theano Tutorial
  • A Deep Learning Tutorial: From Perceptrons to Deep Networks

• Datasets

  • Image QA
  • Columbia-Utrecht Reflectance and Texture Database - Texture and reflectance measurements for over 60 samples of 3D texture, observed with over 200 different combinations of viewing and illumination directions. (Formats: bmp)
  • Ubuntu Dialogue Corpus - Dialogs of ubuntu journal.
  • 微博数据集 - 华为李航实验室发布，也是论文“Neural Responding Machine for Short-Text Conversation”使用的数据集。
  • 微博数据集 - 新浪微博数据集，评论回复短句。
  • OpenSubtitles - Movie subtitles.

• Conferences

  • IJCAI - International Joint Conference on Artificial Intelligence
  • ECML - European Conference on Machine Learning
  • NIPS - Neural Information Processing Systems

• Frameworks

  • Caffe
  • Torch7
  • Theano
  • RNNLM Toolkit
  • SyntaxNet - Google's syntactic parser - A TensorFlow dependency library

• Miscellaneous

  • An efficient, batched LSTM.
  • AlphaGo - A replication of DeepMind's 2016 Nature publication, "Mastering the game of Go with deep neural networks and tree search"