continual-learning-papers

Continual Learning papers list, curated by ContinualAI
https://github.com/ContinualAI/continual-learning-papers

Last synced: 7 days ago
JSON representation

Join the ContinualAI Zotero group
List of papers
- Applications
  - Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Data
  - The Traffic Flow Prediction Method Using the Incremental Learning-Based CNN-LTSM Model: The Solution of Mobile Application
  - Findings of the First Shared Task on Lifelong Learning Machine Translation - jussà, Fethi Bougares and Olivier Galibert. *Proceedings of the Fifth Conference on Machine Translation*, 56--64, 2020. [framework] [nlp]
  - Continual Learning of Predictive Models in Video Sequences via Variational Autoencoders
  - Unsupervised Model Personalization While Preserving Privacy and Scalability: An Open Problem - -14460, 2020. [framework] [mnist] [vision]
  - Incremental Learning for End-to-End Automatic Speech Recognition
  - Neural Topic Modeling with Continual Lifelong Learning
  - CLOPS: Continual Learning of Physiological Signals
  - Clinical Applications of Continual Learning Machine Learning - -e281, 2020.
  - Continual Learning for Domain Adaptation in Chest X-ray Classification - -11, 2020. [vision]
  - Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment Analysis
  - RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning - -16748, 2020. [nlp]
  - Importance Driven Continual Learning for Segmentation Across Domains - Marie Rickmann, Abhijit Guha Roy and Christian Wachinger. *arXiv*, 1--10, 2020. [vision]
  - LAMOL: LAnguage MOdeling for Lifelong Language Learning - Keng Sun, Cheng-Hao Ho and Hung-Yi Lee. *ICLR*, 2020. [nlp]
  - Non-Parametric Adaptation for Neural Machine Translation
  - Continual Adaptation for Efficient Machine Communication
  - Continual Learning for Sentence Representations Using Conceptors
  - Lifelong and Interactive Learning of Factual Knowledge in Dialogues - -31, 2019. [nlp]
  - Making Good on LSTMs' Unfulfilled Promise
  - Lifelong Learning for Scene Recognition in Remote Sensing Images - -1476, 2019. [vision]
  - Towards Continual Learning in Medical Imaging - -4, 2018. [vision]
  - Toward Continual Learning for Conversational Agents
  - Toward an Architecture for Never-Ending Language Learning - Fourth AAAI Conference on Artificial Intelligence*, 1306--1313, 2010. [nlp]
  - Principles of Lifelong Learning for Predictive User Modeling - -46, 2009.
  - Findings of the First Shared Task on Lifelong Learning Machine Translation - jussà, Fethi Bougares and Olivier Galibert. *Proceedings of the Fifth Conference on Machine Translation*, 56--64, 2020. [framework] [nlp]
  - Continual Learning of Predictive Models in Video Sequences via Variational Autoencoders
  - Unsupervised Model Personalization While Preserving Privacy and Scalability: An Open Problem - -14460, 2020. [framework] [mnist] [vision]
  - Neural Topic Modeling with Continual Lifelong Learning
  - CLOPS: Continual Learning of Physiological Signals
  - Continual Learning for Domain Adaptation in Chest X-ray Classification - -11, 2020. [vision]
  - Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment Analysis
  - Importance Driven Continual Learning for Segmentation Across Domains - Marie Rickmann, Abhijit Guha Roy and Christian Wachinger. *arXiv*, 1--10, 2020. [vision]
  - Non-Parametric Adaptation for Neural Machine Translation
  - Episodic Memory in Lifelong Language Learning
  - Continual Adaptation for Efficient Machine Communication
  - Continual Learning for Sentence Representations Using Conceptors
  - Making Good on LSTMs' Unfulfilled Promise
  - Towards Continual Learning in Medical Imaging - -4, 2018. [vision]
  - Toward Continual Learning for Conversational Agents
  - Overcoming Catastrophic Forgetting During Domain Adaptation of Neural Machine Translation - -2068, 2019. [nlp] [rnn]
  - Toward an Architecture for Never-Ending Language Learning - Fourth AAAI Conference on Artificial Intelligence*, 1306--1313, 2010. [nlp]
- Architectural Methods
  - Provable and Efficient Continual Representation Learning
  - Architecture Matters in Continual Learning
  - The Multiple Subnetwork Hypothesis: Enabling Multidomain Learning by Isolating Task-Specific Subnetworks in Feedforward Neural Networks
  - Continual Learning with Node-Importance Based Adaptive Group Sparse Regularization
  - Structured Ensembles: An Approach to Reduce the Memory Footprint of Ensemble Methods - -418, 2021.
  - Continual Learning via Bit-Level Information Preserving - -16683, 2021.
  - SpaceNet: Make Free Space for Continual Learning - -11, 2021. [cifar] [fashion] [mnist] [sparsity]
  - Modular Dynamic Neural Network: A Continual Learning Architecture
  - Continual Learning with Adaptive Weights (CLAW)
  - Continual Learning with Gated Incremental Memories for Sequential Data Processing
  - Continual Learning in Recurrent Neural Networks
  - Explainability in Deep Reinforcement Learning - Rodr\ǵuez. *arXiv:2008.06693 [cs]*, 2020.
  - A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning
  - Bayesian Nonparametric Weight Factorization for Continual Learning - -17, 2020. [bayes] [cifar] [mnist] [sparsity]
  - Efficient Continual Learning with Modular Networks and Task-Driven Priors
  - Progressive Memory Banks for Incremental Domain Adaptation
  - Autonomous Deep Learning: Continual Learning Approach for Dynamic Environments - -674, 2019. [mnist]
  - Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
  - Towards AutoML in the Presence of Drift: First Results - Wei Tu, Yang Yu, Lisheng Sun-Hosoya, Isabelle Guyon and Michele Sebag. *arXiv*, 2019.
  - Continual Unsupervised Representation Learning
  - A Progressive Model to Enable Continual Learning for Semantic Slot Filling - -1284, 2019. [nlp]
  - Adaptive Compression-based Lifelong Learning
  - Frosting Weights for Better Continual Training - -510, 2019. [cifar] [mnist]
  - HOUDINI: Lifelong Learning as Program Synthesis - -8698, 2018.
  - Reinforced Continual Learning - -908, 2018. [cifar] [mnist]
  - Lifelong Learning With Dynamically Expandable Networks
  - Neurogenesis Deep Learning
  - Net2Net: Accelerating Learning via Knowledge Transfer
  - Knowledge Transfer in Deep Block-Modular Neural Networks - -279, 2015. [vision]
  - ELLA: An Efficient Lifelong Learning Algorithm - -515, 2013.
  - A Self-Organising Network That Grows When Required - -1058, 2002. [som]
  - Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
  - Provable and Efficient Continual Representation Learning
  - Architecture Matters in Continual Learning
  - The Multiple Subnetwork Hypothesis: Enabling Multidomain Learning by Isolating Task-Specific Subnetworks in Feedforward Neural Networks
  - Continual Learning with Node-Importance Based Adaptive Group Sparse Regularization
  - Continual Learning with Gated Incremental Memories for Sequential Data Processing
  - Explainability in Deep Reinforcement Learning - Rodr\ǵuez. *arXiv:2008.06693 [cs]*, 2020.
  - Bayesian Nonparametric Weight Factorization for Continual Learning - -17, 2020. [bayes] [cifar] [mnist] [sparsity]
  - Efficient Continual Learning with Modular Networks and Task-Driven Priors
  - Towards AutoML in the Presence of Drift: First Results - Wei Tu, Yang Yu, Lisheng Sun-Hosoya, Isabelle Guyon and Michele Sebag. *arXiv*, 2019.
  - Adaptive Compression-based Lifelong Learning
  - Expert Gate: Lifelong Learning with a Network of Experts
  - Progressive Neural Networks
  - ELLA: An Efficient Lifelong Learning Algorithm - -515, 2013.
  - Net2Net: Accelerating Learning via Knowledge Transfer
  - A Progressive Model to Enable Continual Learning for Semantic Slot Filling - -1284, 2019. [nlp]
  - Compacting, Picking and Growing for Unforgetting Continual Learning - Hao Tu, Cheng-En Wu, Chien-Hung Chen, Yi-Ming Chan and Chu-Song Chen. *NeurIPS*, 13669--13679, 2019. [cifar] [imagenet]
  - HOUDINI: Lifelong Learning as Program Synthesis - -8698, 2018.
  - Dynamic Few-Shot Visual Learning Without Forgetting - -4375, 2018. [imagenet] [vision]
  - Continual Unsupervised Representation Learning
  - Reinforced Continual Learning - -908, 2018. [cifar] [mnist]
- Benchmarks
  - Is Class-Incremental Enough for Continual Learning?
  - A Procedural World Generation Framework for Systematic Evaluation of Continual Learning - Fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track*, 2021.
  - Evaluating Online Continual Learning with CALM - Teodor Sorodoc and Tomas Mikolov. *arXiv*, 2020. [nlp] [rnn]
  - Continual Reinforcement Learning in 3D Non-Stationary Environments - -249, 2020.
  - Stream-51: Streaming Classification and Novelty Detection From Videos - -229, 2020.
  - OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning - -8, 2019. [vision]
  - Incremental Object Learning From Contiguous Views - -8786, 2019.
  - New Metrics and Experimental Paradigms for Continual Learning - -21123, 2018.
  - CORe50: A New Dataset and Benchmark for Continuous Object Recognition - -26, 2017. [vision]
  - vCLIMB: A Novel Video Class Incremental Learning Benchmark
  - Is Class-Incremental Enough for Continual Learning?
  - Defining Benchmarks for Continual Few-Shot Learning
  - OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning - -8, 2019. [vision]
  - CORe50: A New Dataset and Benchmark for Continuous Object Recognition - -26, 2017. [vision]
- Bioinspired Methods
  - A Biologically Plausible Audio-Visual Integration Model for Continual Learning
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Controlled Forgetting: Targeted Stimulation and Dopaminergic Plasticity Modulation for Unsupervised Lifelong Learning in Spiking Neural Networks
  - Storing Encoded Episodes as Concepts for Continual Learning
  - Cognitively-Inspired Model for Incremental Learning Using a Few Examples
  - Spiking Neural Predictive Coding for Continual Learning from Data Streams
  - Brain-like Replay for Continual Learning with Artificial Neural Networks
  - Selfless Sequential Learning
  - Backpropamine: Training Self-Modifying Neural Networks with Differentiable Neuromodulated Plasticity
  - Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations
  - FearNet: Brain-Inspired Model for Incremental Learning
  - Differentiable Plasticity: Training Plastic Neural Networks with Backpropagation - -3568, 2018.
  - Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization
  - SLAYER: Spike Layer Error Reassignment in Time - -1421, 2018.
  - Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing World - -1702, 2017. [nlp] [vision]
  - Diffusion-Based Neuromodulation Can Eliminate Catastrophic Forgetting in Simple Neural Networks - -31, 2017.
  - How Do Neurons Operate on Sparse Distributed Representations? A Mathematical Theory of Sparsity, Neurons and Active Dendrites - -23, 2016. [hebbian] [sparsity]
  - Continuous Online Sequence Learning with an Unsupervised Neural Network Model - -2504, 2016. [spiking]
  - Backpropagation of Hebbian Plasticity for Continual Learning - Continual Learning*, 5, 2016.
  - Mitigation of Catastrophic Forgetting in Recurrent Neural Networks Using a Fixed Expansion Layer - -7, 2013. [mnist] [rnn] [sparsity]
  - Compete to Compute
  - Mitigation of Catastrophic Interference in Neural Networks Using a Fixed Expansion Layer - -729, 2012. [sparsity]
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Continuous Online Sequence Learning with an Unsupervised Neural Network Model - -2504, 2016. [spiking]
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - lpSpikeCon: Enabling Low-Precision Spiking Neural Network Processing for Efficient Unsupervised Continual Learning on Autonomous Agents
  - SpikeDyn: A Framework for Energy-Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments
  - A Biologically Plausible Audio-Visual Integration Model for Continual Learning
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Spiking Neural Predictive Coding for Continual Learning from Data Streams
  - Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations
  - Lifelong Neural Predictive Coding: Sparsity Yields Less Forgetting When Learning Cumulatively - -11, 2019. [fashion] [mnist] [sparsity]
  - Differentiable Plasticity: Training Plastic Neural Networks with Backpropagation - -3568, 2018.
  - How Do Neurons Operate on Sparse Distributed Representations? A Mathematical Theory of Sparsity, Neurons and Active Dendrites - -23, 2016. [hebbian] [sparsity]
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - SLAYER: Spike Layer Error Reassignment in Time - -1421, 2018.
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
  - Synaptic Metaplasticity in Binarized Neural Networks
  - Controlled Forgetting: Targeted Stimulation and Dopaminergic Plasticity Modulation for Unsupervised Lifelong Learning in Spiking Neural Networks
  - Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization
  - Compete to Compute
  - Synaptic Plasticity: Taming the Beast - -1183, 2000. [hebbian]
- Catastrophic Forgetting Studies
  - Continual Learning in the Teacher-Student Setup: Impact of Task Similarity - -6119, 2021.
  - Understanding Continual Learning Settings with Data Distribution Drift Analysis

Categories

List of papers 594 Join the ContinualAI Zotero group 3

Sub Categories

Bioinspired Methods 88 Others 68 Architectural Methods 52 Applications 41 Continual Reinforcement Learning 38 Regularization Methods 36 Rehearsal Methods 36 Neuroscience 34 Review Papers and Books 33 Generative Replay Methods 24 Catastrophic Forgetting Studies 23 Continual Sequential Learning 16 Hybrid Methods 16 Metrics and Evaluations 15 Dissertation and Theses 15 Benchmarks 14 Meta Continual Learning 12 Robotics 11 Classics 9 Continual Few Shot Learning 8 Continual Meta Learning 5