https://github.com/vidit98/lifelong_object_recognition

Repo for competition track Lifelong Robotic Vision, IROS 2019.
https://github.com/vidit98/lifelong_object_recognition

catastrophic-forgetting continual-learning incremental-learning mobilenetv2 object-recognition pytorch

Last synced: 2 months ago
JSON representation

Repo for competition track Lifelong Robotic Vision, IROS 2019.

• Host: GitHub
• URL: https://github.com/vidit98/lifelong_object_recognition
• Owner: vidit98
• Created: 2019-11-01T11:32:40.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-04-14T09:04:31.000Z (about 6 years ago)
• Last Synced: 2025-01-17T20:35:20.627Z (over 1 year ago)
• Topics: catastrophic-forgetting, continual-learning, incremental-learning, mobilenetv2, object-recognition, pytorch
• Language: Python
• Homepage:
• Size: 130 KB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Lifelong_Object_Recognition

## Introduction

Code for Intelligent Replay Sampling for Lifelong Object Recognition, IROS 2019.

[Link to model](https://drive.google.com/open?id=14qocNtQcRAR0ayfOLp6qM3L8mXl9a1Gc)

Continual learning (CL) is the ability of a model to learn continually from a stream of data, building on what was learnt previously, hence exhibiting positive transfer, as well as being able to remember previously seen tasks. 

This task focused on new instance continual learning where number of classes across the tasks will be samw but the domain of the data will change such as occlusion, clutter etc. To know the rules in detail visit [this link](https://lifelong-robotic-vision.github.io/competition/Object-Recognition.html)

There are various methods such as dynamic architectures, regulaization based methods and replay based methods. We propose replay based method.

Dataset used is OpenLoris Dataset. Please refer to competition [website](https://lifelong-robotic-vision.github.io/competition/Object-Recognition.html) for getting the dataset.

## Requirements

* Pytorch 1.1

* Python 3.5

* numpy

* pandas

* PIL

## Method

Given below is the summary of the proposed algorithm. For details please refer to [abstract](https://drive.google.com/file/d/18uw3fSKgSXh_Uw8jm7reRtTuoeHP--pa/view)

![Algorithm](https://github.com/vidit98/Lifelong_Object_Recognition/blob/master/imgs/algo.png)

For running the code please follow the steps in README.txt

## Results

We achieved an mean accuracy of 97.01% at the end of 12th task.

![results](https://github.com/vidit98/Lifelong_Object_Recognition/blob/master/imgs/result.png)

## Future Work

This method can be combined with other methods to further reduce the replay size such as synaptic intelligence. We can also think in the direction of latent space replay or psuedo image generations using GANs.