https://github.com/andreacossu/continual-pretraining-nlp-vision

Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357

continual-learning forgetting image-classification lifelong-learning masked-image-modeling masked-language-models pretrained-models qnli self-supervised senteval sentiment-analysis transformers

Last synced: 21 Jun 2025