https://github.com/keyu-tian/SparK

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
https://github.com/keyu-tian/SparK

bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl

Last synced: about 1 month ago
JSON representation

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

• Host: GitHub
• URL: https://github.com/keyu-tian/SparK
• Owner: keyu-tian
• License: mit
• Created: 2023-01-05T13:19:34.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-23T06:15:47.000Z (8 months ago)
• Last Synced: 2024-07-22T06:34:01.972Z (about 2 months ago)
• Topics: bert, cnn, convnet, convolutional-neural-networks, deep-learning, iclr, iclr2023, instance-segmentation, mae, mask-rcnn, masked-autoencoder, masked-image-modeling, object-detection, pre-trained-model, pretrain, pretraining, pytorch, self-supervised-learning, sparse-convolution, ssl
• Language: Python
• Homepage: https://arxiv.org/abs/2301.03580
• Size: 699 KB
• Stars: 1,402
• Watchers: 26
• Forks: 82
• Open Issues: 9
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• Awesome-Segmentation-With-Transformer - SparK: the first successful BERT/MAE-style pretraining on any convolutional networks - tian/SparK) | (Methods: A Survey / Strong Representation)