Projects in Awesome Lists tagged with pre-trained-model

https://github.com/microsoft/unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

beit beit-3 bitnet deepnet document-ai foundation-models kosmos kosmos-1 layoutlm layoutxlm llm minilm mllm multimodal nlp pre-trained-model textdiffuser trocr unilm xlm-e

Last synced: 29 Sep 2024

https://github.com/thunlp/OpenPrompt

An Open-Source Framework for Prompt-Learning.

ai deep-learning natural-language-processing natural-language-understanding nlp nlp-library nlp-machine-learning pre-trained-language-models pre-trained-model prompt prompt-based-tuning prompt-learning prompt-toolkit prompts pytorch transformer

Last synced: 31 Jul 2024

https://github.com/thunlp/openprompt

An Open-Source Framework for Prompt-Learning.

ai deep-learning natural-language-processing natural-language-understanding nlp nlp-library nlp-machine-learning pre-trained-language-models pre-trained-model prompt prompt-based-tuning prompt-learning prompt-toolkit prompts pytorch transformer

Last synced: 30 Sep 2024

https://github.com/brightmart/albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

albert bert chinese-corpus pre-trained pre-trained-model pytorch roberta tensorflow xlnet

Last synced: 01 Aug 2024

https://github.com/chineseglue/chineseglue

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

albert bert chinese-corpus datasets glue language-understanding nlp pre-trained-model

Last synced: 30 Sep 2024

https://github.com/ChineseGLUE/ChineseGLUE

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

albert bert chinese-corpus datasets glue language-understanding nlp pre-trained-model

Last synced: 01 Aug 2024

https://github.com/keyu-tian/spark

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl

Last synced: 30 Sep 2024

https://github.com/keyu-tian/SparK

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl

Last synced: 31 Jul 2024

https://github.com/ymcui/Chinese-ELECTRA

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

bert chinese chinese-electra electra language-model nlp pre-trained-model pytorch tensorflow

Last synced: 01 Aug 2024

https://github.com/d-li14/involution

[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator

cvpr2021 image-classification instance-segmentation involution object-detection operator pre-trained-model pytorch semantic-segmentation

Last synced: 30 Sep 2024

https://github.com/zjunlp/knowlm

An Open-sourced Knowledgable Large Language Model Framework.

bilingual chinese deep-learning deepspeed english gpt-3 instructie instruction-following instruction-tuning instructions knowlm language-model large-language-models llama lora models pre-trained-language-models pre-trained-model pre-training reasoning

Last synced: 27 Sep 2024

https://github.com/zjunlp/KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

bilingual chinese deep-learning deepspeed english gpt-3 instructie instruction-following instruction-tuning instructions knowlm language-model large-language-models llama lora models pre-trained-language-models pre-trained-model pre-training reasoning

Last synced: 01 Aug 2024

https://github.com/zjunlp/KnowledgeEditingPapers

[知识编辑] Must-read Papers on Knowledge Editing for Large Language Models.

awsome-list easyedit foundation-models knowledge-editing knowlm large-language-models model-editing natural-language-processing paper paper-list pre-trained-language-models pre-trained-model review rome survey

Last synced: 01 Aug 2024

https://github.com/NVlabs/FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

ade20k backbone coco deep-learning foundation-models image-classification image-net object-detection pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition

Last synced: 31 Jul 2024

https://github.com/deepmodeling/Uni-Mol

Official Repository for the Uni-Mol Series Methods

deep-learning molecular-modeling pre-trained-model pretraining

Last synced: 02 Aug 2024

https://github.com/salesforce/PCL

PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"

contrastive-learning pre-trained-model representation-learning self-supervised-learning unsupervsied-learning

Last synced: 03 Aug 2024

https://github.com/NVlabs/GCVit

[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

ade20k backbone coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition

Last synced: 03 Aug 2024

https://github.com/ymcui/PERT

PERT: Pre-training BERT with Permuted Language Model

bert nlp plm pre-trained-model pytorch tensorflow transformers

Last synced: 03 Aug 2024

https://github.com/ZhangYuanhan-AI/NOAH

Searching prompt modules for parameter-efficient transfer learning.

deep-learning domain-generalization pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting

Last synced: 09 Aug 2024

https://github.com/balavenkatesh3322/audio-pretrained-model

A collection of Audio and Speech pre-trained models.

audio audio-processing caffe keras keras-models keras-tensorflow machine-learning mxnet neural-network pre-trained pre-trained-model pre-training python3 pytorch pytorch-models speech-recognition speech-to-text tensorflow tensorflow-models

Last synced: 29 Sep 2024

https://github.com/zjunlp/molgen

[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback

generation huggingface iclr2024 language-model molecular-generation molecular-optimization molecule molgen multitask pre-trained-language-models pre-trained-model pre-training pytorch selfies targeted-molecular-generation

Last synced: 26 Sep 2024

https://github.com/RUCAIBox/MVP

This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.

data-to-text dialog multi-task-learning natural-language-generation natural-language-processing nlg nlp plm pre-trained-model question-answering question-generation seq2seq sequence-to-sequence story-generation summarization text-generation

Last synced: 03 Aug 2024

https://github.com/SLAMPAI/large-scale-pretraining-transfer

Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)

big-transfer chest-x-ray14 chest-xray-images chexpert-dataset covidx-dataset deep-learning distributed-training few-shot-learning fine-tuning imagenet large-scale-learning medical-imaging mimic-cxr padchest-dataset pre-trained-model pre-training pytorch scaling-laws supercomputing transfer-learning

Last synced: 03 Aug 2024