Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with transformer

A curated list of projects in awesome lists tagged with transformer .

https://github.com/InternLM/MindSearch

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

ai-search-engine gpt llm llms multi-agent-systems perplexity-ai search searchgpt transformer web-search

Last synced: 02 Aug 2024

https://github.com/yongzhuo/keras-textclassification

中文长文本分类、短句子分类、多标签分类、两句子相似度(Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short),字词句向量嵌入层(embeddings)和网络层(graph)构建基类,FastText,TextCNN,CharCNN,TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

albert bert capsule charcnn crnn dcnn dpcnn embeddings fasttext han keras keras-textclassification leam nlp rcnn text-classification textcnn transformer vdcnn xlnet

Last synced: 26 Sep 2024

https://github.com/swz30/restormer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

cvpr2022 defocus-deblurring efficient-transformers high-resolution image-deblurring image-deraining image-restoration low-level-vision motion-deblurring pytorch transformer

Last synced: 30 Sep 2024

https://github.com/whai362/pvt

Official implementation of PVT series

backbone detection pvt pvtv2 segmentation transformer

Last synced: 30 Sep 2024

https://github.com/whai362/PVT

Official implementation of PVT series

backbone detection pvt pvtv2 segmentation transformer

Last synced: 31 Jul 2024

https://github.com/vita-group/transgan

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

gan pytorch transformer transformer-encoder transformer-models

Last synced: 30 Sep 2024

https://github.com/VITA-Group/TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

gan pytorch transformer transformer-encoder transformer-models

Last synced: 03 Aug 2024

https://github.com/swz30/Restormer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

cvpr2022 defocus-deblurring efficient-transformers high-resolution image-deblurring image-deraining image-restoration low-level-vision motion-deblurring pytorch transformer

Last synced: 31 Jul 2024

https://github.com/kristerkari/react-native-svg-transformer

Import SVG files in your React Native project the same way that you would in a Web application.

loader react-native react-native-svg svg transformer

Last synced: 15 Aug 2024

https://github.com/PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

bert compression detection distillation ernie nas pruning quantization segmentation sparsity tensorrt transformer yolov5 yolov6 yolov7

Last synced: 31 Jul 2024

https://github.com/els-rd/kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

cuda cuda-kernel pytorch transformer triton

Last synced: 30 Sep 2024

https://github.com/huggingface/pytorch-openai-transformer-lm

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

language-model neural-networks openai pytorch transformer

Last synced: 26 Sep 2024

https://github.com/ELS-RD/kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

cuda cuda-kernel pytorch transformer triton

Last synced: 02 Aug 2024

https://github.com/tencent/turbotransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

albert bert decoder gpt2 gpu huggingface-transformers inference machine-translation nlp pytorch roberta transformer

Last synced: 25 Sep 2024

https://github.com/Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

albert bert decoder gpt2 gpu huggingface-transformers inference machine-translation nlp pytorch roberta transformer

Last synced: 31 Jul 2024

https://github.com/shi-labs/oneformer

OneFormer: One Transformer to Rule Universal Image Segmentation, arxiv 2022 / CVPR 2023

ade20k cityscapes coco image-segmentation instance-segmentation oneformer panoptic-segmentation semantic-segmentation transformer universal-segmentation

Last synced: 30 Sep 2024

https://github.com/SHI-Labs/OneFormer

OneFormer: One Transformer to Rule Universal Image Segmentation, arxiv 2022 / CVPR 2023

ade20k cityscapes coco image-segmentation instance-segmentation oneformer panoptic-segmentation semantic-segmentation transformer universal-segmentation

Last synced: 01 Aug 2024

https://github.com/yoshitomo-matsubara/torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

amazon-sagemaker-lab cifar10 cifar100 coco colab-notebook glue google-colab image-classification imagenet knowledge-distillation natural-language-processing nlp object-detection pascal-voc pytorch semantic-segmentation transformer

Last synced: 01 Oct 2024

https://github.com/ddz16/tsfpaper

This repository contains a reading list of papers on Time Series Forecasting/Prediction (TSF) and Spatio-Temporal Forecasting/Prediction (STF). These papers are mainly categorized according to the type of model.

deep-learning deep-neural-networks paper-lists rnn spatial-temporal-forecasting spatio-temporal spatio-temporal-data spatio-temporal-prediction tcn time-series time-series-analysis time-series-forecasting time-series-models time-series-prediction transformer

Last synced: 30 Sep 2024

https://github.com/ddz16/TSFpaper

This repository contains a reading list of papers on Time Series Forecasting/Prediction (TSF) and Spatio-Temporal Forecasting/Prediction (STF). These papers are mainly categorized according to the type of model.

deep-learning deep-neural-networks paper-lists rnn spatial-temporal-forecasting spatio-temporal spatio-temporal-data spatio-temporal-prediction tcn time-series time-series-analysis time-series-forecasting time-series-models time-series-prediction transformer

Last synced: 02 Aug 2024

https://github.com/sail-sg/poolformer

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)

image-classification mlp pooling pytorch transformer

Last synced: 30 Sep 2024

https://github.com/myhub/tr

Free Offline OCR 离线的中文文本检测+识别SDK

crnn ctpn curved-text deeplearning ocr pixellink text-recognition transformer

Last synced: 01 Oct 2024

https://github.com/br-idl/paddlevit

:robot: PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

classification computer-vision cv deep-learning detection encoder-decoder gan mlp object-detection paddlepaddle segmentation semantic-segmentation transformer vit

Last synced: 30 Sep 2024

https://github.com/MCG-NJU/VideoMAE

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

action-recognition mae masked-autoencoder neurips-2022 pytorch self-supervised-learning transformer video-analysis video-representation-learning video-transformer video-understanding vision-transformer

Last synced: 31 Jul 2024

https://github.com/elixir-nx/bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)

axon elixir hugging-face machine-learning nx pre-trained transformer

Last synced: 30 Sep 2024

https://github.com/Alpha-VLLM/Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

aigc diffusion diffusion-model diffusion-models diffusion-transformer generation-models transformer transformers

Last synced: 31 Jul 2024

https://github.com/alpha-vllm/lumina-t2x

Lumina-T2X is a unified framework for Text to Any Modality Generation

aigc diffusion diffusion-model diffusion-models diffusion-transformer generation-models transformer transformers

Last synced: 01 Oct 2024

https://github.com/the-ai-summer/self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

artificial-intelligence attention attention-mechanism deep-learning machine-learning machine-learning-algorithms self-attention transformer transformers

Last synced: 30 Sep 2024

https://github.com/MilaNLProc/contextualized-topic-models

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.

bert embeddings multilingual-models multilingual-topic-models neural-topic-models nlp nlp-library nlp-machine-learning text-as-data topic-coherence topic-modeling transformer

Last synced: 01 Aug 2024

https://github.com/The-AI-Summer/self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

artificial-intelligence attention attention-mechanism deep-learning machine-learning machine-learning-algorithms self-attention transformer transformers

Last synced: 03 Aug 2024

https://github.com/liucongg/gpt2-newstitle

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

chinese gpt2 news-summarization nlp text-generation torch transformer

Last synced: 30 Sep 2024

https://github.com/nvidia-merlin/transformers4rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

bert gtp huggingface language-model nlp pytorch recommender-system recsys seq2seq session-based-recommendation tabular-data transformer xlnet

Last synced: 01 Oct 2024

https://github.com/hustvl/maptr

[ICLR'23 Spotlight & IJCV'24] MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction

autonomous-driving bev end-to-end iclr2023 online-hdmap-construction real-time shape-representation transformer vectorized-hdmap

Last synced: 30 Sep 2024

https://github.com/liucongg/GPT2-NewsTitle

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

chinese gpt2 news-summarization nlp text-generation torch transformer

Last synced: 02 Aug 2024

https://github.com/NVIDIA-Merlin/Transformers4Rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

bert gtp huggingface language-model nlp pytorch recommender-system recsys seq2seq session-based-recommendation tabular-data transformer xlnet

Last synced: 01 Aug 2024

https://github.com/pbloem/former

Simple transformer implementation from scratch in pytorch.

machine-learning pytorch transformer

Last synced: 30 Sep 2024

https://github.com/unum-cloud/uform

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

bert clip clustering contrastive-learning cross-attention huggingface-transformers image-search language-vision llava multi-lingual multimodal neural-network openai openclip pretrained-models pytorch representation-learning semantic-search transformer vector-search

Last synced: 30 Sep 2024

https://github.com/GaoQ1/rasa_chatbot_cn

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

bert chinese demo intent-classification policy python rasa rasa-chatbot rasa-core rasa-nlu rasa-nlu-gao rasa-x slot-filling tensorflow train-dialogue transformer

Last synced: 01 Aug 2024

https://github.com/google-research/maxim

[CVPR 2022 Oral] Official repository for "MAXIM: Multi-Axis MLP for Image Processing". SOTA for denoising, deblurring, deraining, dehazing, and enhancement.

architecture computer-vision deblurring dehazing denoising deraining enhancement image image-enhancement image-processing image-restoration low-level-vision mlp restoration retouching transformer

Last synced: 02 Aug 2024

https://github.com/athena-team/athena

an open-source implementation of sequence-to-sequence based speech processing engine

asr ctc deployment sequence-to-sequence speaker-recognition speech-recognition speech-synthesis tensorflow transformer tts unsupervised-learning wfst

Last synced: 08 Aug 2024

https://github.com/THUDM/CogView2

official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

pretrained-models pytorch text-to-image transformer

Last synced: 01 Aug 2024

https://github.com/hustvl/MapTR

[ICLR'23 Spotlight] MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction

autonomous-driving bev end-to-end iclr2023 online-hdmap-construction real-time shape-representation transformer vectorized-hdmap

Last synced: 31 Jul 2024

https://github.com/itsdouges/typescript-transformer-handbook

📘 A comprehensive handbook on how to create transformers for TypeScript with code examples

handbook transformer ts-transformer typescript

Last synced: 01 Oct 2024

https://github.com/sooftware/conformer

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

asr augmented cnn conformer conv convolution pytorch recognition speech speech-recognition transformer transformer-xl

Last synced: 08 Aug 2024

https://github.com/alexandre01/deepsvg

[NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.

autoencoder deep-learning deep-svg library machine-learning python pytorch sketch-rnn sketches svg svg-animations svg-vae transformer

Last synced: 02 Aug 2024

https://github.com/THUDM/SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

pretrained-models pytorch transformer

Last synced: 01 Aug 2024

https://github.com/explosion/curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

albert bert camembert dolly2 falcon gptneox llama llm llms nlp pytorch roberta transformer transformers xlm-roberta

Last synced: 30 Sep 2024

https://github.com/flugg/laravel-responder

A Laravel Fractal package for building API responses, giving you the power of Fractal with Laravel's elegancy.

api fractal laravel lumen responder transformer

Last synced: 30 Jul 2024

https://github.com/flugger/laravel-responder

A Laravel Fractal package for building API responses, giving you the power of Fractal with Laravel's elegancy.

api fractal laravel lumen responder transformer

Last synced: 05 Aug 2024

https://github.com/graphdeeplearning/graphtransformer

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

aaai attention graph-deep-learning graph-neural-networks graph-transformer transformer transformer-networks transformers

Last synced: 08 Aug 2024

https://github.com/allegro/allRank

allRank is a framework for training learning-to-rank neural models based on PyTorch.

click-model deep-learning information-retrieval learning-to-rank machine-learning ndcg python pytorch ranking transformer

Last synced: 02 Aug 2024

https://github.com/maxjcohen/transformer

Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.

metamodel timeseries transformer

Last synced: 01 Aug 2024

https://github.com/Separius/BERT-keras

Keras implementation of BERT with pre-trained weights

keras language-modeling nlp pretrained-models tensorflow theano transfer-learning transformer

Last synced: 01 Aug 2024

https://github.com/hustvl/YOLOS

[NeurIPS 2021] You Only Look at One Sequence

computer-vision object-detection transformer vision-transformer

Last synced: 02 Aug 2024

https://github.com/kpe/bert-for-tf2

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

bert keras tensorflow transformer

Last synced: 02 Oct 2024

https://github.com/jacobgil/vit-explain

Explainability for Vision Transformers

deep-learning explainable-ai pytorch transformer vision-transformer

Last synced: 03 Oct 2024

https://github.com/rstrudel/segmenter

[ICCV2021] Official PyTorch implementation of Segmenter: Transformer for Semantic Segmentation

segmentation transformer

Last synced: 31 Jul 2024

https://github.com/xxxnell/how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

loss-landscape pytorch self-attention transformer vision-transformer

Last synced: 03 Aug 2024

https://github.com/lucidrains/tab-transformer-pytorch

Implementation of TabTransformer, attention network for tabular data, in Pytorch

artificial-intelligence attention-mechanism deep-learning tabular-data transformer

Last synced: 03 Oct 2024

https://github.com/jeya-maria-jose/Medical-Transformer

Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

attention deep-learning medical-image-analysis medical-imaging pytorch segmentation transformer transformers

Last synced: 03 Aug 2024

https://github.com/kaituoxu/Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr attention attention-is-all-you-need end-to-end pytorch self-attention transformer

Last synced: 07 Aug 2024

https://github.com/acbull/pyHGT

Code for "Heterogeneous Graph Transformer" (WWW'20), which is based on pytorch_geometric

graph-neural-networks graph-representation-learning heterogeneous-network network-embedding transformer

Last synced: 08 Aug 2024

https://github.com/hila-chefer/Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 01 Aug 2024

https://github.com/microsoft/tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

mixture-of-experts moe nlp pytorch transformer

Last synced: 25 Sep 2024

https://github.com/kyegomez/longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

artificial-intelligence attention attention-is-all-you-need attention-mechanisms chatgpt context-length gpt3 gpt4 machine-learning transformer

Last synced: 27 Sep 2024

https://github.com/lucidrains/linear-attention-transformer

Transformer based on a variant of attention that is linear complexity in respect to sequence length

artificial-intelligence attention-mechanism deep-learning pytorch transformer

Last synced: 03 Oct 2024

https://github.com/yuanxiaosc/BERT_Paper_Chinese_Translation

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

bert chinese-translation paper paper-translate transformer

Last synced: 01 Aug 2024

https://github.com/kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

artificial-intelligence attention attention-is-all-you-need attention-mechanisms chatgpt context-length gpt3 gpt4 machine-learning transformer

Last synced: 03 Aug 2024

https://github.com/researchmm/Stark

[ICCV'21] Learning Spatio-Temporal Transformer for Visual Tracking

transformer

Last synced: 01 Aug 2024