Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with transformer

A curated list of projects in awesome lists tagged with transformer .

https://github.com/SwinTransformer/Transformer-SSL

This is an official implementation for "Self-Supervised Learning with Swin Transformers".

self-supervised-learning swin-transformer transformer

Last synced: 31 Jul 2024

https://github.com/lucidrains/mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

artificial-intelligence deep-learning mixture-of-experts transformer

Last synced: 03 Oct 2024

https://github.com/wjf5203/vnext

Next-generation Video instance recognition framework on top of Detectron2 which supports InstMove (CVPR 2023), SeqFormer(ECCV Oral), and IDOL(ECCV Oral))

instance-segmentation motion object-detection tracking transformer video-instance-segmentation

Last synced: 27 Sep 2024

https://github.com/mit-han-lab/lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention

nlp pytorch transformer

Last synced: 03 Aug 2024

https://github.com/wjf5203/VNext

Next-generation Video instance recognition framework on top of Detectron2 which supports InstMove (CVPR 2023), SeqFormer(ECCV Oral), and IDOL(ECCV Oral))

instance-segmentation motion object-detection tracking transformer video-instance-segmentation

Last synced: 01 Aug 2024

https://github.com/ZikangZhou/HiVT

[CVPR 2022] HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction

autonomous-driving cvpr2022 motion-prediction transformer

Last synced: 31 Jul 2024

https://github.com/pinto0309/onnx2tf

Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massive Transpose extrapolation problem in onnx-tensorflow (onnx-tf). I don't need a Star, but give me a pull request.

android coreml deep-learning docker keras lstm machine-learning model-converter models onnx onnx-tensorflow quantization tensorflow tensorflow-lite tfjs tflite transformer yolov7

Last synced: 03 Oct 2024

https://github.com/megvii-research/MOTR

[ECCV2022] MOTR: End-to-End Multiple-Object Tracking with TRansformer

end-to-end multi-object-tracking pytorch transformer

Last synced: 31 Jul 2024

https://github.com/megvii-model/MOTR

[ECCV2022] MOTR: End-to-End Multiple-Object Tracking with TRansformer

end-to-end multi-object-tracking pytorch transformer

Last synced: 02 Aug 2024

https://github.com/georgian-io/Multimodal-Toolkit

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

huggingface-transformers multimodal-learning natural-language-processing tabular-data transformer

Last synced: 01 Aug 2024

https://github.com/google-research/bigbird

Transformers for Longer Sequences

bert deep-learning longer-sequences nlp transformer

Last synced: 03 Aug 2024

https://github.com/mv-lab/swin2sr

[ECCV] Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restoration. Advances in Image Manipulation (AIM) workshop ECCV 2022. Try it out! over 3.3M runs https://replicate.com/mv-lab/swin2sr

compression compression-artifact-reduction computer-vision deblocking deep-learning denoising eccv2022 image-denoising image-processing image-restoration image-sr image-super-resolution jpeg low-level-vision ntire super-resolution swin2sr swinir transformer vision-transformer

Last synced: 01 Aug 2024

https://github.com/Media-Smart/vedastr

A scene text recognition toolbox based on PyTorch

ocr ocr-recognition pytorch scene-text-recognition text-recognition transformer

Last synced: 01 Aug 2024

https://github.com/azkadev/whisper

Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models

ai android dart flutter ggml indonesia ios linux macos openai speech speech-recognition speech-synthesis speech-to-text transcribe transformer whisper whisper-dart whisper-flutter windows

Last synced: 26 Sep 2024

https://github.com/SysCV/transfiner

Mask Transfiner for High-Quality Instance Segmentation, CVPR 2022

cvpr cvpr2022 efficient-transformers high-quality instance-segmentation transformer

Last synced: 03 Aug 2024

https://github.com/YatingMusic/remi

"Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions", ACM Multimedia 2020

music-generation tensorflow transformer

Last synced: 05 Aug 2024

https://github.com/aelbore/esbuild-jest

A Jest transformer using esbuild

esbuild javascript jest test transformer typescript

Last synced: 31 Jul 2024

https://github.com/zhihu/cuBERT

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

bert cuda deep-learning inference mkl predict tensorflow transformer

Last synced: 01 Aug 2024

https://github.com/bradyz/cross_view_transformers

Cross-view Transformers for real-time Map-view Semantic Segmentation (CVPR 2022 Oral)

cvpr2022 deep-learning pytorch transformer

Last synced: 31 Jul 2024

https://github.com/opendilab/InterFuser

[CoRL 2022] InterFuser: Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer

autonomous-driving bird-view-image transformer

Last synced: 31 Jul 2024

https://github.com/subho406/OmniNet

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

artificial-intelligence deep-learning image-captioning machine-learning multimodal-learning multitask-learning neural-network nlp transformer video-recognition

Last synced: 07 Aug 2024

https://github.com/azure/ms-amp

Microsoft Automatic Mixed Precision Library

amp deep-learning fp8 gpu mixed-precision pytorch transformer

Last synced: 30 Sep 2024

https://github.com/zhvng/open-musiclm

Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.

artificial-intelligence attention music-generation text-to-music transformer

Last synced: 05 Aug 2024

https://github.com/HRNet/HRFormer

[ NeurIPS2021] This is an official implementation of our paper "HRFormer: High-Resolution Transformer for Dense Prediction".

classification hrnet pose-estimation segmentation transformer vision

Last synced: 03 Aug 2024

https://github.com/microsoft/foldingdiff

Diffusion models of protein structure; trigonometry and attention are all you need!

diffusion diffusion-models protein protein-structure-generation proteins transformer

Last synced: 01 Aug 2024

https://github.com/prs-eth/OverlapPredator

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

3dvision attention-mechanism point-cloud registration transformer

Last synced: 31 Jul 2024

https://github.com/lilianweng/transformer-tensorflow

Implementation of Transformer Model in Tensorflow

attention-is tensorflow-models transformer transformer-encoder

Last synced: 26 Sep 2024

https://github.com/likyoo/open-cd

A Change Detection Repo Standing on the Shoulders of Giants

bit change-detection changer deep-learning pytorch transformer

Last synced: 03 Aug 2024

https://github.com/lhoyer/DAFormer

[CVPR22] Official Implementation of DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentation

cvpr2022 semantic-segmentation transformer unsupervised-domain-adaptation

Last synced: 03 Aug 2024

https://github.com/instadeepai/nucleotide-transformer

🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics

deep-learning dna genomics language-model nucleotide transformer

Last synced: 01 Aug 2024

https://github.com/zihangJiang/TokenLabeling

Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"

imagenet lv-vit pytorch segmentation transformer vision

Last synced: 02 Aug 2024

https://github.com/lemonhu/NER-BERT-pytorch

PyTorch solution of named entity recognition task Using Google AI's pre-trained BERT model.

chinese-ner entity-extraction google-bert information-extraction msra named-entity-recognition ner pytorch transformer

Last synced: 01 Aug 2024

https://github.com/igorbek/typescript-plugin-styled-components

TypeScript transformer for improving the debugging experience of styled-components

styled-components transformer typescript typescript-plugin webpack

Last synced: 01 Oct 2024

https://github.com/Igorbek/typescript-plugin-styled-components

TypeScript transformer for improving the debugging experience of styled-components

styled-components transformer typescript typescript-plugin webpack

Last synced: 31 Jul 2024

https://github.com/lucidrains/enformer-pytorch

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

artificial-intelligence attention-mechanism deep-learning dna-sequences gene-expression genomics transformer

Last synced: 03 Oct 2024

https://github.com/muqiujun-ai/bert4pytorch

超轻量级bert的pytorch版本,大量中文注释,容易修改结构,持续更新

bert nlp pytorch transformer

Last synced: 01 Oct 2024

https://github.com/MuQiuJun-AI/bert4pytorch

超轻量级bert的pytorch版本,大量中文注释,容易修改结构,持续更新

bert nlp pytorch transformer

Last synced: 01 Aug 2024

https://github.com/Event-AHU/Mamba_State_Space_Model_Paper_List

[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications

linear-attention-model mamba point-mamba ssm transformer video-mamba vision-mamba

Last synced: 31 Jul 2024

https://github.com/wessberg/cjstoesm

A tool that can transform CommonJS to ESM

api cjs cli commonjs compiler es6 esm modules rollup transformer treeshake typescript webpack

Last synced: 31 Jul 2024

https://github.com/texttron/tevatron

Tevatron - A flexible toolkit for neural retrieval research and development.

dense-retrieval dpr flax information-retrieval jax pytorch question-answering transformer

Last synced: 02 Aug 2024

https://github.com/rish-16/gpt2client

✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝

gpt-2 machine-learning openai tensorflow text-generation transformer

Last synced: 30 Jul 2024

https://github.com/operatorai/modelstore

🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud storage provider.

data-science keras machine-learning mlops modelstore python-library pytorch s3-storage scikit-learn tensorflow transformer

Last synced: 29 Sep 2024

https://github.com/cyberzhg/keras-transformer

Transformer implemented in Keras

attention decoder encoder keras transformer translation

Last synced: 29 Sep 2024

https://github.com/airaria/TextPruner

A PyTorch-based model pruning toolkit for pre-trained language models

model-pruning pre-trained-language-models pruning transformer

Last synced: 03 Aug 2024

https://github.com/lucidrains/conformer

Implementation of the convolutional module from the Conformer paper, for use in Transformers

artificial-intelligence audio deep-learning transformer

Last synced: 03 Oct 2024

https://github.com/dvlab-research/Stratified-Transformer

Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)

cvpr2022 point-cloud semantic-segmentation transformer

Last synced: 31 Jul 2024

https://github.com/megvii-research/MOTRv2

[CVPR2023] MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectors

end-to-end multi-object-tracking pytorch transformer

Last synced: 31 Jul 2024

https://github.com/DongjunLee/transformer-tensorflow

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

attention deep-learning experiments hb-experiment nlp tensorflow transformer translation

Last synced: 01 Aug 2024

https://github.com/Haiyang-W/DSVT

[CVPR2023] Official Implementation of "DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets"

3d-object-detection backbone cvpr2023 point-cloud pytorch transformer

Last synced: 31 Jul 2024

https://github.com/botaoye/OSTrack

[ECCV 2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework

tracking transformer

Last synced: 01 Aug 2024

https://github.com/tpoisonooo/llama.onnx

LLaMa/RWKV onnx models, quantization and testcase

alpaca llama llm onnx onnxruntime quantization rwkv transformer

Last synced: 03 Aug 2024

https://github.com/v-iashin/SpecVQGAN

Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

audio audio-generation bmvc evaluation-metrics gan melgan multi-modal pytorch transformer vas vggsound video video-features video-understanding vqvae

Last synced: 01 Aug 2024

https://github.com/mit-han-lab/hardware-aware-transformers

[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

efficient-model hardware-aware machine-translation natural-language-processing specialization transformer

Last synced: 03 Aug 2024

https://github.com/LiyuanLucasLiu/Transformer-Clinic

Understanding the Difficulty of Training Transformers

initialization nmt transformer wmt

Last synced: 03 Aug 2024

https://github.com/krasserm/fairseq-image-captioning

Transformer-based image captioning extension for pytorch/fairseq

fairseq image-captioning pytorch transformer

Last synced: 03 Oct 2024

https://github.com/jw9730/tokengt

[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch

equivariance gnn graph hypergraph pytorch self-attention transformer

Last synced: 31 Jul 2024

https://github.com/MCG-NJU/SparseBEV

[ICCV 2023] SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos

3d-object-detection autonomous-driving bev-perception transformer

Last synced: 31 Jul 2024

https://github.com/petals-infra/chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

api bloom chatbot distributed-systems gpt guanaco language-models large-language-models llama llama2 transformer volunteer-computing

Last synced: 27 Sep 2024

https://github.com/smousavi05/EQTransformer

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

attention-mechanism deep-learning detection earthquakes global lstm-neural-networks multi-task-learning neural-network phase-picking stead transformer

Last synced: 03 Aug 2024

https://github.com/fudan-zvg/SOFT

[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity

linear-complexity linear-transformer self-attention softmax-free transformer

Last synced: 03 Aug 2024

https://github.com/guillaume-be/rust-tokenizers

Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models

deep-learning rust-lang tokenizer transformer

Last synced: 28 Sep 2024

https://github.com/TuSimple/centerformer

Implementation for CenterFormer: Center-based Transformer for 3D Object Detection (ECCV 2022)

lidar-point-cloud transformer

Last synced: 31 Jul 2024

https://github.com/vectorch-ai/scalellm

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 27 Sep 2024

https://github.com/vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 03 Aug 2024

https://github.com/dvlab-research/SphereFormer

The official implementation for "Spherical Transformer for LiDAR-based 3D Recognition" (CVPR 2023).

3d-object-detection 3d-semantic-segmentation cvpr2023 lidar-point-cloud nuscenes semantickitti transformer waymo

Last synced: 31 Jul 2024

https://github.com/WangRongsheng/MedQA-ChatGLM

🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调,我们的眼光不止于医疗问答

chatglm-6b chatgpt dataset fine-tuning freeze huggingface large-language-models llms lora medical rlhf transformer

Last synced: 02 Aug 2024

https://github.com/lucidrains/routing-transformer

Fully featured implementation of Routing Transformer

artificial-intelligence attention-mechanism deep-learning pytorch transformer

Last synced: 03 Oct 2024

https://github.com/extreme-bert/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

bert deep-learning language-model language-models machine-learning natural-language-processing nlp python pytorch transformer

Last synced: 03 Aug 2024

https://github.com/rxn4chemistry/rxnmapper

RXNMapper: Unsupervised attention-guided atom-mapping. Code complementing our Science Advances publication on "Extraction of organic chemistry grammar from unsupervised learning of chemical reactions" (https://advances.sciencemag.org/content/7/15/eabe4166).

atom-mapping chemistry reactions rxn smiles transformer

Last synced: 01 Aug 2024

https://github.com/maraoz/gpt-scrolls

A collaborative collection of open-source safe GPT-3 prompts that work well

generator gpt-3 language-model openai safety transformer

Last synced: 30 Jul 2024