Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/microsoft/tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

mixture-of-experts moe nlp pytorch transformer

Last synced: 03 Jul 2024

https://github.com/lucidrains/lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

artificial-intelligence attention-mechanism deep-learning equivariance se3 transformer

Last synced: 03 Jul 2024

https://github.com/microsoft/Graphormer

Graphormer is a general-purpose deep learning backbone for molecular modeling.

ai4science deep-learning graph molecule-simulation transformer

Last synced: 03 Jul 2024

https://github.com/jw9730/tokengt

[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch

equivariance gnn graph hypergraph pytorch self-attention transformer

Last synced: 03 Jul 2024

https://github.com/jw9730/hot

[NeurIPS'21] Higher-order Transformers for sets, graphs, and hypergraphs, in PyTorch

equivariance gnn graph hypergraph pytorch self-attention transformer

Last synced: 03 Jul 2024

https://github.com/timeseriesAI/tsai

Time series Timeseries Deep Learning Machine Learning Python Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai

classification cnn deep-learning fastai forecasting inceptiontime machine-learning python pytorch regression rnn rocket self-supervised sequential state-of-the-art time-series time-series-analysis time-series-classification timeseries transformer

Last synced: 02 Jul 2024

https://github.com/zhvng/open-musiclm

Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.

artificial-intelligence attention music-generation text-to-music transformer

Last synced: 02 Jul 2024

https://github.com/dvlab-research/ECCV22-P3AFormer-Tracking-Objects-as-Pixel-wise-Distributions

The official code for our ECCV22 oral paper: tracking objects as pixel-wise distributions.

mot multiple-object-tracking p3aformer tracking transformer

Last synced: 01 Jul 2024

https://github.com/HRNet/HRNet-Semantic-Segmentation

The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919

cityscapes high-resolution high-resolution-net hrnets lip pascal-context segmentation segmentation-transformer semantic-segmentation transformer

Last synced: 01 Jul 2024

https://github.com/swz30/Restormer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

cvpr2022 defocus-deblurring efficient-transformers high-resolution image-deblurring image-deraining image-restoration low-level-vision motion-deblurring pytorch transformer

Last synced: 01 Jul 2024

https://github.com/dvlab-research/Stratified-Transformer

Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)

cvpr2022 point-cloud semantic-segmentation transformer

Last synced: 01 Jul 2024

https://github.com/dvlab-research/SphereFormer

The official implementation for "Spherical Transformer for LiDAR-based 3D Recognition" (CVPR 2023).

3d-object-detection 3d-semantic-segmentation cvpr2023 lidar-point-cloud nuscenes semantickitti transformer waymo

Last synced: 01 Jul 2024

https://github.com/dvlab-research/SparseTransformer

A fast and memory-efficient libarary for sparse transformer with varying token numbers (e.g., 3D point cloud).

3d-point-cloud cuda sparse-transformer transformer

Last synced: 01 Jul 2024

https://github.com/ZikangZhou/HiVT

[CVPR 2022] HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction

autonomous-driving cvpr2022 motion-prediction transformer

Last synced: 01 Jul 2024

https://github.com/kabouzeid/point2vec

Self-Supervised Representation Learning on Point Clouds (GCPR 2023 | T4V Workshop @ CVPR 2023)

lightning machine-learning point-cloud pytorch self-supervised-learning transformer vision vision-transformer

Last synced: 01 Jul 2024

https://github.com/Haiyang-W/UniTR

[ICCV2023] Official Implementation of "UniTR: A Unified and Efficient Multi-Modal Transformer for Bird’s-Eye-View Representation"

3d 3d-object-detection 3d-segmentation backbone bev camera computer-vision iccv2023 lidar multi-modal multi-view point-cloud transformer unified

Last synced: 01 Jul 2024

https://github.com/MCG-NJU/SparseBEV

[ICCV 2023] SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos

3d-object-detection autonomous-driving bev-perception transformer

Last synced: 01 Jul 2024

https://github.com/Haiyang-W/DSVT

[CVPR2023] Official Implementation of "DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets"

3d-object-detection backbone cvpr2023 point-cloud pytorch transformer

Last synced: 01 Jul 2024

https://github.com/gotonote/Autopilot-Notes

自动驾驶笔记,以解析各模块知识点、整合行业优秀解决方案进行阐述,以帮助自己及有需要的读者;包含深度学习、deeplearning、无人驾驶、BEV、Transformer、ADAS、CVPR、特斯拉AI DAY、大模型、chatgpt等内容。由于水平有限,文中不妥之处恳请广大读者批评指正。如有合作意向,请联系 [email protected]

algorithms autopilot bev chatgpt deep-learning self-driving-car transformer tutorial

Last synced: 01 Jul 2024

https://github.com/Little-Podi/Transformer_Tracking

This repository is a paper digest of Transformer-related approaches in visual tracking tasks.

awesome-list cvpr eccv iccv neurips ob object-tracking paper-list single-object-tracking tracking transformer visual-tracking

Last synced: 01 Jul 2024

https://github.com/Bartzi/kiss

Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"

chainer deep-learning paper scene-text-recognition spatial-transformer-networks transformer

Last synced: 30 Jun 2024

https://github.com/Media-Smart/vedastr

A scene text recognition toolbox based on PyTorch

ocr ocr-recognition pytorch scene-text-recognition text-recognition transformer

Last synced: 30 Jun 2024

https://github.com/KonstantinSimeonov/tsx-control-statements

Control flow JSX/TSX elements that get compiled to plain old javascript.

conditional-rendering control-statements if jsx loop react transformer tsx typescript

Last synced: 29 Jun 2024

https://github.com/pigly-di/pigly

unobtrusive dependency-injection for javascript/typescript

dependency-injection inversion-of-control javascript plugin transformer typescript

Last synced: 29 Jun 2024

https://github.com/YePpHa/ts-di-transformer

A proof-of-concept of using interfaces with a dependency injection system with custom transformers

custom dependency injection interface javascript symbol transformer typescript

Last synced: 29 Jun 2024

https://github.com/GoogleFeud/ts-runtime-checks

A typescript transformer that automatically generates validation code from your types.

runtime transformer typescript validation

Last synced: 29 Jun 2024

https://github.com/itsdouges/typescript-transformer-handbook

📘 A comprehensive handbook on how to create transformers for TypeScript with code examples

handbook transformer ts-transformer typescript

Last synced: 29 Jun 2024

https://github.com/itsdouges/awesome-typescript-ecosystem

😎 A list of awesome TypeScript transformers, plugins, handbooks, etc

awesome awesome-list list plugin transformer typescript

Last synced: 29 Jun 2024

https://github.com/acbull/pyHGT

Code for "Heterogeneous Graph Transformer" (WWW'20), which is based on pytorch_geometric

graph-neural-networks graph-representation-learning heterogeneous-network network-embedding transformer

Last synced: 28 Jun 2024

https://github.com/graphdeeplearning/graphtransformer

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

aaai attention graph-deep-learning graph-neural-networks graph-transformer transformer transformer-networks transformers

Last synced: 28 Jun 2024

https://github.com/sooftware/conformer

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

asr augmented cnn conformer conv convolution pytorch recognition speech speech-recognition transformer transformer-xl

Last synced: 28 Jun 2024

https://github.com/athena-team/athena

an open-source implementation of sequence-to-sequence based speech processing engine

asr ctc deployment sequence-to-sequence speaker-recognition speech-recognition speech-synthesis tensorflow transformer tts unsupervised-learning wfst

Last synced: 28 Jun 2024

https://github.com/Guitaricet/relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

deep-learning distributed-training llama nlp peft transformer

Last synced: 28 Jun 2024

https://github.com/m3hrdadfi/zabanshenas

Zabanshenas is a solution for identifying the most likely language of a piece of written text. Demo (👇 )

attention-is-all-you-need detected-languages langdetect language-detector languages langugage-recognition pytorch-implementation roberta transformer transformers

Last synced: 27 Jun 2024

https://github.com/codingonion/awesome-anchor-free-object-detection

A collection of some awesome public Anchor-Free object detection series projects.

anchor-free attention centernet cornernet detr fcos nanodet object-detection transformer yolo yolov5 yolov7 yolox

Last synced: 25 Jun 2024

https://github.com/kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

artificial-intelligence attention attention-is-all-you-need attention-mechanisms chatgpt context-length gpt3 gpt4 machine-learning transformer

Last synced: 25 Jun 2024

https://github.com/ytongbai/ViTs-vs-CNNs

[NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)

robustness transformer

Last synced: 23 Jun 2024

https://github.com/DyGRec/ASReP

Released code of SIGIR2021 Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer.

augmented-sequences item-prediction recommender-system sequential-recommendation transformer

Last synced: 23 Jun 2024

https://github.com/NVIDIA-Merlin/Transformers4Rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

bert gtp huggingface language-model nlp pytorch recommender-system recsys seq2seq session-based-recommendation tabular-data transformer xlnet

Last synced: 22 Jun 2024

https://github.com/Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

albert bert decoder gpt2 gpu huggingface-transformers inference machine-translation nlp pytorch roberta transformer

Last synced: 22 Jun 2024

https://github.com/obss/trapper

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

allennlp deep-learning natural-language-processing nlp python pytorch pytorch-transformers transformer transformers

Last synced: 22 Jun 2024

https://github.com/PaddlePaddle/awesome-DeepLearning

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI

bert classification cnn detection dqn dssm dynabert gan nlp pose recommender-system reinforcement-learning rnn sarsa segmentation tinybert transformer video

Last synced: 22 Jun 2024

https://optimalscale.github.io/LMFlow/

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

chatgpt deep-learning instruction-following language-model pretrained-models pytorch transformer

Last synced: 21 Jun 2024

https://github.com/ddz16/TSFpaper

This repository contains a reading list of papers on Time Series Forecasting/Prediction (TSF) and Spatio-Temporal Forecasting/Prediction (STF). These papers are mainly categorized according to the type of model.

deep-learning deep-neural-networks paper-lists rnn spatial-temporal-forecasting spatio-temporal spatio-temporal-data spatio-temporal-prediction tcn time-series time-series-analysis time-series-forecasting time-series-models time-series-prediction transformer

Last synced: 20 Jun 2024

https://github.com/NiuTrans/NiuTrans.NMT

A Fast Neural Machine Translation System. It is developed in C++ and resorts to NiuTensor for fast tensor APIs.

fast-decoding machine-translation neural-machine-translation transformer

Last synced: 20 Jun 2024

https://github.com/hunghg255/rspress-plugin-shiki

Rspress plugin shiki with transformer

plugins rspress shiki-highlighter transformer

Last synced: 20 Jun 2024

https://github.com/ELS-RD/kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

cuda cuda-kernel pytorch transformer triton

Last synced: 18 Jun 2024

https://github.com/km1994/NLP-Interview-Notes

该仓库主要记录 NLP 算法工程师相关的面试题

bert deel-learning ner nlp transformer

Last synced: 16 Jun 2024

https://github.com/PaddlePaddle/PaddleSeg

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

autonomous-driving human-segmentation image-matting image-segmentation interactive-segmentation lane-detection medical-image-segmentation panoptic-segmentation semantic-segmentation transformer video-segmentation

Last synced: 16 Jun 2024

https://github.com/wuliwei9278/SSE-PT

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

recommender-system regularization sequential sse-pt stochastic-shared-embeddings transformer

Last synced: 16 Jun 2024

https://github.com/texttron/tevatron

Tevatron - A flexible toolkit for neural retrieval research and development.

dense-retrieval dpr flax information-retrieval jax pytorch question-answering transformer

Last synced: 16 Jun 2024

https://github.com/researchmm/Stark

[ICCV'21] Learning Spatio-Temporal Transformer for Visual Tracking

transformer

Last synced: 16 Jun 2024

https://github.com/botaoye/OSTrack

[ECCV 2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework

tracking transformer

Last synced: 16 Jun 2024

https://github.com/dawnyc/ROMTrack

[ICCV 2023] Robust Object Modeling for Visual Tracking, Official Implementation

iccv2023 object-modeling pytorch robustness tracking transformer

Last synced: 16 Jun 2024

https://github.com/DocF/multispectral-object-detection

Multispectral Object Detection with Yolov5 and Transformer

deep-learning object-detection pytorch transformer yolov5

Last synced: 15 Jun 2024

https://github.com/AmrHendy/programming-language-translator

An easy way to use the released TransCoder by Facebook AI Research to convert code from one programming language to another using unsupervised neural machine translation (NMT) systems that use deep-learning to translate text from one natural language to another and is trained only on monolingual source data.

machine-translation nlp programming-language transcoder transformer unsupervised-deep-learning unsupervised-translation

Last synced: 15 Jun 2024

https://github.com/ppogg/YOLOv5-Lite

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

android-app mnn mobilenet ncnn onnxruntime openvivo picodet pplcnet pytorch repvgg shufflenetv2 tensorrt tflite transformer yolov5

Last synced: 15 Jun 2024

https://github.com/PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

bert compression detection distillation ernie nas pruning quantization segmentation sparsity tensorrt transformer yolov5 yolov6 yolov7

Last synced: 15 Jun 2024

https://github.com/iscyy/yoloair2

☁️💡🎈专注于改进YOLOv7,Support to improve Backbone, Neck, Head, Loss, IoU, NMS and other modules

transformer yoloair yolor yolov3 yolov4 yolov5 yolov6 yolov7 yolov8 yolox

Last synced: 15 Jun 2024

https://github.com/hustvl/YOLOS

[NeurIPS 2021] You Only Look at One Sequence

computer-vision object-detection transformer vision-transformer

Last synced: 15 Jun 2024

https://github.com/xmuSistone/ViewpagerTransition

viewpager with parallax pages, together with vertical sliding (or click) and activity transition

parallax transformer transition viewpager

Last synced: 15 Jun 2024

https://github.com/WangRongsheng/MedQA-ChatGLM

🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调,我们的眼光不止于医疗问答

chatglm-6b chatgpt dataset fine-tuning freeze huggingface large-language-models llms lora medical rlhf transformer

Last synced: 14 Jun 2024

https://github.com/megvii-research/RevCol

Official Code of Paper "Reversible Column Networks" "RevColv2"

cnn computer-vision iclr2023 mae pytorch transformer vit

Last synced: 14 Jun 2024

https://github.com/tensorchord/modelz-llm

OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)

llm nlp openai-api transformer

Last synced: 14 Jun 2024

https://github.com/vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 13 Jun 2024

https://github.com/airaria/TextPruner

A PyTorch-based model pruning toolkit for pre-trained language models

model-pruning pre-trained-language-models pruning transformer

Last synced: 13 Jun 2024

https://github.com/extreme-bert/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

bert deep-learning language-model language-models machine-learning natural-language-processing nlp python pytorch transformer

Last synced: 13 Jun 2024

https://github.com/NVIDIA/transformer-ls

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

efficient-transformers long-sequence transformer vision-transformer

Last synced: 13 Jun 2024

https://github.com/MolecularAI/deep-molecular-optimization

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

molecular-optimization multi-property-optimization seq2seq transformer

Last synced: 13 Jun 2024

https://github.com/google-research/bigbird

Transformers for Longer Sequences

bert deep-learning longer-sequences nlp transformer

Last synced: 13 Jun 2024

https://github.com/mit-han-lab/lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention

nlp pytorch transformer

Last synced: 13 Jun 2024

https://github.com/mit-han-lab/hardware-aware-transformers

[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

efficient-model hardware-aware machine-translation natural-language-processing specialization transformer

Last synced: 13 Jun 2024