Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with transformer

A curated list of projects in awesome lists tagged with transformer .

https://github.com/WenjieDu/SAITS

The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-series imputation (impute multivariate incomplete time series containing NaN missing data/values with machine learning). https://arxiv.org/abs/2202.08516

attention attention-mechanism deep-learning imputation imputation-model impute incomplete-data incomplete-time-series interpolation irregular-sampling machine-learning missing-values partially-observed partially-observed-data partially-observed-time-series pytorch self-attention time-series time-series-imputation transformer

Last synced: 01 Aug 2024

https://github.com/DocF/multispectral-object-detection

Multispectral Object Detection with Yolov5 and Transformer

deep-learning object-detection pytorch transformer yolov5

Last synced: 02 Aug 2024

https://github.com/POSTECH-CVLab/FastPointTransformer

Official source code of Fast Point Transformer, CVPR 2022

3d-vision computer-vision cvpr2022 point-cloud transformer

Last synced: 31 Jul 2024

https://github.com/tensorchord/modelz-llm

OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)

llm nlp openai-api transformer

Last synced: 01 Aug 2024

https://github.com/hmunachi/nanodl

A Jax-based library for designing and training transformer models from scratch.

attention attention-mechanism deep-learning distributed-training flax gpt jax llama machine-learning mistral nlp transformer

Last synced: 27 Sep 2024

https://github.com/Haiyang-W/UniTR

[ICCV2023] Official Implementation of "UniTR: A Unified and Efficient Multi-Modal Transformer for Bird’s-Eye-View Representation"

3d 3d-object-detection 3d-segmentation backbone bev camera computer-vision iccv2023 lidar multi-modal multi-view point-cloud transformer unified

Last synced: 31 Jul 2024

https://github.com/gmihaila/ml_things

This is where I put things I find useful that speed up my work with Machine Learning. Ever looked in your old projects to reuse those cool functions you created before? Well, this repo is designed to be a Python Library of functions I created in my previous project that can be reused. I also share some Notebooks Tutorials and Python Code Snippets.

google-colab machine-learning nlp nlp-machine-learning notebooks python-snippets pytorch snippets transformer

Last synced: 27 Sep 2024

https://github.com/akanyaani/gpt-2-tensorflow2.0

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

gpt gpt-2 gpt2 implementation nlp openai pre-training pretraining tensorflow tensorflow2 text-generation transformer

Last synced: 02 Aug 2024

https://github.com/lucidrains/se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

artificial-intelligence attention-mechanism deep-learning equivariance se3 transformer

Last synced: 03 Oct 2024

https://github.com/Haiyang-W/GiT

🔥 [ECCV2024] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"

foundation-models perception transformer unified vision-and-language vision-transformer

Last synced: 31 Jul 2024

https://github.com/rishikksh20/FNet-pytorch

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

feedforward-neural-network fnet fourier-transform image-classification language-model text text-classification transformer vision

Last synced: 03 Aug 2024

https://github.com/abelriboulot/onnxt5

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

inference nlp nlp-machine-learning onnx onnxruntime sentiment-analysis summarization text-classification text-generation transformer transformers translation

Last synced: 01 Aug 2024

https://github.com/L0SG/relational-rnn-pytorch

An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.

deep-learning deepmind language-model language-modeling pytorch recurrent-neural-networks self-attention transformer word-language-model

Last synced: 07 Aug 2024

https://github.com/GoogleFeud/ts-runtime-checks

A typescript transformer that automatically generates validation code from your types.

runtime transformer typescript validation

Last synced: 04 Aug 2024

https://github.com/megvii-research/RevCol

Official Code of Paper "Reversible Column Networks" "RevColv2"

cnn computer-vision iclr2023 mae pytorch transformer vit

Last synced: 31 Jul 2024

https://github.com/woohoolabs/yin

The efficient and elegant JSON:API 1.1 server library for PHP

json-api php psr-7 server transformer

Last synced: 04 Aug 2024

https://github.com/mindspore-lab/mindcv

A toolbox of vision models and algorithms based on MindSpore

computer-vision cv deep-learning image-classification imagenet mindspore models resnet transformer

Last synced: 31 Jul 2024

https://github.com/lucidrains/electra-pytorch

A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch

artificial-intelligence deep-learning pre-training transformer

Last synced: 03 Oct 2024

https://github.com/NVIDIA/transformer-ls

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

efficient-transformers long-sequence transformer vision-transformer

Last synced: 03 Aug 2024

https://github.com/soskek/bert-chainer

Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

bert chainer google natural-language-processi natural-language-understanding nlp transformer

Last synced: 01 Aug 2024

https://github.com/bjascob/amrlib

A python library that makes AMR parsing, generation and visualization simple.

abstract-meaning-representation amr amr-graphs amr-parser amr-parsing neural-network python pytorch spacy spacy-extension text-generation transformer

Last synced: 30 Sep 2024

https://github.com/srush/raspy

An interactive exploration of Transformer programming.

transformer

Last synced: 01 Aug 2024

https://github.com/lucidrains/en-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-Equivariant Graph Neural Network

artificial-intelligence attention-mechanism deep-learning equivariance transformer

Last synced: 03 Oct 2024

https://github.com/maiqingqiang/ChatMLX

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

chat llama mlx mlx-swift qwen swift swift-transformers swiftui transformer transformers

Last synced: 02 Oct 2024

https://github.com/bold-commerce/protoc-gen-struct-transformer

Transformation functions generator for Protocol Buffers.

go golang grpc grpc-go proto protobuf protoc-gen protocol-buffers transformer

Last synced: 03 Aug 2024

https://github.com/lsj2408/transformer-m

[ICLR 2023] One Transformer Can Understand Both 2D & 3D Molecular Data (official implementation)

general-purpose-molecular-model graph-neural-network graph-transformer molecular-modeling molecule transformer

Last synced: 26 Sep 2024

https://github.com/IDEA-Research/Stable-DINO

[ICCV 2023] Official implementation of the paper "Detection Transformer with Stable Matching"

detection-transformer detrex dino object-detection transformer

Last synced: 01 Aug 2024

https://github.com/iscyy/yoloair2

☁️💡🎈专注于改进YOLOv7,Support to improve Backbone, Neck, Head, Loss, IoU, NMS and other modules

transformer yoloair yolor yolov3 yolov4 yolov5 yolov6 yolov7 yolov8 yolox

Last synced: 03 Oct 2024

https://github.com/google/jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

gemma gpt gpu inference jax large-language-models llama llama2 llm llm-inference llmops mlops model-serving pytorch tpu transformer

Last synced: 29 Sep 2024

https://github.com/gwinndr/MusicTransformer-Pytorch

MusicTransformer written for MaestroV2 using the Pytorch framework for music generation

maestro mit music-generation music-transformer python pytorch transformer

Last synced: 01 Aug 2024

https://github.com/lucidrains/graph-transformer-pytorch

Implementation of Graph Transformer in Pytorch, for potential use in replicating Alphafold2

artificial-intelligence deep-learning graphs transformer

Last synced: 03 Oct 2024

https://github.com/ytongbai/ViTs-vs-CNNs

[NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)

robustness transformer

Last synced: 08 Aug 2024

https://github.com/dvlab-research/ECCV22-P3AFormer-Tracking-Objects-as-Pixel-wise-Distributions

The official code for our ECCV22 oral paper: tracking objects as pixel-wise distributions.

mot multiple-object-tracking p3aformer tracking transformer

Last synced: 31 Jul 2024

https://github.com/lucidrains/compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

artificial-intelligence attention-mechanism deep-learning transformer

Last synced: 03 Oct 2024

https://github.com/lucidrains/h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

artificial-intelligence attention attention-mechanism deep-learning transformer

Last synced: 03 Oct 2024

https://github.com/heidelbergcement/hcrystalball

A library that unifies the API for most commonly used libraries and modeling techniques for time-series forecasting in the Python ecosystem.

cross-validation data-science fbprophet model-selection pmdarima sarimax sklearn sklearn-api sklearn-compatible sklearn-library sktime statsmodels tbats time-series time-series-forecasting transformer wrapper

Last synced: 26 Sep 2024

https://github.com/dvlab-research/SparseTransformer

A fast and memory-efficient libarary for sparse transformer with varying token numbers (e.g., 3D point cloud).

3d-point-cloud cuda sparse-transformer transformer

Last synced: 31 Jul 2024

https://github.com/MolecularAI/deep-molecular-optimization

Molecular optimization by capturing chemist’s intuition using the Seq2Seq with attention and the Transformer

molecular-optimization multi-property-optimization seq2seq transformer

Last synced: 03 Aug 2024

https://github.com/NiuTrans/NiuTrans.NMT

A Fast Neural Machine Translation System developed in C++.

fast-decoding machine-translation neural-machine-translation transformer

Last synced: 02 Aug 2024

https://github.com/vasgaowei/TS-CAM

Codes for TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization.

object-localization transformer weakly-supervised-learning

Last synced: 03 Aug 2024

https://github.com/alisafaya/Arabic-BERT

Arabic edition of BERT pretrained language models

arabic arabic-nlp bert bert-language-models language-model nlp transformer

Last synced: 03 Aug 2024

https://github.com/Sense-X/MixMIM

MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning

masked-image-modeling transformer

Last synced: 02 Aug 2024

https://github.com/zhiqwang/sightseq

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

attention crnn ctc densenet faster-rcnn image-captioning mobilenet object-detection ocr pytorch scene-texts text-recognition transformer

Last synced: 07 Aug 2024

https://github.com/pszemraj/textsum

CLI & Python API to easily summarize text-based files with transformers

batch-processing inference inference-api pipeline summarization summary text text-to-text-transformer transformer transformers

Last synced: 03 Oct 2024

https://github.com/bpolaszek/bentools-etl

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

callable etl export extract extractor import input invoke load loader loop output pattern php transform transformer

Last synced: 01 Aug 2024

https://github.com/StonyBrookNLP/deformer

[ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

acl2020 decomposition deformer question-answering transformer

Last synced: 01 Aug 2024

https://github.com/lucidrains/charformer-pytorch

Implementation of the GBST block from the Charformer paper, in Pytorch

artificial-intelligence deep-learning tokenization transformer

Last synced: 03 Oct 2024

https://github.com/xingchensong/speech-transformer-tf2.0

transformer for ASR-systerm (via tensorflow2.0)

end-to-end speech-recognition tensorflow transformer

Last synced: 03 Oct 2024

https://github.com/apple/ml-autofocusformer

This is an official implementation for "AutoFocusFormer: Image Segmentation off the Grid".

aff autofocusformer imagenet object-classification transformer

Last synced: 28 Sep 2024

https://github.com/xingchensong/Speech-Transformer-tf2.0

transformer for ASR-systerm (via tensorflow2.0)

end-to-end speech-recognition tensorflow transformer

Last synced: 02 Aug 2024

https://github.com/Bartzi/kiss

Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"

chainer deep-learning paper scene-text-recognition spatial-transformer-networks transformer

Last synced: 01 Aug 2024

https://github.com/wuliwei9278/SSE-PT

Codes and Datasets for paper RecSys'20 "SSE-PT: Sequential Recommendation Via Personalized Transformer" and NurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"

recommender-system regularization sequential sse-pt stochastic-shared-embeddings transformer

Last synced: 02 Aug 2024

https://github.com/declare-lab/flacuna

Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.

large-language-models llama transformer

Last synced: 02 Aug 2024

https://github.com/DFKI-NLP/TRE

[AKBC 19] Improving Relation Extraction by Pre-trained Language Representations

information-extraction machine-learning multi-task-learning nlp relation-extraction transformer

Last synced: 01 Aug 2024

https://github.com/LogIntelligence/NeuralLog

Log-based Anomaly Detection Without Log Parsing (ASE 2021, Research Track)

deep-learning log-based-anomaly-detection transformer

Last synced: 01 Aug 2024

https://github.com/ChristophReich1996/Cell-DETR

Official and maintained implementation of the paper "Attention-Based Transformers for Instance Segmentation of Cells in Microstructures" [BIBM 2020].

attention bibm-2020 cell-detr cell-segmentation deep-learning instance-segmentation synthetic-biology system-biology transformer

Last synced: 02 Aug 2024

https://github.com/kikyous/rails-vue-loader

Vue.js single file component loader for rails

rails sprockets transformer vue

Last synced: 01 Oct 2024

https://github.com/SkyTNT/midi-model

Midi event transformer for music generation

midi midi-generation music-composition music-generation transformer

Last synced: 05 Aug 2024

https://github.com/rayguan97/M3DETR

Code base for M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

3d-object-detection deep-learning kitti-dataset object-detection point-cloud transformer waymo-open-dataset

Last synced: 31 Jul 2024

https://github.com/juglab/FourierImageTransformer

Fourier Image Transformer (FIT) can solve relevant image analysis tasks in Fourier space.

computer-vision image-processing transformer

Last synced: 03 Aug 2024

https://github.com/madrury/basis-expansions

Basis expansion transformers in sklearn style.

derived-features machine-learning python regression sklearn transformer

Last synced: 26 Sep 2024

https://github.com/lucidrains/uformer-pytorch

Implementation of Uformer, Attention-based Unet, in Pytorch

artificial-intelligence deep-learning image-segmentation transformer unet

Last synced: 03 Oct 2024

https://github.com/KonstantinSimeonov/tsx-control-statements

Control flow JSX/TSX elements that get compiled to plain old javascript.

conditional-rendering control-statements if jsx loop react transformer tsx typescript

Last synced: 02 Aug 2024

https://github.com/lucidrains/lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

artificial-intelligence attention-mechanism deep-learning equivariance se3 transformer

Last synced: 03 Oct 2024

https://github.com/rishit-dagli/perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

artificial-intelligence attention attention-mechanism deep-learning machine-learning neural-network python tensorflow transformer transformers

Last synced: 30 Sep 2024

https://github.com/lucidrains/perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch

artficial-intelligence attention-mechanism deep-learning long-context transformer

Last synced: 03 Oct 2024

https://github.com/legacyai/tf-transformers

State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).

bert gpt2 keras language-model natural-language-processing nlp nlp-library tensorflow tensorflow2 text-classification text-generation transformer

Last synced: 01 Aug 2024

https://github.com/zgr6010/HSI_SSFTT

L. Sun, G. Zhao, Y. Zheng, and Z. Wu. "Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification," in IEEE TGRS, 2022.

convolutional-neural-networks deep-learning hyperspectral-image-classification remote-sensing transformer

Last synced: 31 Jul 2024

https://github.com/microsoft/vidur

A large-scale simulation framework for LLM inference

inference llm simulation transformer vllm

Last synced: 03 Aug 2024

https://github.com/kaslanarian/pydynet

NumPy实现类PyTorch的动态计算图和神经网络框架(MLP, CNN, RNN, Transformer)

autograd cnn cuda cupy deep-learning-framework numpy python pytorch pytorch-implementation rnn transformer

Last synced: 27 Sep 2024

https://github.com/nilportugues/php-json-api

JSON API transformer outputting valid (PSR-7) API Responses.

api json json-api marshaller microservice microservices php php7 serialization serializer transformer

Last synced: 03 Aug 2024

https://github.com/kabouzeid/point2vec

Self-Supervised Representation Learning on Point Clouds (GCPR 2023 | T4V Workshop @ CVPR 2023)

lightning machine-learning point-cloud pytorch self-supervised-learning transformer vision vision-transformer

Last synced: 31 Jul 2024

https://github.com/cloudinary-community/gatsby-transformer-cloudinary

Use Cloudinary images with gatsby-image for high performance and total control!

cloudinary gatsby gatsby-plugin hacktoberfest image transformer

Last synced: 03 Aug 2024

https://github.com/leehanchung/cs182

Berkeley CS182/282A Designing, Visualizing and Understanding Deep Neural Networks

berkeley cnn cs182 cs231n cs231n-assignment natural-language-processing nlp pytorch reinforcement-learning tensorflow transformer

Last synced: 31 Jul 2024

https://github.com/apple/ml-autofocusformer-segmentation

This is an official implementation for "AutoFocusFormer: Image Segmentation off the Grid".

ade20k aff autofocusformer cityscapes coco instance-segmentation panoptic-segmentation semantic-segmentation transformer

Last synced: 28 Sep 2024