Projects in Awesome Lists tagged with transformers

https://github.com/lucidrains/etsformer-pytorch

Implementation of ETSformer, state of the art time-series Transformer, in Pytorch

artificial-intelligence deep-learning exponential-smoothing time-series transformers

Last synced: 14 Nov 2024

https://github.com/ssbuild/deep_training

deep learning

adalora alora deep deep-training lora models torch training transformers

Last synced: 16 Nov 2024

https://github.com/AllenXiangX/SnowflakeNet

(TPAMI 2023) Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

3dvision deep-learning iccv2021 point-cloud-completion pytorch tpami2023 transformers

Last synced: 15 Nov 2024

https://github.com/intellabs/causality-lab

Causal discovery algorithms and tools for implementing new ones

causal-discovery causal-reasoning causality-algorithms constraint-based-causality explainable-ai transformers

Last synced: 13 Nov 2024

https://github.com/ofa-sys/ofasys

OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models

audio computer-vision deep-learning motion multimodal-learning multitask-learning nlp pretrained-models pytorch transformers vision-and-language

Last synced: 10 Oct 2024

https://github.com/jiwidi/Behavior-Sequence-Transformer-Pytorch

This is a pytorch implementation for the BST model from Alibaba https://arxiv.org/pdf/1905.06874.pdf

alibaba behavior behavior-sequence-transformer pytorch recommenders seq2seq seq2seq-attn transformers

Last synced: 05 Nov 2024

https://github.com/minimaxir/imgbeddings

Python package to generate image embeddings with CLIP without PyTorch/TensorFlow

ai clip embeddings image-processing images onnx transformers

Last synced: 14 Nov 2024

https://github.com/yuanzhoulvpi2017/documentsearch

基于sentence transformers和chatglm实现的文档搜索工具

chatglm-6b sbert transformers

Last synced: 08 Nov 2024

https://github.com/OctoberChang/X-Transformer

X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification

extreme-multi-label-classification pytorch text-classification transformers

Last synced: 11 Nov 2024

https://github.com/dipanjans/nlp_workshop_odsc_europe20

Extensive tutorials for the Advanced NLP Workshop in Open Data Science Conference Europe 2020. We will leverage machine learning, deep learning and deep transfer learning to learn and solve popular tasks using NLP including NER, Classification, Recommendation \ Information Retrieval, Summarization, Classification, Language Translation, Q&A and Topic Models.

deep-learning gensim jupyter-notebook machine-learning natural-language-processing nltk python pytorch scikit-learn spacy tensorflow transfer-learning transformers

Last synced: 14 Oct 2024

https://github.com/OutofAi/StableFace

Build your own Face App with Stable Diffusion 2.1

attention-is-all-you-need ddim-inversion diffusion-models faceapp generative-ai generativeai image-editing image-editing-app image-reconstruction photo-editing-app pivotal-inversion prompt2prompt sampling-distribution stable-diffusion stable-diffusion-2-1 stableface transformers

Last synced: 03 Sep 2024

https://github.com/fcakyon/video-transformers

Easiest way of fine-tuning HuggingFace video classification models

accelerate classification deep-learning evaluate huggingface layer machine-learning neptune onnx onnxruntime python pytorch pytorch-video tensorboard transformers video video-classification video-transformer vision wandb

Last synced: 14 Nov 2024

https://github.com/lucidrains/stam-pytorch

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

artificial-intelligence attention-mechanism deep-learning transformers video-classification

Last synced: 15 Nov 2024

https://github.com/skalskip/transformers

Everything you need to know about Transformers! 🤖

attention-mechanism clip detr gpt transformers visual-transformer

Last synced: 23 Oct 2024

https://github.com/warner-benjamin/commented-transformers

Highly commented implementations of Transformers in PyTorch

bert gpt pytorch transformers

Last synced: 28 Oct 2024

https://github.com/pszemraj/textsum

CLI & Python API to easily summarize text-based files with transformers

batch-processing inference inference-api pipeline summarization summary text text-to-text-transformer transformer transformers

Last synced: 14 Nov 2024

https://github.com/patil-suraj/onnx_transformers

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

inference nlp onnx onnxruntime transformers

Last synced: 01 Nov 2024

https://github.com/teelinsan/camoscio

Camoscio: An Italian instruction-tuned language model based on LLaMA

italian language-model llama transformers

Last synced: 16 Nov 2024

https://github.com/AlekseyKorshuk/optimum-transformers

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

benchmark huggingface infinity natural-language-processing nlp onnx onnxruntime optimum pipeline transformers

Last synced: 07 Aug 2024

https://github.com/rasbt/faster-pytorch-blog

Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy

deeplearning lightning pytorch transformers

Last synced: 01 Nov 2024

https://github.com/sayakpaul/robustness-vit

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

computer-vision jax pytorch robustness self-attention tensorflow transformers

Last synced: 01 Nov 2024

https://github.com/yusufhilmi/client-vector-search

A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenAI's text-embedding-ada-002 and is way faster than Pinecone and other VectorDBs.

embedding-models embedding-vectors embeddings openai search text-embeddings transformers vector vector-search

Last synced: 08 Nov 2024

https://github.com/superagent-ai/superagent-py

Superagent Python SDK

ai assistants gpt superagent transformers

Last synced: 15 Nov 2024

https://github.com/dnth/x.infer

Framework agnostic computer vision inference.

computer-vision inference-api ollama pytorch-image-models transformers ultralytics vllm

Last synced: 15 Nov 2024

https://github.com/lucidrains/long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

artificial-intelligence attention-mechanism deep-learning transformers

Last synced: 15 Nov 2024

https://github.com/huggingface/transformers.js-examples

A collection of 🤗 Transformers.js demos and example applications

transformers transformersjs

Last synced: 28 Aug 2024

https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.

gpt gpt-neo transformers

Last synced: 13 Nov 2024

https://github.com/shibing624/nerpy

🌈 NERpy: Implementation of Named Entity Recognition using Python. 命名实体识别工具，支持BertSoftmax、BertSpan等模型，开箱即用。

bert bert-softmax bert-span named-entity-recognition ner nlp pytorch transformers

Last synced: 14 Nov 2024

https://github.com/facebookresearch/LayerSkip

"LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", Accepted to ACL 2024

early-exit layer-drop llm optimization speculative-decoding transformers

Last synced: 23 Oct 2024

https://github.com/tharindudr/transquest

Transformer based translation quality estimation

deep-learning quality-estimation transformers

Last synced: 06 Nov 2024

https://github.com/prrao87/tweet-stance-prediction

Applying NLP transfer learning techniques to predict Tweet stance toward a topic

natural-language-processing nlp openai-gpt python text-classification transfer-learning transformers ulmfit

Last synced: 16 Nov 2024

https://github.com/yihongXU/TransCenter

This is the official implementation of TransCenter (TPAMI). The code and pretrained models are now available here: https://gitlab.inria.fr/yixu/TransCenter_official.

computer-vision deep-learning multiple-object-tracking pytorch transformers

Last synced: 13 Nov 2024

https://github.com/facebookresearch/layerskip

"LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", Accepted to ACL 2024

early-exit layer-drop llm optimization speculative-decoding transformers

Last synced: 06 Nov 2024

https://github.com/lucidrains/memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

artificial-intelligence attention-mechanism memory transformers

Last synced: 15 Nov 2024

https://github.com/lucidrains/infini-transformer-pytorch

Implementation of Infini-Transformer in Pytorch

artificial-intelligence attention-mechanism deep-learning long-context memory transformers

Last synced: 13 Nov 2024

https://github.com/xenova/sponsorblock-ml

Automatically detect in-video YouTube sponsorships, self/unpaid promotions, and interaction reminders.

machine-learning python sponsorblock transformers youtube

Last synced: 28 Oct 2024

https://github.com/wgcban/hypertransformer

[CVPR'22] HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening

attention-mechanism deep-learning hyperspectral-imaging image-fusion multispectral-images pansharpening super-resolution transformers

Last synced: 16 Nov 2024

https://github.com/billp/TermiNetwork

🌏 A zero-dependency networking solution for building modern and secure iOS, watchOS, macOS and tvOS applications.

apple carthage cocoapods deserialization interceptors ios library macos mock-data networking routers swift swift-packages swiftui transformers tvos watchos xcode

Last synced: 17 Aug 2024

https://github.com/clovaai/length-adaptive-transformer

Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)

efficiency evolutionary-search transformers

Last synced: 12 Nov 2024

https://github.com/billp/terminetwork

🌏 A zero-dependency networking solution for building modern and secure iOS, watchOS, macOS and tvOS applications.

apple carthage cocoapods deserialization interceptors ios library macos mock-data networking routers swift swift-packages swiftui transformers tvos watchos xcode

Last synced: 12 Oct 2024

https://github.com/young-geng/m3ae_public

Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation

computer-vision flax jax natural-language-processing transformers

Last synced: 06 Nov 2024

https://github.com/lucidrains/uniformer-pytorch

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

3d-convolutional-network artificial-intelligence attention-mechanism deep-learning transformers video-classification

Last synced: 01 Nov 2024

https://github.com/lucidrains/multimodal-dit-pytorch

Implementation of a multimodal diffusion transformer in Pytorch

artificial-intelligence audio deep-learning denoising-diffusion transformers video

Last synced: 22 Oct 2024

https://github.com/lucidrains/zorro-pytorch

Implementation of Zorro, Masked Multimodal Transformer, in Pytorch

artificial-intelligence attention-mechanisms deep-learning masking multimodal transformers

Last synced: 15 Nov 2024

https://github.com/lucidrains/diffusion-policy

Implementation of Diffusion Policy, Toyota Research's supposed breakthrough in leveraging DDPMs for learning policies for real-world Robotics

artificial-intelligence attention-mechanisms deep-learning denoising-diffusion robotics transformers

Last synced: 14 Nov 2024

https://github.com/lucidrains/rq-transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"

artificial-intelligence attention-mechanism deep-learning image-generation transformers

Last synced: 01 Nov 2024

https://github.com/scrn-vrc/language-translation-with-fragment-shaders

EN to JP and JP to EN with transformer models

deep-neural-networks machine-learning natural-language-processing shaders transformers translation unity3d vrchat

Last synced: 09 Oct 2024

https://github.com/kyegomez/lfm

An open source implementation of LFMs from Liquid AI: Liquid Foundation Models

agents ai genai liquid llms ssm swarms transformers

Last synced: 16 Nov 2024

https://github.com/kamalkraj/stable-diffusion-tritonserver

Deploy stable diffusion model with onnx/tenorrt + tritonserver

deploy docker fp16 inference machine-learning nvidia onnx python3 pytorch stablediffusion tensorrt tensorrt-inference transformers triton-inference-server

Last synced: 07 Nov 2024

https://github.com/qdata/lamp

ECML 2019: Graph Neural Networks for Multi-Label Classification

computer-vision graph-attention-networks graph-neural-networks multi-label-classification nlp transformers

Last synced: 12 Nov 2024

https://github.com/ELS-RD/anonymisation

Anonymization of legal cases (Fr) based on Flair embeddings

anonymization bert camembert dataset-augmentation entities flair legal legal-cases ner pseudo-anonymization spacy transformers

Last synced: 19 Nov 2024

https://github.com/teelinsan/parallel-decoding

Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"

decoding-algorithm deep-learning jacobi-decoding jacobi-iteration natural-language-processing neural-network parallel-decoding transformers

Last synced: 16 Nov 2024

https://github.com/quanta-quest/quanta-quest

AI-powered universal search for all your personal data, tailored just for you. Goal:The world's first product with "edge-side LLMs + consumer data localization" as its core development direction.

agent ai anthropic bert chatgpt claude edge-computing gpt huggingface knowledgebase language-models llm nextjs nlp personal-ass rag semantic-vector-search transformers universal-search workflow

Last synced: 30 Oct 2024

https://github.com/rishit-dagli/perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

artificial-intelligence attention attention-mechanism deep-learning machine-learning neural-network python tensorflow transformer transformers

Last synced: 14 Oct 2024

https://github.com/lucidrains/mirasol-pytorch

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

artificial-intelligence attention-mechanism deep-learning multimodality transformers

Last synced: 15 Nov 2024

https://github.com/yuanzhoulvpi2017/quick_sentence_transformers

sentence-transformers to onnx 让sbert模型推理效率更快

bert pytorch sentence-transformers transformer transformers

Last synced: 08 Nov 2024

https://github.com/lucidrains/hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

artificial-intelligence deep-learning transformers

Last synced: 01 Nov 2024

https://github.com/huggingface/optimum-graphcore

Blazing fast training of 🤗 Transformers on Graphcore IPUs

fine-tuning graphcore machine-learning pytorch training transformers

Last synced: 02 Nov 2024

https://github.com/lucidrains/vn-transformer

A Transformer made of Rotation-equivariant Attention using Vector Neurons

artificial-intelligence attention-mechanism deep-learning geometric-deep-learning transformers

Last synced: 01 Nov 2024

https://github.com/jackaduma/secbert

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

apt attention bert bert-embeddings cyber-security cyber-threat-intelligence cybersecurity deep-learning-security deeplearning machine-learning-security nlp nlp-machine-learning security security-automation threat-analysis threat-detection threat-hunting threat-intelligence transformer-encoder transformers

Last synced: 11 Nov 2024

https://github.com/lucidrains/tf-bind-transformer

A repository with exploration into using transformers to predict DNA ↔ transcription factor binding

artificial-intelligence attention-mechanism deep-learning gene-expression transcription-factor-binding transcription-factors transformers

Last synced: 15 Nov 2024

https://github.com/hv0905/nekoimagegallery

An AI-powered natural language & reverse Image Search Engine powered by CLIP & qdrant.

clip computer-vision image-search image-search-engine search-engine transformers

Last synced: 14 Nov 2024

https://github.com/julesbelveze/bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

bert deebert distillation fastbert lstm nlp pruning pytorch-lightning quantization theseus transformers

Last synced: 15 Nov 2024

https://github.com/uzh-rpg/ssms_event_cameras

[CVPR'24 Spotlight] The official implementation of "State Space Models for Event Cameras"

deep-learning deep-neural-networks event-camera event-cameras machine-learning machine-learning-algorithms neuromorphic recurrent-neural-networks rnn rnn-pytorch rnns spotlight ssm ssms state-space-model state-space-models state-space-representation transformer transformers vision-transformer

Last synced: 06 Nov 2024

https://github.com/dmitryryumin/emnlp-2023-papers

EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. :star: support NLP!

bert computational-linguistics emnlp emnlp2023 gpt language-models llms machine-learning machine-translation multilingual-nlp named-entity-recognition natural-language-processing ner nlp nlp-applications sentiment-analysis syntax-and-semantics text-mining transformers word-embeddings

Last synced: 15 Nov 2024

https://github.com/lucidrains/ponder-transformer

Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper

adaptive-computation-time artificial-intelligence deep-learning transformers

Last synced: 01 Nov 2024

https://github.com/lucidrains/marge-pytorch

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

artificial-intelligence deep-learning pre-training retrieval transformers

Last synced: 01 Nov 2024

https://github.com/kcosta42/VQGAN-CLIP-Docker

Zero-Shot Text-to-Image Generation VQGAN+CLIP Dockerized

deep-learning docker generative-adversarial-network generative-art text-to-image text2image transformers vqgan

Last synced: 26 Sep 2024

https://github.com/cpjku/wechsel

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

bert language-model natural-language-processing nlp transfer-learning transformers

Last synced: 13 Nov 2024

https://github.com/aryan-jadon/Regression-Loss-Functions-in-Time-Series-Forecasting-Tensorflow

This repository contains the implementation of paper Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting with different loss functions in Tensorflow. We have compared 14 regression loss functions performance on 4 different datasets.

deep-learning forecasting keras loss-functions machine-learning python tensorflow time-series time-series-forecasting transformers

Last synced: 02 Nov 2024

https://github.com/xusenlinzy/lit-ie

A training and inference framework for open ner and re models! 信息抽取模型的统一训练和推理框架，包含丰富的开源SOTA模型

bert event-extraction global-pointer gplinker named-entity-recognition natural-language-processing pytorch-lightning relation-extraction transformers uie

Last synced: 10 Nov 2024

https://github.com/lucidrains/product-key-memory

Standalone Product Key Memory module in Pytorch - for augmenting Transformer models

artificial-intelligence deep-learning pytorch transformers

Last synced: 13 Nov 2024

https://github.com/lucidrains/n-grammer-pytorch

Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch

artificial-intelligence deep-learning memory n-gram transformers

Last synced: 01 Nov 2024

https://github.com/alexeykarnachev/full_stack_transformer

Pytorch library for end-to-end transformer models training, inference and serving

gpt-2 language-model language-model-finetuning language-model-generation pytorch-lightning telegram-bot transformers

Last synced: 07 Aug 2024

https://github.com/lucidrains/pi-zero-pytorch

Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence

artificial-intelligence deep-learning flow-matching flow-policy robotics transformers

Last synced: 15 Nov 2024

https://github.com/prajjwal1/fluence

A deep learning library based on Pytorch focussed on low resource language research and robustness

attention deep-learning nlp pytorch transformers

Last synced: 07 Aug 2024

https://github.com/riccorl/transformer-srl

Reimplementation of a BERT based model (Shi et al, 2019), currently the state-of-the-art for English SRL. This model implements also predicate disambiguation.

allennlp bert conll2012 dataset labeling natural-language-processing nlp propbank pytorch role semantic semantic-role-labeling shi span srl srl-annotations srltagger transformer transformers verbatlas

Last synced: 08 Nov 2024

https://github.com/amanchadha/iperceive

attention captioning captioning-videos causality common-sense convolutional-neural-networks dense-captioning distilling-the-knowledge lstm multi-modal python python3 pytorch question-answering reasoning resnets self-attention transformers video videoqa

Last synced: 05 Nov 2024

https://github.com/lucidrains/transframer-pytorch

Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch

artificial-intelligence attention-mechanisms deep-learning transformers unet video-generation

Last synced: 22 Oct 2024

https://github.com/vita-group/ligo

[ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Cox, Zhangyang Wang, Yoon Kim

efficient-training large-language-models model-reusing transformers

Last synced: 16 Nov 2024

https://github.com/ruanchaves/napolab

A Natural Portuguese Language Benchmark (Napolab) for the evaluation of language models.

benchmarks catalan datasets english galician hate-speech huggingface huggingface-transformers large-language-models nlp portuguese python question-answering semantic-similarity spanish text-simplification textual-entailment transformers

Last synced: 06 Nov 2024

https://github.com/udbhavprasad072300/transformer-implementations

Library - Vanilla, ViT, DeiT, BERT, GPT

pytorch transformer-implementations transformers vision-transformers

Last synced: 10 Oct 2024

https://github.com/0x7o/text2keywords

Trained T5 and T5-large model for creating keywords from text

keyt5 keyword natural-language-processing nlp python rut5 t5 transformer transformers

Last synced: 16 Nov 2024

https://github.com/hppRC/simple-simcse-ja

Exploring Japanese SimCSE

japanese pytorch sentence-embeddings sentence-transformers simcse transformers

Last synced: 18 Nov 2024

https://github.com/hpprc/simple-simcse-ja

Exploring Japanese SimCSE

japanese pytorch sentence-embeddings sentence-transformers simcse transformers

Last synced: 27 Oct 2024

https://github.com/declare-lab/cicero

The purpose of this repository is to introduce new dialogue-level commonsense inference datasets and tasks. We chose dialogues as the data source because dialogues are known to be complex and rich in commonsense.

commonsense-reasoning dialogue-systems roberta-model seq2seq transformers

Last synced: 08 Nov 2024