Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with transformers
A curated list of projects in awesome lists tagged with transformers .
https://github.com/helpmefindaname/transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
python transformer-encoder transformers
Last synced: 14 Nov 2024
https://github.com/stong/issho
A text generation web ui that doesn't suck, for models like LLaMA
large-language-models llm transformers webui
Last synced: 12 Nov 2024
https://github.com/artitw/text2class
Multi-class text categorization using state-of-the-art pre-trained contextualized language models, e.g. BERT
artificial-intelligence bert categorization classification classifier machine-learning natural-language-processing natural-language-understanding nlp tensorflow text text-classification transformers
Last synced: 28 Oct 2024
https://github.com/alan-turing-institute/prompto
An open source library for asynchronous querying of LLM endpoints
deep-learning hut23 large-language-models llm-eval llm-evaluation llms machine-learning natural-language-processing nlp python transformer transformers
Last synced: 13 Nov 2024
https://github.com/gmontamat/poor-mans-transformers
Implement Transformers (and Deep Learning) from scratch in NumPy
deep-learning from-scratch machine-learning ml-framework neural-network nlp transformers
Last synced: 30 Oct 2024
https://github.com/moskomule/simple_transformers
Simple transformer implementations that I can understand
Last synced: 16 Nov 2024
https://github.com/srvCodes/continual_learning_with_vit
Code for our CVPR 2022 workshop paper "Towards Exemplar-Free Continual Learning in Vision Transformers"
computer-vision continual-learning cvpr2022 incremental-learning transformers vision-transformer
Last synced: 15 Nov 2024
https://github.com/tlkh/t2t-tuner
Convenient Text-to-Text Training for Transformers
gpt huggingface language-model nlp pytorch t5 transformers
Last synced: 07 Nov 2024
https://github.com/proycon/deepfrog
An NLP-suite powered by deep learning
deep-learning deep-neural-networks dutch folia frog nlp transformers
Last synced: 08 Nov 2024
https://github.com/rishit-dagli/glu
An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.
activation-functions artificial-intelligence deep-learning glu keras machine-learning neural-network python tensorflow transformers
Last synced: 09 Nov 2024
https://github.com/hpprc/defsent
DefSent: Sentence Embeddings using Definition Sentences
bert natural-language-processing nlp transformers
Last synced: 27 Oct 2024
https://github.com/kyegomez/palm2-vadapter
Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter"
ai attention attention-is-all-you-need attention-mechanisms deeplearning ml models multi-modal neural-nets transformers
Last synced: 09 Nov 2024
https://github.com/lucidrains/holodeck-pytorch
Implementation of a holodeck, written in Pytorch
artificial-intelligence deep-learning denoising-diffusion hypernetworks latent-denoising-diffusion scene-representations temporal-scene-representations transformers
Last synced: 23 Oct 2024
https://github.com/losttech/torch.mingpt
A C# implementation of GPT
csharp gpt torchsharp transformers tutorial
Last synced: 09 Nov 2024
https://github.com/flozi00/atra
An open source NLP as a service project focused on providing state of the art systems with ease. Training and inference by simple docker commands
asr chatbot inference llm speech speech-recognition stable-diffusion transformers
Last synced: 27 Oct 2024
https://github.com/m3hrdadfi/zabanshenas
Zabanshenas is a solution for identifying the most likely language of a piece of written text. Demo (👇 )
attention-is-all-you-need detected-languages langdetect language-detector languages langugage-recognition pytorch-implementation roberta transformer transformers
Last synced: 20 Nov 2024
https://github.com/rbitr/ferrite
Simple, lightweight transformers in Fortran
embedding-models embeddings sentence-embeddings sentence-transformers transformer-models transformers
Last synced: 05 Nov 2024
https://github.com/isaaccorley/segmenter-pytorch
PyTorch implementation of "Segmenter: Transformer for Semantic Segmentation" Strudel et al. (2021)
artificial-intelligence computer-vision deep-learning semantic-segmentation transformers vision-transformer
Last synced: 14 Oct 2024
https://github.com/megagonlabs/ginza-transformers
Use custom tokenizers in spacy-transformers
ginza natural-language-processing nlp spacy spacy-transformers sudachitra tokenizers transformers
Last synced: 14 Oct 2024
https://github.com/idsia/lmtool-fwp
PyTorch Language Modeling Toolkit for Fast Weight Programmers
fast-weight-programmers fast-weights language-model pytorch transformers
Last synced: 11 Nov 2024
https://github.com/kyegomez/mc-vit
Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
ai multi-modal multi-modal-transformers multi-modality open-source transformer transformers vit
Last synced: 09 Nov 2024
https://github.com/chrislemke/deep-martin
Text simplification for a better world: Deep-Martin Transformer 🤗
deep-learning huggingface nlp python pytorch text-simplification transformers
Last synced: 16 Nov 2024
https://github.com/sanjaradylov/smiles-gpt
Generative Pre-Training from Molecules
adapters cheminformatics drug-discovery gpt-2 transfer-learning transformers
Last synced: 09 Nov 2024
https://github.com/kyegomez/tinygptv
Simple Implementation of TinyGPTV in super simple Zeta lego blocks
artificial-intelligence attention attention-is-all-you-need deep-learning multi-modal multi-modality transformers
Last synced: 09 Nov 2024
https://github.com/erfanzar/ost-opensourcetransformers
OST Collection: An AI-powered suite of models that predict the next word matches with remarkable accuracy (Text Generative Models). OST Collection is based on a novel approach to work as a full and intelligent NLP Model.
deep-learning nlp pytorch transformer-architecture transformers
Last synced: 07 Nov 2024
https://github.com/xusenlinzy/lightningblocks
pytorch-lightning code blocks for nlp
bert infomation-extraction named-entity-recognition nlp pytorch pytorch-lightning relation-extraction transformers uie
Last synced: 10 Nov 2024
https://github.com/0101011/analitika
Testing Automatic Text Summarization
hdf5 machine-learning natural-language-processing nlp nlp-machine-learning pickle python tokenizer transformers
Last synced: 09 Nov 2024
https://github.com/sayakpaul/action-recognition-in-tensorflow
Contains additional materials for two keras.io blog posts.
action-recognition cnn-rnn keras sequence-models tensorflow transformers ucf-101 video-classification video-models
Last synced: 23 Oct 2024
https://github.com/amazon-science/wqa-contextual-qa
Coala is a python package for Contextual Answer Sentence Selection.
natural-language-processing passage-reranking question-answering transformers
Last synced: 12 Nov 2024
https://github.com/kabachuha/nanogpkant
Testing KAN-based text generation GPT models
gpt kan kanformers kolmogorov-arnold-networks kolmogorov-arnold-representation llm text-generation transformers
Last synced: 04 Nov 2024
https://github.com/do-me/qdrant-frontend
A universal Qdrant table frontend based on transformers.js
huggingface qdrant semanticsearch transformerjs transformers vectordb
Last synced: 15 Nov 2024
https://github.com/tallamjr/astronet
Efficient Deep Learning for Real-time Classification of Astronomical Transients and Multivariate Time-series
astroinformatics deep-compression deep-learning depthwise-separable-convolutions efficient-deep-learning real-time tflite time-series time-series-classification transformers
Last synced: 23 Oct 2024
https://github.com/rkansal47/mpgan
The message passing GAN https://arxiv.org/abs/2106.11535 and generative adversarial particle transformer https://arxiv.org/abs/2211.10295 architectures for generating particle clouds
attention deep-learning generative-adversarial-network graph-neural-networks hep-ex machine-learning physics pytorch simulation transformers
Last synced: 09 Nov 2024
https://github.com/lamm-mit/fieldcompleter
GAN/convolutional and Transformer models to predict missing mechanical information given limited known data in part of the domain, and further characterize the composite geometries from the recovered mechanical fields for 2D and 3D complex microstructures
analysis computer-vision convolutional-neural-networks deep-learning deep-neural-networks design engineering fracture materials materials-informatics non-destructive-testing science strain stress testing transformers
Last synced: 22 Oct 2024
https://github.com/princeton-nlp/multilingualanalysis
Repository for the paper titled: "When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer"
cross-lingual multilingual multilingual-bert transformers zero-shot
Last synced: 11 Nov 2024
https://github.com/notai-tech/indicasr
Speeech Recognition for Indic languages.
asr indian-language pytorch speech-recognition speech-to-text telugu transformers wav2vec wav2vec2
Last synced: 11 Nov 2024
https://github.com/misonsky/hift
memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B
chinese-llama chinese-llama-65b huggingface-transformers large-language-models llama2 llama3 lora memory-efficient-tuning peft-fine-tuning-llm pytorch-implementation transformers
Last synced: 10 Oct 2024
https://github.com/shunk031/allennlp-shiba-model
AllenNLP integration for Shiba: Japanese CANINE model
allennlp canine machine-learning transformers transformers-library
Last synced: 12 Nov 2024
https://github.com/declare-lab/knot
This repository contains the implementation of the paper -- KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
federated-learning transformers
Last synced: 08 Nov 2024
https://github.com/idsia/fpainter
Official repository for the paper "Images as Weight Matrices: Sequential Image Generation Through Synaptic Learning Rules" (ICLR 2023)
fast-weight-programmers fast-weights generative-adversarial-network image-generation neural-learning-rules transformers
Last synced: 11 Nov 2024
https://github.com/FernandoLpz/SpeechRecognition
This repository contains the implementation of an Automatic Speech Recognition system in python, using a client-server architecture with Web Sockets.
automatic-speech-recognition python speech-recognition speech-to-text transformers wav2vec2 websockets
Last synced: 04 Nov 2024
https://github.com/mohd-faizy/06p_sentiment-analysis-with-deep-learning-using-bert
Finetuning BERT in PyTorch for sentiment analysis.
attention-mechanism bert-embeddings bert-model bert-models encoder gpt natural-language-processing pytorch sentiment-classification transformer-architecture transformer-models transformers
Last synced: 11 Oct 2024
https://github.com/aquadzn/deploy-transformers
Easily deploy a state-of-the-art language model from HuggingFace's Transformers
deployment gpt-2 language-model nlp pytorch pytorch-transformers transformers web-app
Last synced: 14 Oct 2024
https://github.com/andreacossu/continual-pretraining-nlp-vision
Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357
continual-learning forgetting image-classification lifelong-learning masked-image-modeling masked-language-models pretrained-models qnli self-supervised senteval sentiment-analysis transformers
Last synced: 15 Oct 2024
https://github.com/kyegomez/athenaos
AthenaOS is a next generation AI-native operating system managed by Swarms of AI Agents
attention-is-all-you-need attention-mechanism evolutionary-algorithms gpt4 operating-system swarms transformer transformers
Last synced: 09 Nov 2024
https://github.com/jianzhnie/multimodaltookit
Incorporate Image, Text and Tabular Data with HuggingFace Transformers
image machine-learning multimodal nlp tabular-data text transformer transformers
Last synced: 27 Oct 2024
https://github.com/izuna385/jel
Japanese Entity Linker.
allennlp entity-linking jel natural-language-processing python pytorch question-answering transformers
Last synced: 08 Nov 2024
https://github.com/arunprsh/ChatGPT-Decoded-GPT2-FAQ-Bot-RLHF-PPO
A Practical Guide to Developing a Reliable FAQ Chatbot with Reinforcement Learning and Human Feedback using GPT-2 on AWS
aws chatbot gpt-2 gpt2 question-answering reinforcement-learning rlhf sagemaker transformers
Last synced: 31 Oct 2024
https://github.com/anakin87/who-killed-laura-palmer
Simple Question Answering system, based on data crawled from Twin Peaks Wiki. It is built using 🔍 Haystack, an awesome open-source framework for building search systems that work intelligently over large document collections.
haystack information-retrieval natural-language-processing neural-search nlp python question-answering semantic-search space streamlit streamlit-webapp transformers
Last synced: 23 Oct 2024
https://github.com/clam004/minichatgpt
annotated tutorial of the huggingface TRL repo for reinforcement learning from human feedback connecting equations from PPO and GAE to the lines of code in the pytorch implementation
deep-learning deep-reinforcement-learning fine-tuning language-model large-language-models nlp pytorch reinforcement-learning reinforcement-learning-from-human-feedback transformers
Last synced: 15 Nov 2024
https://github.com/centre-for-humanities-computing/stormtrooper
Zero/few shot learning components for scikit-learn pipelines with LLMs and transformers.
chatgpt few-shot-learning gpt-4 large-language-models llm scikit-learn transformer transformers zero-shot-learning
Last synced: 10 Oct 2024
https://github.com/telekom/mltb2
Machine Learning Toolbox 2
ai deep-learning hyperparameter-optimization hyperparameter-tuning large-language-models llm machine-learning ml natural-language-processing nlp openai optuna plot transformers
Last synced: 17 Nov 2024
https://github.com/idsia/automated-cl
Official repository for the paper "Automating Continual Learning"
continual-learning cuda fast-weight-programmers fast-weights few-shot-learning linear-transformers meta-learning pytorch self-referential-learning self-referential-weight-matrix transformers
Last synced: 11 Nov 2024
https://github.com/princeton-nlp/dyck-transformer
[ACL 2021] Self-Attention Networks Can Process Bounded Hierarchical Languages
acl acl2021 dyck formal-language regular-language self-attention transformers
Last synced: 11 Nov 2024
https://github.com/robflynnyh/hydra-linear-attention
Implementation of: Hydra Attention: Efficient Attention with Many Heads (https://arxiv.org/abs/2209.07484)
attention efficient-attention linear-attention machine-learning transformers
Last synced: 11 Nov 2024
https://github.com/sayakpaul/vision-transformers-tf
A non-exhaustive collection of vision transformer models implemented in TensorFlow.
inductive-biases keras recognition segmentation tensorflow transformers vision
Last synced: 23 Oct 2024
https://github.com/scalable-ml-deep-learning/fine_tune_whisper
Fine-Tune Whisper for Italian ASR with transformers
automatic-speech-recognition common-voice-dataset huggingface openai transformers whisper
Last synced: 24 Oct 2024
https://github.com/cifkao/context-probing
Black-box language model explanation by context length probing
acl2023 explainability transformers
Last synced: 16 Oct 2024
https://github.com/sappho192/ffxiv-ja-ko-translator
Japanese→Korean translator model specialized in Final Fantasy XIV based on BERT-Japanese & KoGPT2. (FFXIV translator)
bert-japanese ff14 ffxiv japanese ko-gpt2 korean transformers translation
Last synced: 28 Oct 2024
https://github.com/ivanbongiorni/maximal
A TensorFlow-compatible Python library that provides models and layers to implement custom Transformer neural networks. Built on TensorFlow 2.
attention-is-all-you-need attention-mechanism deep-learning keras machine-learning natural-language-generation natural-language-processing natural-language-understanding neural-network nlp tensorflow tensorflow2 transformer transformers
Last synced: 23 Oct 2024
https://github.com/c00k1ez/plain-transformers
Transformer models implementation for training from scratch.
artificial-intelligence data-science deep-learning library natural-language-processing nlp python pytorch transformers
Last synced: 31 Oct 2024
https://github.com/bobazooba/xllm-demo
Demo project using XLLM
chatbot chatgpt deep-learning deep-neural-networks gpt gpt-4 large-language-models llm mistral natural-language-processing nlp openai pytorch torch transfer-learning transformer transformers
Last synced: 27 Oct 2024
https://github.com/sayannath/vit-tf-hub-application
Build and fine-tune your Image Classifier using a Vision Transformer Model from TensorFlow Hub
fine-tuning jax keras tensorflow tf2 tfhub transformers vision-transformer vit
Last synced: 24 Oct 2024
https://github.com/clovaai/pkm-transformers
Official implementation of PKM-augmented language models (Findings of EMNLP 2020)
Last synced: 12 Nov 2024
https://github.com/0x7o/retro-transformer
Easy-to-use Retrieval-Enhanced Transformer implementation
attention-mechanism deep-learning language-model pytorch retrieval transformers
Last synced: 16 Nov 2024
https://github.com/fedebotu/green-planet-transformers-3
MelXior: a Neural Weather Forecasting app distilling knowledge from models including GPT-3, DALL-E and FourCastNet
climate dalle2 foundation-models fourcastnet gpt3 hackaton openai transformers weather
Last synced: 06 Nov 2024
https://github.com/enot-autodl/gpt-j-6b-tensorrt-int8
GPT-J 6B inference on TensorRT with INT-8 precision
enot-autodl gpt-j gpt-j-6b inference int8-inference quantization tensorrt transformers
Last synced: 07 Nov 2024
https://github.com/deeppavlov/autointent
An open source tool for automatic configuration of a text classification pipeline for intent prediction
auto-ml dialog-systems intent-detection nlp transformers
Last synced: 09 Nov 2024
https://github.com/dayyass/pytorch-tutorials
Different Deep Learning tasks solved using PyTorch models.
computer-vision convolutional-neural-networks deeplearning natural-language-processing pytorch reccurent-neural-networks reinforcement-learning transformers
Last synced: 14 Oct 2024
https://github.com/potamides/uniformers
Token-free Language Modeling with ByGPT5 & Friends!
generation language modeling poetry token-free transformers
Last synced: 27 Oct 2024
https://github.com/kyegomez/dev-swarm
A swarm of LLM agents that will help you test, document, and productionize your code!
agents ai anthropic claude gpt4 llms ml transformers
Last synced: 09 Nov 2024
https://github.com/UCSB-NLP-Chang/ULD
Implementation of paper 'Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference'
large-language-models nlp pytorch transformers unlearning
Last synced: 29 Oct 2024
https://github.com/novialriptide/shurl
Shrunk's artificial intelligence platform.
Last synced: 08 Nov 2024
https://github.com/veb-101/keras-vision
Porting vision models to Keras 3 for easily accessibility. Contains MobileViT v1, MobileViT v2
cnn computer-vision deep-learning jax keras keras3 mobilevit mobilevitv1 mobilevitv2 pytorch self-attention tensorflow transformers
Last synced: 07 Nov 2024
https://github.com/aisuko/notebooks
Implementation for the different ML tasks on Kaggle platform with GPUs.
accelerator computer-vision fine-tuning kaggle large-language-models multimodal natural-language-processing neural-network peft pytorch quantization renforcement-learning transformers visulization wandb
Last synced: 08 Nov 2024
https://github.com/amazon-science/text_generation_diffusion_llm_topic
Topic Embedding, Text Generation and Modeling using diffusion
diffusion-models lda machine-learning natural-language-processing nlp sentence-embeddings t5 text-embedding text-embeddings text-generation topic topic-modeling topic-models transformers
Last synced: 12 Nov 2024
https://github.com/aditeyabaral/maple
Implementation of the paper, MAPLE - MAsking words to generate blackout Poetry using sequence-to-sequence LEarning, ICNLSP 2021
blackout-poetry natural-language-processing sequence-labeling summarization token-classification transformers
Last synced: 16 Nov 2024
https://github.com/radames/sentence-embeddings-visualization
embeddings huggingface observablehq transformers visualization
Last synced: 09 Nov 2024
https://github.com/circuit-overtime/elixpo_ai_chapter
A Collaborative Repository Focusing on Machine Learning and Image-Generation!
artificial-intelligence bash express face hacktoberfest hacktoberfest-accepted hacktoberfest2024 hacktoberfest2024-accepted hugging hugging-face javascript machine-learning nodejs pipeline raspberry stable-diffusion transformers
Last synced: 29 Oct 2024
https://github.com/evilfreelancer/rugpt3-custom
Pre-training custom ruGPT3 model on books written by F.M. Dostoevski
dataset dostoevsky gpt prediction rugpt training transformers
Last synced: 29 Oct 2024
https://github.com/emalagoli92/gcvit-tensorflow
TensorFlow 2.X reimplementation of Global Context Vision Transformers, Ali Hatamizadeh, Hongxu (Danny) Yin, Jan Kautz Pavlo Molchanov.
computer-vision deep-learning image-classification python pytorch tensorflow transformers
Last synced: 15 Nov 2024
https://github.com/michaelhly/farglot
A Transformer-based SocialNLP toolkit for Farcaster
Last synced: 18 Oct 2024
https://github.com/upb-lea/mag-net-hub
MagNet Toolkit - Certified Models of the MagNet Challenge
machine-learning magnetics neural-networks power-electronics power-electronics-systems transformers
Last synced: 13 Nov 2024
https://github.com/chanind/linear-relational
Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch
ai huggingface-transformers llms pytorch transformers
Last synced: 08 Nov 2024
https://github.com/gentaiscool/miners
MINERS ⛏️: The semantic retrieval benchmark for evaluating multilingual language models.
benchmark classification deep-learning deep-learning-models efficient generation language-model large-language-models llm machine-learning miner miners ml multilingual nlp retrieval semantic-retrieval sentence-transformers transformers
Last synced: 08 Nov 2024
https://github.com/sorcero/ingestum
Read-only mirror of https://gitlab.com/sorcero/community/ingestum
ingestion monitoring pdf processing python recognition transformers
Last synced: 09 Nov 2024
https://github.com/kyegomez/neosapiens
The next evolution of Agents
agents ai artificial-intelligence ml swarms transformers
Last synced: 09 Nov 2024
https://github.com/iokasimov/joint
Extremely simple effect system for Haskell
Last synced: 29 Oct 2024
https://github.com/rahulbhalley/sentiment-analysis-bert.pytorch
IMDB Sentiment Analysis with BERT
bert pytorch sentiment-analysis transformers
Last synced: 09 Nov 2024
https://github.com/gopikrsmscs/stock-price-prediction-transformer
Tesal Stock Price Prediction Using Transformer
stock-price-prediction tensorflow transformer transformers
Last synced: 18 Nov 2024
https://github.com/cvcio/mediawatch
Empowering news organizations to fight disinformation
ai elas golang grpc kafka misinformation neo4j network-analysis nodejs python spacy transformers
Last synced: 09 Nov 2024
https://github.com/volverjs/ai
Hugging Face Transformers.js wrapper for on-device AI with web-workers
ai huggingface huggingface-transformers on-device-ai remove-background transformers translation vue vuejs web-worker
Last synced: 27 Oct 2024
https://github.com/prrao87/patent-classification
Classify international patents into one of eight categories based on the text of their titles & abstracts using DistilBert & ONNX Runtime
distilbert machine-learning natural-language-processing nlp onnx onnxruntime text-classification transformers
Last synced: 30 Oct 2024
https://github.com/tgautam03/transformers
A Gentle Introduction to Transformers Neural Network
attention-is-all-you-need attention-mechanism deep-neural-networks natural-language-processing transformers
Last synced: 10 Nov 2024
https://github.com/florianrappl/ts-transform-sample
Sample code for using TypeScript transforms.
code-generation example generation sample transformers typescript
Last synced: 24 Oct 2024
https://github.com/x-tabdeveloping/turftopic
Robust and fast topic models with sentence-transformers.
contextual llm topic-modeling transformers
Last synced: 09 Nov 2024
https://github.com/knowledgeforge/keymaker
The most powerful and extensible way to control the output of large language models.
chatgpt constraint gpt grammar lark llm openai regex transformers
Last synced: 13 Oct 2024
https://github.com/thesofakillers/infoshare
Official repository for the paper: "Probing LLMs for Joint Encoding of Linguistic Categories." Findings of EMNLP 2023.
deep-learning dependency-parsing interpretability machine-learning parts-of-speech probing syntax transformers
Last synced: 16 Nov 2024
https://github.com/nateraw/pytorch-lightning-azureml
Narrow the gap between research and production 😎
azure azureml nlp pytorch-lightning transformers
Last synced: 17 Nov 2024
