Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with transformers

A curated list of projects in awesome lists tagged with transformers .

https://github.com/lucidrains/omninet-pytorch

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

artificial-intelligence attention-mechanism deep-learning transformers

Last synced: 02 Nov 2024

https://github.com/ailab-cvc/m2pt

[CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities

artificial-intelligence deep-learning multimodal transformers

Last synced: 14 Nov 2024

https://github.com/lucidrains/self-reasoning-tokens-pytorch

Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto

adaptive-computation artificial-intelligence attention-mechanism deep-learning transformers

Last synced: 14 Nov 2024

https://github.com/kamalkraj/e5-mistral-7b-instruct

Finetune mistral-7b-instruct for sentence embeddings

finetuning huggingface lora mistral-7b peft pytorch sentence-embeddings transformers

Last synced: 07 Nov 2024

https://github.com/catqaq/opentextclassification

OpenTextClassification is all you need for text classification! Open text classification for everyone, enjoy your NLP journey! 这可能是目前为止最全面的开源文本分类项目，支持中英双语、多种模型、多种任务。

bert bert-text-classification chinese-text-classification dpcnn ernie gru lstm multi-label-classification naive-bayes pytorch svm text-classification textcnn textrnn torchtext transformers

Last synced: 19 Nov 2024

https://github.com/taufeeque9/codebook-features

Sparse and discrete interpretability tool for neural networks

codebook features interpretability language-model mechanistic-interpretability transformers

Last synced: 07 Nov 2024

https://github.com/lucidrains/flash-genomics-model

My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other hierarchical methods)

artificial-intelligence attention-mechanisms deep-learning genomics long-context transformers

Last synced: 22 Oct 2024

https://github.com/lucidrains/cross-transformers-pytorch

Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch

artificial-intelligence attention-mechanism deep-learning few-shot-learning transformers

Last synced: 09 Nov 2024

https://github.com/nathanlesage/local-chat

LocalChat is a ChatGPT-like chat that runs on your computer

chat chatbot chatgpt electron huggingface language-model llama llamacpp llm local privacy transformers

Last synced: 10 Oct 2024

https://github.com/antofuller/configaformers

A python library for highly configurable transformers - easing model architecture search and experimentation.

artificial-intelligence deep-learning pytorch transformers

Last synced: 15 Nov 2024

https://github.com/elapse-annals/laravel-plus

Based on Laravel transformation and expansion, more convenient for practical business use

laravel laravel-framework laravel-plus laravel-vue laravelplus php php-framework react-php transformers

Last synced: 07 Nov 2024

https://github.com/kyegomez/jamba

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

ai artificial-neural-networks attention-is-all-you-need attention-mechanism attention-mechanisms gpt ml ssm transformers

Last synced: 09 Nov 2024

https://github.com/kaleidophon/token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

deep-learning deeplearning i2t i2w indexing itos nlp numpy python pytorch rnn rnns seq2seq stoi t2i tensorflow token transformer transformers w2i

Last synced: 09 Nov 2024

https://github.com/koichiyasuoka/esupar

Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa models for Japanese and other languages

ainu chinese classical-chinese coptic english german japanese natural-language-processing nlp serbian thai transformers

Last synced: 16 Nov 2024

https://github.com/dipanjans/adv_nlp_workshop_odsc_europe22

Extensive tutorials for the Advanced NLP Workshop in Open Data Science Conference Europe 2020. We will leverage deep learning and deep transfer learning to solve popular tasks in NLP including Classification, Information Retrieval, Sentiment Analysis, Search Engines, Clustering, Paraphrase Mining, Summarization, Language Translation, Q&A systems

deep-learning gensim huggingface jupyter-notebook machine-learning natural-language-processing python pytorch tensorflow transfer-learning transformers

Last synced: 22 Oct 2024

https://github.com/datawhalechina/unlock-hf

解锁HuggingFace生态的百般用法

datawhale nlp transformers tutorial

Last synced: 09 Nov 2024

https://github.com/iKernels/transformers-lightning

A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transformers.

dataset models transformers

Last synced: 15 Nov 2024

https://github.com/idsia/recurrent-fwp

Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)

fast-weight-programmers fast-weights language-modeling pytorch recurrent-neural-networks reinforcement-learning torchbeast transformers

Last synced: 11 Nov 2024

https://github.com/cdpierse/script_buddy_v2

Script Buddy v2 is a film script text generation tool built using film scripts from the world's most popular film scripts and GPT2.

artificial-intelligence gpt-2 language-generation machine-learning nlp pytorch transformers

Last synced: 08 Nov 2024

https://github.com/kennethenevoldsen/spacy-wrap

spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to include existing fine-tuned models within your SpaCy workflow.

deep-learning huggingface huggingface-transformers language-model machine-learning natural-language-processing nlp pytorch spacy spacy-extension spacy-extensions spacy-models spacy-nlp spacy-pipeline spacy-transformers text-classification transformers

Last synced: 12 Oct 2024

https://github.com/kaleidophon/nlp-uncertainty-zoo

Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.

deep-learning lstm nlp nlp-machine-learning package python pytorch rnn transformers uncertainty-estimation uncertainty-neural-networks uncertainty-quantification

Last synced: 10 Oct 2024

https://github.com/AdrianBZG/LLM-distributed-finetune

Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances

aws deep-learning distributed-training falcon fine-tuning huggingface large-language-models natural-language-processing transformers

Last synced: 15 Nov 2024

https://github.com/adrianbzg/llm-distributed-finetune

Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances

aws deep-learning distributed-training falcon fine-tuning huggingface large-language-models natural-language-processing transformers

Last synced: 05 Nov 2024

https://github.com/buaadreamer/chinese-llava-med

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

ai chinese gpt4v huggingface-datasets llama-factory llava medical minigpt4 mllm multimodal qwen1-5 transformers

Last synced: 28 Oct 2024

https://github.com/obss/trapper

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

allennlp deep-learning natural-language-processing nlp python pytorch pytorch-transformers transformer transformers

Last synced: 27 Oct 2024

https://github.com/lucidrains/coco-lm-pytorch

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch

artificial-intelligence deep-learning pre-training transformers

Last synced: 09 Nov 2024

https://github.com/winstxnhdw/nllb-api

A low-memory high-performance CPU-based API for Meta's No Language Left Behind (NLLB) using CTranslate2, hosted on Hugging Face Spaces.

caddy ctranslate2 docker fastapi huggingface huggingface-spaces machine-translation nllb nllb200 supervisord transformers translation uvicorn-gunicorn

Last synced: 09 Nov 2024

https://github.com/niutrans/introduction-to-transformers

An introduction to basic concepts of Transformers and key techniques of their recent advances.

deep-learning natural-language-processing transformers

Last synced: 11 Nov 2024

https://github.com/bnosac/golgotha

Contextualised Embeddings and Language Modelling using BERT and Friends using R

bert language-modelling natural-language-processing transformer transformers

Last synced: 11 Nov 2024

https://github.com/lucidrains/pause-transformer

Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token

adaptive-computation artificial-intelligence attention-mechanisms deep-learning transformers

Last synced: 02 Nov 2024

https://github.com/rishit-dagli/conformer

An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras

artificial-intelligence attention-mechanism conformer convolutional-neural-networks deep-learning keras machine-learning speech-recognition tensorflow transformers

Last synced: 22 Oct 2024

https://github.com/jhcho99/CoFormer

[CVPR'22] Official PyTorch Implementation of "Collaborative Transformers for Grounded Situation Recognition"

cvpr cvpr2022 deep-learning grounded-situation-recognition pytorch scene-understanding tranformer transformers

Last synced: 28 Oct 2024

https://github.com/marqo-ai/marqo-fashionclip

State-of-the-art CLIP-like models finetuned for the fashion domain. +57% increase in evaluation metrics vs FashionCLIP 2.0.

clip embeddings fashion-classifier fashionclip informationretrieval multimodal recomendations search transformers vectorsearch vision-transformer

Last synced: 16 Nov 2024

https://github.com/kyegomez/gamba

Implementation of PyTorch: "GAMBA: MARRY GAUSSIAN SPLATTING WITH MAMBA FOR SINGLE-VIEW 3D RECONSTRUCTION"

3d-ai ai artificial-intelligence dalle generative-ai mamba ml ssm stable-diffusion transformers

Last synced: 09 Nov 2024

https://github.com/flipkart-incubator/spark-transformers

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

apache-spark data-pipelines export java machine-learning machine-learning-algorithms machine-learning-library mllib scala spark transformers

Last synced: 11 Oct 2024

https://github.com/lvgig/tubular

Python package implementing transformers for pre processing steps for machine learning.

feature-engineering pre-processing transformers

Last synced: 13 Nov 2024

https://github.com/lucidrains/rest-em-pytorch

Implementations and explorations into the ReST𝐸𝑀 algorithm in the new deepmind paper "Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models"

artificial-intelligence deep-learning self-training transformers

Last synced: 22 Oct 2024

https://github.com/aistream-peelout/flow_tutorials

Public tutorials of using Flow Forecast for forecasting and classifying time series data

deep-learning forecasting time-series transformers

Last synced: 16 Nov 2024

https://github.com/ahmedbesbes/audiolizr

A bentoML-powered API to transcribe audio and make sense of it

bentoml bentoml-service docker nlp openai openai-whisper pytube speech-recognition t5 torch transformers

Last synced: 07 Aug 2024

https://github.com/sgrvinod/chess-transformers

Teaching transformers to play chess

chess chess-engine pytorch transformers

Last synced: 07 Nov 2024

https://github.com/hans00/react-native-transformers-example

Example of transformers.js on React Native

onnxruntime react-native transformers

Last synced: 27 Oct 2024

https://github.com/danieldk/oxidized-transformers

Modular Rust transformer/LLM library using Candle

bert llama llama2 llm roberta rust transformers

Last synced: 22 Oct 2024

https://github.com/adirthaborgohain/ner-re

A Named Entity Recognition + Entity Linker + Relation Extraction Pipeline built using spacy v3. Given a text, the pipeline will extract entities from the text as trained and will disambiguate the entities to its normalized form through an Entity Linker connected to a Knowledge Base and will assign a relation between the entities, if any.

named-entity-recognition nlp relation-extraction spacy transformers

Last synced: 09 Nov 2024

https://github.com/matlab-deep-learning/transformer-networks-for-time-series-prediction

Deep Learning in Quantitative Finance: Transformer Networks for Time Series Prediction

deep-learning finance matlab prediction timeseries transformers

Last synced: 09 Nov 2024

https://github.com/anjum48/commonlitreadabilityprize

4th Place solution for the Kaggle CommonLit Readability Prize

huggingface kaggle nlp pytorch transformers

Last synced: 14 Oct 2024

https://github.com/sayakpaul/keras-xla-benchmarks

Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.

benchmarks cnns keras keras-cv tensorflow tensorflow-hub transformers xla

Last synced: 22 Oct 2024

https://github.com/oxidized-transformers/oxidized-transformers

Modular Rust transformer/LLM library using Candle

bert llama llama2 llm roberta rust transformers

Last synced: 10 Oct 2024

https://github.com/bangla-rag/porag

Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.

ai bengali bengali-nlp chromadb langchain llama3 llm nlp rag transformers

Last synced: 10 Oct 2024

https://github.com/lucidrains/tableformer-pytorch

Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch

artificial-intelligence attention-mechanism deep-learning table transformers

Last synced: 22 Oct 2024

https://github.com/tech-srl/layer_norm_expressivity_role

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

attention layer-normalization layernorm transformers

Last synced: 08 Nov 2024

https://github.com/lucidrains/remixer-pytorch

Implementation of the Remixer Block from the Remixer paper, in Pytorch

artificial-intelligence deep-learning transformers

Last synced: 09 Nov 2024

https://github.com/lucidrains/memory-editable-transformer

My explorations into editing the knowledge and memories of an attention network

artificial-intelligence attention-mechanism deep-learning eternal-sunshine-of-spotless-mind transformers

Last synced: 22 Oct 2024

https://github.com/Shigangli/Chimera

Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.

distributed-deep-learning pipeline-parallelism transformers

Last synced: 07 Nov 2024

https://github.com/modeltc/qllm

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

llama llama2 llm post-training-quantization pytorch quantization transformers

Last synced: 05 Nov 2024

https://github.com/lucidrains/learning-to-expire-pytorch

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

artificial-intelligence attention-mechanism deep-learning forgetting memory transformers

Last synced: 22 Oct 2024

https://github.com/kyegomez/simplemamba

Implementation of a modular, high-performance, and simplistic mamba for high-speed applications

artificial-intelligence gpt gpt4 gpt4all machine neural-network open-source pytorch rnn rnn-pytorch rnns ssm tensorflow transformers

Last synced: 16 Nov 2024

https://github.com/pszemraj/ai-msgbot

Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.

ai aitextgen chat-application chatbot deep-learning deepspeed deployment gpt-2 gpt-j gpt-j-6b gradio huggingface huggingface-transformers natural-language-processing nlp nlp-parsing telegram telegram-bot text-generation transformers

Last synced: 03 Oct 2024

https://github.com/wri-dssg-omdena/policy-data-analyzer

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

active-learning bert data-science document-classification environmental huggingface incentives landscape-restoration lda machine-learning nlp policy sbert scraping scrapy sentence-transformers spyder text-classification topic transformers

Last synced: 30 Oct 2024

https://github.com/alan-turing-institute/robots-in-disguise

Information and materials for the Turing's "robots-in-disguise" reading group on fundamental AI research.

deep-learning diffusion-models foundation-model hut23 language-models large-language-models machine-learning nlp transformers

Last synced: 13 Nov 2024

https://github.com/aliosm/simplerepresentations

Easy-to-use text representations extraction library based on the Transformers library.

embeddings nlp transformers

Last synced: 27 Oct 2024

https://github.com/kyegomez/hlt

Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"

ai artificial-intelligence attention attention-is-all-you-need ml multi-modal robotics transformers

Last synced: 16 Nov 2024

https://github.com/uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers

Last synced: 10 Oct 2024

https://github.com/rese1f/aurora

[train + eval + deploy] Aurora Series: A more efficient multimodal large language model series for video.

benchmark computer-vision deploy llm multimodal-large-language-models transformers video-understanding

Last synced: 10 Nov 2024

https://github.com/lucidrains/tranception-pytorch

Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction

artificial-intelligence attention-mechanism deep-learning protein-fitness-prediction retrieval transformers

Last synced: 22 Oct 2024

https://github.com/Furyton/awesome-language-model-analysis

This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers in this list investigate the learning behavior, generalization ability, and other properties of language models through theoretical analysis, empirical analysis, or a combination of both.

ai analysis analytics awesome chatgpt deep-learning generative-ai large-language-models llm nlp theory transformers

Last synced: 19 Sep 2024

https://github.com/kyegomez/gpt4o

Community Open Source Implementation of GPT4o in PyTorch

ai gpt4o gpt5 llm ml transformers

Last synced: 16 Nov 2024

https://github.com/deep-diver/segformer-tf-transformers

This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.

huggingface keras segformer semantic-segmentation tensorflow transformers

Last synced: 09 Nov 2024

https://github.com/ant-louis/belgpt2

🇧🇪 BelGPT-2: the 1st GPT model pretrained in French.

french french-nlp gpt-2 language-model natural-language-processing text-generation transformers

Last synced: 06 Nov 2024

https://github.com/sayakpaul/deploy-hf-tf-vision-models

This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.

autoscaling docker huggingface keras kubernetes kubernetes-engine locust onnx serverless tensorflow tfserving transformers vertex-ai vision-transformers

Last synced: 22 Oct 2024

https://github.com/kyegomez/SimpleMamba

Implementation of a modular, high-performance, and simplistic mamba for high-speed applications

artificial-intelligence gpt gpt4 gpt4all machine neural-network open-source pytorch rnn rnn-pytorch rnns ssm tensorflow transformers

Last synced: 05 Aug 2024

https://github.com/amazon-science/unified-ept

A Unified Efficient Pyramid Transformer for Semantic Segmentation, ICCVW 2021

efficient iccv-2021 pyramid semantic-segmentation transformers

Last synced: 12 Nov 2024

https://github.com/adapter-hub/efficient-task-transfer

Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021

adapters bert nlp roberta transfer-learning transformers

Last synced: 06 Nov 2024

https://github.com/zemlyansky/gpt-tfjs

GPT in TensorFlow.js

gpt tensorflowjs tfjs transformers

Last synced: 08 Nov 2024

https://github.com/innightwolfsleep/llm_telegram_bot

Connect llama-cpp, transformers or text-generation-webui to telegram bot api.

llama llamacpp oobabooga telegram-bot text-generation-webui transformers

Last synced: 10 Oct 2024

https://github.com/kyegomez/simba

A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series"

agents imagenet llms multi-modal recurrent-networks ss4 ssm transformers

Last synced: 16 Nov 2024

https://github.com/alan-turing-institute/xpandas

Universal 1d/2d data containers with Transformers functionality for data analysis.

pandas python python3 sklearn transformers

Last synced: 13 Oct 2024

https://github.com/jhcho99/gsrtr

[BMVC'21] Official PyTorch Implementation of "Grounded Situation Recognition with Transformers"

bmvc2021 deep-learning grounded-situation-recognition pytorch scene-understanding transformers

Last synced: 28 Oct 2024

https://github.com/nipunsadvilkar/roberta-base-mr

RoBERTa Marathi Language model trained from scratch during huggingface 🤗 x flax community week

flax huggingface jax marathi roberta transformers

Last synced: 08 Nov 2024

https://github.com/lewtun/dl4phys

Deep learning for particle physicists

cnns deep-learning particle-physics transformers

Last synced: 09 Nov 2024

https://github.com/gaussalgo/adaptor

ACL 2022: Adaptor: a library to easily adapt a language model to your own task, domain, or custom objective(s).

domain-adaptation multi-objective-optimization ner nlp pytorch robustness text-classification text-generation transformers

Last synced: 08 Nov 2024

https://github.com/bayer-science-for-a-better-life/data2text-bioleaflets

Biomedical Data-to-Text Generation via Fine-Tuning Transformers

biomedical-text-mining data-to-text nlp-machine-learning transformers

Last synced: 26 Sep 2024

https://github.com/Bradley-Butcher/Conformers

Unofficial implementation of Conformal Language Modeling by Quach et al

alignment conformal-prediction language-model transformers

Last synced: 17 Nov 2024

https://github.com/mv-lab/ViT-FGVC8

"Exploring Vision Transformers for Fine-grained Classification" at CVPRW FGVC8

computer-vision cub200-2011 cvpr deep-learning fgvc fine-grained-classification stanford-dogs-dataset transformers vit

Last synced: 05 Nov 2024

https://github.com/sayakpaul/count-tokens-hf-datasets

This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Dataflow.

apache-beam dataflow hf-datasets tokenizers transformers unigram-tokenization

Last synced: 23 Oct 2024

https://github.com/declare-lab/team

Our EMNLP 2022 paper on MCQA

deberta mcq question-answering roberta transformers

Last synced: 08 Nov 2024

https://github.com/stong/issho

A text generation web ui that doesn't suck, for models like LLaMA

large-language-models llm transformers webui

Last synced: 12 Nov 2024

https://github.com/helpmefindaname/transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

python transformer-encoder transformers

Last synced: 14 Nov 2024

https://github.com/declare-lab/exemplary-empathy

This repository contains the source codes of the paper -- Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication

dialogue-generation dialogue-systems emotion-recognition emotion-recognition-in-conversation empathetic-dialogues empathetic-responses huggingface transformers

Last synced: 08 Nov 2024