Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/lucidrains/deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

artificial-intelligence deep-learning implicit-neural-representation multi-modality siren text-to-image transformers

Last synced: 03 Jul 2024

https://github.com/lucidrains/TimeSformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

artificial-intelligence attention-mechanism deep-learning transformers video-classification

Last synced: 03 Jul 2024

https://github.com/moskomule/simple_transformers

Simple transformer implementations that I can understand

transformers

Last synced: 03 Jul 2024

https://github.com/autonomousvision/transfuser

[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving; [CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

autonomous-driving imitation-learning sensor-fusion transformers

Last synced: 03 Jul 2024

https://github.com/Beomi/KcBERT

🤗 Pretrained BERT model & WordPiece tokenizer trained on Korean Comments 한국어 댓글로 프리트레이닝한 BERT 모델과 데이터셋

bert bert-model korean-nlp nlp transformers

Last synced: 02 Jul 2024

https://github.com/SKTBrain/KoBERT

Korean BERT pre-trained cased (KoBERT)

bert korean-nlp language-model nlp pytorch transformers

Last synced: 02 Jul 2024

https://github.com/lucidrains/toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

api-calling artificial-intelligence attention-mechanisms deep-learning transformers

Last synced: 01 Jul 2024

https://github.com/fathyb/parcel-plugin-typescript

🚨 Enhanced TypeScript support for Parcel

code-quality lint parcel-plugin transformers type-checker typescript

Last synced: 01 Jul 2024

https://github.com/FernandoLpz/SpeechRecognition

This repository contains the implementation of an Automatic Speech Recognition system in python, using a client-server architecture with Web Sockets.

automatic-speech-recognition python speech-recognition speech-to-text transformers wav2vec2 websockets

Last synced: 01 Jul 2024

https://github.com/AviVahl/ts-tools

TypeScript Tools for Node.js

loader nodejs tools transformers transpilation typescript webpack

Last synced: 29 Jun 2024

https://github.com/lucidrains/medical-chatgpt

Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis

artificial-intelligence attention-mechanisms deep-learning medicine transformers

Last synced: 29 Jun 2024

https://github.com/kha-white/manga-ocr

Optical character recognition for Japanese text, with the main focus being Japanese manga

comics computer-vision deep-learning japanese manga ocr transformers

Last synced: 29 Jun 2024

https://github.com/kmeng01/rome

Locating and editing factual associations in GPT (NeurIPS 2022)

gpt interpretability pytorch transformers

Last synced: 29 Jun 2024

https://github.com/ukairia777/tensorflow-nlp-tutorial

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

bert bert-ner dpo huggingface keras-tutorial llama llm lora named-entity-recognition natural-language-processing nlp nlp-tutorial question-answering sft tensorflow trainer transformers

Last synced: 29 Jun 2024

https://github.com/Curated-Awesome-Lists/awesome-llms-fine-tuning

Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!

ai awesome-list deep-learning fine-tuning gpt large-language-models llms machine-learning nlp transformers

Last synced: 29 Jun 2024

https://github.com/graphdeeplearning/graphtransformer

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

aaai attention graph-deep-learning graph-neural-networks graph-transformer transformer transformer-networks transformers

Last synced: 28 Jun 2024

https://github.com/m3hrdadfi/zabanshenas

Zabanshenas is a solution for identifying the most likely language of a piece of written text. Demo (👇 )

attention-is-all-you-need detected-languages langdetect language-detector languages langugage-recognition pytorch-implementation roberta transformer transformers

Last synced: 27 Jun 2024

https://github.com/predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 26 Jun 2024

https://github.com/lucidrains/meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

artificial-intelligence attention-mechanisms deep-learning mesh-generation transformers

Last synced: 26 Jun 2024

https://github.com/koayon/awesome-adaptive-computation

A curated reading list of research in Adaptive Computation, Dynamic Compute & Mixture of Experts (MoE).

adaptive-computation computer-vision machine-learning mixture-of-experts nlp pytorch tensorflow transformers

Last synced: 25 Jun 2024

https://github.com/AllenXiangX/SnowflakeNet

(TPAMI 2023) Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

3dvision deep-learning iccv2021 point-cloud-completion pytorch tpami2023 transformers

Last synced: 23 Jun 2024

https://github.com/linjieli222/HERO

Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"

pretraining pytorch transformers tvr vision-and-language

Last synced: 23 Jun 2024

https://github.com/ChenRocks/UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

pre-training pytorch transformers vision-and-language

Last synced: 23 Jun 2024

https://github.com/lucidrains/nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

artificial-intelligence attention-mechanism deep-learning text-to-audio text-to-video transformers

Last synced: 23 Jun 2024

https://github.com/j-min/VL-T5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

pretraining transformers vision-and-language vl-bart vl-t5

Last synced: 23 Jun 2024

https://github.com/grammarly/gector

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

bert grammatical-error-correction natural-language-processing nlp roberta sequence-labeling text-simplification transformers xlnet

Last synced: 23 Jun 2024

https://github.com/JetRunner/BERT-of-Theseus

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

bert glue model-compression nlp transformers

Last synced: 22 Jun 2024

https://github.com/obss/trapper

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

allennlp deep-learning natural-language-processing nlp python pytorch pytorch-transformers transformer transformers

Last synced: 22 Jun 2024

https://github.com/huggingface/awesome-huggingface

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.

awesome awesome-list huggingface machine-learning nlp transformers

Last synced: 22 Jun 2024

https://github.com/zemlyansky/gpt-tfjs

GPT in TensorFlow.js

gpt tensorflowjs tfjs transformers

Last synced: 21 Jun 2024

https://maartengr.github.io/BERTopic/

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

bert ldavis machine-learning nlp sentence-embeddings topic topic-modeling topic-modelling topic-models transformers

Last synced: 21 Jun 2024

https://loraexchange.ai

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 21 Jun 2024

https://github.com/cvg/LightGlue

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)

deep-learning image-matching pose-estimation transformers

Last synced: 20 Jun 2024

https://github.com/huggingface/alignment-handbook

Robust recipes to align language models with human and AI preferences

llm rlhf transformers

Last synced: 20 Jun 2024

https://github.com/hiyouga/ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

alpaca chatglm chatglm2 chatgpt fine-tuning huggingface language-model lora peft pytorch qlora rlhf transformers

Last synced: 20 Jun 2024

https://github.com/IDSIA/modern-srwm

Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)

fast-weight-programmers fast-weights pytorch reinforcement-learning rnn-based-few-shot-learning self-referential-learning self-referential-weight-matrix torchbeast transformers

Last synced: 19 Jun 2024

https://github.com/TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

large-multimodal-models llama llava nlp tinyllama transformers vision-language

Last synced: 17 Jun 2024

https://github.com/lucidrains/DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers

Last synced: 16 Jun 2024

https://github.com/hppRC/bert-classification-tutorial

【2023年版】BERTによるテキスト分類

bert deep-learning japanese nlp python pytorch transformers

Last synced: 16 Jun 2024

https://github.com/patil-suraj/onnx_transformers

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

inference nlp onnx onnxruntime transformers

Last synced: 16 Jun 2024

https://github.com/OctoberChang/X-Transformer

X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification

extreme-multi-label-classification pytorch text-classification transformers

Last synced: 16 Jun 2024

https://github.com/lucidrains/PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

artificial-general-intelligence attention-mechanism deep-learning jax transformers

Last synced: 16 Jun 2024

https://github.com/lucasjinreal/yolov7_d2

🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥

detection detextron2 detr face instance-segmentation object-detection onnx tensorrt transformers yolo yolov6 yolov7 yolox

Last synced: 15 Jun 2024

https://github.com/IbrahimSobh/llms

Large Language Models: In this repository Language models are introduced covering both theoretical and practical aspects.

deeplearning generative-ai llms nlp transformers

Last synced: 14 Jun 2024

https://github.com/denis2054/transformers-for-nlp-2nd-edition

Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more

bert chatgpt chatgpt-api dall-e dall-e-api deep-learning gpt-3-5-turbo gpt-4 gpt-4-api huggingface-transformers machine-learning natural-language-processing nlp openai python pytorch roberta-model transformers trax

Last synced: 14 Jun 2024

https://github.com/OpenLLMAI/OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

deepspeed large-language-models raylib reinforcement-learning reinforcement-learning-from-human-feedback transformers vllm

Last synced: 14 Jun 2024

https://github.com/imoneoi/openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

large-language-models open-source transformers

Last synced: 14 Jun 2024

https://github.com/hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚡

bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers

Last synced: 14 Jun 2024

https://github.com/hiyouga/dual-contrastive-learning

Code for our paper "Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation"

bert contrastive-learning deep-learning natural-language-processing neural-networks text-classification transformers

Last synced: 13 Jun 2024

https://github.com/ymcui/PERT

PERT: Pre-training BERT with Permuted Language Model

bert nlp plm pre-trained-model pytorch tensorflow transformers

Last synced: 13 Jun 2024

https://github.com/ymcui/MacBERT

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

bert language-model macbert nlp pytorch tensorflow transformers

Last synced: 13 Jun 2024

https://github.com/lhao499/RingAttention

Transformers with Arbitrarily Large Context

large-language-models long-context memory-efficient transformers

Last synced: 13 Jun 2024

https://github.com/lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers

Last synced: 13 Jun 2024

https://github.com/lucidrains/recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

artificial-intelligence attention-mechanisms deep-learning long-context memory recurrence transformers

Last synced: 13 Jun 2024

https://github.com/lucidrains/FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

artificial-intelligence attention-mechanism deep-learning efficient-transformers transformers

Last synced: 13 Jun 2024

https://github.com/OpenBMB/VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

diffusion-models large-language-models multimodal transformers

Last synced: 12 Jun 2024

https://github.com/yusufhilmi/client-vector-search

A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenAI's text-embedding-ada-002 and is way faster than Pinecone and other VectorDBs.

embedding-models embedding-vectors embeddings openai search text-embeddings transformers vector vector-search

Last synced: 12 Jun 2024

https://github.com/text-yoga/transformers-wasm

WIP implementation of transformers in rust+wasm

llm transformers wasm

Last synced: 12 Jun 2024

https://github.com/sonoisa/qiita-title-generation

Qiitaの記事本文を与えるとタイトルを自動生成してくれる深層学習モデルの推論処理

deep-learning natural-language-processing t5 transformers

Last synced: 12 Jun 2024

https://github.com/do-me/SemanticFinder

SemanticFinder - frontend-only live semantic search with transformers.js

ai codemirror semantic-search semanticsearch transformers

Last synced: 11 Jun 2024

https://github.com/vipulraheja/IteraTeR

Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)

bart bert iterative-text-editing iterative-text-revision natural-language-processing nlp pegasus roberta text-editing text-revision transformer transformers writing-assistant writing-systems

Last synced: 11 Jun 2024

https://github.com/THUDM/CogView

Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".

pretrained-models pytorch text-to-image transformers

Last synced: 11 Jun 2024

https://github.com/microsoft/generative-ai-for-beginners

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

ai azure chatgpt dall-e generative-ai generativeai gpt language-model llms openai prompt-engineering semantic-search transformers

Last synced: 11 Jun 2024

https://github.com/xenova/whisper-web

ML-powered speech recognition directly in your browser

javascript transformers whisper

Last synced: 11 Jun 2024

https://github.com/UKPLab/gpl

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

bert domain-adaptation information-retrieval nlp transformers vector-search

Last synced: 09 Jun 2024

https://github.com/huggingface/optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

diffusers distillation inference intel onnx openvino optimization pruning quantization transformers

Last synced: 08 Jun 2024

https://github.com/huggingface/optimum-graphcore

Blazing fast training of 🤗 Transformers on Graphcore IPUs

fine-tuning graphcore machine-learning pytorch training transformers

Last synced: 07 Jun 2024

https://github.com/gsarti/t5-flax-gcp

Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP

gcp huggingface seq2seq t5 text-to-text-transfer-transformer tpu tpu-vm transformers

Last synced: 07 Jun 2024

https://github.com/lucidrains/RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

artificial-intelligence attention-mechanism deep-learning retrieval transformers

Last synced: 07 Jun 2024

https://github.com/google-research/magvit

Official JAX implementation of MAGVIT: Masked Generative Video Transformer

generative-model transformers video-generation

Last synced: 07 Jun 2024

https://github.com/kakaobrain/kogpt

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

deeplearning generative-model gpt gpt3 huggingface kakaobrain kogpt korean nlp transformers

Last synced: 07 Jun 2024

https://github.com/hila-chefer/Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 07 Jun 2024

https://github.com/JohnGiorgi/DeCLUTR

The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to open an issue if you run into any trouble!

allennlp contrastive-learning metric-learning natural-language-processing pytorch representation-learning self-supervised-learning semantic-search semantic-text-similarity sentence-embeddings sentence-similarity transformers

Last synced: 02 Jun 2024