Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/shm007g/LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

alpaca chatgpt deepspeed ggml gpt gpt4 gptq llama llm loralib pytorch tensorflow transformers vicuna

Last synced: 23 Apr 2024

https://github.com/r2d4/rellm

Exact structure out of any language model completion.

huggingface-transformers llm transformers

Last synced: 23 Apr 2024

https://github.com/AlekseyKorshuk/optimum-transformers

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

benchmark huggingface infinity natural-language-processing nlp onnx onnxruntime optimum pipeline transformers

Last synced: 22 Apr 2024

https://github.com/lucidrains/PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

artificial-general-intelligence attention-mechanism deep-learning transformers

Last synced: 22 Apr 2024

https://github.com/lucidrains/flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

artificial-intelligence attention-mechanism deep-learning transformers visual-question-answering

Last synced: 22 Apr 2024

https://github.com/cevek/ttypescript

Over TypeScript tool to use custom transformers in the tsconfig.json

custom-transformer transformer-typescript transformers typescript

Last synced: 20 Apr 2024

https://github.com/NVlabs/GroupViT

Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.

image-text-matching semantic-segmentation transformers zero-shot-learning

Last synced: 20 Apr 2024

https://github.com/jessevig/bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization

Last synced: 20 Apr 2024

https://github.com/srvCodes/continual_learning_with_vit

Code for our CVPR 2022 workshop paper "Towards Exemplar-Free Continual Learning in Vision Transformers"

computer-vision continual-learning cvpr2022 incremental-learning transformers vision-transformer

Last synced: 20 Apr 2024

https://github.com/Lightning-Universe/lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning

hydra pytorch pytorch-lightning transformers

Last synced: 19 Apr 2024

https://github.com/IntelLabs/nlp-architect

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

bert deep-learning deeplearning dynet nlp nlu pytorch quantization tensorflow transformers

Last synced: 17 Apr 2024

https://github.com/iKernels/transformers-lightning

A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transformers.

dataset models transformers

Last synced: 16 Apr 2024

https://github.com/minimaxir/imgbeddings

Python package to generate image embeddings with CLIP without PyTorch/TensorFlow

ai clip embeddings image-processing images onnx transformers

Last synced: 16 Apr 2024

https://github.com/lucidrains/musiclm-pytorch

Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

artificial-intelligence attention-mechanisms deep-learning music-synthesis transformers

Last synced: 16 Apr 2024

https://github.com/xenova/transformers.js?utm_source=tldrnewsletter

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

browser javascript transformers webml

Last synced: 16 Apr 2024

https://github.com/xenova/sponsorblock-ml

Automatically detect in-video YouTube sponsorships, self/unpaid promotions, and interaction reminders.

machine-learning python sponsorblock transformers youtube

Last synced: 16 Apr 2024

https://github.com/yuanzhoulvpi2017/zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)

bert bloom chatglm-6b clip dolly falcon gpt gpt-neox gpt2 huggingface-transformers llama2 nlp pipeline pytorch text-generation transformers

Last synced: 16 Apr 2024

https://github.com/foundationvision/var

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction"

auto-regressive-model diffusion-models image-generation transformers

Last synced: 12 Apr 2024

https://github.com/google-research/scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

attention computer-vision deep-learning jax research transformers vision-transformer

Last synced: 12 Apr 2024

https://github.com/lucidrains/x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

artificial-intelligence attention-mechanism deep-learning transformers

Last synced: 11 Apr 2024

https://github.com/jeya-maria-jose/Medical-Transformer

Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

attention deep-learning medical-image-analysis medical-imaging pytorch segmentation transformer transformers

Last synced: 10 Apr 2024

https://github.com/iusztinpaul/hands-on-llms

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

3-pipeline-design aws beam bytewax cicd comet-ml docker fine-tuning generative-ai huggingface langchain llmops llms mlops qdrant qlora streaming transformers

Last synced: 10 Apr 2024

https://github.com/jiwidi/Behavior-Sequence-Transformer-Pytorch

This is a pytorch implementation for the BST model from Alibaba https://arxiv.org/pdf/1905.06874.pdf

alibaba behavior behavior-sequence-transformer pytorch recommenders seq2seq seq2seq-attn transformers

Last synced: 08 Apr 2024

https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.

gpt gpt-neo transformers

Last synced: 08 Apr 2024

https://github.com/g8a9/ferret

A python package for benchmarking interpretability techniques on Transformers.

benchmarking interpretability machine-learning transformers

Last synced: 08 Apr 2024

https://github.com/jerry1993-tech/Cornucopia-LLaMA-Fin-Chinese

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效的金融垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

chinese finance large-language-models llama nlp qa rlhf sft text-generation transformers

Last synced: 07 Apr 2024

https://github.com/romsto/Inappropriate-Language-Classifier

Online video games need a better system to detect inappropriate language in chat, and using machine learning models could help create a safer and more enjoyable environment for all players.

deep-learning hate-speech-detection huggingface machine-learning natural-language-processing natural-language-understanding transformers

Last synced: 06 Apr 2024

https://github.com/iryna-kondr/scikit-llm

Seamlessly integrate LLMs into scikit-learn.

chatgpt deep-learning llm machine-learning scikit-learn transformers

Last synced: 06 Apr 2024

https://github.com/MediaBrain-SJTU/MING

明医 (MING):中文医疗问诊大模型

consultation huggingface llm medical pytorch transformers

Last synced: 06 Apr 2024

https://github.com/EleutherAI/knowledge-neurons

A library for finding knowledge neurons in pretrained transformer models.

interpretability transformers

Last synced: 05 Apr 2024

https://github.com/RelevanceAI/vectorhub

Vector Hub - Library for easy discovery, and consumption of State-of-the-art models to turn data into vectors. (text2vec, image2vec, video2vec, graph2vec, bert, inception, etc)

artificial-intelligence audio-processing deep-learning deeplearning embeddings encodings image2vec machine-learning neural-network python pytorch tensorflow tfhub transformers vector vector-similarity video-processing word2vec

Last synced: 05 Apr 2024

https://github.com/lucidrains/audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

artificial-intelligence attention-mechanisms audio-synthesis deep-learning transformers

Last synced: 05 Apr 2024

https://github.com/hugofloresgarcia/vampnet

music generation with masked transformers!

deep-learning music music-generation transformers

Last synced: 05 Apr 2024

https://github.com/lucidrains/BS-RoFormer

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

artificial-intelligence attention-mechanisms deep-learning music-source-separation transformers

Last synced: 05 Apr 2024

https://github.com/kyegomez/SimpleMamba

Implementation of a modular, high-performance, and simplistic mamba for high-speed applications

artificial-intelligence gpt gpt4 gpt4all machine neural-network open-source pytorch rnn rnn-pytorch rnns ssm tensorflow transformers

Last synced: 05 Apr 2024

https://github.com/lucidrains/memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

approximate-nearest-neighbors artificial-intelligence attention-mechanism deep-learning memory retrieval transformers

Last synced: 05 Apr 2024

https://github.com/utterworks/fast-bert

Super easy library for BERT based NLP models

bert fast-bert fastai transformers

Last synced: 05 Apr 2024

https://github.com/apocas/restai

RestAI is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex, Ollama and HF Pipelines. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama. Precise embeddings usage and tuning.

embeddings fastapi langchain llama llamaindex llava llm ollama openai openaiapi python rag stable-diffusion transformers

Last synced: 02 Apr 2024

https://github.com/sagorbrur/bangla-bert

Bangla-Bert is a pretrained bert model for Bengali language

bangla bangla-nlp bert lm nlp transformers

Last synced: 02 Apr 2024

https://github.com/hate-alert/Fear-speech-analysis

Can fear be used for polarisation and spreading negativity? Our paper accepted in The Web conference 2021 tries to explore this question in light of public Whatsapp groups.

dataset facebook-ads fear-speech fearspeech hate-speech hatespeech natural-language-processing paper survey transformers whatsapp whatsapp-groups

Last synced: 02 Apr 2024

https://github.com/cfiltnlp/hiner

This repository contains the HiNER dataset released with our paper at LREC 2022

dataset deep-learning hindi machine-learning named-entity-recognition natural-language-processing nlp pytorch tensorflow2 transformers

Last synced: 02 Apr 2024

https://github.com/sagorbrur/codeswitch

CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed data.

code-mixed code-switching codeswitch hindi-english huggingface language-identification ner nlp pos pos-tagging sentiment-analysis spanish-english transformers

Last synced: 02 Apr 2024

https://github.com/eloialonso/iris

Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%.

artificial-intelligence atari deep-learning machine-learning reinforcement-learning research transformers world-models

Last synced: 01 Apr 2024

https://github.com/robflynnyh/hydra-linear-attention

Implementation of: Hydra Attention: Efficient Attention with Many Heads (https://arxiv.org/abs/2209.07484)

attention efficient-attention linear-attention machine-learning transformers

Last synced: 01 Apr 2024

https://github.com/AutoGPTQ/AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

deep-learning inference large-language-models llms nlp pytorch quantization transformer transformers

Last synced: 30 Mar 2024

https://github.com/golsun/DialogRPT

EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data"

conversational-ai dataset dialog dialog-datasets dialogpt gpt-2 human-feedback-data pretrained-models pytorch transformers

Last synced: 28 Mar 2024

https://github.com/rajaswa/indic-syntax-evaluation

Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages

dataset deep-learning hacktoberfest indic-nlp syntax transformers

Last synced: 28 Mar 2024

https://github.com/AlignmentResearch/tuned-lens

Tools for understanding how transformer predictions are built layer-by-layer

machine-learning pytorch transformers

Last synced: 27 Mar 2024

https://github.com/notAI-tech/Anuvaad

State of the art open-source translation for Indic languages.

hindi india indic-languages kannada malayalam marathi mt5 multilingual nlp tamil telugu transformer transformers translation

Last synced: 27 Mar 2024

https://github.com/intel-analytics/ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.

analytics-zoo bigdl distributed-deep-learning keras llm python pytorch scala spark tensorflow transformers

Last synced: 27 Mar 2024

https://github.com/The-AI-Summer/self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

artificial-intelligence attention attention-mechanism deep-learning machine-learning machine-learning-algorithms self-attention transformer transformers

Last synced: 27 Mar 2024

https://github.com/microsoft/generative-ai-for-beginners?WT.mc_id=academic-122979-leestott

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

ai azure chatgpt dall-e generative-ai generativeai gpt language-model llms openai prompt-engineering semantic-search transformers

Last synced: 27 Mar 2024

https://github.com/lihanghang/NLP-Knowledge-Graph

自然语言处理、知识图谱、对话系统三大技术研究与应用。

bert deep-learning ernie event-driven kbqa knowledge-graph machine-learning ner nlp transformers

Last synced: 25 Mar 2024

https://github.com/lonePatient/Bert-Multi-Label-Text-Classification

This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.

albert bert fine-tuning multi-label-classification nlp pytorch pytorch-implmention text-classification transformers xlnet

Last synced: 25 Mar 2024

https://github.com/IAmPara0x/Yuno

Yuno is context based search engine for anime.

anime deep-learning python search-engine transformers

Last synced: 24 Mar 2024

https://github.com/lucidrains/phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

artificial-intelligence attention-mechanisms deep-learning imagination-machine text-to-video transformers

Last synced: 24 Mar 2024

https://github.com/the-crypt-keeper/can-ai-code

Self-evaluating interview for AI coders

ai ggml humaneval langchain llama-cpp llm transformers

Last synced: 24 Mar 2024

https://github.com/kaushaltrivedi/fast-bert

Super easy library for BERT based NLP models

bert fast-bert fastai transformers

Last synced: 23 Mar 2024

https://github.com/NVIDIA/Megatron-LM

Ongoing research training transformer models at scale

large-language-models model-para transformers

Last synced: 23 Mar 2024

https://github.com/huggingface/optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

graphcore habana inference intel onnx onnxruntime optimization pytorch quantization tflite training transformers

Last synced: 23 Mar 2024

https://github.com/huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion llm lora parameter-efficient-learning python pytorch transformers

Last synced: 23 Mar 2024

https://github.com/combust/mleap

MLeap: Deploy ML Pipelines to Production

data-pipelines python scala scikit-learn spark tensorflow transformers

Last synced: 23 Mar 2024

https://github.com/ThilinaRajapakse/simpletransformers

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

conversational-ai information-retrival named-entity-recognition question-answering text-classification transformers

Last synced: 21 Mar 2024

https://github.com/Ethan-yt/guwenbert

GuwenBERT: 古文预训练语言模型(古文BERT) A Pre-trained Language Model for Classical Chinese (Literary Chinese)

bert classical-chinese guwenbert literary-chinese transformers

Last synced: 21 Mar 2024

https://github.com/explosion/curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

albert bert camembert dolly2 falcon gptneox llama llm llms nlp pytorch roberta transformer transformers xlm-roberta

Last synced: 21 Mar 2024

https://github.com/microsoft/presidio-research

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

deep-learning flair machine-learning named-entity-recognition natural-language-processing ner nlp pii privacy spacy transformers

Last synced: 20 Mar 2024

https://github.com/BlinkDL/RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers

Last synced: 19 Mar 2024

https://github.com/declare-lab/flan-alpaca

This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.

alpaca flan-t5 language-model llm transformers

Last synced: 19 Mar 2024

https://github.com/EleutherAI/gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

gpt gpt-2 gpt-3 language-model transformers

Last synced: 19 Mar 2024

https://github.com/EleutherAI/gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

deepspeed-library gpt-3 language-model transformers

Last synced: 19 Mar 2024