Projects in Awesome Lists tagged with language-model

https://github.com/arcee-ai/DALM

Domain Adapted Language Modeling Toolkit - E2E RAG

language-model llm retrieval retrieval-augmented-generation

Last synced: 09 Aug 2024

https://github.com/tbepler/protein-sequence-embedding-iclr2019

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

deep-learning language-model protein-embedding protein-modeling protein-representation-learning protein-sequence protein-structure pytorch recurrent-neural-networks

Last synced: 03 Aug 2024

https://github.com/rishikksh20/FNet-pytorch

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

feedforward-neural-network fnet fourier-transform image-classification language-model text text-classification transformer vision

Last synced: 03 Aug 2024

https://github.com/xu-song/bert-as-language-model

BERT as language model, fork from https://github.com/google-research/bert

bert language-model tensorflow

Last synced: 01 Aug 2024

https://github.com/xu-song/bert_as_language_model

BERT as language model, fork from https://github.com/google-research/bert

bert language-model tensorflow

Last synced: 22 Aug 2024

https://github.com/L0SG/relational-rnn-pytorch

An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.

deep-learning deepmind language-model language-modeling pytorch recurrent-neural-networks self-attention transformer word-language-model

Last synced: 07 Aug 2024

https://github.com/PlanTL-GOB-ES/lm-spanish

Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

benchmarks corpora embeddings language-model nlp transformers

Last synced: 05 Aug 2024

https://github.com/mead-ml/mead-baseline

Deep-Learning Model Exploration and Development for NLP

baseline bert classification convolutional-neural-networks deep-learning deep-learning-architectures experimentation hacktoberfest keras language-model machine-learning nlp nlp-tasks pytorch recurrent-neural-networks seq2seq tensorflow transformers visdom

Last synced: 27 Sep 2024

https://github.com/bhattbhavesh91/voice-assistant-whisper-chatgpt

This repository will guide you to create your own Smart Virtual Assistant like Google Assistant using Open AI's ChatGPT, Whisper. The entire solution is created using Python & Gradio.

chatgpt chatgpt-api google-assistant gpt-3 gradio huggingface language-model language-models openapi virtual-assistant voice-assistant whisper

Last synced: 26 Sep 2024

https://github.com/backprop-ai/backprop

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

bert fine-tuning image-classification language-model multilingual-models natural-language-processing nlp question-answering text-classification transfer-learning transformers

Last synced: 02 Aug 2024

https://github.com/uesleibros/OpenGPT

OpenGPT 3.5/4 is a project aimed at providing practical and user-friendly APIs. The APIs allow for easy integration with various applications, making it simple for developers to incorporate the natural language processing capabilities of GPT into their projects.

ai api artificial-intelligence chatbot chatgpt-api chatgpt-free free free-gpt free-to-use gpt gpt-3 gpt-4 language-model model openai openai-api proxy python reverse-engineering services

Last synced: 05 Aug 2024

https://github.com/huangwl18/language-planner

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

artificial-intelligence codex deep-learning embodied-ai foundation-models gpt-3 in-context-learning knowledge-extraction language-model planning transformers

Last synced: 01 Aug 2024

https://github.com/twang2218/vocab-coverage

语言模型中文认知能力分析

bert chatglm chinese embeddings language-model llama llm

Last synced: 27 Sep 2024

https://github.com/brightmart/xlnet_zh

中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large

bert language-model pre-train roberta xlnet

Last synced: 01 Aug 2024

https://github.com/snap-stanford/GreaseLM

[ICLR 2022 spotlight]GreaseLM: Graph REASoning Enhanced Language Models for Question Answering

biomedical-ques commonsense-reasoning graph-neural-networks knowledge-graph language-model question-answering

Last synced: 02 Aug 2024

https://github.com/rolczynski/automatic-speech-recognition

🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)

automatic-speech-recognition deep-learning deepspeech distill keras language-model machine-learning neural-networks speech-recognition speech-to-text tensorflow tensorflow-models

Last synced: 26 Sep 2024

https://github.com/CraftJarvis/MC-Planner

Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

language-model minecraft

Last synced: 03 Aug 2024

https://github.com/hkproj/pytorch-llama

LLaMA 2 implemented from scratch in PyTorch

language-model llama llama2 paper-implementations pytorch

Last synced: 27 Sep 2024

https://github.com/epfl-dlab/aiflows

🤖🌊 aiFlows: The building blocks of your collaborative AI

agent agents ai ai-framework ai-frameworks chatgpt copilot gpt language-model language-models llm llms open-source oss python

Last synced: 01 Aug 2024

https://github.com/ollama4j/ollama4j

A simple Java library for interacting with Ollama server.

gen-ai genai generative-ai gpt java language-model large-language-models llama llama2 llama3 llm ollama

Last synced: 27 Sep 2024

https://github.com/Open3DA/LL3DA

[CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Language 3D Assistant.

3d 3d-models 3d-to-text cvpr2024 gpt instruction-tuning language-model llm multi-modal scene-understanding

Last synced: 26 Sep 2024

https://github.com/runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

language-model llm runpod vllm

Last synced: 01 Aug 2024

https://github.com/tomchang25/whisper-auto-transcribe

Auto transcribe tool based on whisper

asr deep-learning gradio gradio-interface language-model pytorch speech-processing speech-recognition speech-to-text text-to-speech video-captioning voice-activity-detection

Last synced: 04 Aug 2024

https://github.com/intelligentnode/intellinode

Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation

anthropic chatbot chatgpt claude dall-e embeddings gemini google-ai gpt-4 hugging-face image-generation language-model mistralai nodejs openai prompt-engineering semantic-search speech-synthesis vectors

Last synced: 02 Aug 2024

https://github.com/intelligentnode/IntelliNode

Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation

anthropic chatbot chatgpt claude dall-e embeddings gemini google-ai gpt-4 hugging-face image-generation language-model mistralai nodejs openai prompt-engineering semantic-search speech-synthesis vectors

Last synced: 01 Aug 2024

https://github.com/allenai/ScienceWorld

ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.

language-model machine-learning reinforcement-learning text-based-game text-based-game-framework

Last synced: 01 Aug 2024

https://github.com/iPieter/RobBERT

A Dutch RoBERTa-based language model

bert bert-model language-model nlp nlp-resources roberta transformers

Last synced: 03 Aug 2024

https://github.com/teilomillet/gollm

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

ai anthropic dspy genai generative-ai generative-ai-tools go golang groq language-model llm openai prompt-engineering prompt-optimization structured-output

Last synced: 22 Aug 2024

https://github.com/SteveKGYang/MentalLLaMA

This repository introduces MentaLLaMA, the first open-source instruction following large language model for interpretable mental health analysis.

chatgpt gpt4 interpretability language-model large-language-models llama2 mental-health natural-language-processing natural-language-understanding social-media

Last synced: 01 Aug 2024

https://github.com/CyberZHG/keras-xlnet

Implementation of XLNet that can load pretrained checkpoints

glue keras language-model nlp xlnet

Last synced: 03 Aug 2024

https://github.com/cyberzhg/keras-xlnet

Implementation of XLNet that can load pretrained checkpoints

glue keras language-model nlp xlnet

Last synced: 27 Sep 2024

https://github.com/rylans/getlang

Natural language detection package in pure Go

language-model natural-language nlp

Last synced: 30 Jul 2024

https://github.com/picovoice/picollm

On-device LLM Inference Powered by X-Bit Quantization

compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llm llm-inference llms mistral mixtral model-compression natural-language-processing quantization self-hosted

Last synced: 27 Sep 2024

https://github.com/anis-marrouchi/chatpdf-gpt

ChatPDF-GPT is an innovative chat interface application powered by LangChain and OpenAI, allowing users to upload and chat with PDF documents, stored in Pinecone vector database and Supabase storage.

chatbot full-stack langchain language-model machine-learning nextjs openai pdf pinecone react supabase

Last synced: 27 Sep 2024

https://github.com/arc-eng/engine

An AI agent for your development workflow that can search and manipulate the code base, browse the internet and interact with Github issues and pull requests

agent ai bot chatgpt collaboration generative-ai gpt-4 language-model llm openai

Last synced: 22 Sep 2024

https://github.com/thesephist/modelexicon

This AI Does Not Exist: generate realistic descriptions of made-up machine learning models.

gpt-j huggingface language-model machine-learning oaklang torus-dom

Last synced: 01 Aug 2024

https://github.com/citiususc/Smarty-GPT

A wrapper of LLMs that biases its behaviour using prompts and contexts in a transparent manner to the end-users

awesome-chatgpt-prompts chatgpt gpt gpt-3 gpt-35-turbo gpt-4 language-model prompt-engineering prompts python t5 wrapper

Last synced: 31 Jul 2024

https://github.com/citiususc/smarty-gpt

A wrapper of LLMs that biases its behaviour using prompts and contexts in a transparent manner to the end-users

awesome-chatgpt-prompts chatgpt gpt gpt-3 gpt-35-turbo gpt-4 language-model prompt-engineering prompts python t5 wrapper

Last synced: 02 Oct 2024

https://github.com/PR-Pilot-AI/pr-pilot

An AI agent for your development workflow that can search and manipulate the code base, browse the internet and interact with Github issues and pull requests

agent ai bot chatgpt collaboration generative-ai gpt-4 language-model llm openai

Last synced: 01 Aug 2024

https://github.com/cyberzhg/keras-gpt-2

Load GPT-2 checkpoint and generate texts

gpt-2 keras language-model nlp

Last synced: 27 Sep 2024

https://github.com/AkshitIreddy/CUPCAKEAGI

🧁👋 Welcome to CupcakeAGI, where we bake up some sweet and creamy AGI goodness! 🍰🤖

agent agi artificial-intelligence language-model llm

Last synced: 07 Aug 2024

https://github.com/alisafaya/Arabic-BERT

Arabic edition of BERT pretrained language models

arabic arabic-nlp bert bert-language-models language-model nlp transformer

Last synced: 03 Aug 2024

https://github.com/zjunlp/molgen

[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback

generation huggingface iclr2024 language-model molecular-generation molecular-optimization molecule molgen multitask pre-trained-language-models pre-trained-model pre-training pytorch selfies targeted-molecular-generation

Last synced: 26 Sep 2024

https://github.com/mallahyari/llm-hub

A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like GPT-3

chatgpt deep-learning gpt-3 gpt-4 language-model llms nlp openai

Last synced: 31 Jul 2024

https://github.com/AI21Labs/lm-evaluation

Evaluation suite for large-scale language models.

evaluation-framework language-model

Last synced: 02 Aug 2024

https://github.com/kuleshov-group/mdlm

Simplified Masked Diffusion Language Model

diffusion-models language-model text

Last synced: 01 Aug 2024

https://github.com/txsun1997/CoLAKE

COLING'2020: CoLAKE: Contextualized Language and Knowledge Embedding

deep-learning knowledge-embedding knowledge-graph language-model natural-language-processing

Last synced: 03 Aug 2024

https://github.com/oxpig/AbLang

AbLang: A language model for antibodies

antibodies language-model protein-sequences semantic

Last synced: 02 Aug 2024

https://github.com/kmario23/KenLM-training

Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2

automatic-speech-recognition deep-neural-networks deep-speech kenlm kenlm-toolkit language-model language-modeling natural-language-processing probabilistic-models python speech-recognition

Last synced: 07 Aug 2024

https://github.com/ictnlp/truthx

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

baichuan chatglm chatgpt explainable-ai gpt-4 hallucination hallucinations language-model llama llama2 llama3 llm llm-inference llms mistral representation safety truthfulness

Last synced: 27 Sep 2024

https://github.com/l294265421/alpaca-rlhf

Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat

alpaca chatgpt language-model large-language-models llama llm reinforcement-learning rlhf

Last synced: 31 Jul 2024

https://github.com/coreylowman/llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

cuda deep-learning inference language-model llama neural-network rust rust-lang

Last synced: 02 Aug 2024

https://chats-lab.github.io/KokoMind/

KokoMind: Can LLMs Understand Social Interactions?

chatgpt deep-learning gpt-4 language-model neural-network nlp

Last synced: 03 Aug 2024

https://github.com/Glaciohound/LM-Infinite

Implementation of paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"

language-model long-context model-diagnostics

Last synced: 04 Aug 2024

https://github.com/hupe1980/golc

🚀 Building Go applications with LLMs through composability

agents ai ai21 anthropic bedrock cohere ernie gemini genai go golang huggingface langchain language-model llm openai palm prompt-engineering rag

Last synced: 01 Oct 2024

https://github.com/OpenShapeLab/ShapeGPT

ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Model, a unified and user-friendly shape-language model

3d-generation caption-generation chatgpt gpt language-model multi-modal shape unified

Last synced: 31 Jul 2024

https://github.com/legacyai/tf-transformers

State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).

bert gpt2 keras language-model natural-language-processing nlp nlp-library tensorflow tensorflow2 text-classification text-generation transformer

Last synced: 01 Aug 2024

https://github.com/sail-sg/sailor-llm

Sailor: Open Language Models for South-East Asia

indonesia language-model lao malay sea thai vietnam

Last synced: 29 Sep 2024

https://github.com/csinva/imodelsx

Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.

ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai

Last synced: 26 Sep 2024

https://github.com/paebbels/pyvhdlparser

Streaming based VHDL parser.

language-model parser python-3 vhdl

Last synced: 01 Oct 2024

https://github.com/Paebbels/pyVHDLParser

Streaming based VHDL parser.

language-model parser python-3 vhdl

Last synced: 30 Jul 2024

https://github.com/csinva/imodelsX

Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.

ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai

Last synced: 02 Aug 2024

https://github.com/hitz-zentroa/lm-contamination

The LM Contamination Index is a manually created database of contamination evidences for LMs.

chatgpt contamination language-model large-language-models llm lm

Last synced: 09 Aug 2024

https://github.com/alexeykarnachev/full_stack_transformer

Pytorch library for end-to-end transformer models training, inference and serving

gpt-2 language-model language-model-finetuning language-model-generation pytorch-lightning telegram-bot transformers

Last synced: 07 Aug 2024

https://github.com/pawangeek/Deep-NLP-Resources

Curated list of all NLP Resources

commonsense discourse information-extraction language-model lexicon machine-translation parsing questions-and-answers sentiment text-classification text-generation

Last synced: 01 Aug 2024

https://github.com/xtekky/gpt4local

Openai-style, fast & lightweight local language model inference w/ documents

ai chatbot chatbots chatgpt chatgpt-api documents gpt gpt-4 gpt4free language-model llm llm-inference local local-llm openai openai-api python

Last synced: 01 Aug 2024

https://github.com/nguyenvulebinh/vietnamese-electra

Electra pre-trained model using Vietnamese corpus

bert bert-embeddings deep-learning electra fine-tuning huggingface language-model natural-language-processing tensorflow2 transformer vietnamese vietnamese-nlp

Last synced: 01 Aug 2024

https://github.com/batzner/tensorlm

Wrapper library for text generation / language models at char and word level with RNN in TensorFlow

char-lm char-rnn language-model nlp tensorflow tensorflow-library

Last synced: 31 Jul 2024

https://github.com/lucidrains/mlp-gpt-jax

A GPT, made only of MLPs, in Jax

artificial-intelligence deep-learning jax language-model multilayer-perceptron

Last synced: 03 Oct 2024

https://github.com/rbitr/llm.f90

LLM inference in Fortran

ai chatbot cpu-inference language-model llama llama2 llamacpp llm mamba phi-2 state-space-model transformer

Last synced: 27 Sep 2024

https://github.com/nathanlesage/local-chat

LocalChat is a ChatGPT-like chat that runs on your computer

chat chatbot chatgpt electron huggingface language-model llama llamacpp llm local privacy transformers

Last synced: 27 Sep 2024

https://github.com/chiang-yuan/llamp

A web app and Python API for multi-modal RAG framework to ground LLMs on high-fidelity materials informatics. An agentic materials scientist powered by @materialsproject, @langchain-ai, and @openai

ai4science cheminformatics language-model materials-informatics retrieval-augmented-generation

Last synced: 02 Aug 2024

https://github.com/kennethenevoldsen/spacy-wrap

spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to include existing fine-tuned models within your SpaCy workflow.

deep-learning huggingface huggingface-transformers language-model machine-learning natural-language-processing nlp pytorch spacy spacy-extension spacy-extensions spacy-models spacy-nlp spacy-pipeline spacy-transformers text-classification transformers

Last synced: 28 Sep 2024

https://github.com/ShareGPT4Omni/ShareGPT4V

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

chatgpt eccv2024 gpt gpt-4v gpt4v instruction-tuning language-model large-language-models large-multimodal-models large-vision-language-models vision-language-model

Last synced: 03 Aug 2024

https://github.com/Merck/Sapiens

Sapiens is a human antibody language model based on BERT.

antibody bert embeddings language-model sapiens

Last synced: 26 Sep 2024

https://github.com/sfischer13/python-arpa

:snake: Python library for n-gram models in ARPA format

arpa computational-linguistics language-model library lm nlp python python-3

Last synced: 01 Oct 2024

https://github.com/microsoft/augmented-interpretable-models

Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.

ai artificial-intelligence deep-learning distillation embedding explainability huggingface interpretability language-model large-language-models linear linear-models logistic-regression machine-learning ml neural-network scikit-learn sentiment-classification transformer transparent

Last synced: 26 Sep 2024

https://github.com/kevin-free/chatgpt-prompt-engineering-for-developers

吴恩达《ChatGPT Prompt Engineering for Developers》课程中英版

chatgpt deep-learning language-model openai prompt-engineering

Last synced: 02 Aug 2024

https://github.com/friederrr/GHOSTS

GHOSTS dataset

benchmark dataset language-model

Last synced: 09 Aug 2024

https://github.com/microsoft/automated-explanations

Explain a black-box module in natural language.

artificial-intelligence automated-interpretability data-science explanation fmri fmri-data-analysis gpt gpt4 huggingface interpretability language-model large-language-models machine-learning mechanistic-interpretability neuroscience xai

Last synced: 30 Sep 2024

https://github.com/Lingkai-Kong/Calibrated-BERT-Fine-Tuning

Code for Paper: Calibrated Language Model Fine-Tuning for In- and Out-of-Distribution Data

bert calibration deep-learning language-model nlp nlp-machine-learning ood-detection open-world-classification robustness text-classification uncertainty-estimation uncertainty-quantification

Last synced: 02 Aug 2024

https://github.com/uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers

Last synced: 27 Sep 2024

https://github.com/pooya-mohammadi/persian-spell-checker-kenlm

A complete instruction for training a Persian spell checker and a language model based on SymSpell and KenLM, respectively using Wikipedia dataset.

bash kenlm language-model nlp persian python spellcheck spellchecker symspell

Last synced: 04 Aug 2024

https://github.com/sonnhfit/sonagent

Self-Repairing Autonomous Agent for Digital Consciousness Backup Using Large Language Models (LLM) and powerful code generation capability, self-editing source code and self-debugging its own source code

agent ai autonomus-robots chatgpt code-generation language-model large-language-models llama2 llm ml self self-coding self-debugging self-editing-its-own-source-code self-editing-source-code self-repairing