awesome-llmops
Awesome series for LLMOps
https://github.com/KennethanCeyer/awesome-llmops
Last synced: 2 days ago
JSON representation
-
Tools (GitHub)
-
LLMOps vs MLOps
- langchain -  - The library which assists in the development of applications with LLM.
- llama_index -  - A project that provides a central interface to connect your LLM's with external data.
- Stanford Alpaca -  - A repository of Stanford Alpaca project, a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.
- LoRA -  - An implementation of "LoRA: Low-Rank Adaptation of Large Language Models".
- Dolly -  - A large language model trained on the Databricks Machine Learning Platform.
- LMFlow -  - An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Model for All.
- Promptify -  - An utility / tookit for Prompt engineering.
- Jarvis -  - A system to connect LLMs with ML community, a composite model connector via the LLM interface.
- dalai -  - The cli tool to run LLaMA on the local machine.
- haystack -  -an open source NLP framework to interact with the data using Transformer models and LLMs.
- deeplake -  - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets.
- alpaca-lora -  - Instruct-tune LLaMA on consumer hardware.
- bosquet -  - LLMOps for Large Language Model based applications.
- gradio -  - An UI helper for the machine learning model.
- sharegpt -  - An open-source Chrome Extension for you to share your wildest ChatGPT conversations with one click.
- Snowkel AI -  - The data platform for foundation models.
- promptflow -  - A toolkit that simplifies the development of LLM-based AI applications, from ideation to deployment.
- Auto-GPT -  - An experimental open-source attempt to make GPT-4 fully autonomous.
- langflow -  - An UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.
- Helicone AI -  - Open-source LLM observability platform for logging, monitoring, and debugging AI applications. Simple 1-line integration to get started.
- Starwhale -  - An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.
- DeepSpeed -  - A deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
-
-
RLHF
-
LLMOps vs MLOps
- evals -  - A curated list of reinforcement learning with human feedback resources.
- trlx -  - A repo for distributed training of language models with Reinforcement Learning via Human Feedback. (RLHF)
- PaLM-rlhf-pytorch -  - Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture.
-
-
Awesome
-
Prompt Engineering
-
LLMOps vs MLOps
- PromptBase - Marketplace of the prompt engineering
- PromptHero - The website for prompt engineering
- Prompt Search - The search engine for the prompt engineering
- Prompt Perfect - Auto Prompt Optimizer
- Learn Prompting - The tutorial website for the prompt engineering
- Blog: Prompt Leaking
- Paper: Prefix-Tuning: Optimizing Continuous Prompts for Generation
- Blog: Exploring Prompt Injection Attacks
-
-
Optimization
-
LLMOps vs MLOps
- Blog: A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using Hugging Face Transformers, Accelerate and bitsandbytes
- Blog: Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
- Blog: Handling big models for inference
- Blog: How To Fine-Tune the Alpaca Model For Any Language | ChatGPT Alternative
- Paper: LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
- Gist: Script to decompose/recompose LLAMA LLM models with different number of shards
-
-
Tools (Other)
-
LLMOps vs MLOps
- PaLM2 API - An API service that makes PaLM2, Large Language Models (LLMs), available to Google Cloud Vertex AI.
- Perspective API - A tool that can help mitigate toxicity and ensure healthy dialogue online.
- OpenLLM (by BentoML) - A deployment tool from BentoML that simplifies serving various large language models in production environments.
- LangSmith - A monitoring and debugging platform by the LangChain team that provides systematic performance tracking, error analysis, and logging for LLM-based applications.
-
Programming Languages
Sub Categories
Keywords
deep-learning
10
machine-learning
9
ai
9
llm
8
chatgpt
7
pytorch
7
gpt
6
large-language-models
6
prompt-engineering
5
python
4
openai
4
language-model
4
chatgpt-api
3
nlp
3
gpt-3
3
transformers
3
reinforcement-learning
3
data-science
3
llmops
3
prompt-tuning
2
prompt-toolkit
2
human-feedback
2
bert
2
prompt
2
langchain
2
ml
2
mlops
2
agents
2
rag
2
vector-database
2
instruction-following
2
fine-tuning
2
chatbot
2
generative-ai
1
information-retrieval
1
llamaindex
1
question-answering
1
retrieval-augmented-generation
1
semantic-search
1
squad
1
summarization
1
computer-vision
1
cv
1
framework
1
datalake
1
datasets
1
image-processing
1
data
1
application
1
multi-modal
1