Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-llmops
Awesome series for LLMOps
https://github.com/KennethanCeyer/awesome-llmops
Last synced: 6 days ago
JSON representation
-
Tools (GitHub)
-
LLMOps vs MLOps
- Stanford Alpaca -  - A repository of Stanford Alpaca project, a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.
- LoRA -  - An implementation of "LoRA: Low-Rank Adaptation of Large Language Models".
- Dolly -  - A large language model trained on the Databricks Machine Learning Platform.
- DeepSpeed -  - A deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- LMFlow -  - An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Model for All.
- Promptify -  - An utility / tookit for Prompt engineering.
- Jarvis -  - A system to connect LLMs with ML community, a composite model connector via the LLM interface.
- dalai -  - The cli tool to run LLaMA on the local machine.
- haystack -  -an open source NLP framework to interact with the data using Transformer models and LLMs.
- deeplake -  - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets.
- alpaca-lora -  - Instruct-tune LLaMA on consumer hardware.
- bosquet -  - LLMOps for Large Language Model based applications.
- gradio -  - An UI helper for the machine learning model.
- sharegpt -  - An open-source Chrome Extension for you to share your wildest ChatGPT conversations with one click.
- Snowkel AI -  - The data platform for foundation models.
- promptflow -  - A toolkit that simplifies the development of LLM-based AI applications, from ideation to deployment.
- Auto-GPT -  - An experimental open-source attempt to make GPT-4 fully autonomous.
- langflow -  - An UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.
- bosquet -  - LLMOps for Large Language Model based applications.
- langchain -  - The library which assists in the development of applications with LLM.
- llama_index -  - A project that provides a central interface to connect your LLM's with external data.
-
-
RLHF
-
LLMOps vs MLOps
- evals -  - A curated list of reinforcement learning with human feedback resources.
- trlx -  - A repo for distributed training of language models with Reinforcement Learning via Human Feedback. (RLHF)
- PaLM-rlhf-pytorch -  - Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture.
-
-
Awesome
-
Prompt Engineering
-
LLMOps vs MLOps
- PromptBase - Marketplace of the prompt engineering
- PromptHero - The website for prompt engineering
- Prompt Search - The search engine for the prompt engineering
- Prompt Perfect - Auto Prompt Optimizer
- Learn Prompting - The tutorial website for the prompt engineering
- Blog: Prompt Leaking
- Paper: Prefix-Tuning: Optimizing Continuous Prompts for Generation
-
-
Optimization
-
LLMOps vs MLOps
- Blog: A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using Hugging Face Transformers, Accelerate and bitsandbytes
- Blog: Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
- Blog: Handling big models for inference
- Blog: How To Fine-Tune the Alpaca Model For Any Language | ChatGPT Alternative
- Paper: LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
- Gist: Script to decompose/recompose LLAMA LLM models with different number of shards
-
-
Tools (Other)
-
LLMOps vs MLOps
- PaLM2 API - An API service that makes PaLM2, Large Language Models (LLMs), available to Google Cloud Vertex AI.
- Perspective API - A tool that can help mitigate toxicity and ensure healthy dialogue online.
- PaLM2 API - An API service that makes PaLM2, Large Language Models (LLMs), available to Google Cloud Vertex AI.
-
Programming Languages
Sub Categories
Keywords
deep-learning
10
machine-learning
9
ai
9
chatgpt
8
pytorch
7
large-language-models
6
llm
5
gpt
5
python
5
language-model
4
prompt-engineering
4
gpt-3
4
openai
4
data-science
3
reinforcement-learning
3
chatgpt-api
3
transformers
3
nlp
3
artificial-intelligence
2
prompt
2
prompt-tuning
2
prompt-toolkit
2
gpt-4
2
human-feedback
2
instruction-following
2
ml
2
chatbot
2
bert
2
generative-ai
2
semantic-search
1
retrieval-augmented-generation
1
rag
1
question-answering
1
information-retrieval
1
prompt-versioning
1
llama
1
prompting
1
prompts
1
promptversioning
1
platform
1
adaptation
1
deberta
1
gpt-2
1
lora
1
low-rank
1
roberta
1
databricks
1
dolly
1
billion-parameters
1
compression
1