awesome-instruction-dataset
A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
https://github.com/yaodongC/awesome-instruction-dataset
Last synced: about 1 month ago
JSON representation
[(allenai/natural-instructions)|1.6K|ML|MT|HG](https://github.com/allenai/natural-instructions)
[(allenai/prosocial-dialog)|58K|EN|MT|MIX](https://huggingface.co/datasets/allenai/prosocial-dialog)
[(Anthropic/hh-rlhf)|22k|EN|MT|MIX](https://huggingface.co/datasets/Anthropic/hh-rlhf)
[(bigscience/xP3)|N/A|ML|MT|MIX](https://huggingface.co/datasets/bigscience/xP3)
[(databrickslabs/dolly)|15K|EN|MT|HG](https://github.com/databrickslabs/dolly/tree/master/data)
[(google-research/FLAN)|N/A|EN|MT|MIX](https://github.com/google-research/FLAN/tree/main/flan/v2)
[(haotian-liu/LLaVA)|150K|EN|MT|MIX](https://huggingface.co/datasets/liuhaotian/LLaVA-Instruct-150K)
[(Hello-SimpleAI/HC3-Chinese)|13K|CN|MT|MIX](https://huggingface.co/datasets/Hello-SimpleAI/HC3-Chinese)
[(HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG](https://huggingface.co/datasets/HuggingFaceH4/stack-exchange-preferences)
[(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|CN|MT|SI](https://github.com/Instruction-Tuning-with-GPT-4/GPT-4-LLM)
[(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX](https://github.com/Instruction-Tuning-with-GPT-4/GPT-4-LLM)
[(JosephusCheung/GuanacoDataset)|534K|ML|MT|SI](https://huggingface.co/datasets/JosephusCheung/GuanacoDataset)
[(nomic-ai/gpt4all)|437k|EN|MT|COL](https://github.com/nomic-ai/gpt4all)
[(OpenAssistant/oasst1)|161K|ML|MT|HG](https://huggingface.co/datasets/OpenAssistant/oasst1)
[(orhonovich/unnatural-instructions)|240K|EN|MT|MIX](https://github.com/orhonovich/unnatural-instructions)
[(PhoebusSi/Alpaca-CoT)|500k|ML|MT|COL](https://huggingface.co/datasets/QingyiSi/Alpaca-CoT)
[(Reddit/eli5)|500k|EN|MT|HG](https://huggingface.co/datasets/eli5)
- r/explainlikeimfive
- eli5 dataset - exchange-paired](https://huggingface.co/datasets/lvwerra/stack-exchange-paired).
[(RyokoAI/ShareGPT52K)|90K|ML|MT|SI](https://huggingface.co/datasets/RyokoAI/ShareGPT52K)
[({sunrainyg}/{InstructCV)|EN|MT|MIX}]{https://github.com/AlaaLab/InstructCV}
[(tatsu-lab/Alpaca)|52K|EN|MT|SI](https://github.com/tatsu-lab/stanford_alpaca)
[(thu-coai/Safety-Prompts)|100k|CN|MT|MIX](https://github.com/thu-coai/Safety-Prompts)
Uncategorized
Uncategorized
- (Vision-CAIR/MiniGPT-4)|5K|EN|MT|MIX
- (haotian-liu/LLaVA)|150K|EN|MT|MIX
- (JosephusCheung/GuanacoDataset)|534K|ML|MT|SI
- (allenai/prosocial-dialog)|58K|EN|MT|MIX
- (bigscience/xP3)|N/A|ML|MT|MIX
- (PhoebusSi/Alpaca-CoT)|500k|ML|MT|COL
- (google-research/FLAN)|N/A|EN|MT|MIX
- (YeungNLP/firefly-train-1.1M)|1100k|CN|MT|COL
- (databrickslabs/dolly)|15K|EN|MT|HG
- (OpenAssistant/oasst1)|161K|ML|MT|HG
- (RyokoAI/ShareGPT52K)|90K|ML|MT|SI
- (zjunlp/Mol-Instructions)|2043K|ML|MT|MIX
- (Anthropic/hh-rlhf)|22k|EN|MT|MIX
- (HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG
- (stanfordnlp/SHP)|385k|EN|MT|HG
- nichtdax/awesome-totally-open-chatgpt
- (gururise/Cleaned Alpaca)|52K|EN|MT|SI
- (XueFuzhao/InstructionWild)|52K|EN|CN|MT|SI
- (allenai/natural-instructions)|1.6K|ML|MT|HG
- (nomic-ai/gpt4all)|437k|EN|MT|COL
- (thunlp/UltraChat)|280k|EN|TS|MIX
- (cascip/ChatAlpaca)|10k|EN|MT|MIX
- (Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX
- (thu-coai/Safety-Prompts)|100k|CN|MT|MIX