awesome-open-foundation-models

Open foundation models, such LLama2, ChatGLM, etc.
https://github.com/wgwang/awesome-open-foundation-models

Last synced: 2 days ago
JSON representation

开源开放的基础大模型列表
- QWen-1.5-110B - 04-24||
- The Pile
- Gemma-1 - 02-20|终端设备|
- LLaMA-3 - 04-18||
- DBRX - 03-27|MOE 36B/132B, 4/16experts|
- ChatGLM3 - 10-25|
- Aquila2
- Deepseek Coder
- DeepSeek-V2 - 05-06|MoE 21B/236B，160Experts，2Activate|
- Yi-1.5 - 05-13|零一万物，在Yi之上用了500B 语料增量训练得到|
- Hunyuan-DiT - 05-13|腾讯混元文生图|
- Arctic - 04-22|Dense(10B)-MoE(128X3.66B), 17B/480B，3阶段训练，1T+1.5T+1T tokens|
- Grok-1 - 03-17|MoE 8 Expert|
- InternLM2 - 09-18|
模型架构
- LLaMA
- GPTQ

Programming Languages

Categories

开源开放的基础大模型列表 14 模型架构 2

Sub Categories

Keywords

llm 2 rlhf 1 pretrained-models 1 long-context 1 large-language-model 1 gpt 1 flash-attention 1 fine-tuning-llm 1 chinese 1 chatbot 1 llm-training 1 llm-inference 1