https://github.com/allenai/OLMoE

OLMoE: Open Mixture-of-Experts Language Models
https://github.com/allenai/OLMoE

Last synced: 3 months ago
JSON representation

OLMoE: Open Mixture-of-Experts Language Models

• Host: GitHub
• URL: https://github.com/allenai/OLMoE
• Owner: allenai
• License: apache-2.0
• Created: 2024-06-22T21:56:46.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-10-23T23:32:02.000Z (3 months ago)
• Last Synced: 2024-10-24T11:49:30.888Z (3 months ago)
• Language: Jupyter Notebook
• Homepage: https://arxiv.org/abs/2409.02060
• Size: 59.7 MB
• Stars: 419
• Watchers: 10
• Forks: 32
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• StarryDivineSky - allenai/OLMoE - of-Expert 语言模型。完全开放、最先进的 Expert 模型混合，具有 13 亿个有效参数和 69 亿个总参数。所有数据、代码和日志均已发布。 (A01_文本生成_文本对话 / 大语言对话模型及数据)