Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/huggingface/nanotron
Minimalistic large language model 3D-parallelism training
https://github.com/huggingface/nanotron
Last synced: about 2 months ago
JSON representation
Minimalistic large language model 3D-parallelism training
- Host: GitHub
- URL: https://github.com/huggingface/nanotron
- Owner: huggingface
- License: apache-2.0
- Created: 2023-09-11T14:40:28.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-22T18:27:33.000Z (5 months ago)
- Last Synced: 2024-04-23T00:12:52.622Z (5 months ago)
- Language: Python
- Homepage:
- Size: 11.7 MB
- Stars: 777
- Watchers: 43
- Forks: 53
- Open Issues: 38
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-local-ai - Nanotron - Minimalistic large language model 3D-parallelism training. (Training)
- awesome-production-machine-learning - Nanotron - Nanotron provides distributed primitives to train a variety of models efficiently using 3D parallelism. (Training Orchestration)