https://github.com/rasbt/gradient-accumulation-blog

Finetuning BLOOM on a single GPU using gradient-accumulation
https://github.com/rasbt/gradient-accumulation-blog

ai bloom deeplearning llm pytorch transformer

Last synced: about 1 year ago
JSON representation

Finetuning BLOOM on a single GPU using gradient-accumulation

• Host: GitHub
• URL: https://github.com/rasbt/gradient-accumulation-blog
• Owner: rasbt
• License: apache-2.0
• Created: 2023-03-21T23:36:00.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2023-03-29T14:53:19.000Z (about 3 years ago)
• Last Synced: 2025-03-30T22:11:09.524Z (about 1 year ago)
• Topics: ai, bloom, deeplearning, llm, pytorch, transformer
• Language: Python
• Homepage: https://sebastianraschka.com/blog/2023/llm-grad-accumulation.html
• Size: 17.6 KB
• Stars: 28
• Watchers: 2
• Forks: 3
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# gradient-accumulation-blog