https://github.com/rasbt/dora-from-scratch

LoRA and DoRA from Scratch Implementations
https://github.com/rasbt/dora-from-scratch

finetuning llm pytorch

Last synced: about 1 year ago
JSON representation

LoRA and DoRA from Scratch Implementations

• Host: GitHub
• URL: https://github.com/rasbt/dora-from-scratch
• Owner: rasbt
• License: mit
• Created: 2024-02-18T17:31:42.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-03-05T19:05:26.000Z (over 2 years ago)
• Last Synced: 2025-03-02T13:08:25.867Z (over 1 year ago)
• Topics: finetuning, llm, pytorch
• Language: Jupyter Notebook
• Homepage: https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch
• Size: 41 KB
• Stars: 196
• Watchers: 3
• Forks: 14
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# LoRA and DoRA From Scratch

LoRA and DoRA from Scratch implementations as supplementary material for the article [https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch](https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch).