https://github.com/rasbt/dora-from-scratch

LoRA and DoRA from Scratch Implementations
https://github.com/rasbt/dora-from-scratch

finetuning llm pytorch

Last synced: 1 day ago
JSON representation

LoRA and DoRA from Scratch Implementations

• Host: GitHub
• URL: https://github.com/rasbt/dora-from-scratch
• Owner: rasbt
• License: mit
• Created: 2024-02-18T17:31:42.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-03-05T19:05:26.000Z (9 months ago)
• Last Synced: 2024-11-07T19:51:13.416Z (9 days ago)
• Topics: finetuning, llm, pytorch
• Language: Jupyter Notebook
• Homepage: https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch
• Size: 41 KB
• Stars: 188
• Watchers: 3
• Forks: 13
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LoRA and DoRA From Scratch

LoRA and DoRA from Scratch implementations as supplementary material for the article [https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch](https://magazine.sebastianraschka.com/p/lora-and-dora-from-scratch).