Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/eljandoubi/copilot
Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
https://github.com/eljandoubi/copilot
8bit-optimizer gradiio huggingface-accelerate huggingface-datasets huggingface-peft huggingface-transformers lion-optimizer paged-optimizer pytorch
Last synced: about 2 months ago
JSON representation
Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
- Host: GitHub
- URL: https://github.com/eljandoubi/copilot
- Owner: eljandoubi
- License: apache-2.0
- Created: 2024-02-01T12:03:17.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-02-05T18:32:52.000Z (11 months ago)
- Last Synced: 2024-04-17T15:09:15.244Z (9 months ago)
- Topics: 8bit-optimizer, gradiio, huggingface-accelerate, huggingface-datasets, huggingface-peft, huggingface-transformers, lion-optimizer, paged-optimizer, pytorch
- Language: Jupyter Notebook
- Homepage:
- Size: 241 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Copilot
Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
## Installation
### Remote
Follow the instructions in the notebook [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/eljandoubi/Copilot/blob/main/LightweightFineTuning.ipynb) to install and run the procedure.### Lcoal
If you are trying this locally, follow these instructions first:```bash
conda create -n "copilot" python=3.11conda activate copilot
git clone https://github.com/eljandoubi/Copilot.git
cd Copilot
pip install -r requirements.txt
jupyter notebook
```