Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/eljandoubi/copilot

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
https://github.com/eljandoubi/copilot

8bit-optimizer gradiio huggingface-accelerate huggingface-datasets huggingface-peft huggingface-transformers lion-optimizer paged-optimizer pytorch

Last synced: about 2 months ago
JSON representation

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.

Awesome Lists containing this project

README

        

# Copilot

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.

## Installation

### Remote
Follow the instructions in the notebook [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/eljandoubi/Copilot/blob/main/LightweightFineTuning.ipynb) to install and run the procedure.

### Lcoal
If you are trying this locally, follow these instructions first:

```bash
conda create -n "copilot" python=3.11

conda activate copilot

git clone https://github.com/eljandoubi/Copilot.git

cd Copilot

pip install -r requirements.txt

jupyter notebook
```