https://github.com/timelesshc/codellama-nl2sql
Fine tune codellama-7b-hf to achieve natural language to SQL ability
https://github.com/timelesshc/codellama-nl2sql
codellama deepspeed fine-tuning lora nl2sql python text2sql
Last synced: 7 months ago
JSON representation
Fine tune codellama-7b-hf to achieve natural language to SQL ability
- Host: GitHub
- URL: https://github.com/timelesshc/codellama-nl2sql
- Owner: timelesshc
- Created: 2024-09-12T04:13:43.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-09-13T09:01:44.000Z (about 1 year ago)
- Last Synced: 2025-01-15T19:34:35.413Z (9 months ago)
- Topics: codellama, deepspeed, fine-tuning, lora, nl2sql, python, text2sql
- Language: Python
- Homepage:
- Size: 3.96 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Text2SQL on CodeLlama 7B
Use LoRA to fine tune codellama-7b-hf to achieve natural language to SQL ability. Deepspeed is also used in this project.
## Technologies Used
- LoRA
- DeepSpeed
## Run the Code
Download codellama-7b model and save to `codellama-7b-hf` folder.
Run command:
```
deepspeed code_llama_finetune.py
```
## Test Result
Run command:
```
python final_test.py
```
## Result
The final SQL execution accuracy is >70%