Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/transmissions11/bistro
Opinionated GPT implementation and finetuning harness.
https://github.com/transmissions11/bistro
Last synced: 3 months ago
JSON representation
Opinionated GPT implementation and finetuning harness.
- Host: GitHub
- URL: https://github.com/transmissions11/bistro
- Owner: transmissions11
- License: apache-2.0
- Created: 2023-08-08T00:04:46.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-22T08:33:20.000Z (8 months ago)
- Last Synced: 2024-05-23T02:16:25.414Z (8 months ago)
- Language: Python
- Homepage:
- Size: 247 MB
- Stars: 5
- Watchers: 2
- Forks: 0
- Open Issues: 10
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# bistro
Opinionated GPT implementation and finetuning harness.
## Installation
Cloning the repo:
```sh
git clone [email protected]:transmissions11/bistro.git
cd bistro
```
Installing dependencies:
```sh
pip install -r requirements.txt
```
Downloading and setting up a base model:
```sh
python lit_script.py download --repo_id lmsys/vicuna-7b-v1.5
python lit_script.py convert_hf_checkpoint --checkpoint_dir checkpoints/lmsys/vicuna-7b-v1.5 --dtype bfloat16
```
_(Optional)_ Use Flash Attention 2 (only available in PyTorch 2.2)
```bash
pip uninstall -y torch torchvision torchaudio torchtext
pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu121
```
See [lit-gpt's setup guide](https://github.com/Lightning-AI/lit-gpt#setup) for additional info.
## Acknowledgements
Built on [lit-gpt](https://github.com/Lightning-AI/lit-gpt).