An open API service indexing awesome lists of open source software.

https://github.com/glavin001/llm-trainer

Training/Fine-Tuning Large Language Models
https://github.com/glavin001/llm-trainer

Last synced: about 1 month ago
JSON representation

Training/Fine-Tuning Large Language Models

Awesome Lists containing this project

README

        

# LLM Trainer

> Training/Fine-Tuning Large Language Models

Login to Docker:

```bash
sudo docker login
```

Pull existing Docker image to warm build cache:

```bash
sudo docker pull glavin001/llm-trainer:may-28-433
```

Build & start container with Jupyter labs/notebook:

```bash
sudo docker compose up --build
```

If you see error:
> tornado.web.HTTPError: HTTP 403: Forbidden

Then stop the docker container and retry.

Login to Weights and Biases:

```bash
wandb login -u USERNAME
```

```bash
./scripts/train.sh
```