https://github.com/hppRC/template-pytorch-lightning-hydra-mlflow-poetry

An easy to use ML template project using Pytorch-Lightning, Hydra, Mlflow, and Poetry.
https://github.com/hppRC/template-pytorch-lightning-hydra-mlflow-poetry

Last synced: about 7 hours ago
JSON representation

An easy to use ML template project using Pytorch-Lightning, Hydra, Mlflow, and Poetry.

• Host: GitHub
• URL: https://github.com/hppRC/template-pytorch-lightning-hydra-mlflow-poetry
• Owner: hppRC
• Created: 2021-07-23T06:59:49.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-07-23T07:00:00.000Z (over 3 years ago)
• Last Synced: 2024-11-10T04:03:27.710Z (2 days ago)
• Language: Python
• Homepage:
• Size: 185 KB
• Stars: 59
• Watchers: 3
• Forks: 8
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Template Pytorch-Lightning Hydra Mlflow Poetry

The code in this repository is based on [pytorch/examples](https://github.com/pytorch/examples/blob/2639cf050493df9d3cbf065d45e6025733add0f4/vae/main.py).

## Template Design

![An overview of this template](./.github/images/pytorch-template.001.png)

Configurations written in `yaml` are in `configs` directory.

You can easily overwrite these configurations through command line arguments.

## Instllation

```bash

poetry install

```

## Run Training

```bash

# single run with default settings

poetry run python main.py

# single run

poetry run python main.py gpus=[0,1,2,3] batch_size=128 trainer.accelerator=ddp trainer.precision=16 optimizer=sgd scheduler.step_size=1

# multi runs

poetry run python main.py -m optimizer=adam,rmsprop,sgd trainer.precision=16,32 scheduler.step_size=1

```

## Start Mlflow Server

```bash

poetry run mlflow ui

# access http://127.0.0.1:5000

```

## Run Formatter

```bash

poetry run pysen run format

```