An open API service indexing awesome lists of open source software.

https://github.com/enhuiz/pytorch-training-utilities

A set of PyTorch training utilities (WIP).
https://github.com/enhuiz/pytorch-training-utilities

Last synced: about 2 months ago
JSON representation

A set of PyTorch training utilities (WIP).

Awesome Lists containing this project

README

        

# PyTorch Training Utilities (WIP)

This is a collection of PyTorch training utilities that I am currently using. Please note that the interfaces may change frequently. If you have checked out the correct commit, you should not encounter any issues.

To run the training utility, use one of the following commands:

```
deepspeed .py
```

or

```
python .py
```

## Warning

- Be cautious when using the deepspeed branch to train GANs. The gradients of different engines must be properly managed, as the zero_grad function is not called before feedforward to support gradient accumulation.