Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kamo-naoyuki/ptmod
A Command line utility to modify serialized PyTorch model states.
https://github.com/kamo-naoyuki/ptmod
dnn pytorch
Last synced: about 1 month ago
JSON representation
A Command line utility to modify serialized PyTorch model states.
- Host: GitHub
- URL: https://github.com/kamo-naoyuki/ptmod
- Owner: kamo-naoyuki
- License: mit
- Created: 2020-10-01T15:59:26.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2020-11-14T17:57:42.000Z (almost 4 years ago)
- Last Synced: 2024-04-23T23:46:38.243Z (7 months ago)
- Topics: dnn, pytorch
- Language: Python
- Homepage:
- Size: 32.2 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# ptmod: Modify PyTorch model
A Command line utility to modify serialized PyTorch model states.
## Install
```sh
pip install ptmod
```
## The definition of pytorch model file
In the context of this text, a model file should be a serialized `state_dict` object. See for mote detail: https://pytorch.org/docs/stable/notes/serialization.html
```python
# e.g.
import torch
class Block(torch.nn.Module):
def __init__(self):
super().__init__()
self.layer1 = torch.nn.Linear(10, 10)
self.layer2 = torch.nn.Linear(10, 10)
class Model(torch.nn.Module):
def __init__(self):
super().__init__()
self.block1 = Block()
self.block2 = Block()
model = Model()
torch.save(model.state_dict(), "model.pth")
```
## Show the contents in a model file
### Usage
```
ptmod-ls model.pth
# OR
ptmod "ls model.pth"
```
### Example
```sh
% ptmod "ls model.pth"
block1.layer1.weight
block1.layer1.bias
block1.layer2.weight
block1.layer2.bias
block2.layer1.weight
block2.layer1.bias
block2.layer2.weight
block2.layer2.bias
```
```sh
% ptmod "ls -l model.pth"
block1.layer1.weight (10, 10)
block1.layer1.bias (10,)
block1.layer2.weight (10, 10)
block1.layer2.bias (10,)
block2.layer1.weight (10, 10)
block2.layer1.bias (10,)
block2.layer2.weight (10, 10)
block2.layer2.bias (10,)
```
## Copy parameters
### Usage
```
ptmod-cp model.pth:key out.pth:key2
# OR
ptmod "cp model.pth:key out.pth:key2"
```
### Example
```sh
% ptmod "cp model.pth:block1 out.pth" "ls out.pth"
layer1.weight
layer1.bias
layer2.weight
layer2.bias
```
```sh
% ptmod "cp model.pth:block1 out.pth:foo" "ls out.pth"
foo.layer1.weight
foo.layer1.bias
foo.layer2.weight
foo.layer2.bias
```
## Remove parameters
### Usage
```
ptmod-rm model.pth:key
# OR
ptmod "rm model.pth:key"
```
### Example
```sh
% ptmod "cp model.pth out.pth" "rm out.pth:block1" "ls out.pth"
block2.layer1.weight
block2.layer1.bias
block2.layer2.weight
block2.layer2.bias
```
```sh
% ptmod "cp model.pth out.pth" "rm out.pth:block2.layer2" "ls out.pth"
block2.layer1.weight
block2.layer1.bias
block1.layer1.weight
block1.layer1.bias
block1.layer2.weight
block1.layer2.bias
```
## Sum/Average parameters
### Usage
```
ptmod-average out.pth model1.pth model2.pth ...
# OR
ptmod "average out.pth model1.pth model2.pth ...
```
### Example
```sh
% ptmod "average out.pth model1.pth model2.pth"
```
```sh
% ptmod "sum out.pth model1.pth model2.pth"
```