https://github.com/xunge/pytorch_lmdb_imagenet

Use lmdb to speed up imagenet dataset
https://github.com/xunge/pytorch_lmdb_imagenet

imagenet lmdb pytorch

Last synced: 5 months ago
JSON representation

Use lmdb to speed up imagenet dataset

• Host: GitHub
• URL: https://github.com/xunge/pytorch_lmdb_imagenet
• Owner: xunge
• License: gpl-3.0
• Created: 2019-10-22T13:04:20.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2021-04-09T07:42:13.000Z (over 4 years ago)
• Last Synced: 2024-08-04T03:09:33.686Z (about 1 year ago)
• Topics: imagenet, lmdb, pytorch
• Language: Python
• Size: 25.4 KB
• Stars: 93
• Watchers: 2
• Forks: 17
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

          
## pytorch_lmdb_imagenet

Convert ImageNet dataset to lmdb, adapted from [https://github.com/Lyken17/Efficient-PyTorch](https://github.com/Lyken17/Efficient-PyTorch)

1. Change Imagenet train set and val set to lmdb

```

python folder2lmdb.py

```

2. Test the dataset

```

python dataset_test.py

```

3. Train Imagenet

```

python train_imagenet.py /path/to/dataset/imagenet/  --lmdb

```