https://github.com/yyong119/im2cad
Unofficial code for IM2CAD
https://github.com/yyong119/im2cad
deep-learning im2cad lsun tensorflow
Last synced: about 2 months ago
JSON representation
Unofficial code for IM2CAD
- Host: GitHub
- URL: https://github.com/yyong119/im2cad
- Owner: yyong119
- License: mit
- Created: 2018-01-26T05:12:35.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2018-03-01T04:51:00.000Z (over 7 years ago)
- Last Synced: 2025-02-25T12:04:52.914Z (4 months ago)
- Topics: deep-learning, im2cad, lsun, tensorflow
- Language: Python
- Homepage:
- Size: 15.6 KB
- Stars: 24
- Watchers: 2
- Forks: 7
- Open Issues: 2
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
# IM2CAD
It's a repository trying to achieve the idea in paper IM2CAD. The main goal of this paper is to reconstruct a scene that is similar to the given photo of a room.
## Datasets used in the paper
- LSUN is needed in pixel-level labeling task to estimate the room geometry.
- imagenet2012 dataset is used to detect the objects in the room(pre-trained model was used in the paper).
- ShapeNet 3D models are the objects will appear in the reconstructed scene. (an account may needed to download data)
## Main Process to achieve the result
#### Room geometry estimation
The lsun indoor dataset can be downloaded from the above link, or you can fork the official GitHub repository lsun and follow the instructions there.
The FCN is modified from the repo FCN.tensorflow. Note: The format of lsun indoor dataset is different a bit from the ADEChallengeData2016 dataset which is used in the origin repository.
To train the network, just running the following command:
```shell
python FCN.py --mode=train
```
It can also visualize the part of results by replacing the "train" with "visualize".
#### Object detection
According to the paper, the Faster-RCNN is used to detect the objects occured in the indoor scene.