{"id":13563051,"url":"https://github.com/bytedance/ImageDream","last_synced_at":"2025-04-03T19:32:23.724Z","repository":{"id":213419337,"uuid":"731333742","full_name":"bytedance/ImageDream","owner":"bytedance","description":"The code releasing for https://image-dream.github.io/","archived":false,"fork":false,"pushed_at":"2024-01-27T19:33:26.000Z","size":18109,"stargazers_count":764,"open_issues_count":20,"forks_count":34,"subscribers_count":9,"default_branch":"main","last_synced_at":"2025-03-27T19:17:03.642Z","etag":null,"topics":["research"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bytedance.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-13T21:09:37.000Z","updated_at":"2025-03-21T22:02:53.000Z","dependencies_parsed_at":"2024-08-01T13:29:02.009Z","dependency_job_id":null,"html_url":"https://github.com/bytedance/ImageDream","commit_stats":null,"previous_names":["bytedance/imagedream"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FImageDream","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FImageDream/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FImageDream/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FImageDream/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bytedance","download_url":"https://codeload.github.com/bytedance/ImageDream/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247065407,"owners_count":20877769,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["research"],"created_at":"2024-08-01T13:01:14.655Z","updated_at":"2025-04-03T19:32:20.719Z","avatar_url":"https://github.com/bytedance.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# ImageDream Reconstruction\nPeng Wang, Yichun Shi\n\n[Project Page](https://image-dream.github.io/) | [Paper](https://arxiv.org/abs/2312.02201) | [Demo]()\n\n[imagedream-threestudio-teaser](https://github.com/bytedance/ImageDream/assets/146033206/bcf67b1a-38f9-42cf-81df-b8b2f4fa007f)\n\n## Installation \n\nThis part is the same as original [MVDream-threestudio](https://github.com/bytedance/MVDream-threestudio). Skip it if you already have installed the environment.\n\n\n## Quickstart\nClone the modelcard on the [Huggingface ImageDream Model Page](https://huggingface.co/Peng-Wang/ImageDream/) under ```./extern/ImageDream/release_models/```\n\nIn the paper, we use the configuration with soft-shading. It would need an A100 GPU in most cases to compute normal:\n```sh\nexport PYTHONPATH=$PYTHONPATH:./extern/ImageDream\nimage_file=\"./extern/ImageDream/assets/astronaut.png\"\nckpt_file=\"./extern/ImageDream/release_models/ImageDream/sd-v2.1-base-4view-ipmv.pt\"\ncfg_file=\"./extern/ImageDream/imagedream/configs/sd_v2_base_ipmv.yaml\"\n\npython3 launch.py \\\n    --config configs/$method.yaml --train --gpu 0 \\\n    name=\"imagedream-sd21-shading\" tag=\"astronaut\" \\\n    system.prompt_processor.prompt=\"an astronaut riding a horse\" \\\n    system.prompt_processor.image_path=\"${image_file}\" \\\n    system.guidance.ckpt_path=\"${ckpt_file}\" \\\n    system.guidance.config_path=\"${cfg_file}\"\n```\n\n***For diffusion only model, refer to subdir*** ```./extern/ImageDream/```\n***Check*** ```./threestudio/scripts/run_imagedream.sh``` ***for a bash example.***\n\n\n## Credits\n- This code is forked from [threestudio](https://github.com/threestudio-project/threestudio) and [MVDream](https://github.com/bytedance/MVDream-threestudi) for SDS and 3D Generation.\n\n## Tips\n1. Place the object in the center and do not make it too large/small in the image.\n2. If you have an object cutting image edge, in config, tuning the parameters range of elevation and fov to be a larger range, e.g. ```[0, 30]```, otherwise, you may do image outpainting and follow tips 1.\n3. Check the results with ImageDream diffusion model before using it in 3D rendering to save time.\n\n## PreComputed Results\n- Since there is some randomness in diffusion model and time costly to get baseline results. We put our pre-computed results for reproducing Tab.1 in the paper in a [hugging face dataset card](https://huggingface.co/datasets/Peng-Wang/ImageDream)\n\n\n## Citing\nIf you find ImageDream helpful, please consider citing:\n\n``` bibtex\n@article{wang2023imagedream,\n  title={ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation},\n  author={Wang, Peng and Shi, Yichun},\n  journal={arXiv preprint arXiv:2312.02201},\n  year={2023}\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbytedance%2FImageDream","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbytedance%2FImageDream","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbytedance%2FImageDream/lists"}