{"id":13445092,"url":"https://fanegg.github.io/UV-Volumes/","last_synced_at":"2025-03-20T19:31:36.294Z","repository":{"id":46215692,"uuid":"474788985","full_name":"fanegg/UV-Volumes","owner":"fanegg","description":"[CVPR 2023] UV Volumes for Real-time Rendering of Editable Free-view Human Performance","archived":false,"fork":false,"pushed_at":"2024-03-06T12:34:46.000Z","size":54970,"stargazers_count":140,"open_issues_count":6,"forks_count":8,"subscribers_count":21,"default_branch":"main","last_synced_at":"2024-08-03T22:04:36.374Z","etag":null,"topics":["avatar","nerf"],"latest_commit_sha":null,"homepage":"https://fanegg.github.io/UV-Volumes","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fanegg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2022-03-27T23:54:54.000Z","updated_at":"2024-07-30T21:16:07.000Z","dependencies_parsed_at":"2024-01-18T18:12:16.079Z","dependency_job_id":"b06ca6e1-90de-4157-9105-b966b8bfd58c","html_url":"https://github.com/fanegg/UV-Volumes","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fanegg%2FUV-Volumes","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fanegg%2FUV-Volumes/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fanegg%2FUV-Volumes/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fanegg%2FUV-Volumes/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fanegg","download_url":"https://codeload.github.com/fanegg/UV-Volumes/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221800051,"owners_count":16882469,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["avatar","nerf"],"created_at":"2024-07-31T04:01:49.650Z","updated_at":"2024-10-28T07:30:25.128Z","avatar_url":"https://github.com/fanegg.png","language":"Python","funding_links":[],"categories":["Papers","Uncategorized","Tools, Pipeline \u0026 Utilities"],"sub_categories":["Uncategorized","Gaussian Splatting \u0026 NeRF"],"readme":"# UV Volumes for Real-time Rendering of Editable Free-view Human Performance\n**[Project Page](https://fanegg.github.io/UV-Volumes) | [Paper](https://openaccess.thecvf.com/content/CVPR2023/papers/Chen_UV_Volumes_for_Real-Time_Rendering_of_Editable_Free-View_Human_Performance_CVPR_2023_paper.pdf) | [Latest arXiv](https://arxiv.org/pdf/2203.14402.pdf) | [Supplementary](https://openaccess.thecvf.com/content/CVPR2023/supplemental/Chen_UV_Volumes_for_CVPR_2023_supplemental.pdf)**\n\n\u003e UV Volumes for Real-time Rendering of Editable Free-view Human Performance  \n\u003e [Yue Chen*](https://scholar.google.com/citations?user=M2hq1_UAAAAJ\u0026hl=en), [Xuan Wang*](https://scholar.google.com/citations?user=h-3xd3EAAAAJ\u0026hl=en), [Xingyu Chen](https://scholar.google.com/citations?user=gDHPrWEAAAAJ\u0026hl=en), [Qi Zhang](https://scholar.google.com/citations?user=2vFjhHMAAAAJ\u0026hl=en), [Xiaoyu Li](https://scholar.google.com/citations?user=Dt0PcAYAAAAJ\u0026hl=en), [Yu Guo†](https://scholar.google.com/citations?user=OemeiSIAAAAJ\u0026hl=en), [Jue Wang](https://scholar.google.com/citations?user=Bt4uDWMAAAAJ\u0026hl=en), [Fei Wang](https://scholar.google.com/citations?user=uU2JTpUAAAAJ\u0026hl=en)  \n\u003e (* equal contribution，† corresponding author)  \n\u003e CVPR 2023\n\n[![UV Volumes for Real-time Rendering of Editable Free-view Human Performance](https://res.cloudinary.com/marcomontalbano/image/upload/v1678176939/video_to_markdown/images/youtube--JftQnXLMmPc-c05b58ac6eb4c4700831b2b3070cd403.jpg)](https://youtu.be/JftQnXLMmPc \"UV Volumes for Real-time Rendering of Editable Free-view Human Performance\")\n\nThis repository is an official implementation of [UV-Volumes](https://fanegg.github.io/UV-Volumes) using [pytorch](https://pytorch.org/).\n\n## Installation\n\nPlease see [INSTALL.md](INSTALL.md) for manual installation.\n\n## Run the code on ZJU-MoCap\n\nPlease see [INSTALL.md](INSTALL.md) to download the dataset.\n\n\u003c!-- We provide the pretrained models at [here](https://). --\u003e\n\n### Training on ZJU-MoCap\n\nTake the training on `sequence 313` as an example.\n\n```\npython3 train_net.py --cfg_file configs/zju_mocap_exp/313.yaml exp_name zju313 resume False output_depth True\n```\nYou can monitor the training process by Tensorboard.\n```\ntensorboard --logdir data/record/UVvolume_ZJU\n```\n\n### Test on ZJU-MoCap\n\nTake the test on `sequence 313` as an example.\n\n\u003c!-- 1. Download the corresponding pretrained model and put it to `$ROOT/data/trained_model/UVvolume_ZJU/zju313/latest.pth`. --\u003e\n\n```\npython3 run.py --type evaluate --cfg_file configs/zju_mocap_exp/313.yaml exp_name zju313 use_lpips True test.frame_sampler_interval 1 use_nb_mask_at_box True save_img True T_threshold 0.75 \n```\n\n\n## Run the code on CMU Panoptic\n\nPlease see [INSTALL.md](INSTALL.md) to download and process the dataset.\n\n\u003c!-- We provide the pretrained models at [here](https://). --\u003e\n\n### Training on CMU Panoptic\n\nTake the training on `171204_pose4_sample6` as an example.\n\n```\npython3 train_net.py --cfg_file configs/cmu_exp/p4s6.yaml exp_name p4s6 resume False output_depth True\n```\nYou can monitor the training process by Tensorboard.\n```\ntensorboard --logdir data/record/UVvolume_CMU\n```\n\n### Test on CMU Panoptic\n\nTake the test on `171204_pose4_sample6` as an example.\n\n\u003c!-- 1. Download the corresponding pretrained model and put it to `$ROOT/data/trained_model/UVvolume_CMU/p4s6/latest.pth`. --\u003e\n\n```\npython3 run.py --type evaluate --cfg_file configs/cmu_exp/p4s6.yaml exp_name p4s6 use_lpips True test.frame_sampler_interval 1 use_nb_mask_at_box True save_img True\n```\n\n\n## Citation\n\nIf you find this code useful for your research, please use the following BibTeX entry.\n\n```bibtex\n@inproceedings{chen2023uv,\n  title={UV Volumes for real-time rendering of editable free-view human performance},\n  author={Chen, Yue and Wang, Xuan and Chen, Xingyu and Zhang, Qi and Li, Xiaoyu and Guo, Yu and Wang, Jue and Wang, Fei},\n  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},\n  pages={16621--16631},\n  year={2023}\n}\n```\n\n\n## Acknowledge\nOur code is based on the awesome pytorch implementation of [NeuralBody](https://github.com/zju3dv/neuralbody). We appreciate all the contributors.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/fanegg.github.io%2FUV-Volumes%2F","html_url":"https://awesome.ecosyste.ms/projects/fanegg.github.io%2FUV-Volumes%2F","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/fanegg.github.io%2FUV-Volumes%2F/lists"}