{"id":30591885,"url":"https://github.com/ptrvilya/object-popup","last_synced_at":"2026-03-12T03:30:57.292Z","repository":{"id":198027555,"uuid":"630054253","full_name":"ptrvilya/object-popup","owner":"ptrvilya","description":"[CVPR'23] Method to infer objects from human interactions","archived":false,"fork":false,"pushed_at":"2025-05-30T07:05:50.000Z","size":8804,"stargazers_count":46,"open_issues_count":3,"forks_count":3,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-09-09T23:53:53.204Z","etag":null,"topics":["3d-human","cvpr","cvpr2023","cvpr23","human-object","human-object-interaction"],"latest_commit_sha":null,"homepage":"https://virtualhumans.mpi-inf.mpg.de/object_popup/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ptrvilya.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-04-19T15:12:11.000Z","updated_at":"2025-07-24T13:09:51.000Z","dependencies_parsed_at":"2023-10-04T04:19:57.629Z","dependency_job_id":null,"html_url":"https://github.com/ptrvilya/object-popup","commit_stats":null,"previous_names":["ptrvilya/object-popup"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ptrvilya/object-popup","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ptrvilya%2Fobject-popup","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ptrvilya%2Fobject-popup/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ptrvilya%2Fobject-popup/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ptrvilya%2Fobject-popup/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ptrvilya","download_url":"https://codeload.github.com/ptrvilya/object-popup/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ptrvilya%2Fobject-popup/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30414258,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-12T00:40:14.898Z","status":"online","status_checked_at":"2026-03-12T02:00:07.260Z","response_time":114,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["3d-human","cvpr","cvpr2023","cvpr23","human-object","human-object-interaction"],"created_at":"2025-08-29T17:41:20.120Z","updated_at":"2026-03-12T03:30:57.287Z","avatar_url":"https://github.com/ptrvilya.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003c!-- HEADER --\u003e\n\u003cp align=\"center\"\u003e\n    \u003ch1 align=\"center\"\u003eObject pop-up: Can we infer 3D objects and their poses from human interactions alone?\u003c/h1\u003e\n    \u003c!-- authors --\u003e\n    \u003cp align=\"center\"\u003e\n        \u003ca href=\"https://virtualhumans.mpi-inf.mpg.de/people/Petrov.html\"\u003e\u003cb\u003eIlya A. Petrov\u003c/b\u003e\u003c/a\u003e\n        \u0026emsp;\n        \u003ca href=\"https://riccardomarin.github.io/\"\u003e\u003cb\u003eRiccardo Marin\u003c/b\u003e\u003c/a\u003e\n        \u0026emsp;\n        \u003ca href=\"https://virtualhumans.mpi-inf.mpg.de/people/Chibane.html\"\u003e\u003cb\u003eJulian Chibane\u003c/b\u003e\u003c/a\u003e\n        \u0026emsp;\n        \u003ca href=\"https://virtualhumans.mpi-inf.mpg.de/people/pons-moll.html\"\u003e\u003cb\u003eGerard Pons-Moll\u003c/b\u003e\u003c/a\u003e\n    \u003c/p\u003e\n    \u003c!-- conference --\u003e\n    \u003ch3 align=\"center\"\u003eCVPR 2023\u003c/h3\u003e\n    \u003c!-- teaser --\u003e\n    \u003cp align=\"center\"\u003e\n        \u003cimg src=\"assets/petrov23popup.gif\" alt=\"Project Teaser\" width=\"600px\"\u003e\n    \u003c/p\u003e\n    \u003c!-- badges --\u003e\n    \u003cp align=\"center\"\u003e\n        \u003ca href=\"https://arxiv.org/abs/2306.00777\"\u003e\n            \u003cimg src=\"https://img.shields.io/badge/arXiv-2306.00777-b31b1b.svg?style=for-the-badge\" alt=\"Paper PDF\"\u003e\n        \u003c/a\u003e\n        \u0026emsp;\n        \u003ca href=\"https://virtualhumans.mpi-inf.mpg.de/object_popup/\"\u003e\n            \u003cimg src=\"https://img.shields.io/badge/Project-Page-blue?style=for-the-badge\u0026logo=Google%20chrome\u0026logoColor=white\" alt=\"Project Page\"\u003e\n        \u003c/a\u003e\n        \u0026emsp;\n        \u003ca href=\"https://youtu.be/buEz9ES-R_o\"\u003e\n            \u003cimg src=\"https://img.shields.io/badge/YouTube-video-black?style=for-the-badge\u0026logo=youtube\u0026logoColor=white\u0026labelColor=FF0000\u0026color=black\" alt=\"YouTube video\"\u003e\n        \u003c/a\u003e\n    \u003c/p\u003e\n\u003c/p\u003e\n\n\n## Environment\nThe code was tested under `Ubuntu 22.04, Python 3.10, CUDA 11.8, PyTorch 2.0.1`.\\\nUse the following command to create a conda environment with necessary dependencies:\n```bash\nconda env create -f environment.yml\n```\n\n\n## Data downloading and processing\nThe steps are described in [docs/data.md](./docs/data.md).\n\n\n## Pre-trained models and evaluation\nPre-trained models can be obtained from the [link](https://nc.mlcloud.uni-tuebingen.de/index.php/s/8H4EHmx9MA8sBEs). With the commands:\n```bash\nwget https://nc.mlcloud.uni-tuebingen.de/index.php/s/PG8wZ5HRKytEY8S/download/object_pop_up_noclass.tar -P ./assets \nwget https://nc.mlcloud.uni-tuebingen.de/index.php/s/Dfx9rfQ2tW4ZsEY/download/object_pop_up_class.tar -P ./assets\n```\n\nUse the following commands to run evaluation:\n```bash\n# model without class prediction (assumes 24GB GPU memory)\npython evaluate.py scenarios/gb_PNv2_noclass.toml -b 64 -w 20 -d grab behave -g -rc ./assets/object_pop_up_noclass.tar -c configs/smplh.toml\n# model with class prediction (assumes 24GB GPU memory)\npython evaluate.py scenarios/gb_PNv2_class.toml -b 64 -w 20 -d grab behave -g -rc ./assets/object_pop_up_class.tar -c configs/smplh.toml\n```\n\n\n## Training\nUse the following command to run the training:\n```bash\npython train.py scenarios/gb_PNv2_noclass.toml -b 32 -w 10 -nowb -ep 0001_smplh -c configs/smplh.toml\n```\n\n\n## Citation\n```bibtex\n@inproceedings{petrov2023popup,\n   title={Object pop-up: Can we infer 3D objects and their poses from human interactions alone?},\n   author={Petrov, Ilya A and Marin, Riccardo and Chibane, Julian and Pons-Moll, Gerard},\n   booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},\n   year={2023}\n}\n```\n\n\n## Acknowledgements\nThis project benefited from the following resources:\n* [BEHAVE](https://virtualhumans.mpi-inf.mpg.de/behave/license.html) and [GRAB](https://grab.is.tue.mpg.de/) datasets;\n* [grab](https://github.com/otaheri/GRAB) preprocessing code; \n* [smplx](https://github.com/vchoutas/smplx) repository: SMPL-X to SMPL+H conversion;\n* [PointNet v2 implementation](https://github.com/yanx27/Pointnet_Pointnet2_pytorch/): encoder model;\n* [blendify](https://github.com/ptrvilya/blendify/): all visualizations;\n* [blogpost](http://danshiebler.com/2016-09-14-parallel-progress-bar/): parallel map implementation.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fptrvilya%2Fobject-popup","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fptrvilya%2Fobject-popup","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fptrvilya%2Fobject-popup/lists"}