{"id":24396832,"url":"https://github.com/ai4ce/egopat3dv2","last_synced_at":"2026-02-02T12:03:14.489Z","repository":{"id":231619108,"uuid":"666233422","full_name":"ai4ce/EgoPAT3Dv2","owner":"ai4ce","description":"[ICRA 2024] Official Implementation of EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction","archived":false,"fork":false,"pushed_at":"2024-10-10T18:33:53.000Z","size":263836,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-22T20:43:39.633Z","etag":null,"topics":["computer-vision","dataset","egocentric-vision","human-robot-collaboration","human-robot-interaction","robotics"],"latest_commit_sha":null,"homepage":"https://ai4ce.github.io/EgoPAT3Dv2/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ai4ce.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-07-14T02:59:41.000Z","updated_at":"2025-03-23T12:41:39.000Z","dependencies_parsed_at":"2025-04-22T20:37:09.690Z","dependency_job_id":"d1c952cd-6e40-4172-a7b5-12eff246988c","html_url":"https://github.com/ai4ce/EgoPAT3Dv2","commit_stats":null,"previous_names":["ai4ce/egopat3dv2"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ai4ce/EgoPAT3Dv2","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ai4ce%2FEgoPAT3Dv2","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ai4ce%2FEgoPAT3Dv2/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ai4ce%2FEgoPAT3Dv2/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ai4ce%2FEgoPAT3Dv2/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ai4ce","download_url":"https://codeload.github.com/ai4ce/EgoPAT3Dv2/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ai4ce%2FEgoPAT3Dv2/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29012209,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-02T10:37:29.253Z","status":"ssl_error","status_checked_at":"2026-02-02T10:37:28.644Z","response_time":58,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","dataset","egocentric-vision","human-robot-collaboration","human-robot-interaction","robotics"],"created_at":"2025-01-19T21:58:39.201Z","updated_at":"2026-02-02T12:03:14.447Z","avatar_url":"https://github.com/ai4ce.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# [EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction](https://ai4ce.github.io/EgoPAT3Dv2/).\n\n[Irving Fang](https://irvingf7.github.io/)\\*, [Yuzhong Chen](https://github.com/yuzhongchen/)\\*, [Yifan Wang]()\\*, [Jianghan Zhang]()\\+, [Qiushi Zhang]()\\+, [Jiali Xu]()\\+, [Xibo He](), [Weibo Gao](), [Hao Su](), [Yiming Li](https://yimingli-page.github.io/), [Chen Feng](https://scholar.google.com/citations?user=YeG8ZM0AAAAJ)\n\n![](./figs/figure1_v2.jpg)\n## Project Website\nPlease visit [our project website](https://ai4ce.github.io/EgoPAT3Dv2/) for more information, such as a **video presentation**.\n\n\n## Environment Setup\nThe project was developed on `Python 3.11.5` and `PyTorch 2.1.1` with `CUDA 11.8.0` binaries. For more details about the required packages, please take a look at `requirements.txt`\n\n\n## Dataset\nPlease visit our [Hugging Face repo](https://huggingface.co/datasets/ai4ce/EgoPAT3Dv2/tree/main) to access and prepare the dataset.\n\n## Training\nWe used the configuration files in `configs` to control the hyperparameters during our experiments. For more details on the hyperparameters, please refer to the [README](./configs/README.md) for configuration files.\n\nTo train a model with specified hyperparameters, please run\n```\npython train_DDP.py --config_file [your configuration file]\n```\n\n**Note:** Our training code is written for distributed training on NYU HPC with `PyTorch DDP` and `singularity` container. Please modify the `train_DDP.py` code to suit your needs. You can refer to the `train.SBATCH` file for more info on our distributed training setup.\n\n## Testing\nWe used the configuration files in `configs` to control the hyperparameters during our experiments. For more details on the hyperparameters, please refer to the [README](./configs/README.md) for configuration files.\n\nTo test a model with specified hyperparameters, please run\n```\npython test_DDP.py --config_file [your configuration file]\n```\n\n**Note:** Slightly different from the training code, our testing code is written for single-card inference. Similarly, you can check out the `test.SBATCH` file for more info on our HPC testing setup.\n\n### Testing Results Visualization\nTo produce aggregated results similar to what's presented in Table I of the paper, please run\n```\npython eval.py --model_name [model name in the config file]\n```\n\nYou can also use the `--mode` parameter to dictate whether the test results are created for the seen or unseen test set.\n\n**Note:** We are currently updating this file.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fai4ce%2Fegopat3dv2","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fai4ce%2Fegopat3dv2","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fai4ce%2Fegopat3dv2/lists"}