Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/JunukCha/Text2HOI
Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction
https://github.com/JunukCha/Text2HOI
Last synced: about 1 month ago
JSON representation
Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction
- Host: GitHub
- URL: https://github.com/JunukCha/Text2HOI
- Owner: JunukCha
- License: mit
- Created: 2024-03-28T17:01:26.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-06-11T04:15:46.000Z (3 months ago)
- Last Synced: 2024-07-19T11:53:21.591Z (about 2 months ago)
- Language: Python
- Size: 62.5 KB
- Stars: 30
- Watchers: 4
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- arctic - Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction
README
# Text2HOI
Official code of Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction in CVPR 2024
[Arxiv paper](https://arxiv.org/pdf/2404.00562v2.pdf) / [Project page](.)
## Data
### H2O
[Donwload](https://h2odataset.ethz.ch/).
### GRAB
[Donwload](https://grab.is.tue.mpg.de/index.html).
### ARCTIC
[Donwload](https://github.com/zc-alexfan/arctic/blob/master/docs/data/README.md#download-full-arctic).
### MANO
[Donwload](https://mano.is.tue.mpg.de/).
### Object pickle file
[Download](https://drive.google.com/drive/folders/1-bnfGdKPb-iqkjrO7kIJe72BmqUqDzyI?usp=sharing)
```
data
├─ h2o
│ ├─ obj.pkl
│ └─ object
│ ├─ book
│ ├─ cappuccino
│ ├─ chips
│ ├─ cocoa
│ ├─ espresso
│ ├─ lotion
│ ├─ milk
│ └─ spray
|
├─ grab
│ ├─ obj.pkl
│ ├─ processed_object_meshes
│ └─ contact_meshes
│ ├─ airplane.ply
│ ├─ alarmclock.ply
│ ├─ apple.ply
│ ├─ banana.ply
│ ...
|
├─ arctic
│ ├─ obj.pkl
│ └─ downloads/data/meta/object_vtemplates
│ ├─ box
│ ├─ capsulemachine
│ ├─ espressomachine
│ ├─ ketchup
│ ...
│
└─ mano
└─ mano_v1_2
└─ models
├─ info.txt
├─ LICENSE.txt
├─ MANO_LEFT.pkl
└─ MANO_RIGHT.pkl
```
### Preprocessing GRAB object
GRAB objects have so many vertiecs. So we reduce the number of vertices to 4,000.
```
python preprocessing_grab_object.py
```
## Checkpoints
[Download](https://drive.google.com/drive/folders/1bfYF94-dVy-mA0n4cIRb_wI4ohPC6KK5?usp=sharing)
```
checkpoints
├─ h2o
├─ grab
└─ arctic
```
## Installation
```
source scripts/install.sh
```
## Demo
```
source scripts/install.sh
```
## For Future Work
[Text description for Arctic](https://drive.google.com/file/d/18AtaBpQa9Z9pnQTkjObgOHjSSijT59gz/view?usp=sharing)