https://github.com/ashawkey/InTeX

Interactive Text-to-Texture Synthesis via Unified Depth-aware Inpainting.
https://github.com/ashawkey/InTeX

interactive text-to-texture

Last synced: 29 days ago
JSON representation

Interactive Text-to-Texture Synthesis via Unified Depth-aware Inpainting.

• Host: GitHub
• URL: https://github.com/ashawkey/InTeX
• Owner: ashawkey
• Created: 2023-08-18T02:31:24.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-03-19T08:30:25.000Z (9 months ago)
• Last Synced: 2024-07-08T06:01:47.065Z (5 months ago)
• Topics: interactive, text-to-texture
• Language: Python
• Homepage: https://me.kiui.moe/intex/
• Size: 2.7 MB
• Stars: 182
• Watchers: 7
• Forks: 6
• Open Issues: 7
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

• ai-game-devtools - InteX - to-Texture Synthesis via Unified Depth-aware Inpainting. |[arXiv](https://arxiv.org/abs/2403.11878) | | Texture | (<span id="texture">Texture</span> / <span id="tool">Tool (AI LLM)</span>)

README

        
# InteX

This repository contains the official implementation for *InteX: Interactive Text-to-Texture Synthesis via Unified Depth-aware Inpainting*.

### [Project Page](https://me.kiui.moe/intex/) | [Arxiv](https://arxiv.org/abs/2403.11878)

![teaser](assets/teaser.jpg)

### Install

```bash

pip install -r requirements.txt

# nvdiffrast

pip install git+https://github.com/NVlabs/nvdiffrast/

```

### Usage

```bash

### generate texture for a mesh based on a prompt (command line), output will be saved to ./logs

# please check ./configs/revani.yaml for each parameter's meaning

python main.py --config configs/revani.yaml mesh=data/dragon.glb prompt="a red pet dragon with fire patterns" save_path=dragon_fire.glb text_dir=True

### open local GUI for interactive editing

python main.py --config configs/revani.yaml mesh=data/dragon.glb prompt="a red pet dragon with fire patterns" save_path=dragon_fire.glb text_dir=True gui=True

### simple web GUI with gradio

python app.py

```

Please check `./scripts` for more examples.

### Acknowledgement

This work is built on many amazing research works and open-source projects, thanks a lot to all the authors for sharing!

- [nvdiffrast](https://github.com/NVlabs/nvdiffrast)

- [dearpygui](https://github.com/hoffstadt/DearPyGui)

### Citation

```

@article{tang2024intex,

  title={InTeX: Interactive Text-to-Texture Synthesis via Unified Depth-aware Inpainting},

  author={Tang, Jiaxiang and Lu, Ruijie and Chen, Xiaokang and Wen, Xiang and Zeng, Gang and Liu, Ziwei},

  journal={arXiv preprint arXiv:2403.11878},

  year={2024}

}

```