https://github.com/aniketrajnish/text-to-material-unity

Generate materials from text prompts in Unity
https://github.com/aniketrajnish/text-to-material-unity

chatgpt chatgpt-api dall-e dalle dalle-2 dalle-3 dalle-api generative-ai generative-art gpt-3 gpt-4 openai openai-api unity unity-tool unity3d

Last synced: 3 months ago
JSON representation

Generate materials from text prompts in Unity

• Host: GitHub
• URL: https://github.com/aniketrajnish/text-to-material-unity
• Owner: aniketrajnish
• License: mit
• Created: 2023-12-27T17:56:28.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-03-06T07:06:49.000Z (11 months ago)
• Last Synced: 2024-05-21T06:50:40.022Z (9 months ago)
• Topics: chatgpt, chatgpt-api, dall-e, dalle, dalle-2, dalle-3, dalle-api, generative-ai, generative-art, gpt-3, gpt-4, openai, openai-api, unity, unity-tool, unity3d
• Language: C#
• Homepage:
• Size: 2.05 MB
• Stars: 69
• Watchers: 4
• Forks: 8
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Text-To-Material-Unity

Generate materials from text prompts in Unity. Uses `chatgpt` and `dall-e` models.

 ![placeholder_t2m](https://github.com/aniketrajnish/Text-To-Material-Unity/assets/58925008/865d1290-4e04-4f8d-b56a-112dc7bc50bf)

https://github.com/aniketrajnish/Text-To-Material-Unity/assets/58925008/59d84850-b002-425e-aeda-0a1c67a77153

## Updates 

* Support for URP and HDRP available now, download from the [Releases Section](https://github.com/aniketrajnish/Text-To-Material-Unity/releases/tag/v001).

* For URP, import `Editor Coroutines` into the project from the Package Manager, if it's not available by default.

## Usage

* Download the `.unitypackage` from the [Releases Section](https://github.com/aniketrajnish/Text-To-Material-Unity/releases/tag/v001).

* Create/Login to your OpenAI account and get your API key from [here](https://platform.openai.com/api-keys).

* Import the package in your Unity Project.

* Go to `Project Settings -> T2M -> paste your API key`

* Right click in the Project Window, click on `Create - > T2M` to open the Text-To-Material window.

* Enter the prompt describing the type of material and texture of the material you want to create.

* Choose the model to use, the image size, and the quality (only for `dall-e-3`) for textures.

* Click on Generate. The textures and materials are generated and saved in the `Assets/T2M Materials` folder.

## Note

* `gpt-4` and `dall-e-3` might not be available for all the users.

* The resposne generated by AI can sometimes not be in the proper format that we expect it to be for parsing. In such cases, just click on generate again. It works >90% of the time.

## Contributing

Contributions to the project are welcome. Currently working on:

* ~~Support for URP & HDRP materials.~~ [Done!]

* Support more texture maps. (Metallic map, Smoothness map, Roughness map etc.)

* Support for materials based on different shaders.

* ~~Better prompts for texture generation, to ensure seamless textures.~~ [Done!]

* Support for materials based on custom shaders (ig ambitious).

  

## License

MIT License

## Acknowledgement

Thankful to Keijiro Takahashi for his [AI Command Project](https://github.com/keijiro/AICommand).