An open API service indexing awesome lists of open source software.

https://github.com/paxnea/llm-multimodal-nudging

Zero-Shot Learning for Multimodal Nudging
https://github.com/paxnea/llm-multimodal-nudging

content-creation generative-ai llm multimodal recommender-system zero-shot-learning

Last synced: 6 months ago
JSON representation

Zero-Shot Learning for Multimodal Nudging

Awesome Lists containing this project

README

          

# Zero-Shot Learning for Multimodal Nudging
Source code for the paper "[Zero-Shot Recommendations with Pre-Trained Large Language Models for Multimodal Nudging](https://arxiv.org/abs/2309.01026)".

![input_embedding](https://github.com/paxnea/wain23/assets/133911288/7b697e0b-9c51-454b-8387-ad042d9ce392)

## File Structure
* directory `./content_generation/` contains files used for synthetic data generation
* directory `./data/` contains the generated dataset: user descriptions, messages, and image captions
* `main.ipynb` loads the generated data and computes recommendations via the proposed zero-shot approach

## Examples of Multimodal Recommendations
![USER0](https://github.com/paxnea/wain23/assets/133911288/6a72e831-322b-482e-9fb6-de562db4527c)
![USER1](https://github.com/paxnea/wain23/assets/133911288/60f9002a-6fab-462f-b517-d98142e2b8db)
![USER2](https://github.com/paxnea/wain23/assets/133911288/2f91697a-af5c-4db0-8784-6c7d9dbda26e)
![USER3](https://github.com/paxnea/wain23/assets/133911288/777815fd-2be5-4a23-9f15-33dfde848896)
![USER4](https://github.com/paxnea/wain23/assets/133911288/62c45934-ae61-41c6-8cbf-ea565559cac8)