https://github.com/benitomartin/multimodal-youtube-recipes

Multimodal Recipe Recommender using Qdrant, LlamaIndex, and Google Gemini
https://github.com/benitomartin/multimodal-youtube-recipes

gemini google-cloud-platform jupyter-notebook llama-index python qdrant

Last synced: 3 days ago
JSON representation

Multimodal Recipe Recommender using Qdrant, LlamaIndex, and Google Gemini

• Host: GitHub
• URL: https://github.com/benitomartin/multimodal-youtube-recipes
• Owner: benitomartin
• Created: 2024-07-11T13:59:03.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-07-11T19:05:43.000Z (6 months ago)
• Last Synced: 2024-11-08T10:09:59.366Z (about 2 months ago)
• Topics: gemini, google-cloud-platform, jupyter-notebook, llama-index, python, qdrant
• Language: Jupyter Notebook
• Homepage: https://medium.com/@benitomartin/cooking-with-ai-building-a-smart-multimodal-recipe-recommender-using-qdrant-llamaindex-and-2d6d1fa6566c
• Size: 1.33 MB
• Stars: 9
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Multimodal Recipe Recommender using Qdrant, LlamaIndex, and Google Gemini 🚀







This repository contains a notebook with a multimodal system using images as frames from YouTube videos, LlamaIndex framework, Qdrant as a vector database, and Gemini as embedding and llm model. 

Main Steps

- **Data Ingestion**: Load videos and metadata from a YouTube playlist

- **Indexing**: MultiModalVectorStoreIndex from LlamaIndex

- **Embedding and Model**: Gemini

- **Vector Store**: Qdrant with 2 collections (text and images)

- **Query Retrieval**: Top recipe and frame images

Feel free to ⭐ and clone this repo 😉

## Tech Stack

![Python](https://img.shields.io/badge/python-3670A0?style=for-the-badge&logo=python&logoColor=ffdd54)

![Google Cloud](https://img.shields.io/badge/GoogleCloud-%234285F4.svg?style=for-the-badge&logo=google-cloud&logoColor=white)

![Jupyter Notebook](https://img.shields.io/badge/jupyter-%23FA0F00.svg?style=for-the-badge&logo=jupyter&logoColor=white)

## Project Description

For detailed project descriptions, refer to this [Medium article](https://medium.com/@benitomartin/cooking-with-ai-building-a-smart-multimodal-recipe-recommender-using-qdrant-llamaindex-and-2d6d1fa6566c).