https://github.com/seeed-projects/multimodal-rag-on-jetson
This project has implemented the RAG function on Jetson with video formats.
https://github.com/seeed-projects/multimodal-rag-on-jetson
Last synced: about 1 year ago
JSON representation
This project has implemented the RAG function on Jetson with video formats.
- Host: GitHub
- URL: https://github.com/seeed-projects/multimodal-rag-on-jetson
- Owner: Seeed-Projects
- License: mit
- Created: 2024-06-06T06:39:30.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-13T10:21:35.000Z (about 2 years ago)
- Last Synced: 2025-03-28T14:21:32.851Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 78.3 MB
- Stars: 7
- Watchers: 2
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Multimodel RAG with [Ollama:llava](https://github.com/dusty-nv/jetson-containers/tree/master/packages/llm/ollama) and [LlamaIndex](https://www.llamaindex.ai/) on Jetson
Here I use reComputer J4012 powered by NVIDIA [Jetson Orin NX 16GB](https://www.seeedstudio.com/reComputer-J4012-p-5586.html).
## Prepare environment
```
# install the container tools
git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh
```
```
# Ollam:llava will be our multimodel model
jetson-containers run --name ollama $(autotag ollama)
ollama run llava
```
The result is as follows:
Open a new terminal(Ctrl+Alt+T) and run:
```
cd jetson-containers
cd data
git clone https://github.com/Seeed-Projects/Multimodal-RAG-on-Jetson
cd ..
jetson-containers run $(autotag l4t-pytorch)
cd data/Multimodal-RAG-on-Jetson
```
## Run Multimodel-RAG-on-Jetson
```
bash run.sh
```
## Result
you can check [here](https://www.hackster.io/lijiahaoxyz/video-chat-with-multimodal-rag-on-jetson-cd83f9) in hackster for more information.
[](https://www.youtube.com/watch?v=RbkATardT2I)