https://github.com/datvodinh/rag-chatbot
Chat with multiple PDFs locally
https://github.com/datvodinh/rag-chatbot
chatbot chatbot-ui chatbots gradio llama-index llama3 llm mistral ollama question-answering rag
Last synced: 4 months ago
JSON representation
Chat with multiple PDFs locally
- Host: GitHub
- URL: https://github.com/datvodinh/rag-chatbot
- Owner: datvodinh
- License: apache-2.0
- Created: 2024-03-16T14:05:28.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-11T04:30:01.000Z (over 1 year ago)
- Last Synced: 2025-06-07T09:44:14.505Z (11 months ago)
- Topics: chatbot, chatbot-ui, chatbots, gradio, llama-index, llama3, llm, mistral, ollama, question-answering, rag
- Language: Python
- Homepage:
- Size: 8.7 MB
- Stars: 537
- Watchers: 13
- Forks: 82
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-side-quests - datvodinh/rag-chatbot
- StarryDivineSky - datvodinh/rag-chatbot
- Awesome-Ollama - Ollama RAG Chatbot
README
# 🤖 Chat with multiple PDFs locally
## 📖 Table of Contents
- [📖 Table of Contents](#-table-of-contents)
- [⭐️ Key Features](#️-key-features)
- [💡 Idea (Experiment)](#-idea-experiment)
- [💻 Setup](#-setup)
- [1. Kaggle (Recommended)](#1-kaggle-recommended)
- [2. Local](#2-local)
- [2.1. Clone project](#21-clone-project)
- [2.2 Install](#22-install)
- [2.3 Run](#23-run)
- [3. Go to: `http://0.0.0.0:7860/` or Ngrok link after setup completed](#3-go-to-http00007860-or-ngrok-link-after-setup-completed)
- [🌟 Star History](#-star-history)
## ⭐️ Key Features
- Easy to run on `Local` or `Kaggle` (new)
- Using any model from `Huggingface` and `Ollama`
- Process multiple PDF inputs.
- Chat with multiples languages (Coming soon).
- Simple UI with `Gradio`.
## 💡 Idea (Experiment)
## 💻 Setup
## 1. Kaggle (Recommended)
- Import [`notebooks/kaggle.ipynb`](notebooks/kaggle.ipynb) to Kaggle
- Replace `` with your tokens.
## 2. Local
### 2.1. Clone project
```bash
git clone https://github.com/datvodinh/rag-chatbot.git
cd rag-chatbot
```
### 2.2 Install
#### 2.2.0 Install `uv` (once)
```bash
curl -LsSf https://astral.sh/uv/install.sh | sh
```
> Make sure `~/.local/bin` (default install location) is on your `PATH`.
#### 2.2.1 Docker
```bash
docker compose up --build
```
#### 2.2.2 Using script (Ollama, Ngrok, python package)
```bash
bash ./scripts/install_extra.sh
```
#### 2.2.3 Install manually
##### 1. `Ollama`
- MacOS, Window: [Download](https://ollama.com/)
- Linux
```bash
curl -fsSL https://ollama.com/install.sh | sh
```
##### 2. `Ngrok`
- Macos
```bash
brew install ngrok/ngrok/ngrok
```
- Linux
```bash
curl -s https://ngrok-agent.s3.amazonaws.com/ngrok.asc \
| sudo tee /etc/apt/trusted.gpg.d/ngrok.asc >/dev/null \
&& echo "deb https://ngrok-agent.s3.amazonaws.com buster main" \
| sudo tee /etc/apt/sources.list.d/ngrok.list \
&& sudo apt update \
&& sudo apt install ngrok
```
##### 3. Install `rag_chatbot` Package
```bash
uv sync --locked
```
### 2.3 Run
```bash
bash ./scripts/run.sh
```
or
```bash
uv run python -m rag_chatbot --host localhost
```
- Using Ngrok
```bash
bash ./scripts/run.sh --ngrok
```
### 3. Go to: `http://0.0.0.0:7860/` or Ngrok link after setup completed
## 🌟 Star History
[](https://star-history.com/#datvodinh/rag-chatbot&Date)