{"id":18297642,"url":"https://github.com/chaosgen/rag-chatbot","last_synced_at":"2025-04-09T09:14:27.387Z","repository":{"id":261160128,"uuid":"881373409","full_name":"chaosgen/rag-chatbot","owner":"chaosgen","description":"Chat with multiple PDFs locally","archived":false,"fork":false,"pushed_at":"2024-11-29T06:03:26.000Z","size":8929,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-15T03:18:12.054Z","etag":null,"topics":["chatbot","chatbot-ui","gradio","llama-index","llama3","llm","mistral","ollama","python","question-answering","rag"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chaosgen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-31T12:54:46.000Z","updated_at":"2024-12-07T22:20:20.000Z","dependencies_parsed_at":"2024-11-05T02:38:15.622Z","dependency_job_id":null,"html_url":"https://github.com/chaosgen/rag-chatbot","commit_stats":null,"previous_names":["chaosgen/rag-chatbot"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chaosgen%2Frag-chatbot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chaosgen%2Frag-chatbot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chaosgen%2Frag-chatbot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chaosgen%2Frag-chatbot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chaosgen","download_url":"https://codeload.github.com/chaosgen/rag-chatbot/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248008630,"owners_count":21032556,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chatbot","chatbot-ui","gradio","llama-index","llama3","llm","mistral","ollama","python","question-answering","rag"],"created_at":"2024-11-05T15:03:36.137Z","updated_at":"2025-04-09T09:14:27.372Z","avatar_url":"https://github.com/chaosgen.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🤖 Chat with multiple PDFs locally\n\n![alt text](assets/demo.png)\n\n# 📖 Table of Contents\n\n- [`Feature`](#⭐️-features)\n- [`Idea`](#-idea)\n- [`Setup`](#💻-setup)\n  - [`Kaggle`](#1-kaggle-recommended)\n  - [`Local`](#2-local)\n    - [`Clone`](#21-clone-project)\n    - [`Install`](#22-install)\n    - [`Run`](#23-run)\n- [`Todo`](#🎯-todo)\n\n# ⭐️ Key Features\n\n- Easy to run on `Local` or `Kaggle` (new)\n- Using any model from `Huggingface` and `Ollama`\n- Process multiple PDF inputs.\n- Chat with multiples languages (Coming soon).\n- Simple UI with `Gradio`.\n\n# 💡 Idea (Experiment)\n\n![](./assets/rag-flow.svg)\n\n![](./assets/retriever.svg)\n\n# 💻 Setup\n\n## 1. Kaggle (Recommended)\n\n- Import [`notebooks/kaggle.ipynb`](notebooks/kaggle.ipynb) to Kaggle\n- Replace `\u003cYOUR_NGROK_TOKEN\u003e` with your tokens.\n\n## 2. Local\n\n### 2.1. Clone project\n\n```bash\ngit clone https://github.com/chaosgen/rag-chatbot.git\ncd rag-chatbot\n```\n\n### 2.2 Install\n\n#### 2.2.1 Docker\n\n```bash\ndocker compose up --build\n```\n\n#### 2.2.2 Using script (Ollama, Ngrok, python package)\n\n```bash\nsource ./scripts/install_extra.sh\n```\n\n#### 2.2.3 Install manually\n\n##### 1. `Ollama`\n\n- MacOS, Window: [Download](https://ollama.com/)\n\n- Linux\n\n```bash\ncurl -fsSL https://ollama.com/install.sh | sh\n```\n\n##### 2. `Ngrok`\n\n- Macos\n\n```bash\nbrew install ngrok/ngrok/ngrok\n```\n\n- Linux\n\n```bash\ncurl -s https://ngrok-agent.s3.amazonaws.com/ngrok.asc \\\n| sudo tee /etc/apt/trusted.gpg.d/ngrok.asc \u003e/dev/null \\\n\u0026\u0026 echo \"deb https://ngrok-agent.s3.amazonaws.com buster main\" \\\n| sudo tee /etc/apt/sources.list.d/ngrok.list \\\n\u0026\u0026 sudo apt update \\\n\u0026\u0026 sudo apt install ngrok\n```\n\n##### 3. Install `rag_chatbot` Package\n\n```bash\nsource ./scripts/install.sh\n```\n\n### 2.3 Run\n\n```bash\nsource ./scripts/run.sh\n```\n\nor\n\n```bash\npython -m rag_chatbot --host localhost\n```\n\n- Using Ngrok\n\n```bash\nsource ./scripts/run.sh --ngrok\n```\n\n### 3. Go to: `http://0.0.0.0:7860/` or Ngrok link after setup completed\n\n## 🎯 Todo\n\n- [x] Add evaluation.\n- [x] Better Document Processing.\n- [ ] Support better Embedding Model for Vietnamese and other languages.\n- [ ] ReAct Agent.\n- [ ] Document mangement (Qrdant, MongoDB,...)\n\n## 🌟 Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=chaosgen/rag-chatbot\u0026type=Date)](https://star-history.com/#chaosgen/rag-chatbot\u0026Date)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchaosgen%2Frag-chatbot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchaosgen%2Frag-chatbot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchaosgen%2Frag-chatbot/lists"}