{"id":25836891,"url":"https://github.com/betkh/llm-chatbot","last_synced_at":"2025-03-01T02:36:29.249Z","repository":{"id":275364901,"uuid":"912635980","full_name":"BeTKH/LLM-Chatbot","owner":"BeTKH","description":"LLM Based ChatBot for Quantitative Carbon foorprint analysis ","archived":false,"fork":false,"pushed_at":"2025-02-27T18:20:59.000Z","size":5582,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-28T02:04:05.704Z","etag":null,"topics":["deepseek-r1","llama3","llms","mistral"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BeTKH.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-06T04:43:54.000Z","updated_at":"2025-02-27T18:21:03.000Z","dependencies_parsed_at":"2025-02-02T01:18:19.696Z","dependency_job_id":"ccebcde6-ab23-4054-b04c-87cf4250a469","html_url":"https://github.com/BeTKH/LLM-Chatbot","commit_stats":null,"previous_names":["betkh/llama-chatbot","betkh/llm-chatbot"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BeTKH%2FLLM-Chatbot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BeTKH%2FLLM-Chatbot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BeTKH%2FLLM-Chatbot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BeTKH%2FLLM-Chatbot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BeTKH","download_url":"https://codeload.github.com/BeTKH/LLM-Chatbot/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241309090,"owners_count":19941722,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deepseek-r1","llama3","llms","mistral"],"created_at":"2025-03-01T02:36:26.444Z","updated_at":"2025-03-01T02:36:29.244Z","avatar_url":"https://github.com/BeTKH.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## ChatBot with LLMs\n\n### Video Demo (click on the image)\n\n[Watch video Demo](https://www.youtube.com/watch?v=EgKAD9C_Hks)\n\n### Architecture\n\n\u003cimg width=\"100%\" alt=\"demo.png\" src=\"public/archtect.png\"\u003e\n\n### Query processing\n\n\u003cimg width=\"60%\" alt=\"demo.png\" src=\"public/prompt_selector.png\"\u003e\n\n### Front-end\n\n\u003cimg width=\"80%\" alt=\"demo.png\" src=\"public/front-end.png\"\u003e\n\n### Sample Outputs\n\n\u003cimg width=\"100%\" alt=\"demo.png\" src=\"public/ops/op1.png\"\u003e\n\u003cimg width=\"100%\" alt=\"demo.png\" src=\"public/ops/op2.png\"\u003e\n\u003cimg width=\"100%\" alt=\"demo.png\" src=\"public/ops/op3.png\"\u003e\n\n\u003c!-- #### Output comparison from various models --\u003e\n\n\u003c!-- \u003cimg width=\"80%\" alt=\"Screenshot 2024-01-29 at 3 55 38 PM\" src=\"public/deepseek-r1.png\"\u003e\n\n\u003cimg width=\"80%\" alt=\"Screenshot 2024-01-29 at 3 55 38 PM\" src=\"public/llama2.png\"\u003e --\u003e\n\n### How to run the app\n\n1. Setup virtual environment with [`pipenv`](https://pipenv.pypa.io/en/latest/installation.html)\n\n2. Install dependencies\n\n   ```\n   pipenv install\n   ```\n\n   To install exact versions run:\n\n   ```\n   pipenv install --ignore-pipfile\n   ```\n\n3. Download ollama (Two approaches:)\n\n   - form from [github](https://github.com/ollama/ollama?tab=readme-ov-file)\n     or\n\n   - from the [website](https://ollama.com/download/mac)\n\n4. Download LLM models via ollama\n\n   Explore list of LLM models via ollama [here](https://ollama.com/library)\n\n   e.g. to download `llama3.2` run:\n\n   ```\n   ollama run llama3.2\n   ```\n\n   e.g. to download `deepseek-r1` run:\n\n   ```\n   ollama run deepseek-r1\n   ```\n\n   To download model with specific size e.g. 14B parameters = 9.0GB here is the [link](https://ollama.com/library/deepseek-r1:14b)\n\n   ```\n   ollama run deepseek-r1:14b\n   ```\n\n5. Run the app\n\n   ```\n   python app.py\n   ```\n\n   OR\n\n   ```\n   python3 app.py\n   ```\n\n### App challanges\n\n- live rendering of outputs to front end (frontend problems)\n- some models are rellay heavy, but accurate (smller models are less acurate)\n- formatting of outputs e.g tables, codes, images\n- performing quantitative analysis and visualizations \u0026 rendiering those to front end\n\n### some goals\n\n- add a drop down menu to select model\n- format and clean generated quntitatve data to perform visualizations\n- steering LLM output using feedback mechanism\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbetkh%2Fllm-chatbot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbetkh%2Fllm-chatbot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbetkh%2Fllm-chatbot/lists"}