Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/iam-baivab/llama-2-ggml-medical-chatbot
Llama2-Medical-Chatbot is a medical chatbot that uses the Llama-2-7B-Chat-GGML model and the pdf The Gale Encyclopedia of Medicine, Volume 1, 2nd Edition. It is still under development, but it has the potential to be a valuable tool for patients, healthcare professionals, and researchers.
https://github.com/iam-baivab/llama-2-ggml-medical-chatbot
all-minilm-l6-v2 chainlit ggml llama2 llama2-7b sentence-transformers streamlit
Last synced: about 1 month ago
JSON representation
Llama2-Medical-Chatbot is a medical chatbot that uses the Llama-2-7B-Chat-GGML model and the pdf The Gale Encyclopedia of Medicine, Volume 1, 2nd Edition. It is still under development, but it has the potential to be a valuable tool for patients, healthcare professionals, and researchers.
- Host: GitHub
- URL: https://github.com/iam-baivab/llama-2-ggml-medical-chatbot
- Owner: iam-baivab
- License: mit
- Created: 2024-05-27T07:53:29.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-05-29T00:44:31.000Z (6 months ago)
- Last Synced: 2024-09-23T11:03:47.797Z (about 2 months ago)
- Topics: all-minilm-l6-v2, chainlit, ggml, llama2, llama2-7b, sentence-transformers, streamlit
- Language: Python
- Homepage: https://huggingface.co/spaces/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot
- Size: 498 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
---
license: mit
language:
- en
pipeline_tag: conversational
tags:
- llama2
- text-generation
- text-classification
- conversational
- medical
library_name: transformers
---
# 🐍 Llama-2-GGML-Medical-Chatbot 🤖
The **Llama-2-7B-Chat-GGML-Medical-Chatbot** is a repository for a medical chatbot that uses the _Llama-2-7B-Chat-GGML_ model and the pdf _The Gale Encyclopedia of Medicine_. The chatbot is still under development, but it has the potential to be a valuable tool for patients, healthcare professionals, and researchers. The chatbot can be used to answer questions about medical topics, provide summaries of medical articles, and generate medical text. However, it is important to note that the chatbot is not a substitute for medical advice from a qualified healthcare professional.
## 📚 Here are some of the features of the Llama-2-7B-Chat-GGML-Medical-Chatbot:
- It uses the _Llama-2-7B-Chat-GGML_ model, which is a **large language model (LLM)** that has been fine-tuned.
* Name - **llama-2-7b-chat.ggmlv3.q2_K.bin**
* Quant method - q2_K
* Bits - 2
* Size - **2.87 GB**
* Max RAM required - 5.37 GB
* Use case - New k-quant method. Uses GGML_TYPE_Q4_K for the attention.vw and feed_forward.w2 tensors, GGML_TYPE_Q2_K for the other tensors.
* **Model:** Know more about model **[Llama-2-7B-Chat-GGML](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML)**
- It is trained on the pdf **[The Gale Encyclopedia of Medicine, Volume 1, 2nd Edition, 637-page PDF](https://github.com/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot/blob/main/data/71763-gale-encyclopedia-of-medicine.-vol.-1.-2nd-ed.pdf)**, which is a comprehensive medical reference that provides information on a wide range of medical topics. This means that the chatbot is able to answer questions about a variety of medical topics.
- This is a sophisticated medical chatbot, developed using Llama-2 7B and Sentence Transformers. Powered by **[Langchain](https://python.langchain.com/docs/get_started/introduction)** and **[Chainlit](https://docs.chainlit.io/overview)**, This bot operates on a powerful CPU computer that boasts a minimum of
* Operating system: Linux, macOS, or Windows
* CPU: Intel® Core™ i3
* RAM: **8 GB**
* Disk space: 7 GB
* GPU: None **(CPU only)**
- It is still under development, but it has the potential to be a valuable tool for patients, healthcare professionals, and researchers.
## 🚀 Quickstart
1. Open Git Bash.
2. Change the current working directory to the location where you want the cloned directory.
3. Type `git clone`, and then paste the URL you copied earlier.
```bash
git clone https://github.com/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot.git
```
Press Enter to create your local clone.
4. Install the pip packages in requirements.txt
```bash
pip install -r requirements.txt
```
5. Now run it!
```ternimal
chainlit run model.py -w
```
## 📖 ChatBot Conversession
### ⛓️Chainlit ver. on [#v1.0.1.dev20230913](https://github.com/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot/releases/tag/v1.0.1.dev20230913)
### ⚡Streamlit ver. on [#v2.0.1.dev20231230](https://github.com/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot/releases/tag/v2.0.1.dev20231230)
### DEMO: 📽️Conversession.vid.mp4->https://cdn-uploads.huggingface.co/production/uploads/64d8c442a4839890b2490db9/iI4t0lhjkCw3dDSvWQ4Jk.mp4
