https://github.com/ubertidavide/local_gpt

Ready to deploy Offline LLM AI web chat.
https://github.com/ubertidavide/local_gpt

ai chat gpt llm offline offline-gpt offline-llm ready-to-deploy ready-to-use web webchat

Last synced: about 1 month ago
JSON representation

Ready to deploy Offline LLM AI web chat.

• Host: GitHub
• URL: https://github.com/ubertidavide/local_gpt
• Owner: ubertidavide
• License: apache-2.0
• Created: 2024-05-11T18:09:27.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-05-12T07:54:14.000Z (8 months ago)
• Last Synced: 2024-05-12T08:35:36.660Z (8 months ago)
• Topics: ai, chat, gpt, llm, offline, offline-gpt, offline-llm, ready-to-deploy, ready-to-use, web, webchat
• Language: Python
• Homepage:
• Size: 5.86 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# local_gpt

Ready to deploy Offline LLM AI web chat.

## Usage

Instructions to install all the required software and settings.

1. Install Torch from the [official site](https://pytorch.org/get-started/locally/), for more performance use the cuda version if you have the needed hardware.  

2. Clone this repository  

```bash

    git clone --recurse-submodules https://github.com/ubertidavide/local_gpt.git

```

2. Install all Python dependencies using pip:  

```bash

    pip install -r requirements.txt

```

3. Insert your preferred prompt at `line 24` in the `main.py` code, you could found some awasome promts [here](https://github.com/f/awesome-chatgpt-prompts)  

4. Deploy the app locally:  

```bash

    streamlit run main.py

```