https://github.com/billwparker/chat_application

Chat Application using Streamlit and local models
https://github.com/billwparker/chat_application

Last synced: 11 days ago
JSON representation

Chat Application using Streamlit and local models

• Host: GitHub
• URL: https://github.com/billwparker/chat_application
• Owner: billwparker
• Created: 2024-02-11T14:11:29.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-02-11T14:16:54.000Z (9 months ago)
• Last Synced: 2024-08-01T22:54:47.657Z (3 months ago)
• Language: Python
• Size: 1.95 KB
• Stars: 4
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Chat Application using Streamlit and local models

# Create conda environment, we'll call it chat

conda create -n chat python=3.11

# Install dependencies

pip install openai

pip install streamlit

# Download Ollama

(Ollama only works on Mac for Linux right now. For Windows you could use LMStudio)

https://ollama.com/

# Choose and run local model using Ollama

## This command will download the mistral model for ollama to use

ollama pull mistral

## This command will run mistral at http://localhost:11434/v1

ollama run mistral

# Streamlit app

Build Streamlit python file. We'll call it app.py.

## This command will run Streamlit app

streamlit run app.py