https://github.com/anujyadav140/autarchllm
Autarch LLM - A Local ChatGPT
https://github.com/anujyadav140/autarchllm
flutter llm llms local ngrok ollama ollama-client
Last synced: 7 months ago
JSON representation
Autarch LLM - A Local ChatGPT
- Host: GitHub
- URL: https://github.com/anujyadav140/autarchllm
- Owner: anujyadav140
- Created: 2024-12-30T23:45:12.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2025-01-07T00:28:31.000Z (9 months ago)
- Last Synced: 2025-01-20T20:56:09.896Z (9 months ago)
- Topics: flutter, llm, llms, local, ngrok, ollama, ollama-client
- Language: JavaScript
- Homepage:
- Size: 6.71 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Autarch LLM
Autarch is an Ollama compatabile, flutter web, android and windows app for working with privately hosted models such as Llama 2, Mistral, Gemini and more. It's essentially ChatGPT app UI that connects to your private models hosted through ngrok/localhost.
## Getting Started
1. Downlaod Ollama https://ollama.com/download/windows
2. Download ngrok https://download.ngrok.com/windows
3. Ollama can be accessed using ngrok with the following command line: ngrok http 11434 --host-header="localhost:11434"
4. Go to the Autarch LLM app and find the settings button
5. Change the Ollama Serve Uri textfield to your ngrok url
6. You are good to go!