https://github.com/statikfintechllc/godcore
All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!
https://github.com/statikfintechllc/godcore
ai chatbot chatgpt cuda dashboard fastapi llama-cpp llm local-ai mistral openai-compatible react selfhosted webui
Last synced: 4 months ago
JSON representation
All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!
- Host: GitHub
- URL: https://github.com/statikfintechllc/godcore
- Owner: statikfintechllc
- License: mit
- Created: 2025-06-08T15:27:55.000Z (5 months ago)
- Default Branch: master
- Last Pushed: 2025-06-22T18:51:23.000Z (4 months ago)
- Last Synced: 2025-06-22T19:37:21.136Z (4 months ago)
- Topics: ai, chatbot, chatgpt, cuda, dashboard, fastapi, llama-cpp, llm, local-ai, mistral, openai-compatible, react, selfhosted, webui
- Language: Python
- Homepage: https://statikfintechllc.github.io/AscendAI/
- Size: 25.4 MB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: docs/README.md
- Contributing: docs/CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: docs/CODE_OF_CONDUCT.md
- Security: docs/SECURITY.md
Awesome Lists containing this project
README
# GodCore Llama Mistral-13B Experiment
> **Currently in the middle of adding a main feature — Switch between Local and "Cloud" ChatGPT Chatting non-api.**
>
> **Stay tuned if this intrigues you.**
*ADHD is a Curse, I think*
⚠️*The Working Directory will be AscendAI/GremlinGPT, His tools are Architeched. Time to attach and Debug*⚠️
---
*Documentation is updated frequently. If you see an issue, submit a PR or open an issue!*
AscendAI Traffic
The Institute’s Propietary System:
**The world’s first *R‑SRACS* (Recursive, Self-Referential Autonomous Cognitive System)**
Reset: After 7:00pm CST on First 2 Clones
---
> Clone release v.0.2.0, it has background image bug, but it works, v.0.3.0 is currently under construction*
*V.0.3.0 will be the Background image bug removal for mobile(Done), Proper Alignment of contents in the SideBar on Mobile(Done), as well as proper Hide-away side bar on DeskTop(In-Progress). And The Addition Of the GPT_handler.py, router.py, and setupProxy.js.(In-Progress)*
---
**🚀 Built by a Solo Engineer, Not a Prompt Engineer**
- *This system—GodCore—was built in 5 days, from scratch, by one hands-on builder.*
- *No coding background. No team. It’s a persistent, multi-brain LLM dashboard.
- *Local Mistral and free ChatGPT, streaming UI, persistent chat history, and instant mobile access (QR/ngrok).*
**If you want to hire a doer, not a talker, contact me:**
**ascend.gremlin@gmail.com** | *[Ko-fi](https://ko-fi.com/statikfintech_llc)* | *[Patreon](https://patreon.com/StatikFinTech_LLC?utm_medium=unknown&utm_source=join_link&utm_campaign=creatorshare_creator&utm_content=copyLink)*
or
**ascend.help@gmail.com** | *[Ko-fi](https://ko-fi.com/statikfintech_llc)* | *[Patreon](https://patreon.com/StatikFinTech_LLC?utm_medium=unknown&utm_source=join_link&utm_campaign=creatorshare_creator&utm_content=copyLink)*
---
## **Install & Setup**
```bash
# 1. Clone and get in
git clone https://github.com/statikfintechllc/GodCore.git && \
cd GodCore
# 2. Install all dependencies and set up environment
cd environment && ./install.sh && \
# 3. After install.sh runs it places's your downloaded model file here:(Always double check)
# /path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf
# 4. Activate the environment
conda activate runmistral && \
cd .. && cd frontend/ && \
source ~/miniconda3/etc/profile.d/conda.sh && \
conda activate runmistral && \
npm install
```
*Inside environment/install.sh Change this "/path/to/", so it matches your system:*
```bash
MODEL_PATH = "/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf" #CHANGE ME
```
*Inside run_llama.py Change this to match your system:*
```bash
MODEL_PATH = "/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf" #CHANGE ME
```
## **Start the Full Stack**
```bash
cd backend && \
./start_all.sh
# This will:
# - Launch the FastAPI backend (localhost:8000)
# - Launch the React frontend (localhost:3000)
```
## **Manual Start** *(Advanced/Debug)*
*Soon debunk, and bug free*
> Start backend only:
```bash
conda activate runmistral && \
python run_llama.py
# (Backend API live at http://localhost:8000)
```
> Start frontend only:
```bash
cd frontend && \
npm install && \ # (first time only)
npm start # (Frontend live at http://localhost:3000)
```
## 📡 Remote Access (ngrok) Setup
1. [Register for ngrok](https://ngrok.com/) and copy your **auth token** from your [dashboard](https://dashboard.ngrok.com/get-started/your-authtoken).
2. On your system:
```sh
ngrok config add-authtoken
```
3. Run the launch script:
```sh
cd backend && \
./launch_ngrok-UI.sh
```
4. **Scan the QR code** shown in your terminal or **open the printed ngrok URL** in your phone’s browser.
Your GremlinGPT UI is now instantly accessible from your phone or any remote device.
## **API Spec**
1. POST /v1/chat/completions
- OpenAI-compatible: send {"model": ..., "messages": ...}
- See frontend/src/App.js for example usage.
2. Model Download
- Downloaded by install.sh is Mistral-13B-Instruct (e.g. Q5_K_M) from TheBloke on HuggingFace, to GodCore/environment.
3. Place the model file in:
> *install.sh does this for you, but checking is good*
```bash
/your/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf
```
---
## **Stop All Services**
```bash
cd backend
./stop_all.sh
# (Kills backend and frontend processes)
```
---
**The Local LLM (llama.cpp) with Mistral-13B model**
> FastAPI backend
> OpenAI-compatible route: `/v1/chat/completions`
> Custom React dashboard (full-feature, modern UI)
> All-in-one repo, fully wired and ready
**The Cloud LLM (ChatGPT) with GPT_handler**
> Same as Local
> State-of-the-Art OCR and Scrapping with live feed text-extraction
> - That’s the wild “screen scrape” automation you’re running with pytesseract + pyautogui for GPT_handler.
> - You’re not just doing “API call,” you’re doing live window wrangling.
---
## 🚨 Known Issues & Breaking Changes (Last Updated(by myself): 2025-06-09)
- **Llava wheel upgrade (I found it in early June 2025):**
Recent update to Llava introduced a new Python wheel that breaks old installs.
**Solution:** See [llama-cpp-python/README.md#installation] for correct wheel and pip flags.
_If you get errors about incompatible architecture or missing symbols, re-install with the new wheel instructions. My install.sh builds clean Cuda Wheel every time if you remove your old runmistral environment._
- **General advice:**
- I built this to fully install amd build proper the furst try, you can use this soley for a gpu llama wheel build by adjusting the environment name in the .yml file in GodCore/environment.
- Always check Python version compatibility (see `environment/conda_env.yml`).
- If you run into dependency issues, try a clean install (`conda remove --all`, then fresh `install.sh`).
- Report any new issues in [GitHub Issues](https://github.com/statikfintechllc/GodCore/issues).