{"id":28793340,"url":"https://github.com/statikfintechllc/godcore","last_synced_at":"2025-06-25T22:03:28.813Z","repository":{"id":297975888,"uuid":"998424819","full_name":"statikfintechllc/GodCore","owner":"statikfintechllc","description":"All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!","archived":false,"fork":false,"pushed_at":"2025-06-22T18:51:23.000Z","size":26639,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-06-22T19:37:21.136Z","etag":null,"topics":["ai","chatbot","chatgpt","cuda","dashboard","fastapi","llama-cpp","llm","local-ai","mistral","openai-compatible","react","selfhosted","webui"],"latest_commit_sha":null,"homepage":"https://statikfintechllc.github.io/AscendAI/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/statikfintechllc.png","metadata":{"files":{"readme":"docs/README.md","changelog":null,"contributing":"docs/CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":"docs/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"docs/SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"custom":["https://patreon.com/StatikFinTech_LLC?utm_medium=unknown\u0026utm_source=join_link\u0026utm_campaign=creatorshare_creator\u0026utm_content=copyLink","https://ko-fi.com/statikfintech_llc","https://cash.app/$statikmoney8","https://paypal.me/statikmoney8","https://www.blockchain.com/btc/address/bc1qarsr966ulmcs3mlcvae7p63v4j2y2vqrw74jl8","https://etherscan.io/address/0xC2db50A0fc6c95f36Af7171D8C41F6998184103F"]}},"created_at":"2025-06-08T15:27:55.000Z","updated_at":"2025-06-22T18:51:26.000Z","dependencies_parsed_at":"2025-06-22T19:39:08.294Z","dependency_job_id":null,"html_url":"https://github.com/statikfintechllc/GodCore","commit_stats":null,"previous_names":["statikfintechllc/godcore"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/statikfintechllc/GodCore","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/statikfintechllc%2FGodCore","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/statikfintechllc%2FGodCore/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/statikfintechllc%2FGodCore/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/statikfintechllc%2FGodCore/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/statikfintechllc","download_url":"https://codeload.github.com/statikfintechllc/GodCore/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/statikfintechllc%2FGodCore/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261960495,"owners_count":23236571,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","chatbot","chatgpt","cuda","dashboard","fastapi","llama-cpp","llm","local-ai","mistral","openai-compatible","react","selfhosted","webui"],"created_at":"2025-06-18T02:00:40.634Z","updated_at":"2025-06-25T22:03:28.805Z","avatar_url":"https://github.com/statikfintechllc.png","language":"Python","funding_links":["https://patreon.com/StatikFinTech_LLC?utm_medium=unknown\u0026utm_source=join_link\u0026utm_campaign=creatorshare_creator\u0026utm_content=copyLink","https://ko-fi.com/statikfintech_llc","https://cash.app/$statikmoney8","https://paypal.me/statikmoney8","https://www.blockchain.com/btc/address/bc1qarsr966ulmcs3mlcvae7p63v4j2y2vqrw74jl8","https://etherscan.io/address/0xC2db50A0fc6c95f36Af7171D8C41F6998184103F"],"categories":[],"sub_categories":[],"readme":"\u003clink rel=\"stylesheet\" type=\"text/css\" href=\"docs/custom.css\"\u003e\n\u003cdiv align=\"center\"\u003e\n  \u003ca\nhref=\"https://github.com/statikfintechllc/GodCore/blob/master/LICENSE\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/OPEN%20USE-black?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"Fair Use License\"/\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/statikfintechllc/GodCore/blob/master/LICENSE\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/GODCORE%20v.0.2.0-darkred?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"GremlinGPT License\"/\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003ca\nhref=\"https://github.com/statikfintechllc/GodCore/blob/master/About Us/WHY_GREMLINGPT.md\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Why-black?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"Why\"/\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/statikfintechllc/GodCore/blob/master/About Us/WHY_GREMLINGPT.md\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/SFTi-darkred?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"GremlinGPT\"/\u003e\n  \u003c/a\u003e\n  \u003ca \n  href=\"https://ko-fi.com/statikfintech_llc\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Support-black?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"Support\"/\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://patreon.com/StatikFinTech_LLC?utm_medium=unknown\u0026utm_source=join_link\u0026utm_campaign=creatorshare_creator\u0026utm_content=copyLink\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/SFTi-darkred?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"SFTi\"/\u003e\n  \u003c/a\u003e\n  \n# GodCore Llama Mistral-13B Experiment\n\n\u003e **Currently in the middle of adding a main feature — Switch between Local and \"Cloud\" ChatGPT Chatting non-api.**\n\u003e \n\u003e **Stay tuned if this intrigues you.**\n\n*ADHD is a Curse, I think*\n\n⚠️*The Working Directory will be AscendAI/GremlinGPT, His tools are Architeched. Time to attach and Debug*⚠️\n\n---\n\n*Documentation is updated frequently. If you see an issue, submit a PR or open an issue!*\n\n\u003c/div\u003e\n\n\u003ch1 align=\"center\"\u003eAscendAI Traffic\u003c/h1\u003e\n\u003cdiv align=\"center\"\u003e\n  \u003cem\u003e\n    \n  The Institute’s Propietary System:  \n  **The world’s first *R‑SRACS* (Recursive, Self-Referential Autonomous Cognitive System)**\u003c/h1\u003e\n    \n  \u003c/em\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003ca href=\"https://raw.githubusercontent.com/statikfintechllc/AscendAI/main/docs/traffic_graph.png\"\u003e\n  \u003cimg src=\"https://raw.githubusercontent.com/statikfintechllc/AscendAI/main/docs/traffic_graph.png\" alt=\"Traffic Graph\" /\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n  \n\u003cdiv align=\"center\"\u003e\n  \u003cem\u003e\nReset: After 7:00pm CST on First 2 Clones\n  \u003c/em\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003ca\nhref=\"https://github.com/statikfintechllc/AscendDocs_of_GovSeverance/blob/master/Docs\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Learn-black?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"Why\"/\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/statikfintechllc/AscendDocs_of_GovSeverance/blob/master/Docs\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Why-darkred?style=for-the-badge\u0026logo=dragon\u0026logoColor=gold\" alt=\"GremlinGPT\"/\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n\n---\n\n\u003cdiv align=\"center\"\u003e\n\n\u003e Clone release v.0.2.0, it has background image bug, but it works, v.0.3.0 is currently under construction*\n\n  *V.0.3.0 will be the Background image bug removal for mobile(Done), Proper Alignment of contents in the SideBar on Mobile(Done), as well as proper Hide-away side bar on DeskTop(In-Progress). And The Addition Of the GPT_handler.py, router.py, and setupProxy.js.(In-Progress)*\n\n\u003c/div\u003e\n\n---\n\n**🚀 Built by a Solo Engineer, Not a Prompt Engineer**\n\n- *This system—GodCore—was built in 5 days, from scratch, by one hands-on builder.*\n- *No coding background. No team. It’s a persistent, multi-brain LLM dashboard.\n- *Local Mistral and free ChatGPT, streaming UI, persistent chat history, and instant mobile access (QR/ngrok).*\n\n**If you want to hire a doer, not a talker, contact me:**\n\n**ascend.gremlin@gmail.com** | *[Ko-fi](https://ko-fi.com/statikfintech_llc)* | *[Patreon](https://patreon.com/StatikFinTech_LLC?utm_medium=unknown\u0026utm_source=join_link\u0026utm_campaign=creatorshare_creator\u0026utm_content=copyLink)*\n\nor\n\n**ascend.help@gmail.com** | *[Ko-fi](https://ko-fi.com/statikfintech_llc)* | *[Patreon](https://patreon.com/StatikFinTech_LLC?utm_medium=unknown\u0026utm_source=join_link\u0026utm_campaign=creatorshare_creator\u0026utm_content=copyLink)*\n\n---\n\n## **Install \u0026 Setup**\n\n```bash\n# 1. Clone and get in\ngit clone https://github.com/statikfintechllc/GodCore.git \u0026\u0026 \\\ncd GodCore\n\n# 2. Install all dependencies and set up environment\ncd environment \u0026\u0026 ./install.sh \u0026\u0026 \\\n\n# 3. After install.sh runs it places's your downloaded model file here:(Always double check)\n# /path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf\n\n# 4. Activate the environment\nconda activate runmistral \u0026\u0026 \\\ncd .. \u0026\u0026 cd frontend/ \u0026\u0026 \\\nsource ~/miniconda3/etc/profile.d/conda.sh \u0026\u0026 \\\nconda activate runmistral \u0026\u0026 \\\nnpm install\n```\n\n*Inside environment/install.sh Change this \"/path/to/\", so it matches your system:*\n\n```bash\nMODEL_PATH = \"/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf\"          #CHANGE ME\n```\n\n*Inside run_llama.py Change this to match your system:*\n\n```bash\nMODEL_PATH = \"/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf\"          #CHANGE ME\n```\n\n## **Start the Full Stack**\n\n```bash\ncd backend \u0026\u0026 \\\n./start_all.sh\n\n# This will:\n#   - Launch the FastAPI backend (localhost:8000)\n#   - Launch the React frontend (localhost:3000)\n```\n\n## **Manual Start** *(Advanced/Debug)*\n*Soon debunk, and bug free*\n\n\u003e Start backend only:\n\n```bash\nconda activate runmistral \u0026\u0026 \\\npython run_llama.py\n# (Backend API live at http://localhost:8000)\n```\n\n\u003e Start frontend only:\n\n```bash\ncd frontend \u0026\u0026 \\\nnpm install \u0026\u0026 \\   # (first time only)\nnpm start     # (Frontend live at http://localhost:3000)\n```\n\n## 📡 Remote Access (ngrok) Setup\n\n1. [Register for ngrok](https://ngrok.com/) and copy your **auth token** from your [dashboard](https://dashboard.ngrok.com/get-started/your-authtoken).\n2. On your system:\n    ```sh\n    ngrok config add-authtoken \u003cYOUR_TOKEN_HERE\u003e\n    ```\n3. Run the launch script:\n    ```sh\n    cd backend \u0026\u0026 \\\n    ./launch_ngrok-UI.sh\n    ```\n4. **Scan the QR code** shown in your terminal or **open the printed ngrok URL** in your phone’s browser.\n\nYour GremlinGPT UI is now instantly accessible from your phone or any remote device.\n\n## **API Spec**\n1. POST /v1/chat/completions\n- OpenAI-compatible: send {\"model\": ..., \"messages\": ...}\n- See frontend/src/App.js for example usage.\n\n2. Model Download\n- Downloaded by install.sh is Mistral-13B-Instruct (e.g. Q5_K_M) from TheBloke on HuggingFace, to GodCore/environment.\n\n3. Place the model file in:\n\u003e *install.sh does this for you, but checking is good*\n```bash\n/your/path/to/GodCore/models/Mistral-13B-Instruct/mistral-13b-instruct-v0.1.Q5_K_M.gguf\n```\n\n---\n\n## **Stop All Services**\n\n```bash\ncd backend\n./stop_all.sh\n# (Kills backend and frontend processes)\n```\n\n---\n\n**The Local LLM (llama.cpp) with Mistral-13B model**\n\u003e FastAPI backend\n\u003e OpenAI-compatible route: `/v1/chat/completions`\n\u003e Custom React dashboard (full-feature, modern UI)\n\u003e All-in-one repo, fully wired and ready\n\n**The Cloud LLM (ChatGPT) with GPT_handler**\n\u003e Same as Local\n\u003e State-of-the-Art OCR and Scrapping with live feed text-extraction\n\u003e     - That’s the wild “screen scrape” automation you’re running with pytesseract + pyautogui for GPT_handler.\n\u003e     - You’re not just doing “API call,” you’re doing live window wrangling.\n\n---\n\n## 🚨 Known Issues \u0026 Breaking Changes (Last Updated(by myself): 2025-06-09)\n\n- **Llava wheel upgrade (I found it in early June 2025):**  \n  Recent update to Llava introduced a new Python wheel that breaks old installs.  \n  **Solution:** See [llama-cpp-python/README.md#installation] for correct wheel and pip flags.  \n  _If you get errors about incompatible architecture or missing symbols, re-install with the new wheel instructions. My install.sh builds clean Cuda Wheel every time if you remove your old runmistral environment._\n\n- **General advice:**\n- I built this to fully install amd build proper the furst try, you can use this soley for a gpu llama wheel build by adjusting the environment name in the .yml file in GodCore/environment.\n  - Always check Python version compatibility (see `environment/conda_env.yml`).\n  - If you run into dependency issues, try a clean install (`conda remove --all`, then fresh `install.sh`).\n  - Report any new issues in [GitHub Issues](https://github.com/statikfintechllc/GodCore/issues).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstatikfintechllc%2Fgodcore","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstatikfintechllc%2Fgodcore","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstatikfintechllc%2Fgodcore/lists"}