{"id":27295880,"url":"https://github.com/svetlyo81/godot-nemo","last_synced_at":"2026-05-08T13:13:51.907Z","repository":{"id":276578197,"uuid":"926207573","full_name":"svetlyo81/godot-nemo","owner":"svetlyo81","description":"Godot 4 custom build to run Mistral-Nemo-Instruct-2407 and SDXL finetunes for Windows 10/later.","archived":false,"fork":false,"pushed_at":"2025-11-04T17:51:50.000Z","size":56,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-11-04T19:05:43.909Z","etag":null,"topics":["ai","app-development","game-development","godot","llm","mistral-nemo","opencv","stable-diffusion","windows"],"latest_commit_sha":null,"homepage":"","language":"GDScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/svetlyo81.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-02-02T19:56:07.000Z","updated_at":"2025-11-04T17:42:31.000Z","dependencies_parsed_at":"2025-02-09T07:18:43.562Z","dependency_job_id":"9ef6200d-5f3a-4f52-8a39-180a6504d113","html_url":"https://github.com/svetlyo81/godot-nemo","commit_stats":null,"previous_names":["svetlyo81/godot-nemo"],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/svetlyo81/godot-nemo","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/svetlyo81%2Fgodot-nemo","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/svetlyo81%2Fgodot-nemo/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/svetlyo81%2Fgodot-nemo/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/svetlyo81%2Fgodot-nemo/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/svetlyo81","download_url":"https://codeload.github.com/svetlyo81/godot-nemo/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/svetlyo81%2Fgodot-nemo/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32781871,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-08T08:22:46.396Z","status":"ssl_error","status_checked_at":"2026-05-08T08:22:45.650Z","response_time":54,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","app-development","game-development","godot","llm","mistral-nemo","opencv","stable-diffusion","windows"],"created_at":"2025-04-11T23:29:30.578Z","updated_at":"2026-05-08T13:13:51.895Z","avatar_url":"https://github.com/svetlyo81.png","language":"GDScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# godot-nemo\n\nGodot-Nemo is my custom Godot Engine build that can run Mistral-Nemo-Instruct-2407 (the 12b model) and SDXL finetunes based on Godot 4 and the Godot LLM plugin, llama.cpp, stable-diffusion.cpp, and OpenCV. It targets Windows 10 and Vulkan compatible GPUs with 6GB VRAM.\n\n## Compiling the source\n\nInstall Git and clone the repositories:\n\n```\ngit clone https://github.com/svetlyo81/llama.cpp\ngit clone https://github.com/svetlyo81/stable-diffusion.cpp\ngit clone https://github.com/svetlyo81/godot\ngit clone https://github.com/svetlyo81/godot-nemo\n\ngit clone https://github.com/opencv/opencv.git -b 4.x\ncd opencv\ngit clone https://github.com/opencv/opencv_contrib -b 4.x\n```\n\n### Building llama.cpp\n\n```\ncd llama.cpp\nmkdir build\ncd build\n```\n\n#### CUDA build\n\nInstall Visual Studio 2022, CMake and the CUDA Toolkit (https://developer.nvidia.com/cuda-toolkit) and optionally copy the following files to godot/bin (create the bin folder since it doesn't exist yet). While not required to run Godot on your system, the files would be needed on systems that don't have the toolkit installed. Microsoft Visual C++ Redistributable may be required on systems where Visual Studio isn't available. It should be installed along with the NVIDIA drivers but can be found here too https://aka.ms/vs/17/release/vc_redist.x64.exe\n\nCUDA/bin/cublas64_XX.dll -\u003e godot/bin\n\nCUDA/bin/cublasLt64_XX.dll -\u003e godot/bin\n\nCUDA/bin/cudart64_XX.dll -\u003e godot/bin\n\n```\ncmake .. -DBUILD_SHARED_LIBS=ON -DGGML_CUDA=ON\ncmake --build . --config Release\n```\n\nCopy the files to the respective folders:\n\nllama.cpp/build/bin/release/ggml.dll -\u003e godot/bin\n\nllama.cpp/build/bin/release/llama.dll -\u003e godot/bin\n\nllama.cpp/build/src/Release/llama.lib -\u003e godot/modules/gdllama/llama-win\n\nllama.cpp/build/ggml/src/Release/ggml.lib -\u003e godot/modules/gdllama/llama-win\n\n#### Vulkan build\n\nInstall MSYS2:\n\nhttps://github.com/msys2/msys2-installer/releases\n\nhttps://github.com/msys2/msys2-installer/releases/download/2024-12-08/msys2-x86_64-20241208.exe\n\nRun the following commands in the UCRT64 terminal:\n\n```\npacman -S git \\\n    mingw-w64-ucrt-x86_64-gcc \\\n    mingw-w64-ucrt-x86_64-cmake \\\n    mingw-w64-ucrt-x86_64-vulkan-devel \\\n    mingw-w64-ucrt-x86_64-shaderc \\\n    mingw-w64-ucrt-x86_64-scons\n```\n\n```\ncmake .. -DBUILD_SHARED_LIBS=ON -DGGML_VULKAN=1\ncmake --build . --config Release\n```\n\nllama.cpp/build/bin/release/libggml.dll -\u003e godot/bin\n\nllama.cpp/build/bin/release/libllama.dll -\u003e godot/bin\n\nllama.cpp/build/ggml/src/libggml.dll.a -\u003e godot/modules/gdllama/llama-win\n\nllama.cpp/build/src/libllama.dll.a -\u003e godot/modules/gdllama/llama-win\n\nllama.cpp/build/common/libcommon.a -\u003e godot/modules/gdllama/llama-win\n\nmsys2/ucrt64/bin/libgcc_s_seh-1.dll -\u003e godot/bin\n\nmsys2/ucrt64/bin/libgomp-1.dll -\u003e godot/bin\n\nmsys2/ucrt64/bin/libstdc++-6.dll -\u003e godot/bin\n\nmsys2/ucrt64/bin/libwinpthread-1.dll -\u003e godot/bin\n\n### Building stable-diffusion.cpp\n\n```\ncd stable-diffusion.cpp\nmkdir build\ncd build\n```\n\n#### CUDA build\n\n```\ncmake .. -DSD_BUILD_SHARED_LIBS=ON -DSD_CUDA=ON\ncmake --build . --config Release\n```\n\nstable-diffusion.cpp/build/bin/release/stable-diffusion.dll -\u003e godot/bin\n\nstable-diffusion.cpp/build/release/stable-diffusion.lib -\u003e godot/modules/gdllama/diffusion-win\n\n#### Vulkan build\n\n```\ncmake .. -DSD_BUILD_SHARED_LIBS=ON -DSD_VULKAN=ON\ncmake --build . --config Release\n```\n\nstable-diffusion.cpp/build/bin/libstable-diffusion.dll -\u003e godot/bin\n\nstable-diffusion.cpp/build/libstable-diffusion.dll.a -\u003e godot/modules/gdllama/diffusion-win\n\n### Building OpenCV\n\n```\ncd opencv\nmkdir build\ncd build\n```\n\n#### Visual Studio 2022\n\n```\ncmake -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DBUILD_opencv_legacy=OFF -DBUILD_EXAMPLES=ON -DOPENCV_EXTRA_MODULES_PATH=../opencv_contrib/modules ..\ncmake --build . --config Release -j 7\ncmake --install . --config Release\n```\n\nbuild/install/include/opencv2 -\u003e $(VC_IncludePath), for example:\nProgram Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.38.33130/include\n\nall the .lib files in build/install/x64/vc17/lib -\u003e $(VC_LibraryPath_x64), for example:\nProgram Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.38.33130/lib/x64\n\nbuild/bin/Release/ opencv_core4130.dll opencv_imgproc4130.dll opencv_imgcodecs4130.dll opencv_dnn4130.dll opencv_dnn_superres4130.dll -\u003e godot/bin\n\n#### MSYS2\n\n```\ncmake -G \"Ninja\" -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/mingw64 -DBUILD_SHARED_LIBS=ON -DWITH_DSHOW=OFF -DWITH_MSMF=OFF -DBUILD_opencv_legacy=OFF -DBUILD_EXAMPLES=ON -DOPENCV_EXTRA_MODULES_PATH=../opencv_contrib/modules ..\nninja\nninja install\n```\n\nmsys2\\mingw64\\include\\opencv2 -\u003e msys2\\ucrt64\\include\n\nall the .a files in msys2\\mingw64\\x64\\mingw\\lib -\u003e msys2\\ucrt64\\lib\n\nmsys2\\mingw64\\x64\\mingw\\bin\\ libopencv_core4130.dll libopencv_imgproc4130.dll libopencv_imgcodecs4130.dll libopencv_dnn4130.dll libopencv_dnn_superres4130.dll -\u003e godot/bin\n\n### Building Godot\n\n#### Visual Studio 2022\n\nGenerate Visual Studio solution:\n\n```\nscons platform=windows vsproj=yes dev_build=yes\n```\n\nBuild without debug symbols (dev_build=yes for debug build):\n\n```\nscons platform=windows dev_build=no\n```\n\nAdding the --clean parameter to the command above will clean the respective build.\n\n#### MSYS2\n\n```\nscons platform=windows use_mingw=yes\n```\n\n## Running the demo\n\nDownload the following files and put them in the godot-nemo/godot-nemo-demo folder:\n\n\nMistral-Nemo-Instruct-2407.Q5_K_M.gguf\n\nhttps://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF/blob/9124e92876a2a7c0e8741d7176343f45b3896960/Mistral-Nemo-Instruct-2407-Q5_K_M.gguf\n\n\nmxbai-embed-large-v1.Q5_K_M.gguf\n\nhttps://huggingface.co/ChristianAzinn/mxbai-embed-large-v1-gguf/blob/main/mxbai-embed-large-v1.Q5_K_M.gguf\n\n\nDreamShaperXL_Lightning-SFW.safetensors\n\nhttps://huggingface.co/Lykon/dreamshaper-xl-lightning/blob/main/DreamShaperXL_Lightning-SFW.safetensors\n\n\nThe Godot Editor binaries will be placed in godot/bin, run the console one and drag the godot-nemo-demo folder in the Editor window the first time you open the demo.\n\n## On the dangers of AI\n\nI think the main danger of using AI in games is reproducing copyrighted material. This can happen without AI too and anyone can sue anybody for anything. In a real world game application you may want to query the LLM with the user prompt to detect mentions of copyrighted material and use img2img to control image generation. There is also concern that some users may become attached to fictional AI characters and consequently be manipulated by them to do something or be exploited in some way.\n\nI don't have actual experience in any of this, also I'm not responsible for others but with all the controversy surrounding AI I felt that I should at least mention it. Again, with more than 50% of humans believeing either/both that the Earth is flat and that there's an invisible man watching them from the sky at all times personally I consider humans to be the danger at this time. They're more likely to do somebody harm than admit they're wrong about something. I wish it was a joke but beware the dangers.\n\n## godot-nemo goes closed-source\n\nI couldn't resist adding this section. Its humorous title is not entirely incorrect. Moving forward I want to explore the application of more powerful image generation models. I can't however seem to find a way to do it while maintaining a relatively low hardware requirement. Also I'm not too happy with custom licensed models (as is the case with SDXL), I'd rather always use Apache 2.0 licensed models. But mostly I feel that if I were to increase the hardware requirements it might make people who don't own higher end graphics hardware left out. I think high end hardware today may become more mainstream tomorrow. I'm sure not everyone will agree so perhaps this project can contribute best to the OSS community in its current form, besides as a single individual I don't have the resources to cover and maintain a lot of specific use cases.\n\n## References\n\n[Godot Engine](https://github.com/godotengine/godot)\n\n[Godot LLM Plugin](https://github.com/Adriankhl/godot-llm-template)\n\n[llama.cpp](https://github.com/ggerganov/llama.cpp)\n\n[stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp)\n\n[OpenCV](https://github.com/opencv)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsvetlyo81%2Fgodot-nemo","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsvetlyo81%2Fgodot-nemo","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsvetlyo81%2Fgodot-nemo/lists"}