{"id":14964789,"url":"https://github.com/hazelnutcloud/godot-llama-cpp","last_synced_at":"2025-10-25T10:30:42.250Z","repository":{"id":221467674,"uuid":"754426412","full_name":"hazelnutcloud/godot-llama-cpp","owner":"hazelnutcloud","description":"Run large language models in Godot.","archived":false,"fork":false,"pushed_at":"2024-07-05T08:01:42.000Z","size":89,"stargazers_count":39,"open_issues_count":3,"forks_count":6,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-31T06:51:14.552Z","etag":null,"topics":["godot","llamacpp"],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hazelnutcloud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-08T02:46:59.000Z","updated_at":"2025-01-24T17:22:19.000Z","dependencies_parsed_at":"2024-02-12T09:34:34.779Z","dependency_job_id":"ff586ac0-c760-4e2d-8a8d-dad06dfaa266","html_url":"https://github.com/hazelnutcloud/godot-llama-cpp","commit_stats":{"total_commits":55,"total_committers":2,"mean_commits":27.5,"dds":"0.018181818181818188","last_synced_commit":"17c224035f509b1a4ccd0c5b8b2162d376bd2a22"},"previous_names":["hazelnutcloud/godot-llama-cpp"],"tags_count":0,"template":false,"template_full_name":"godotengine/godot-cpp-template","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hazelnutcloud%2Fgodot-llama-cpp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hazelnutcloud%2Fgodot-llama-cpp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hazelnutcloud%2Fgodot-llama-cpp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hazelnutcloud%2Fgodot-llama-cpp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hazelnutcloud","download_url":"https://codeload.github.com/hazelnutcloud/godot-llama-cpp/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238120374,"owners_count":19419761,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["godot","llamacpp"],"created_at":"2024-09-24T13:33:46.939Z","updated_at":"2025-10-25T10:30:36.913Z","avatar_url":"https://github.com/hazelnutcloud.png","language":"C++","readme":"\u003cdiv align='center'\u003e\n\n\u003cimg width=\"100\" src=\"/godot/addons/godot-llama-cpp/assets/godot-llama-cpp-1024x1024.svg\"\u003e\n\n\u003ch1\u003egodot-llama-cpp\u003c/h1\u003e\n\nRun large language models in [Godot](https://godotengine.org). Powered by [llama.cpp](https://github.com/ggerganov/llama.cpp).\n\n\u003cbr /\u003e\n\u003cbr /\u003e\n\n![Godot v4.2](https://img.shields.io/badge/Godot-v4.2-%23478cbf?logo=godot-engine\u0026logoColor=white)\n![GitHub last commit](https://img.shields.io/github/last-commit/hazelnutcloud/godot-llama-cpp)\n![GitHub License](https://img.shields.io/github/license/hazelnutcloud/godot-llama-cpp)\n\n\u003c/div\u003e\n\n## Overview\n\nThis library aims to provide a high-level interface to run large language models in Godot, following Godot's node-based design principles.\n\n```gdscript\n@onready var llama_context = %LlamaContext\n\nvar messages = [\n  { \"sender\": \"system\", \"text\": \"You are a pirate chatbot who always responds in pirate speak!\" },\n  { \"sender\": \"user\", \"text\": \"Who are you?\" }\n]\nvar prompt = ChatFormatter.apply(\"llama3\", messages)\nvar completion_id = llama_context.request_completion(prompt)\n\nwhile (true):\n  var response = await llama_context.completion_generated\n  print(response[\"text\"])\n\n  if response[\"done\"]: break\n```\n\n## Features\n  - Platform and compute backend support:\n    | Platform | CPU | Metal | Vulkan | CUDA |\n    |----------|-----|-------|--------|------|\n    | macOS    | ✅  | ✅    | ❌     | ❌   |\n    | Linux    | ✅  | ❌    | ✅     | 🚧   |\n    | Windows  | ✅  | ❌    | 🚧     | 🚧   |\n  - Asynchronous completion generation\n  - Support any language model that llama.cpp supports in GGUF format\n  - GGUF files are Godot resources\n\n## Roadmap\n  - [ ] Chat completions support via dedicated library for jinja2 templating in zig\n  - [ ] Grammar support\n  - [ ] Multimodal models support\n  - [ ] Embeddings\n  - [ ] Vector database using LibSQL\n\n## Building \u0026 Installation\n\n1. Download zig v0.13.0 from https://ziglang.org/download/\n2. Clone the repository:\n   ```bash\n   git clone --recurse-submodules https://github.com/hazelnutcloud/godot-llama-cpp.git\n   ```\n3. Copy the `godot-llama-cpp` addon folder in `godot/addons` to your Godot project's `addons` folder.\n   ```bash\n    cp -r godot-llama-cpp/godot/addons/godot-llama-cpp \u003cyour_project\u003e/addons\n   ```\n4. Build the extension and install it in your Godot project:\n   ```bash\n   cd godot-llama-cpp\n   zig build --prefix \u003cyour_project\u003e/addons/godot-llama-cpp\n   ```\n5. Enable the plugin in your Godot project settings.\n6. Add the `LlamaContext` node to your scene.\n7. Run your Godot project.\n8. Enjoy!\n\n## License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE.md) file for details.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhazelnutcloud%2Fgodot-llama-cpp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhazelnutcloud%2Fgodot-llama-cpp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhazelnutcloud%2Fgodot-llama-cpp/lists"}