{"id":24802919,"url":"https://github.com/ovoshatchery/ovos-solver-plugin-llmcpp","last_synced_at":"2025-06-25T02:38:02.306Z","repository":{"id":148708528,"uuid":"616861504","full_name":"OVOSHatchery/ovos-solver-plugin-llmcpp","owner":"OVOSHatchery","description":null,"archived":false,"fork":false,"pushed_at":"2023-03-29T06:47:35.000Z","size":26,"stargazers_count":7,"open_issues_count":1,"forks_count":1,"subscribers_count":5,"default_branch":"dev","last_synced_at":"2025-05-17T02:12:28.957Z","etag":null,"topics":["proof-of-concept","work-in-progress"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/OVOSHatchery.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-03-21T08:32:17.000Z","updated_at":"2024-05-19T05:41:21.000Z","dependencies_parsed_at":"2023-05-28T17:15:09.211Z","dependency_job_id":null,"html_url":"https://github.com/OVOSHatchery/ovos-solver-plugin-llmcpp","commit_stats":null,"previous_names":["openvoiceos/ovos-solver-plugin-alpacacpp","ovoshatchery/ovos-solver-plugin-llmcpp","openvoiceos/ovos-solver-plugin-llmcpp"],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/OVOSHatchery/ovos-solver-plugin-llmcpp","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OVOSHatchery%2Fovos-solver-plugin-llmcpp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OVOSHatchery%2Fovos-solver-plugin-llmcpp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OVOSHatchery%2Fovos-solver-plugin-llmcpp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OVOSHatchery%2Fovos-solver-plugin-llmcpp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/OVOSHatchery","download_url":"https://codeload.github.com/OVOSHatchery/ovos-solver-plugin-llmcpp/tar.gz/refs/heads/dev","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OVOSHatchery%2Fovos-solver-plugin-llmcpp/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260474848,"owners_count":23014780,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["proof-of-concept","work-in-progress"],"created_at":"2025-01-30T05:16:44.411Z","updated_at":"2025-06-25T02:38:02.284Z","avatar_url":"https://github.com/OVOSHatchery.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# \u003cimg src='https://camo.githubusercontent.com/57d5fd32c5b51e73fce9077a45f155db3edecd5dfe31d272d73569cb23ef779c/68747470733a2f2f692e696d6775722e636f6d2f6c41645a6a376d2e6a706567' card_color='#40DBB0' width='50' height='50' style='vertical-align:bottom'/\u003e  LLM.cpp Persona\n \nGive OpenVoiceOS some sass with [Alpaca.cpp](https://github.com/antimatter15/alpaca.cpp), [GPT4All.cpp](https://github.com/zanussbaum/gpt4all.cpp) or [Bloomz.cpp](https://github.com/NouamaneTazi/bloomz.cpp)\n\nThis plugin requires providing the path to the executable and model, it uses subprocess which allows it to work with these programs without requiring python bindings\n\nDedicated plugins may exist for each LLM\n\n\n## Examples \n\n* \"What is best in life?\"\n* \"Do you like dogs\"\n* \"Does God exist?\"\n\n\n## Usage\n\nSpoken answers api\n\n```python\nfrom ovos_solver_llmcpp import LLMcppSolver\n\nALPACA_MODEL_FILE = \"./models/ggml-alpaca-7b-q4.bin\"\nGPT4ALL_MODEL_FILE = \"./models/gpt4all-lora-quantized.bin\"\n\n# binpath = \"~/alpaca.cpp/chat\"\nbinpath = \"~/gpt4all.cpp/chat\"\n\nbot = LLMcppSolver({\"model\": GPT4ALL_MODEL_FILE,\n                    \"executable_path\": binpath})\n\nsentence = bot.spoken_answer(\"Qual é o teu animal favorito?\", {\"lang\": \"pt-pt\"})\n# Meus animais favoritos são cães, gatos e tartarugas!\n\nfor q in [\"Does god exist?\",\n          \"what is the speed of light?\",\n          \"what is the meaning of life?\",\n          \"What is your favorite color?\",\n          \"What is best in life?\"]:\n    a = bot.get_spoken_answer(q)\n    print(q, a)\n\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fovoshatchery%2Fovos-solver-plugin-llmcpp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fovoshatchery%2Fovos-solver-plugin-llmcpp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fovoshatchery%2Fovos-solver-plugin-llmcpp/lists"}