{"id":14964785,"url":"https://github.com/iakashpaul/ghudsavar","last_synced_at":"2025-07-19T08:33:36.516Z","repository":{"id":224703062,"uuid":"763988088","full_name":"iakashpaul/Ghudsavar","owner":"iakashpaul","description":"Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes","archived":false,"fork":false,"pushed_at":"2024-05-04T05:05:59.000Z","size":17,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-07-18T22:34:33.858Z","etag":null,"topics":["gemma","gemma-2b","ggml","gguf","google","huggingface","llama","llamacpp","server"],"latest_commit_sha":null,"homepage":"https://huggingface.co/spaces/iAkashPaul/Ghudsavar","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iakashpaul.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-27T09:25:27.000Z","updated_at":"2025-03-29T18:52:30.000Z","dependencies_parsed_at":"2024-02-29T11:55:21.350Z","dependency_job_id":"cb04d600-3d2b-4c47-9bee-d5bff74791e3","html_url":"https://github.com/iakashpaul/Ghudsavar","commit_stats":{"total_commits":13,"total_committers":1,"mean_commits":13.0,"dds":0.0,"last_synced_commit":"b46442820d5b9bb50a48e8d5badeaf3fc8436fbb"},"previous_names":["iakashpaul/ghudsavar"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/iakashpaul/Ghudsavar","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FGhudsavar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FGhudsavar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FGhudsavar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FGhudsavar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iakashpaul","download_url":"https://codeload.github.com/iakashpaul/Ghudsavar/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FGhudsavar/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265905087,"owners_count":23846695,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gemma","gemma-2b","ggml","gguf","google","huggingface","llama","llamacpp","server"],"created_at":"2024-09-24T13:33:46.511Z","updated_at":"2025-07-19T08:33:36.491Z","avatar_url":"https://github.com/iakashpaul.png","language":"Dockerfile","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ghudsavar 🏇🏻\n\nGhudsavar (Horse rider) - Helps you spin up a quick [llama.cpp](https://github.com/ggerganov/llama.cpp) server (OpenAI API compatbile) which plugs into ```langchain``` \u0026 ```llamaindex``` w/o sweat. Currently for CPU only runtimes, made available as a docker image. Duplicate this [🤗 HF-space](https://huggingface.co/spaces/iAkashPaul/server.cpp) as your own CPU or GPU(with suitable build flags \u0026 ngl params) space \u0026 change the model weights to your own GGUF file. \n\n\u003e BTW the free tier with 2 CPU-cores runs between 5-8tok/s with Gemma-2B-Instruct@Q8, which is alright for quick testing.\n\n## Local setup\n\n```bash\ngit clone https://github.com/iakashpaul/Ghudsavar.git\ncd Ghudsavar\ndocker build -t iakashpaul/Ghudsavar:latest .\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiakashpaul%2Fghudsavar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fiakashpaul%2Fghudsavar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiakashpaul%2Fghudsavar/lists"}