{"id":26123228,"url":"https://github.com/adysec/ollama_load_balancer","last_synced_at":"2025-03-10T15:46:05.944Z","repository":{"id":281633639,"uuid":"945892704","full_name":"adysec/Ollama_Load_Balancer","owner":"adysec","description":"Ollama负载均衡服务器 | 一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。","archived":false,"fork":false,"pushed_at":"2025-03-10T10:23:42.000Z","size":0,"stargazers_count":51,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-10T10:36:07.302Z","etag":null,"topics":["ai","deepseek-r1","embed","embedded","embeddings","gpt","llm","ollama","ollama-api","ollama-app","ollama-chat","ollama-client","qwq"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/adysec.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-10T09:41:45.000Z","updated_at":"2025-03-10T10:35:06.000Z","dependencies_parsed_at":"2025-03-10T10:36:21.057Z","dependency_job_id":"4689dd43-32a4-4039-a074-5b9d4b7b4bfe","html_url":"https://github.com/adysec/Ollama_Load_Balancer","commit_stats":null,"previous_names":["adysec/ollama_load_balancer"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/adysec%2FOllama_Load_Balancer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/adysec%2FOllama_Load_Balancer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/adysec%2FOllama_Load_Balancer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/adysec%2FOllama_Load_Balancer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/adysec","download_url":"https://codeload.github.com/adysec/Ollama_Load_Balancer/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242882812,"owners_count":20200974,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","deepseek-r1","embed","embedded","embeddings","gpt","llm","ollama","ollama-api","ollama-app","ollama-chat","ollama-client","qwq"],"created_at":"2025-03-10T15:46:03.039Z","updated_at":"2025-03-10T15:46:05.939Z","avatar_url":"https://github.com/adysec.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ollama 负载均衡服务器\n\nOllama 负载均衡服务器是一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。\n\n## 特性\n\n- **高性能** - 采用先进的算法和技术来实现高效的请求分发。\n- **易配置** - 简单直观的配置文件使得部署和调整变得轻而易举。\n- **可扩展性** - 支持动态添加或移除后端服务节点，无需重启服务器。\n- **安全性** - 无原有Ollama漏洞利用路径相关路由，无法通过该负载均衡服务器删除源服务器模型及数据。\n\n## 使用场景\n\n- 提升Web应用和服务的可用性\n- 均衡分布式系统的负载\n- 快速故障转移和恢复\n- 作为代理服务器，不使原生ollama端口对外暴露\n\n## 说明\n\n`ollama.db`: 存储源服务器列表，通过`/api/tags`接口获取，可使用自建Ollama或公网开放的Ollama服务器\n\n## 支持接口\n\n`/`: Ollama is running\n\n`/api/tags`: 已启用的模型列表\n\n`/v1/models`: 已启用的模型列表(OpenAI接口)\n\n`/api/version`: Ollama版本号\n\n`/api/chat`：LLM模型调用\n\n`/api/embed`：embedding模型调用\n\n`/api/embeddings`：embedding模型调用\n\n\n不支持`/api/show`、`/api/copy`、`/api/create`、`/api/push`、`/api/delete`、`/api/pull`、`/api/ps`等有一定危险性的接口\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fadysec%2Follama_load_balancer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fadysec%2Follama_load_balancer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fadysec%2Follama_load_balancer/lists"}