{"id":35185346,"url":"https://github.com/iamjoybo/ktransformers","last_synced_at":"2026-04-01T17:02:16.601Z","repository":{"id":287485575,"uuid":"964892936","full_name":"IAMJOYBO/ktransformers","owner":"IAMJOYBO","description":"清华大学 KTransformers Docker Image Build Tool","archived":false,"fork":false,"pushed_at":"2025-04-20T23:29:52.000Z","size":215,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2026-03-27T23:42:21.916Z","etag":null,"topics":["deepseek","deepseek-ai","deepseek-api","deepseek-chat","deepseek-coder","deepseek-llm","deepseek-math","deepseek-r1","deepseek-r1-zero","deepseek-v3","docker","docker-compose","docker-container","docker-image","ktransformers"],"latest_commit_sha":null,"homepage":"https://github.com/kvcache-ai/ktransformers","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/IAMJOYBO.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-04-12T01:23:28.000Z","updated_at":"2025-09-05T16:15:41.000Z","dependencies_parsed_at":null,"dependency_job_id":"02aeab7a-925b-4a85-9213-d91a40d5244d","html_url":"https://github.com/IAMJOYBO/ktransformers","commit_stats":null,"previous_names":["iamjoybo/ktransformers"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/IAMJOYBO/ktransformers","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IAMJOYBO%2Fktransformers","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IAMJOYBO%2Fktransformers/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IAMJOYBO%2Fktransformers/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IAMJOYBO%2Fktransformers/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/IAMJOYBO","download_url":"https://codeload.github.com/IAMJOYBO/ktransformers/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IAMJOYBO%2Fktransformers/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31290538,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-01T13:12:26.723Z","status":"ssl_error","status_checked_at":"2026-04-01T13:12:25.102Z","response_time":53,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deepseek","deepseek-ai","deepseek-api","deepseek-chat","deepseek-coder","deepseek-llm","deepseek-math","deepseek-r1","deepseek-r1-zero","deepseek-v3","docker","docker-compose","docker-container","docker-image","ktransformers"],"created_at":"2025-12-29T04:57:36.226Z","updated_at":"2026-04-01T17:02:16.591Z","avatar_url":"https://github.com/IAMJOYBO.png","language":"Dockerfile","readme":"# 清华大学 KTransformers Docker Image Build Tool\n## Docker镜像\n### registry.cn-hangzhou.aliyuncs.com/joybo/ktransformers\n|序号|Tag|构建时间|指令集|PyTorch版本|New|WEB|架构|\n| ----------- | ----------- | ----------- | ----------- | ----------- | ----------- | ----------- | ----------- |\n|01|v2025.04.12-action|2025.4.12|NATIVE|2.6.0+cu126|[最新镜像](../../actions/workflows/docker_build.yaml)|❌|amd64|\n|02|v2025.04.13-action-web|2025.4.13|NATIVE|2.6.0+cu126|[最新镜像](../../actions/workflows/docker_build_web.yaml)|✅|amd64|\n\u003e PyTorch基础镜像：[https://hub.docker.com/r/pytorch/pytorch/tags](https://hub.docker.com/r/pytorch/pytorch/tags)\n### Docker Compose 示例（无WEB）\n```yaml\nservices:\n  ktransformers:\n    image: registry.cn-hangzhou.aliyuncs.com/joybo/ktransformers:v2025.04.12-action\n    container_name: ktransformers\n    hostname: ktransformers\n    environment:\n      - TZ=Asia/Shanghai\n      # - NVIDIA_VISIBLE_DEVICES=0\n    volumes:\n      - ./DeepSeek-V2-Lite-Chat-GGUF:/app/model/DeepSeek-V2-Lite-Chat-GGUF\n    ports:\n      - \"10002:10002\"\n    runtime: nvidia\n    deploy:\n      resources:\n        reservations:\n          devices:\n          - driver: nvidia\n            # device_ids: ['0']\n            capabilities: [gpu]\n    stdin_open: true\n    tty: true\n    restart: no\n    networks:\n      - ktransformers\n    entrypoint: [\"python\", \"-m\", \"ktransformers.local_chat\", \"--model_path=/app/model/DeepSeek-V2-Lite-Chat\", \"--gguf_path=/app/model/DeepSeek-V2-Lite-Chat-GGUF\"]\n\nnetworks:\n  ktransformers:\n    driver: bridge\n    name: ktransformers\n```\n### Docker Compose 示例（带WEB）\n#### 🌐 FastAPI：http://\u003cIP地址\u003e:10002/docs，具体请参见 [fastapi](https://fastapi.tiangolo.com/zh/#api) 官方文档\n#### 🌐 WebChat：http://\u003cIP地址\u003e:10002/web/index.html#/chat\n```yaml\nservices:\n  ktransformers:\n    image: registry.cn-hangzhou.aliyuncs.com/joybo/ktransformers:v2025.04.13-action-web\n    container_name: ktransformers\n    hostname: ktransformers\n    environment:\n      - TZ=Asia/Shanghai\n      # - NVIDIA_VISIBLE_DEVICES=0\n    volumes:\n      - ./DeepSeek-V2-Lite-Chat-GGUF:/app/model/DeepSeek-V2-Lite-Chat-GGUF\n    ports:\n      - \"10002:10002\"\n    runtime: nvidia\n    deploy:\n      resources:\n        reservations:\n          devices:\n          - driver: nvidia\n            # device_ids: ['0']\n            capabilities: [gpu]\n    stdin_open: true\n    tty: true\n    restart: no\n    networks:\n      - ktransformers\n    entrypoint: [\"ktransformers\", \"--model_path=/app/model/DeepSeek-V2-Lite-Chat\", \"--gguf_path=/app/model/DeepSeek-V2-Lite-Chat-GGUF\", \"--port=10002\", \"--web=True\"]\n\nnetworks:\n  ktransformers:\n    driver: bridge\n    name: ktransformers\n```\n由于官方的WEB的问题，无法正常使用WEBUI聊天，需要先修改config.js\n(/workspace/ktransformers/ktransformers/website/public/config.js)\n```js\nwindow.configWeb = {\n    apiUrl: '/v1',\n    port: 8080,\n  };\n```\n### Docker Image 说明\n```\n【预下载的模型配置】\n1、DeepSeek-R1：/app/model/DeepSeek-R1\n2、DeepSeek-V3-0324：/app/model/DeepSeek-V3-0324\n3、DeepSeek-V2-Lite-Chat：/app/model/DeepSeek-V2-Lite-Chat\n\n【启动命令：LocalChat】（GGUF文件需要下载到对应的目录内，仅允许存在GGUF文件，且不允许存在多个不同量化版本的GGUF）\n1、DeepSeek-R1：python -m ktransformers.local_chat --model_path=/app/model/DeepSeek-R1 --gguf_path=/app/model/DeepSeek-R1-GGUF\n2、DeepSeek-V3-0324：python -m ktransformers.local_chat --model_path=/app/model/DeepSeek-V3-0324 --gguf_path=/app/model/DeepSeek-V3-0324-GGUF\n3、DeepSeek-V2-Lite-Chat：python -m ktransformers.local_chat --model_path=/app/model/DeepSeek-V2-Lite-Chat --gguf_path=/app/model/DeepSeek-V2-Lite-Chat-GGUF\n\n【启动命令：WEB服务】（GGUF文件需要下载到对应的目录内，仅允许存在GGUF文件，且不允许存在多个不同量化版本的GGUF）\n1、DeepSeek-R1：ktransformers --model_path=/app/model/DeepSeek-R1 --gguf_path=/app/model/DeepSeek-R1-GGUF --port=10002 --web=True\n2、DeepSeek-V3-0324：ktransformers --model_path=/app/model/DeepSeek-V3-0324 --gguf_path=/app/model/DeepSeek-V3-0324-GGUF --port=10002 --web=True\n3、DeepSeek-V2-Lite-Chat：ktransformers --model_path=/app/model/DeepSeek-V2-Lite-Chat --gguf_path=/app/model/DeepSeek-V2-Lite-Chat-GGUF --port=10002 --web=True\n\n【部分GGUF的地址：国内可访问】\n1、DeepSeek-R1：https://hf-mirror.com/unsloth/DeepSeek-R1-GGUF\n2、DeepSeek-V3-0324：https://hf-mirror.com/unsloth/DeepSeek-V3-0324-GGUF\n3、DeepSeek-V2-Lite-Chat：https://hf-mirror.com/mradermacher/DeepSeek-V2-Lite-Chat-GGUF\n```\n## 官方仓库\n[https://github.com/kvcache-ai/ktransformers.git](https://github.com/kvcache-ai/ktransformers.git)\n## 官方部署文档\n[https://kvcache-ai.github.io/ktransformers/en/install.html](https://kvcache-ai.github.io/ktransformers/en/install.html)\n## WEB 部署文档\n[https://kvcache-ai.github.io/ktransformers/en/api/server/website.html](https://kvcache-ai.github.io/ktransformers/en/api/server/website.html)\n## Docker 部署文档\n[https://github.com/kvcache-ai/ktransformers/blob/main/doc/en/Docker.md](https://github.com/kvcache-ai/ktransformers/blob/main/doc/en/Docker.md)\n## Dockerfile 文件\n[https://github.com/kvcache-ai/ktransformers/blob/main/Dockerfile](https://github.com/kvcache-ai/ktransformers/blob/main/Dockerfile)\n\n# Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=IAMJOYBO/ktransformers\u0026type=Date)](https://www.star-history.com/#IAMJOYBO/ktransformers\u0026Date)\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiamjoybo%2Fktransformers","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fiamjoybo%2Fktransformers","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiamjoybo%2Fktransformers/lists"}