{"id":28367016,"url":"https://github.com/infuseai/primelm","last_synced_at":"2025-10-23T19:57:29.206Z","repository":{"id":213625967,"uuid":"731402724","full_name":"InfuseAI/PrimeLM","owner":"InfuseAI","description":"The large language model service and project dialogue system platform, built for enterprises, is provided by InfuseAI.","archived":false,"fork":false,"pushed_at":"2024-01-03T08:56:05.000Z","size":3238,"stargazers_count":6,"open_issues_count":0,"forks_count":0,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-05-29T00:15:33.675Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/InfuseAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-12-14T02:17:18.000Z","updated_at":"2025-01-15T18:47:54.000Z","dependencies_parsed_at":"2024-01-03T10:01:41.063Z","dependency_job_id":"21c4f548-8f03-4812-b0dc-090cf2b29ba3","html_url":"https://github.com/InfuseAI/PrimeLM","commit_stats":null,"previous_names":["infuseai/primelm"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/InfuseAI/PrimeLM","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2FPrimeLM","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2FPrimeLM/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2FPrimeLM/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2FPrimeLM/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/InfuseAI","download_url":"https://codeload.github.com/InfuseAI/PrimeLM/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2FPrimeLM/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261012811,"owners_count":23096916,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-29T00:13:53.770Z","updated_at":"2025-10-23T19:57:29.189Z","avatar_url":"https://github.com/InfuseAI.png","language":null,"readme":"# PrimeLM\n\nEnglish Version: Please see the [English version document](./English/README.md)\n\n（備註：此產品會因相關需求，隨時進行修正，並且更新於此。）\n\n## I. 平台介紹\n\n為企業所打造的大型語言模型服務與專案對話系統平台，本系統由 InfuseAI 提供服務。\n\n- 平台功能\n\n|帳號權限管理|對話平台介面|\n|-----|-----|\n|![img1](./img/primelm-demo-1.png)|![img2](./img/primelm-demo-2.png)|\n\n|知識庫介接轉換|測試模型API|\n|-----|-----|\n|![img3](./img/primelm-demo-3.png)|![img4](./img/primelm-demo-4.png)|\n\n## II. 為何要使用 PrimeLM 成為企業內部的 LLM 管理系統?\n\n為了協助企業迅速且有效地導入大型語言模型，本應用著重於以下幾個關鍵領域：\n\n1. 企業機密資料外洩與資安問題：鑒於公司的風險評估，無法採用某些大型語言模型，從而增加了整合這些模型的挑戰。\n2. 模型學習內部知識的能力：考慮到公司內部擁有豐富的知識庫文件，探索如何有效地使模型快速吸收這些知識成為關鍵。\n3. 持續改進模型的可能性：如果不定期更新大型語言模型，可能會遇到無法解答的問題，因此確保模型的持續進步變得至關重要。\n4. 大型語言模型的專案管理：隨著企業逐步在日常工作環境中整合LLM的不同專案，針對知識庫和模型的管理、專案權限和帳號的有效控制變得尤為重要。\n\n## III. 產品 Roadmap\n\n![PrimeLM Solution Roadmap](./img/primelm-roadmap.png)\n\n## IV. 平台目前支援的模型\n\n- OpenAI API Service: \n\n  本平台支援 OpenAI API Service，包含：\n\n  1. OpenAI API Service\n  2. Azure OpenAI API Service (AOAI)\n\n- LlaMa GGUF 模型：\n\n  本平台支援[GGUF模型](https://huggingface.co/models?search=gguf)格式進行服務啟動與使用\n\n- 繁體中文 Llama GGUF 模型：\n\n  本平台確認可使用的繁體中文 Llama 模型整理如下：\n\n| Model Name               | Author                                                    | HuggingFace Repo                                                                                                      |\n|--------------------------|-----------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------|\n| Taiwan-LLaMa-v1.0        | 台大陳縕儂實驗室 林彥廷博士生候選人                       | [yentinglin/Taiwan-LLaMa-v1.0](https://huggingface.co/yentinglin/Taiwan-LLaMa-v1.0)                                   |\n| Taiwan-LLM-7B-v2.1-chat  | 台大陳縕儂實驗室 林彥廷博士生候選人 \u003cbr\u003e 優必達株式會社 Ubitus | [yentinglin/Taiwan-LLM-7B-v2.1-chat](https://huggingface.co/yentinglin/Taiwan-LLM-7B-v2.1-chat)                       |\n| Taiwan-LLM-13B-v2.0-chat | 台大陳縕儂實驗室 林彥廷博士生候選人 \u003cbr\u003e 優必達株式會社 Ubitus | [yentinglin/Taiwan-LLM-13B-v2.0-chat](https://huggingface.co/yentinglin/Taiwan-LLM-13B-v2.0-chat)                     |\n| Mistral-7B-v0.1          | Mistral AI Team                                           | [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)                                         |\n| TAIDE-7B-b.11.0.0       | 國科會                                                    | [TAIDE 官方網站](https://taide.tw/) \u003cbr\u003e 備註：目前尚未公開，InfuseAI 已與國科會進行合作，確認模型使用與串接方式 |\n\n## V. 知識庫支援方式\n\n- 可透過 CSV 檔案匯入轉換成 Embedding Vector，並且存放到 [pgvector Database](https://github.com/pgvector/pgvector) 來進行存放作業。\n- 後續會根據客戶需求，來導入更多的知識庫。\n\n## VI. 產品使用聯絡方式\n\n- [ 方法 1 ] 將相關需求撰寫，並且寄送至 InfuseAI Business E-mail: [business@infuseai.io](mailto:user@example.com)\n- [ 方法 2 ] 填寫以下表單，將由專人與您聯絡：\n\n  #TODO: form generation\n\n## VII. 產品傳單\n\n![PrimeLM flyer](./img/primelm-flyer.png)","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finfuseai%2Fprimelm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finfuseai%2Fprimelm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finfuseai%2Fprimelm/lists"}