https://github.com/liudding/go-llm-api
百度文心一言千帆 GO SDK；智谱 AI、腾讯混元、讯飞星火、商汤日日新、MinMax
https://github.com/liudding/go-llm-api
Last synced: 12 months ago
JSON representation
百度文心一言千帆 GO SDK；智谱 AI、腾讯混元、讯飞星火、商汤日日新、MinMax
- Host: GitHub
- URL: https://github.com/liudding/go-llm-api
- Owner: liudding
- Created: 2023-09-28T06:57:44.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-20T04:36:32.000Z (about 2 years ago)
- Last Synced: 2025-04-06T08:41:33.195Z (about 1 year ago)
- Language: Go
- Homepage:
- Size: 58.6 KB
- Stars: 12
- Watchers: 1
- Forks: 4
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# go-llm-api
百度千帆、智谱 Ai、腾讯混元、讯飞星火、商汤日日新、MinMax 等的大语言模型非官方 API，支持以下模型：
* 百度千帆平台所有模型
* 智谱 AI 模型
* 腾讯混元
* 等等
## Installation
```
go get github.com/liudding/go-llm-api
```
要求 go 版本最低是 1.18.
## Usage
### 百度千帆 Ernie:
```go
package main
import (
"context"
"fmt"
"github.com/liudding/github.com/liudding/go-llm-api/baidu"
)
func main() {
client := NewClient("xxxx", "yyyy", true)
stream, err := client.CreateChatCompletionStream(context.Background(), ChatCompletionRequest{
Messages: []ChatCompletionMessage{
{
Role: ChatMessageRoleUser,
Content: "Hello!",
},
},
Stream: true,
})
defer stream.Close()
fmt.Println("Stream response: ")
for {
response, err := stream.Recv()
if errors.Is(err, io.EOF) {
fmt.Printf("\nStream finished: %d %s\n", response.ErrorCode, response.ErrorMsg)
return
}
if err != nil {
fmt.Printf("\nStream error: %v\n", err)
return
}
fmt.Printf("error: %s\n", response.ErrorMsg)
fmt.Printf("resp: %s\n", response.Result)
}
}
```
### 智谱
```go
token, _ := zhipu.GenerateAuthToken(l.svcCtx.Config.ZhipuAi.Key, time.Minute*60)
client := zhipu.NewClient(token)
stream, err := client.CreateChatCompletionStream(context.Background(), zhipu.ChatCompletionRequest{
Prompt: []zhipu.ChatCompletionMessage{
{
Role: zhipu.ChatMessageRoleUser,
Content: prompt,
},
},
Temperature: 0.7,
//RequestId: "",
Incremental: true,
//ReturnType: "",
//Ref: ChatCompletionRef{},
}, zhipu.ModelTurbo)
defer stream.Close()
```