Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/alesr/chatbot

Implements a chatbot with custom embeddings using OpenAI APIs and pgVector
https://github.com/alesr/chatbot

Last synced: 3 days ago
JSON representation

Implements a chatbot with custom embeddings using OpenAI APIs and pgVector

Host: GitHub
URL: https://github.com/alesr/chatbot
Owner: alesr
License: mit
Created: 2023-07-31T23:10:50.000Z (over 1 year ago)
Default Branch: master
Last Pushed: 2023-08-01T10:35:58.000Z (over 1 year ago)
Last Synced: 2024-11-22T05:28:39.334Z (2 months ago)
Language: Go
Size: 19.5 KB
Stars: 0
Watchers: 3
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

# chatbot
Implements a chatbot with custom embeddings using OpenAI APIs and pgVector.

## Package Documentation

To access the package documentation, install godoc with the following command: go install -v golang.org/x/tools/cmd/godoc@latest. Then, run godoc -http=:6060 and open http://localhost:6060/pkg/github.com/alesr/chatbot/ in your browser. Alternatively, if you have Task installed, you can run task godoc.

## Example:

The following example illustrates how to train a model and pose a question. When invoking the Train method, the service reads data from the provided io.Reader, splits it into chunks, and creates an OpenAI embedding for each chunk. The embeddings are then stored in a pgVector database, along with the original text, user ID, and collection ID. It's important to note that each user can have multiple collections, and each collection can contain numerous embeddings.

Upon invoking the Ask method, the service creates an embedding for the question and compares it to the embeddings in the collection using cosine similarity. The answer that exhibits the highest similarity is returned.

The method then makes a request to the OpenAI API to generate a chat completion, using the text from the most similar embedding as the prompt, and the original question.

```go
func ExampleService_Train() {
client := openaicli.New(os.Getenv("OPENAI_API_KEY"), &http.Client{})

db, _ := sqlx.Open(
"postgres",
"postgres://user:password@localhost:5432/testdb?sslmode=disable",
)

repo := storage.NewPostgres(db)

svc := chatbot.NewService(os.Getenv("OPENAI_API_KEY"), client, repo)

input := chatbot.TrainInput{
UserID: "user1",
Model: "text-embedding-ada-002",
Data: []io.Reader{
strings.NewReader(
`Unbearable Lightness of Being is an exploration of human life in its intricacies and contradictions. A poignant excerpt reads, "Human life occurs only once, and the reason we cannot determine which of our decisions are good and which are bad is that in a given situation we can make only one decision; we are not granted a second, third, or fourth life for comparison." It beautifully captures the essence of the book's exploration of existence, love, and choices.`,
),
strings.NewReader(
`Milan Kundera is a renowned Czech-born French author, known for his profound and philosophical narratives. His works often blend elements of history, politics, and existentialism. Kundera's most famous novel, "The Unbearable Lightness of Being," is celebrated for its introspective exploration of love and fate, reflecting his unique style of merging philosophy with fiction. He is esteemed for his insightful contributions to 20th-century literature.`,
),
strings.NewReader(
`Neptune, the eighth and farthest known planet from the Sun in our solar system, is known for its striking blue color, attributed to its atmosphere composed of hydrogen, helium, and methane. This gas giant, discovered in 1846, has a strong magnetic field, extreme weather conditions with the fastest wind speeds in the solar system, and a total of 14 known moons. The largest, Triton, is the only large moon in the solar system that orbits in the opposite direction of its planet's rotation, a retrograde orbit.`,
),
strings.NewReader(
`In Roman mythology, Neptune was the god of freshwater and the sea, a counterpart to the Greek god Poseidon. Known for his powerful and volatile nature, he ruled all bodies of water and was often depicted holding a trident. Neptune was also one of the chief gods and was considered the brother of Jupiter and Pluto. The Romans held a festival, Neptunalia, in his honor, which was marked by games and water-based festivities. It's fascinating to note the parallels between the turbulent and mysterious nature of the planet and its namesake god.`,
),
},
}

collectionID, _ := svc.Train(context.TODO(), input)

fmt.Print(collectionID)

// Output example: coll-00000000-0000-0000-0000-000000000000
}

func ExampleService_Ask() {
client := openaicli.New(os.Getenv("OPENAI_API_KEY"), &http.Client{})

db, _ := sqlx.Open(
"postgres",
"postgres://user:password@localhost:5432/testdb?sslmode=disable",
)

repo := storage.NewPostgres(db)

svc := chatbot.NewService(os.Getenv("OPENAI_API_KEY"), client, repo)

input := `What neptune the planned has to do with the roman god?`

answer, _ := svc.Ask(context.Background(), "user1", "coll-00000000-0000-0000-0000-000000000000", input)

fmt.Print(answer)

// Output example: Given the deep influence of ancient mythology on naming celestial bodies, the planet was named after the Roman god of the sea, Neptune, who held a similar role to the Greek god Poseidon. The Roman god was associated with the sea, freshwater, and other bodies of water, symbolizing both their tranquil and tempestuous aspects. The name Neptune was chosen to capture the mysterious and powerful nature of the planet, which lies so distant in the outer reaches of our solar system.
}
```