https://github.com/pablosanchi/rag-go-milvus
Vectorstore backend - go - milvus
https://github.com/pablosanchi/rag-go-milvus
docker go hexagonal-architecture llm milvus mistral-7b ollama
Last synced: 2 months ago
JSON representation
Vectorstore backend - go - milvus
- Host: GitHub
- URL: https://github.com/pablosanchi/rag-go-milvus
- Owner: PabloSanchi
- Created: 2023-12-09T01:54:45.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-03-07T18:24:34.000Z (over 1 year ago)
- Last Synced: 2024-04-23T11:38:03.907Z (over 1 year ago)
- Topics: docker, go, hexagonal-architecture, llm, milvus, mistral-7b, ollama
- Language: Go
- Homepage:
- Size: 222 KB
- Stars: 1
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Vectorstore with GO and MILVUS
## Embedding Util - Ollama
In this project, I am exploring advanced AI capabilities using Ollama and Milvus. For detailed information about Ollama's AI technologies, you can visit their [website](https://ollama.ai/).
### Using Mistral Model for Embedding with Ollama
My focus is on utilizing the embedding feature of the Mistral model provided by Ollama. This feature converts text data into numerical vectors of 4096 dimensions.
### About Milvus Datastore
[Milvus](https://milvus.io/docs) is an open-source database specifically tailored for storing and managing embeddings. Embeddings are essentially data transformed into numeric vector formats. This functionality is crucial for enabling semantic search, where we can find data based on its meaning and context.
#### Key Functionalities of this project:
- **Create Collection**: Initiating new data collections.
- **Delete Collection**: Removing existing collections.
- **List Collections**: Displaying all available collections.
- **Upsert Documents**: Adding or updating documents in collections.
- **Search Documents**: Conducting searches within collections to find relevant or similar documents.
### Project Purpose
The primary aim of this project is educational, focusing on applying hexagonal architecture in [go](https://go.dev/). This architecture facilitates a modular and maintainable code structure.
## TODO
- [ ] Dynamic schema
- [X] Testing (ongoing...)
- [X] Build Milvus + Ollama with mistal + Go backend with docker
## RUNNING
- `sudo docker compose up -d`
- `docker exec -it ollama ollama run mistral`
- DONE 🙂