https://github.com/kvdomingo/genai-lab
GenAI playground maximizing the use of open-source software and models
https://github.com/kvdomingo/genai-lab
chromadb dagster langchain nvidia-cuda ollama python unstructured
Last synced: about 2 months ago
JSON representation
GenAI playground maximizing the use of open-source software and models
- Host: GitHub
- URL: https://github.com/kvdomingo/genai-lab
- Owner: kvdomingo
- Created: 2024-10-23T10:10:09.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-02-20T12:59:08.000Z (3 months ago)
- Last Synced: 2025-03-15T22:31:45.629Z (3 months ago)
- Topics: chromadb, dagster, langchain, nvidia-cuda, ollama, python, unstructured
- Language: Python
- Homepage:
- Size: 1.33 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# GenAI Lab
## Prerequisites
- [ ] [Mise](https://mise.jdx.dev)
- [ ] Docker
- [ ] Recent graphics drivers + CUDA support
## Running locally
```shell
# Install prerequisites
mise install
# Enter Poetry shell
poetry shell
# Start the Ollama backend and Chroma vector database
task
# Run the chatbot
python -m vanilla
```
The chatbot uses the `llama3.2` (3B) model by default. To change the model, get the model name from
the Ollama [models](https://ollama.com/library) list and pass it to the `-m`/`--model` argument.
```shell
python -m vanilla -- --model gemma2
```