Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kvdomingo/genai-lab
GenAI playground maximizing the use of open-source software and models
https://github.com/kvdomingo/genai-lab
chromadb dagster langchain nvidia-cuda ollama openai python
Last synced: 19 days ago
JSON representation
GenAI playground maximizing the use of open-source software and models
- Host: GitHub
- URL: https://github.com/kvdomingo/genai-lab
- Owner: kvdomingo
- Created: 2024-10-23T10:10:09.000Z (2 months ago)
- Default Branch: main
- Last Pushed: 2024-11-27T11:39:22.000Z (about 1 month ago)
- Last Synced: 2024-11-27T12:28:50.583Z (about 1 month ago)
- Topics: chromadb, dagster, langchain, nvidia-cuda, ollama, openai, python
- Language: Python
- Homepage:
- Size: 916 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# GenAI Lab
## Prerequisites
- [ ] [Mise](https://mise.jdx.dev)
- [ ] Docker
- [ ] Recent graphics drivers + CUDA support
## Running locally
```shell
# Install prerequisites
mise install
# Enter Poetry shell
poetry shell
# Start the Ollama backend and Chroma vector database
task
# Run the chatbot
python -m vanilla
```
The chatbot uses the `llama3.2` (3B) model by default. To change the model, get the model name from
the Ollama [models](https://ollama.com/library) list and pass it to the `-m`/`--model` argument.
```shell
python -m vanilla -- --model gemma2
```