https://github.com/bruvduroiu/dagster-llama-pipeline

Orchestrate complex Llama chains using Dagster
https://github.com/bruvduroiu/dagster-llama-pipeline

Last synced: about 9 hours ago
JSON representation

Orchestrate complex Llama chains using Dagster

• Host: GitHub
• URL: https://github.com/bruvduroiu/dagster-llama-pipeline
• Owner: bruvduroiu
• Created: 2023-07-20T03:40:24.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-21T11:15:43.000Z (over 1 year ago)
• Last Synced: 2024-04-16T00:38:36.529Z (7 months ago)
• Language: Python
• Size: 55.7 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Dagster ❤️ Llama 🦙

Toy example using Dagster orchestration in conjunction with [llama.cpp](https://github.com/ggerganov/llama.cpp) to achieve a performant and observable data pipeline.

This repo is the supporting material for the blog post: [Dagster ❤️ Llama - orchestration for modern LLM pipelines](https://buduroiu.com/blog/dagster-llama-data-engineering)

## Installation

```bash

pyenv local 3.9.x

poetry config virtualenvs.in-project true --local

poetry install

```

## To run

```bash

# Start up Llama server

poetry run python -m llama_cpp.server --model ggml-model-q4_0.bin

# Start dagit

poetry run dagit -f src/__init__.py -d .

```