https://github.com/l-mds/local-data-stack

https://github.com/l-mds/local-data-stack

Last synced: 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/l-mds/local-data-stack
• Owner: l-mds
• Created: 2024-10-26T15:35:24.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-11-05T06:43:03.000Z (4 months ago)
• Last Synced: 2024-11-05T07:24:28.670Z (4 months ago)
• Language: Python
• Size: 333 KB
• Stars: 10
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# local data stack template

- dagster, dbt, duckdb

- pixi

- docker

- ruff, pyright, taplo, pytest

- cruft

## usage

Prerequisites: 

- an installation of cruft `pip install cruft jinja2-ospath`

- an installation of pixi https://pixi.sh/latest/#installation `curl -fsSL https://pixi.sh/install.sh | bash`

- text editor of choice such as vscode

- docker

```bash

pixi run tpl-init-cruft

# alternatively:

cruft create cruft create [email protected]:l-mds/local-data-stack.git

cd <>

git init

git add .

git commit -m "initial commit"

pixi update

git commit -m "set dependencies"

git commit -m "reformatting"

pixi run fmt

```

Post install:

- update the secrets in the `.env` files by executing: `openssl rand -base64 32` and setting a suitable secret

- ensure the `.env.enc` can be created by following the instructions in [documentation/secops]