https://github.com/kvdomingo/dagster-test
dagster-test
https://github.com/kvdomingo/dagster-test
Last synced: 4 months ago
JSON representation
dagster-test
- Host: GitHub
- URL: https://github.com/kvdomingo/dagster-test
- Owner: kvdomingo
- Created: 2023-07-18T10:24:55.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-07-18T10:25:01.000Z (almost 2 years ago)
- Last Synced: 2025-01-04T06:24:19.745Z (5 months ago)
- Language: Python
- Size: 67.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# dagster_test
This is a [Dagster](https://dagster.io/) project scaffolded
with [`dagster project scaffold`](https://docs.dagster.io/getting-started/create-new-project).
## Getting started
First, install your Dagster code location as a Python package. By using the --editable
flag, pip will install your Python package
in ["editable mode"](https://pip.pypa.io/en/latest/topics/local-project-installs/#editable-installs)
so that as you develop, local code changes will automatically apply.
```bash
pip install -e ".[dev]"
```
Then, start the Dagster UI web server:
```bash
dagster dev
```
Open http://localhost:3000 with your browser to see the project.
You can start writing assets in `dagster_test/assets.py`. The assets are automatically
loaded into the Dagster code location as you define them.
## Development
### Adding new Python dependencies
You can specify new Python dependencies in `setup.py`.
### Unit testing
Tests are in the `dagster_test_tests` directory and you can run tests using `pytest`:
```bash
pytest dagster_test_tests
```
### Schedules and sensors
If you want to enable
Dagster [Schedules](https://docs.dagster.io/concepts/partitions-schedules-sensors/schedules)
or [Sensors](https://docs.dagster.io/concepts/partitions-schedules-sensors/sensors) for
your jobs, the [Dagster Daemon](https://docs.dagster.io/deployment/dagster-daemon)
process must be running. This is done automatically when you run `dagster dev`.
Once your Dagster Daemon is running, you can start turning on schedules and sensors for
your jobs.
## Deploy on Dagster Cloud
The easiest way to deploy your Dagster project is to use Dagster Cloud.
Check out the [Dagster Cloud Documentation](https://docs.dagster.cloud) to learn more.