https://github.com/prefecthq/prefect-firebolt
Prefect integrations for working with Firebolt data warehouses.
https://github.com/prefecthq/prefect-firebolt
firebolt prefect
Last synced: about 2 months ago
JSON representation
Prefect integrations for working with Firebolt data warehouses.
- Host: GitHub
- URL: https://github.com/prefecthq/prefect-firebolt
- Owner: PrefectHQ
- License: apache-2.0
- Created: 2022-09-20T12:26:49.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-09-30T01:24:48.000Z (8 months ago)
- Last Synced: 2025-04-11T02:58:17.970Z (about 2 months ago)
- Topics: firebolt, prefect
- Language: Python
- Homepage: https://prefecthq.github.io/prefect-firebolt/
- Size: 1.68 MB
- Stars: 4
- Watchers: 5
- Forks: 1
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
# prefect-firebolt
## Welcome!
`prefect-firebolt` is a collection of Prefect integrations for working with Firebolt data warehouses.
[Firebolt](https://www.firebolt.io/) is a Cloud Data Warehousing solution that helps its users streamline their Data Analytics and access to insights. For more information about getting started with Firebolt, read [Firebolt's getting started guide](https://docs.firebolt.io/getting-started.html).
## Getting Started
### Python setup
Requires an installation of Python 3.7+.
We recommend using a Python virtual environment manager such as pipenv, conda or virtualenv.
These tasks are designed to work with Prefect 2.0. For more information about how to use Prefect, please refer to the [Prefect documentation](https://orion-docs.prefect.io/).
### Installation
Install `prefect-firebolt` with `pip`:
```bash
pip install prefect-firebolt
```
Then, register to [view the Firebolt blocks](https://orion-docs.prefect.io/ui/blocks/) on Prefect Cloud:
```bash
prefect block register -m prefect_firebolt
```
Note, to use the `load` method on Blocks, you must already have a block document [saved through code](https://orion-docs.prefect.io/concepts/blocks/#saving-blocks) or [saved through the UI](https://orion-docs.prefect.io/ui/blocks/).
### Write and run a flow
Execute a query against a Firebolt database:
```python
from prefect import flow
from prefect_firebolt import FireboltCredentials, FireboltDatabase, query_firebolt
@flow
def run_firebolt_query():
firebolt_database_block = FireboltDatabase(
database="travel",
credentials=FireboltCredentials(
username="[email protected]", password="dont42panic"
),
)
results = query_firebolt(
database=firebolt_database_block,
query="SELECT * FROM ex_intergalactic_trips LIMIT 100",
)
return results
run_firebolt_query()
```
## Resources
If you encounter any bugs while using `prefect-firebolt`, feel free to open an issue in the [prefect-firebolt](https://github.com/PrefectHQ/prefect-firebolt) repository.
If you have any questions or issues while using `prefect-firebolt`, you can find help in either the [Prefect Discourse forum](https://discourse.prefect.io/) or the [Prefect Slack community](https://prefect.io/slack).
Feel free to ⭐️ or watch [`prefect-firebolt`](https://github.com/PrefectHQ/prefect-firebolt) for updates too!
## Development
If you'd like to install a version of `prefect-firebolt` for development, clone the repository and perform an editable install with `pip`:
```bash
git clone https://github.com/PrefectHQ/prefect-firebolt.git
cd prefect-firebolt/
pip install -e ".[dev]"
# Install linting pre-commit hooks
pre-commit install
```