Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/Datavault-UK/automate-dv

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
https://github.com/Datavault-UK/automate-dv

data-vault dataengineering datalake datavault datavault20 datawarehouse datawarehousing dbt elt etl metadata snowflake sql

Last synced: 3 months ago
JSON representation

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

Host: GitHub
URL: https://github.com/Datavault-UK/automate-dv
Owner: Datavault-UK
License: apache-2.0
Created: 2019-09-27T11:13:15.000Z (about 5 years ago)
Default Branch: master
Last Pushed: 2024-05-15T11:26:37.000Z (6 months ago)
Last Synced: 2024-05-19T03:13:28.756Z (6 months ago)
Topics: data-vault, dataengineering, datalake, datavault, datavault20, datawarehouse, datawarehousing, dbt, elt, etl, metadata, snowflake, sql
Homepage: https://www.automate-dv.com
Size: 8.24 MB
Stars: 461
Watchers: 28
Forks: 111
Open Issues: 41
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

awesome-data-temporality - dbtvault
awesome-starred - Datavault-UK/automate-dv - A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs) (sql)
jimsghstars - Datavault-UK/automate-dv - A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs) (Others)

README

        


  

  

  [![Documentation Status](https://img.shields.io/badge/docs-stable-blue)](https://automate-dv.readthedocs.io/en/stable/?badge=stable)

  [![Slack](https://img.shields.io/badge/Slack-Join-yellow?style=flat&logo=slack)](https://join.slack.com/t/dbtvault/shared_invite/enQtODY5MTY3OTIyMzg2LWJlZDMyNzM4YzAzYjgzYTY0MTMzNTNjN2EyZDRjOTljYjY0NDYyYzEwMTlhODMzNGY3MmU2ODNhYWUxYmM2NjA)





  

  [![dbt Versions](https://img.shields.io/badge/compatible%20dbt%20versions-%3E=1.4%20%3C=1.8.x-orange?logo=dbt)](https://automate-dv.readthedocs.io/en/latest/versions/)



[Changelog and past doc versions](https://automate-dv.readthedocs.io/en/latest/changelog/)

# AutomateDV by [Datavault](https://www.data-vault.com)

Build your own Data Vault data warehouse! AutomateDV is a free to use dbt package that generates & executes the ETL you need to run a Data Vault 2.0 Data Warehouse on your data platform.

What does AutomateDV offer?

- productivity gains, fewer errors

- multi-threaded execution of the generated SQL

- your data modeller can generate most of the ETL code directly from their mapping metadata

- your ETL developers can focus on the 5% of the SQL code that is different

- dbt generates documentation and data flow diagrams

powered by [dbt](https://www.getdbt.com/), a registered trademark of [dbt Labs](https://www.getdbt.com/dbt-labs/about-us/)

## Worked example project

Learn quickly with our worked example:

- [Read the docs](https://automate-dv.readthedocs.io/en/latest/worked_example/)

- [Project Repository](https://github.com/Datavault-UK/automate-dv-demo)

## Supported platforms:

[Platform support matrix](https://automate-dv.readthedocs.io/en/latest/platform_support/)

## Installation

Check [dbt Hub](https://hub.getdbt.com/Datavault-UK/automate_dv/latest/) for the latest installation instructions, 

or [read the docs](https://docs.getdbt.com/docs/build/packages) for more information on installing packages.

## Usage

1. Create a model for your table.

2. Provide metadata

3. Call the appropriate template macro

```bash

# Configure model

{{- config(...)                          -}}

# Provide metadata

{%- set src_pk = ...                     -%}

...

# Call the macro

{{ automate_dv.hub(src_pk, src_nk, src_ldts,

                   src_source, source_model) }}

```

## Join our Slack Channel

Talk to our developers and other members of our growing community, get support and discuss anything related to AutomateDV or Data Vault 2.0

[![Join our Slack](https://img.shields.io/badge/Slack-Join-yellow?style=flat&logo=slack)](https://join.slack.com/t/dbtvault/shared_invite/enQtODY5MTY3OTIyMzg2LWJlZDMyNzM4YzAzYjgzYTY0MTMzNTNjN2EyZDRjOTljYjY0NDYyYzEwMTlhODMzNGY3MmU2ODNhYWUxYmM2NjA)

## Social 

[![Twitter Follow](https://img.shields.io/badge/Twitter-1DA1F2?style=for-the-badge&logo=twitter&logoColor=white)](https://twitter.com/Automate_DV)

[![LinkedIn](https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white)](https://www.linkedin.com/showcase/automate-dv/)

[![Youtube](https://img.shields.io/badge/YouTube-FF0000?style=for-the-badge&logo=youtube&logoColor=white)](https://www.youtube.com/@AutomateDV)

## Awards



   

    

  



## Contributing

[View our contribution guidelines](CONTRIBUTING.md)

## License

[Apache 2.0](LICENSE)