Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with data-modeling
A curated list of projects in awesome lists tagged with data-modeling .
https://github.com/dbt-labs/dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
analytics business-intelligence data-modeling dbt-viewpoint elt pypa slack
Last synced: 29 Sep 2024
https://github.com/fishtown-analytics/dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
analytics business-intelligence data-modeling dbt-viewpoint elt pypa slack
Last synced: 12 Sep 2024
https://github.com/san089/udacity-data-engineering-projects
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
airflow airflow-operators aws aws-ec2 aws-s3 aws-sdk cassandra cassandra-database cloudformation cluster data data-engineering data-engineering-pipeline data-lake data-modeling data-warehouse etl-pipeline infrastructure postgres postgresql-database
Last synced: 29 Sep 2024
https://github.com/san089/Udacity-Data-Engineering-Projects
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
airflow airflow-operators aws aws-ec2 aws-s3 aws-sdk cassandra cassandra-database cloudformation cluster data data-engineering data-engineering-pipeline data-lake data-modeling data-warehouse etl-pipeline infrastructure postgres postgresql-database
Last synced: 01 Aug 2024
https://github.com/dbt-labs/metricflow
MetricFlow allows you to define, build, and maintain metrics in code.
analytics business-intelligence data data-modeling metrics pypi semantic-layer
Last synced: 30 Sep 2024
https://github.com/data-engineering-community/data-engineering-wiki
The best place to learn data engineering. Built and maintained by the data engineering community.
data data-engineer data-engineering data-modeling data-pipelines database etl sql
Last synced: 30 Sep 2024
https://github.com/fal-ai/dbt-fal
do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.
analytics data-modeling dbt machine-learning machinelearning pandas python
Last synced: 06 Aug 2024
https://github.com/alanchn31/data-engineering-projects
Personal Data Engineering Projects
airflow aws-redshift cassandra data-engineering data-engineering-nanodegree data-lake data-modeling data-warehouse ingest-data mongodb postgres scrapy spark star-schema
Last synced: 29 Sep 2024
https://github.com/structr/structr
Structr is an integrated low-code development and runtime environment that uses a graph database.
backend backend-framework data-modeling frontend-framework full-stack graalvm graph graph-database graphql low-code low-code-development-platform open-api platform-as-a-service polyglot-programming productivity productivity-tools schema-design software-as-a-service web-application-framework web-development
Last synced: 30 Sep 2024
https://github.com/alanchn31/Data-Engineering-Projects
Personal Data Engineering Projects
airflow aws-redshift cassandra data-engineering data-engineering-nanodegree data-lake data-modeling data-warehouse ingest-data mongodb postgres scrapy spark star-schema
Last synced: 01 Aug 2024
https://github.com/mswjs/data
Data modeling and relation library for testing JavaScript applications.
api data-modeling fixtures mocking orm testing testing-tool
Last synced: 01 Aug 2024
https://github.com/ananas-analytics/ananas-desktop
A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.
analytics business-intelligence data-modeling etl hackable-data visualization
Last synced: 01 Aug 2024
https://github.com/chaoss/augur
Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/ and learn more about Augur at our website https://augurlabs.io
chaoss data-collection data-modeling data-visualization defined-metrics facade git github hacktoberfest hacktoberfest2020 health linux linux-foundation metrics open-source opensource python-library research sustainability unix
Last synced: 30 Jul 2024
https://github.com/quarylabs/quary
Transform data together. Model, test and deploy as a team.
analytics business-intelligence data-modeling elt
Last synced: 31 Jul 2024
https://github.com/monarch-initiative/ontogpt
LLM-based ontological extraction tools, including SPIRES
ai chat-gpt data-modeling gpt-3 information-extraction language-models large-language-models linkml llm monarchinitiative named-entity-recognition ner nlp oaklib obofoundry relation-extraction
Last synced: 01 Aug 2024
https://github.com/hofstadter-io/hof
Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.
code-generator cue cuelang data-modeling declarative-programming hacktoberfest hofstadter llm migrations-generator tui workflow-engine
Last synced: 31 Jul 2024
https://github.com/morenoh149/postgresDBSamples
Sample databases for postgres
data-modeling database postgresql sample-databases
Last synced: 31 Jul 2024
https://github.com/dry-rb/dry-struct
Typed struct and value objects
constraints data data-modeling dry-rb ruby struct type-safety types value-object
Last synced: 06 Aug 2024
https://github.com/3rd/tsdiagram
Create diagrams and plan your code with TypeScript.
data-modeling diagram diagrams typescript
Last synced: 02 Aug 2024
https://github.com/tellery/tellery
Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.
analytics bigquery business-intelligence collaboration dashboard data-analytics data-modeling data-science data-visualization database dbt notebook self-hosted sql
Last synced: 29 Sep 2024
https://github.com/linkml/linkml
Linked Open Data Modeling Language
data-dictionaries data-modeling hacktoberfest json-ld-context json-schema linked-data linkml linkml-schema modeling owl rdf schema semantic-web shacl shex standards
Last synced: 01 Aug 2024
https://github.com/flor91/data-engineering-nanodegree
Projects done in the Data Engineering Nanodegree by Udacity.com
aws cassandra data-engineering data-modeling dimensional-model postgres udacity-course udacity-nanodegree
Last synced: 29 Sep 2024
https://github.com/ignoreintuition/jSchema
A simple, easy to use data modeling framework for JavaScript
data data-modeling data-structures data-visualization dataset drop filter group groupby hacktoberfest javascript javascript-library multiple-datasets orderby sort
Last synced: 01 Aug 2024
https://github.com/aws-samples/amazon-dynamodb-design-patterns
This repo contains sample data models to demonstrate design patterns for Amazon DynamoDB.
Last synced: 01 Aug 2024
https://github.com/gclunies/reflekt
Define, govern, and model event data for warehouse-first product analytics.
avo customer-data-platform data-modeling data-quality data-warehouse dbt dbt-package events governance product-analytics schema-registry segment segment-protocols
Last synced: 26 Sep 2024
https://github.com/GClunies/Reflekt
Define, govern, and model event data for warehouse-first product analytics.
avo customer-data-platform data-modeling data-quality data-warehouse dbt dbt-package events governance product-analytics schema-registry segment segment-protocols
Last synced: 05 Sep 2024
https://github.com/malloydata/malloy-composer
Malloy Composer is a simple application to build dashboards or run ad-hoc queries using an existing Malloy model
business-analytics business-intelligence data data-modeling data-visualization malloy semantic-modeling
Last synced: 17 Aug 2024
https://github.com/linkml/linkml-model
Link Modeling Language (LinkML) model
data-integration data-modeling graph-ql json json-schema linked-data linkml metadata metamodel schema-language semantic-web shacl shex uml yaml
Last synced: 26 Sep 2024
https://github.com/cleverage/eav-manager
Blazing fast data modeling and enrichment
admin data-management data-modeling symfony
Last synced: 30 Sep 2024
https://github.com/hackolade/OpenAPI
Hackolade plugin for OpenAPI 3 API documentation
api-management data-modeling json model-driven oas openapi openapi-specification openapi3 schema-design swagger swagger-documentation yaml
Last synced: 01 Aug 2024
https://github.com/hackolade/openapi
Hackolade plugin for OpenAPI 3 API documentation
api-management data-modeling json model-driven oas openapi openapi-specification openapi3 schema-design swagger swagger-documentation yaml
Last synced: 28 Sep 2024
https://github.com/thehyve/tmtk
tranSMART Arborist ETL toolkit
data-curation data-modeling jupyter-notebook transmart
Last synced: 27 Sep 2024
https://github.com/kathleenwest/WCFStockServiceSingletonWithClientChannelFactory
This project presents a WCF Stock Service Library (StockServiceLib) that mimics a stock exchange. The service is implemented as a “singleton” and maintains persistent data between client calls and can handle multiple client sessions. The service is hosted via a console application (StockServiceHost). The client and service participate in a bi-directional/callback relationship. The client (StockClient) uses the ChannelFactory pattern as opposed to “Add Service Reference” with SVCUTIL. The client and service share a common assembly (SharedLib) that contains the key contract and data model information. Furthermore, a Utilities project is used by the client console application to facilitate user data entry and the complicated details of building and managing the WCF ChannelFactory connection implementation. The ProxyGen class inside the Utilities project abstracts the details of implementing and managing a generic ChannelFactory connection to a generic service for a client. Note: The Utilities project library was included as base code for my lab project to facilitate speedy completion; we were not expected to code this Utilities project ourselves due to complexity and time constraints. The remaining projects in the solution (SharedLib, StockClient, StockServiceHost, and StockServiceLib), I completed individually per requirements for the lab project.
callback callback-api channelfactory client-server client-server-example concurrency concurrent-programming contracts data-modeling data-models service service-library stock-market stock-market-simulator wcf wcf-bindings wcf-client wcf-proxy wcf-service wcf-service-client-demo
Last synced: 02 Aug 2024
https://github.com/woodruffw/github-actions-models
Unofficial Rust data models for GitHub Actions
ci data-modeling github-actions
Last synced: 01 Oct 2024
https://github.com/najuzilu/dm-apachecassandra
Data Modeling with Apache Cassandra
apache-cassandra data-engineering data-modeling python sql star-schema
Last synced: 29 Sep 2024
https://github.com/mr-chang95/data-modeling-with-apache-cassandra
Data Modeling With Apache Cassandra for Udacity's Data Engineering Program. Using Python in Jupyter Notebook.
apache-cassandra data-engineering data-modeling etl-pipeline jupyter-notebook python udacity-nanodegree
Last synced: 29 Sep 2024
https://github.com/moore3229/erin-moore
Data Engineer Portfolio
apache-cassandra aws data-engineering data-modeling etl etl-automation etl-pipeline snowflake
Last synced: 29 Sep 2024
https://github.com/adrian-pasek-prv/data-modeling-with-cassandra
Create a data model in Apache Cassandra for music streaming app
apache-cassandra data data-engineering data-modeling python
Last synced: 29 Sep 2024
https://github.com/alvincrespo/data_models
Data model examples to help inspire.
data-modeling database ruby-on-rails
Last synced: 26 Sep 2024
https://github.com/sdspot2034/exploring-parquet
Project to compare write efficiency and memory efficiency of CSV and Parquet files
chunking csv-export data-engineering data-modeling database decorators etl mysql parquet pyspark python3 spark
Last synced: 28 Sep 2024
https://github.com/maxinexiong/data-modelling-with-apache-cassandra
This project implemented Apache Cassandra data modelling to support Sparkify's analysis of user activity and song play data. It involved consolidating partitioned files into a single CSV, designing and creating tables based on specific queries from Sparkify’s analytics team, and inserting the data from the CSV into the tables using CQL commands.
apache-cassandra data-modeling etl etl-pipeline nosql nosql-database nosql-query python
Last synced: 29 Sep 2024
https://github.com/prneidhardt/data-modeling
Sparkify Project
apache-cassandra data-modeling etl-pipeline
Last synced: 29 Sep 2024
https://github.com/eedu7/todo-list-api
alembic authentication crud-api data-modeling database fastapi pydantic python sqlalchemy
Last synced: 26 Sep 2024
https://github.com/eedu7/expense-tracker-api
authentication data-modeling fastapi jwt jwt-authentication pydantic python restful-api sqlalchemy
Last synced: 26 Sep 2024
https://github.com/senssei/data-sieve
data-mining data-modeling machine-learning
Last synced: 02 Oct 2024
https://github.com/alexandrabaturina/data-modeling-with-apache-cassandra
ETL pipeline to transfer data from csv files into Apache Cassandra database using Python and CQL
apache-cassandra cql-queries data-modeling python-etl-pipeline
Last synced: 29 Sep 2024
https://github.com/molinsagustin/cinedata
# CineData Trabajo práctico grupal para la materia Ingeniería de Datos I en la Universidad Argentina de la Empresa. El mismo consistió en el desarrollo de una base de datos relacional en Microsoft SQL Server Managment Studio utilizando metodología Ágil SCRUM, que se utilizó desde el relevamiento de requisitos hasta la implementación final.
agile data data-modeling database diagram entity-relationship-diagram microsoft-sql-server relational-databases relational-model scrum scrum-agile sql sqlserver
Last synced: 28 Sep 2024
https://github.com/shrikantnaidu/data-modeling-with-cassandra
Data Modeling with Cassandra
cassandra data-modeling etl-pipeline
Last synced: 29 Sep 2024
https://github.com/thanhvie/de_udacity_project_2
Project: Data modeling with Apache Cassandra
apache-cassandra data-modeling
Last synced: 29 Sep 2024