Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Data visualization

Data visualization is the visual depiction of data through the use of graphs, plots, and informational graphics. Its practitioners use statistics and data science to convey the meaning behind data in ethical and accurate ways.

GitHub: https://github.com/topics/data-visualization
Wikipedia: https://en.wikipedia.org/wiki/Data_visualization
Created by: Charles Joseph Minard
Aliases: dataviz,
Last updated: 2025-01-27 00:07:08 UTC
JSON Representation

https://github.com/nialled69/sugarcane-production-project

Exploratory Data Analysis (Univariate and Bivariate analysis) on World-wide Sugarcane Production dataset.

csv data-visualization dataanalysis-projects eda jupyter-notebook matplotlib-pyplot pandas-dataframe python3 seaborn

Last synced: 12 Jan 2025

https://github.com/ndleah/school-donation

💰 Top school donors analysis

cufflinks data-analysis data-science data-visualization dataset exploratory-analysis python python-library python3

Last synced: 12 Jan 2025

https://github.com/sandravizz/d3.js-beginners-course

This repository belongs to a d3.js beginners course, which I'm teaching in different universities.

d3 d3js data-visualization html javascript

Last synced: 26 Dec 2024

https://github.com/alan2207/data-visualization

Data Visualization with D3 and React

d3 data-visualization react

Last synced: 25 Jan 2025

https://github.com/juanchiparra/recreating-with-d3

A weekly personal challenge with D3.js.

d3 data-visualization

Last synced: 11 Dec 2024

https://github.com/mmarcon/pretty-data

Intuitive way of creating d3 visualization headlessly.

charts d3 d3js data-visualization data-viz headless

Last synced: 08 Dec 2024

https://github.com/prabhupavitra/data-visualization-with-r

Data Visualization with R and Python

animated-gif bar-chart data-visualization data-visualizations financial-data-analysis financial-data-science ggplot2 heatmap visualization visualizing-distributions

Last synced: 26 Jan 2025

https://github.com/m-dadej/wc19sd

wrapper functions to extract data from World COVID19 survey data API

coronavirus covid-19 data-mining data-science data-visualization

Last synced: 10 Jan 2025

https://github.com/IMBurbank/trump-world-graph

TrumpWorld Associate Connections - Force Directed Graph

corruption d3 d3-js d3js d3v4 data-visualization data-world donald-trump es2016 force-directed-graphs freecodecamp freecodecamp-challenge graph javascript sass trump trump-world visualization

Last synced: 02 Dec 2024

https://github.com/trainingbypackt/data-visualization-with-python-elearning

Create an impact with meaningful data insights using interactive and engaging visuals

data-visualization datascience geoplotlib matplotlib numpy pandas python seaborn

Last synced: 14 Nov 2024

https://github.com/dmytrovoytko/data-engineering-amazon-reviews

Data Engineering project for ZoomCamp`24: JSONL -> PostgreSQL/BigQuery + Metabase + Mage.AI

bash-script bigquery codespaces data-analysis data-visualization etl metabase pipeline python-script

Last synced: 14 Nov 2024

https://github.com/jcm-ai/standard-bank-data-science-virtual-experience-programme

This repository has all of the assignments I had to do for the Standard Bank Data Science Virtual Experience Program. 📉👨‍💻📊📈

automl business-analysis business-solutions client-communication data-analysis data-mining data-science data-visualization machine-learning machine-learning-algorithms matplotlib-pyplot model-evaluation model-interpretation power-point presentation-slides programming-language python3 seaborn sql statical-analysis

Last synced: 09 Jan 2025

https://github.com/epictetusz1/chessvisualization

A chess .pgn parser, .pgn extractor, adding a chess opening book with data visualization and web scraper. Separating projects from a private repo of mine.

chess chess-database chess-game chess-openings data-visualization database mysql

Last synced: 25 Dec 2024

https://github.com/madhurimarawat/ml-model-datasets-using-streamlits

This repository contains my machine learning models implementation code using streamlit in the Python programming language.

classifier data-visualization decision-tree diabetes-dataset digits-dataset hyperparameter-tuning iris-dataset kaggle-datasets knn linear-regression logistic-regression machine-learning-algorithms naive-bayes-algorithm python random-forest regressor streamlit-deployment supervised-learning svm wine-dataset

Last synced: 14 Nov 2024

https://github.com/butzee/wildfire_visualization_and_hci

This project was developed as part of the "Visualization and HCI" lecture, which required creating an interactive visualization application beyond static illustrations and simple graphs. Visualization of 2.3 million wildfires in U.S. from Spatial wildfire occurrence data for the United States, 1992-2020.

data-visualization deckgl interaction maptalks

Last synced: 22 Jan 2025

https://github.com/artix41/traveler

Traveler Salesman with genetic algorithm

c-plus-plus data-visualization genetic-algorithm travelling-salesman

Last synced: 17 Jan 2025

https://github.com/jananiarunachalam/Data-Science-Portfolio

Data Science Projects Repository

analytics api data-cleaning data-science data-visualization databases deep-learning excel machine-learning numpy pandas plotly predictive-modeling python3 r r-programming sql

Last synced: 27 Nov 2024

https://github.com/neelshah18/neelshah18.github.io

Neel Shah's Website

article blog data-analysis data-science data-visualization deep-learning machine-learning personal-website

Last synced: 30 Nov 2024

https://github.com/unidata/awips2-ncep

awips data-visualization forecasting gempak hdf5 meteorology ncep postgresql python

Last synced: 13 Nov 2024

https://github.com/fatihilhan42/data-science-projects

In this repo, there are (beginner-upper) level projects in the field of data science. I will host these projects that I have done in this field every day in this repo. With the hope that it will be useful to those who are interested in the field of data science like me and will just start...

data-analysis data-engineering data-mining data-science data-structures data-visualization database datascience fatihilhan fortytwo fortytwofficial jupyter-notebook python

Last synced: 01 Dec 2024

https://github.com/rahulgrover99/quora-question-pairs

Innovation Lab Project

data-visualization deep-learning nlp-machine-learning quora-question-pairs

Last synced: 09 Nov 2024

https://github.com/aryehky/arduino

🚀 C++ Machine Learning Project: Digit Recognition with Support Vector Machine (SVM) 🖥️ This project is a robust implementation of digit recognition using Support Vector Machine (SVM) in C++. The SVM algorithm, a powerful supervised learning technique, is employed to classify handwritten digits from the famous MNIST dataset.

cpp data-visualization machine-learning preprocessing

Last synced: 08 Dec 2024

https://github.com/flowforfrank/d3-treemap

🌲 Treemap created with D3.js

d3 d3js data data-visualization javascript svg treemap tutorial webtips

Last synced: 07 Dec 2024

https://github.com/18alantom/the_genius_batch

In Mumbai University, we are all geniuses!

data-visualization seaborn

Last synced: 31 Dec 2024

https://github.com/holgerbrandl/data_science_with_kotlin

Sources and slides of my KotlinConf2018 presentation about data-science with kotlin

data-science data-visualization java kotlin

Last synced: 21 Jan 2025

https://github.com/gaurav-van/data_science__machine_learning-projects

Compilation of Data Science and Machine Learning Projects Completed During My Bachelor's Degree

classification data data-science data-science-projects data-visualization deep-learning deep-learning-models deep-learning-projects deep-neural-networks inceptionv3 machine-learning machine-learning-projects python regression streamlit

Last synced: 08 Dec 2024

https://github.com/maayanlab/l1000fwd

Large-scale visualization of drug-induced transcriptomic signatures

data-visualization drug-discovery threejs

Last synced: 21 Nov 2024

https://github.com/thecoderpinar/earthquake-explorer

🌍🔍 Explore and analyze earthquake data worldwide using this interactive data science project. Visualize earthquake occurrences, patterns, and geographical distribution. Dive deep into seismic data, perform exploratory data analysis, and gain insights into earthquake trends.

data-analysis data-science data-visualization earthquake-analysis exploratory-data-analysis geospatial-analysis interactive-maps jupyter-notebook machine-learning python seismic-data

Last synced: 16 Dec 2024

https://github.com/koolreport/instant

Create KoolReport's report or widget instantly everywhere without setting up a full report

data-visualization koolreport reporting-engine reporting-tool

Last synced: 14 Nov 2024

https://github.com/savinrazvan/attention

Visualize BERT's attention mechanism with a user-friendly script. Input text with a masked token, predict the masked word, and generate attention diagrams to understand BERT's focus. Ideal for AI enthusiasts and NLP researchers.

ai attention-mechanism bert cs50 data-visualization harvard-cs50 masked-language-model natural-language-processing nlp python transformer

Last synced: 10 Jan 2025

https://github.com/gangula-karthik/kaki-app

A web app uniting everyone for big wins and a greener Singapore! 🚀🌳

community-project data-visualization flask-application nlp singapore social-media-app sustainability web-application

Last synced: 22 Dec 2024

https://github.com/mnpsnuwan/dj_ds

Django Data Science report application.

data-science data-visualization django html-css-javascript python reports

Last synced: 17 Dec 2024

https://github.com/alexcombessie/communitweet

Web App to find communities around a topic on Twitter

data-visualization nlp social-media twitter webapp

Last synced: 24 Dec 2024

https://github.com/qc20/polygonplayground

An interactive 3D physics playground where polygons come to life, blending design and technology in a captivating simulation.

3d-graphics cannonjs creative-coding data-visualization educational-tool frontend-development generative-art geometry interactive-design javascript physics-simulation threejs user-experience-design web-animation webgl

Last synced: 31 Dec 2024

https://github.com/mine-cetinkaya-rundel/2021-ggplot2-vis-sig

PSI VIS SiG webinar (19 May 2021) on the grammar of graphics and ggplot2

data-visualization ggplot2 rstats

Last synced: 22 Dec 2024

https://github.com/cyan33/front-end-data-visualization

:eyes: Web Data Visualization for the graduate thesis in 2017.

cheerio data-visualization echarts expressjs frontend javascript

Last synced: 31 Dec 2024

https://github.com/okuvshynov/hcl

Horizon chart tool for terminal.

cli-app data-visualization monitoring rust

Last synced: 23 Jan 2025

https://github.com/mrankitgupta/mrankitgupta

Myself Ankit Gupta, This contains a short & interesting introduction about me.

ai ankit ankit-gupta ankitgupta artificial-intelligence awesome-readme data-analysis data-science data-visualisation data-visualization github github-profile github-profile-readme machine-learning mrankitgupta profile python readme readme-profile social

Last synced: 17 Nov 2024

https://github.com/pyladiesams/vizualisation-sep2019

Use Matplotlib and Seaborn to explore data.

data-visualization matplotlib pandas python seaborn workshop

Last synced: 09 Nov 2024

https://github.com/thenorthkun/twitter-gender-text-analysis

This Project contains a vivid analysis of texts, words (using NLP) typed by Male & Female users active on Twitter. 🐦👨📝

analysis data-visualization natural-language-processing scikit-learn

Last synced: 30 Nov 2024

https://github.com/shawseanyang/health-vulnerability-mapper

1st Place – Amazon's AWS Data Exchange Challenge Hackathon

amazon amazon-web-services aws covid-19 covid-19-data data-visualization socioeconomic

Last synced: 04 Dec 2024

https://github.com/bohnacker/treemap.js

A javascript library for calculating a treemap

data-visualization graph recursion treemap

Last synced: 07 Dec 2024

https://github.com/mierune/svelte-maplibre-gl

[draft] Svelte wrapper for MapLibre GL JS (supports Svlete 5+ only)

data-visualization map maplibre runes svelte svelte-components visualization

Last synced: 23 Nov 2024

https://github.com/schmytzi/simpleplottable

A simple table to include in ggplot

alignment data-visualization ggplot2 table

Last synced: 16 Jan 2025

https://github.com/mariona-ft/data-mining-mida

MINERIA DE DADES Curs 2023-24 EPSEVG

data-mining data-science data-visualization datascience epsevg ipython-notebook prediccion-de-datos prediction prediction-model predictive-modeling universitat-politecnica-catalunya university-project upc

Last synced: 13 Nov 2024

https://github.com/mathworks/precipitation-variability-analysis-matlab

Access, process and visualize global climate (precipitation) data from the WCRP CMIP6 database

climate data-visualization jupyter-notebook matlab open-data open-science rainfall-data statistical-tests

Last synced: 09 Nov 2024

https://github.com/rdch106/browser-stats

Web browser usage statistics

data-adquisition data-visualization spider

Last synced: 19 Jan 2025

https://github.com/virajbhutada/power-bi-resources

Comprehensive Power BI resources covering interview questions, group training materials, project portfolio ideas, and a cheat sheet for quick reference. Elevate your Power BI skills with curated content designed to enhance your proficiency and boost project success.

data-analysis data-modeling data-visualization dax-expression interview-preparation portfolio-projects powerbi quick-reference visualization-techniques

Last synced: 10 Jan 2025

https://github.com/pottekkat/matplotlib-basics

A jupyter notebook that walks you through the basics of matplotlib for data science applications

data-analysis data-visualization machine-learning matplotlib pyplot python

Last synced: 07 Jan 2025

https://github.com/easonlai/chat_with_csv_streamlit_with_chart

In this repository, you will find an example code for creating an interactive chat experience that allows you to ask questions about your CSV data with chart visualization capabilities.

azure-openai azure-openai-api azure-openai-service chart-visualization data-analysis data-visualization gpt gpt-3 langchain langchain-python matplotlib openai python streamlit streamlit-webapp

Last synced: 10 Nov 2024

https://github.com/prajwalchapke055/accenture-data-analytics-and-visualization-forage

NAVIGATING NUMBERS - Apply your data analytics & visualization skills to advise a social media client on their content creation strategy as a Data Analyst at Accenture

accenture communication data-analysis data-modeling data-understanding data-visualization forage internship internship-task job-simulation presentation project-planning public-speaking storytelling strategy teamwork virtual-internship

Last synced: 22 Jan 2025

https://github.com/doragd/data-mining-projects

Report and source code for Data Mining projects

data-mining data-visualization machine-learning

Last synced: 17 Dec 2024

https://github.com/ekenes/elections

Time-series visualization of electoral swing/shift in the U.S presidential elections 2000-2020.

data-visualization elections party voting

Last synced: 01 Dec 2024

https://github.com/shrutika252/breast-cancer-detection

data-visualization logistic-regression regression-models

Last synced: 15 Dec 2024

https://github.com/apiko-dev/dataforce

Analytics for Salesforce with Meteor.js

data-analysis data-visualization javascript meteorjs nodejs salesforce visualization

Last synced: 16 Jan 2025

https://github.com/fx2y/datanarrate

[WIP] LLM-powered agent for adaptive data analysis across multiple sources. Uses natural language for complex queries, visualizations, and insights. Features autonomous planning, SQL/Elasticsearch generation, and AI storytelling. Built with LangChain, GPT-4, FastAPI, and React.

ai data-analysis data-visualization elasticsearch fastapi gpt-4 langchain machine-learning nlp react sql

Last synced: 16 Jan 2025

https://github.com/manju1807/advanced-weather-app-nextjs

Weatherly is a comprehensive weather application that provides real-time updates, forecasts, and detailed weather metrics. It's built with modern web technologies to provide a seamless and engaging user experience.

advanced-weather-app data-visualization interactive-maps nextjs-14 openweather-api react reactjs real-time-weather redux-toolkit server-side-rendering tailwindcss typescript weather-app weather-app-react weather-application weather-dashboard weather-forecast weather-monitoring

Last synced: 31 Dec 2024

https://github.com/ewen-lbh/parcoursup-dataviz

Récupère et génère des graphiques de vos vœux en liste d'attente automatiquement

data-visualization parcoursup

Last synced: 11 Dec 2024

https://github.com/gher-uliege/seadatacloud

Tools and interfaces to work with DIVA interpolation software tool.

data-analysis data-visualization interpolation nco netcdf ocean-sciences oceanography

Last synced: 11 Dec 2024

https://github.com/tomasesquivelgc/d3-bar-chart

📊📈This is my first Data Visualization project using D3. Bar Chart app fetches U.S.A GDP info and displays it on screen using responsive code.

d3 data-visualization freecodecamp-project javascript-library

Last synced: 06 Jan 2025

https://github.com/quantumudit/zomato-restaurants-analysis

This project focuses on analyzing and visualizing restaurants listed in Zomato across Bengaluru city of India using Python and Power BI

data-analytics data-transformation data-visualization etl geospatial-analysis jupyter-notebook power-bi python

Last synced: 26 Dec 2024

https://github.com/kitnato/reia

Renewable Energy Impact Analytics

data-analytics data-visualization renewable-energy

Last synced: 17 Dec 2024

https://github.com/super-lou/aeag_toolbox

🛠️ R toolbox to provide a simple way of interacting with all the code necessary to carry out hydrological stationnarity analysis for the Agence de l'Eau Adour-Garonne (AEAG)

climate climate-change climate-data data-analysis data-visualization environment hydrology inrae low-water mann-kendall mann-kendall-tests r stationarity-test statistics

Last synced: 23 Dec 2024

https://github.com/ihabbendidi/diamond-analysis

Exploratory statistical analysis of a Diamond dataset

data-analysis data-visualization exploratory-data-analysis machine-learning r

Last synced: 16 Dec 2024

https://github.com/huseyincenik/data_science

Data Science materials

data data-science data-structures data-visualization dataanalysis dataengineering datapreparation dataprocessing datascience dataset time-series time-series-analysis timeline timeseries timeseries-analysis timeseriesforecasting

Last synced: 01 Dec 2024

https://github.com/do-me/instagreens-bonn

Scripts and files for https://geo.rocks/instagreens/

cultural-ecosystem-services data-science data-visualization instagram javascript openstreetmap python socialmedia socialmediaanalytics

Last synced: 16 Jan 2025

https://github.com/bovem/datawiz

End-to-End data science pipeline application based on Django and Dash.

dash dashboard data-science data-visualization django machine-learning prototype python python-project

Last synced: 11 Jan 2025

https://github.com/ymorsi7/ayatica

Exploring patterns, miracles, and linguistic features in Islamic sacred texts through data visualization

d3 d3js data data-visualization hadith hadiths islam islamic quran visualization

Last synced: 23 Jan 2025

https://github.com/storopoli/r_scripts

Couple of handy R Scripts that I use in a daily basis for Scientific Research

data-analysis data-science data-visualization r scientific

Last synced: 20 Nov 2024

https://github.com/asifdotexe/sentimentscoringmodel

This project focuses on performing sentiment analysis on Amazon reviews using natural language processing (NLP) techniques. It includes various steps, from data exploration and preprocessing to building and evaluating sentiment models.

data-analysis data-visualization natural-language-processing sentiment-analysis

Last synced: 15 Nov 2024

https://github.com/jared-fowler/prettyglm

prettyglm provides a set of functions which can easily create beautiful coefficient summaries which can readily be shared and explained.

classification classification-model data-science data-visualization glm linear-models r r-package regression regression-analysis regression-model regression-models rstats rstats-package statistical-models

Last synced: 09 Jan 2025

https://github.com/0mppula/bookstackr

A comprehensive book tracking application allowing the users to track their read books by year, category and format. Book data can be viewed both in table and chart format.

books chartjs data-science data-visualization firebase firebase-auth form-validation react-router-dom react-select react-table-v7 reactjs redux-thunk redux-toolkit tracker-application typescript

Last synced: 11 Nov 2024

https://github.com/ayemunhossain/python-data-visualization

This is a repository for data visualization learners. Here i use matplotlib wish is a quite famous library of python.

data-visualization datavisualization matplotlib matplotlib-animation matplotlib-figures matplotlib-tutorial python python3

Last synced: 01 Dec 2024

https://github.com/ehtisham-sadiq/final-year-project-material-

This repository contains all the material and data related to final year project.

data-analysis data-science data-visualization deep-learning implementation-of-algorithms machine-learning machine-learning-algorithms natural-language-processing python3

Last synced: 22 Jan 2025

https://github.com/quantumudit/analyzing-whiskyexchange-whisky

This project focuses on scraping data related to Japanese Whiskey from the Whiskey Exchange website; performing necessary transformations on the scraped data and then analyzing & visualizing it using Jupyter Notebook and Power BI.

data-analysis data-science data-transformation data-visualization etl jupyter-notebook power-bi python webscraping

Last synced: 26 Dec 2024

https://github.com/martinkalema/malaria-in-africa

This project is aimed at understanding, mitigating, and controlling the impact of malaria in Africa.

data-mining data-preprocessing data-visualization

Last synced: 11 Jan 2025

https://github.com/greenpeace/gpes-visualisations

Proposal for tools and style guide - Visualisations in the Spanish office sites.

data-visualization guidelines infographics multimedia

Last synced: 17 Nov 2024

https://github.com/laomu1988/demo-vue-tree

vue树形图展示

data-visualization vue

Last synced: 04 Dec 2024

https://github.com/barrettotte/lol-r-data-visual

Use the Riot Games API to visualize League of Legends user's stats; An introduction to data visualization and R (Only 2 basic visualizations)

data-visualization ggplot league-api league-of-legends r riot-games-api

Last synced: 09 Dec 2024

https://github.com/ahmedshahriar/eda_basketball

basketball basketball-stats data data-science data-visualization pandas python python3 streamlit

Last synced: 17 Jan 2025

https://github.com/hrbrmstr/hilbertv4

Create and Annotate 'Hilbert Curve' 'IPv4' Heatmaps in R

data-visualization ggplot2 hilbert-curve ipv4 ipv4-heatmap r rstats

Last synced: 18 Dec 2024

https://github.com/steponask/sorting_algorithms_sfml

🔍📊 Sorting Algorithm Visualization made using SFML and C++

data-visualization gui sfml sfml-cpp sfml-sorting-algorithm sorting-algorithm-visualizations

Last synced: 25 Nov 2024

https://github.com/prakharjadaun/ml-learn-with-me

Learn Machine learning and its different algorithms with me. In this repo, I upload well explained ml algorithms and topics related to statistics.

backpropagation data-visualization keras-neural-networks learn-with-me machine-learning numpy seaborn

Last synced: 18 Jan 2025

https://github.com/phantasy-project/mpl4qt

data-visualization gui matplotlib python qt qt-designer qt5 visualization widgets

Last synced: 16 Nov 2024

https://github.com/gjbex/python-dashboards

Repository that contains material for training sessions on creating dashboards using Python.

dash dashboard data-analysis data-exploration data-science data-visualization panel python streamlit training training-materials visualization

Last synced: 22 Nov 2024

https://github.com/carterbox/tofu

View realtime and forecasted electricity rates; analyze historic energy use and rates.

data-visualization electricity-consumption electricity-prices flutter-app

Last synced: 07 Dec 2024

https://github.com/edgi-govdata-archiving/100days

Website for EDGI 100 Days Report

data-visualization jekyll website

Last synced: 25 Nov 2024

https://github.com/faizanmohd5/web-scraping-iphone-11-reviews

This is a web scraping project that extracts customer reviews for the iPhone 11 from Flipkart.com using Python and BeautifulSoup. The extracted data is saved in a CSV file for further analysis. Use it as a starting point for your own web scraping projects or for analyzing customer reviews of the iPhone 11.

beautifulsoup csv data-visualization dataanalysis dataextraction datainsights datamining datapreprocessing ecommerce-website ipython-notebook jupyter-notebook python reviews reviewscrapper webscraping

Last synced: 12 Jan 2025

https://github.com/husna-poyraz/python-and-tensorflow-for-data-science

data-analysis data-visualization matplotlib matplotlib-pyplot numpy pandas python

Last synced: 09 Jan 2025

https://github.com/purrproof/calldata-visualizer

ABI Calldata Layout Visualizer

abi abi-decoding calldata calldata-analysis calldata-layout data-visualization ethereum evm solidity solidity-tools web3 web3-tools

Last synced: 01 Dec 2024

https://github.com/prakhar-ff13/yellow-taxi-demand-prediction

Predicting Taxi Demand in various regions of New York City

data-analysis data-analytics data-science data-visualization machine-learning python3 time-series

Last synced: 30 Nov 2024

https://github.com/prajwalchapke055/cognizant-artificial-intelligence-job-simulation-forage

Advise one of Cognizant’s clients on a supply chain issue by applying knowledge of machine learning models.

artificial-intelligence cognizant communication data-analysis data-modeling data-visualization development evaluation forage job-simulation machine-learning machine-learning-algorithms machine-learning-engineering model-interpretation presentation problem-statement python quality-assurance skills virtual-internship

Last synced: 22 Jan 2025

https://github.com/aymane-maghouti/hr-data-pipeline-azure

This project is a comprehensive data engineering solution that extracts HR data from a GitHub repository, performs data transformations using Azure services, and creates an interactive HR dashboard using Power BI. The goal is to enable HR professionals and decision-makers to gain insights from the HR data for better workforce management.

azure-blob-storage azure-cloud-services azure-data-factory azure-databricks data-engineering data-extraction data-ingestion data-pipeline data-visualization etl-process power-bi