Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists by AdamPaternostro

A curated list of projects in awesome lists by AdamPaternostro .

https://github.com/adampaternostro/azure-databricks-dev-ops

Complete end to end sample of doing DevOps with Azure Databricks

azure-databricks azure-dev-ops azure-devops databricks-workspace github-actions

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-power-bi-embedded-sample

Shows how to setup and configure Power BI Embedded quickly. It also provides an Azure Function to get the Embedded tokens for a pure JavaScript sample.

azure powerbi powerbi-embedded powerbi-report powerbi-setup

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-databricks-log4j-to-appinsights

Connect your Spark Databricks clusters Log4J output to the Application Insights Appender

application-insights azure-monitor databricks

Last synced: 16 Oct 2025

https://github.com/AdamPaternostro/Azure-Synapse-SQL-Serverless-Generate-From-Hive

This is a script that will read a Hive metastore and generate SQL Serverless create view statements.

Last synced: 31 Mar 2025

https://github.com/adampaternostro/azure-synapse-sql-serverless-generate-from-hive

This is a script that will read a Hive metastore and generate SQL Serverless create view statements.

Last synced: 18 Jul 2025

https://github.com/adampaternostro/training-azure-devops

Using Azure Dev Ops to deploy Infrastructure as Code, Web application, Staging Slots and Docker images. Also, contains my best practices when using DevOps in the cloud.

azure azure-arm-templates azure-devops azure-functions-v2 best-practices devops training-labs

Last synced: 22 Jun 2025

https://github.com/adampaternostro/azure-app-insights-distrubuted-tracing

How to use Application Insights to do distributed tracing through a Web App, REST API, Function App, Service Bus, Databricks and Data Factory.

application-insights azure azure-data-factory azure-functions databricks monitoring service-bus

Last synced: 08 Sep 2025

https://github.com/adampaternostro/devops-best-practices

DevOps-Best-Practices

Last synced: 12 Apr 2025

https://github.com/adampaternostro/azure-big-data-and-machine-learning-architecture

A ready to use architecture for processing data and performing machine learning in Azure

azure azure-data-factory azure-data-lake big-data ml-ops

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-web-app-nginx-reverse-proxy-dotnet-core-linux

Dotnet Core MVC web app running on Linux using Docker and nginx as a reverse proxy

azure azure-web-app-service dockerfile dotnet-core nginx nginx-proxy

Last synced: 13 Aug 2025

https://github.com/adampaternostro/azure-sample-arm-template-architecture

Shows how to build a set of linked templates with conditions, loops, array and complex parameters

azure azure-arm azure-arm-template azure-arm-templates infrastructure-as-code

Last synced: 29 Jul 2025

https://github.com/AdamPaternostro/Azure-SQL-DW-Synapse-Test-Case-Runner

Cross platform tool for running test cases in a serial or concurrently and log the results to a set of tables to see the results.

azure azure-synapse-analytics dotnetcore mpp sql-data-warehouse

Last synced: 31 Mar 2025

https://github.com/adampaternostro/azure-sql-dw-synapse-test-case-runner

Cross platform tool for running test cases in a serial or concurrently and log the results to a set of tables to see the results.

azure azure-synapse-analytics dotnetcore mpp sql-data-warehouse

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-cloud-services-to-app-service-web-apps

Best practices and lessons learned converting Azure Classic Cloud services to Azure App Service Web Apps

azure azure-app-service azure-cloud-services azure-webapp azure-webjob lets-encrypt letsencrypt

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-databricks-token-rotation

A script that will rotate Azure Databricks tokens utilizing Azure Key Vault

azure databricks keyvault

Last synced: 18 Aug 2025

https://github.com/adampaternostro/azure-databricks-with-spline

Using Spline with Azure Databricks

azure-databricks lineage spline

Last synced: 06 Jan 2026

https://github.com/adampaternostro/azure-deploy-vsts-on-vnet-app-service-environment

Shows how to use Visual Studio Team Services to deploy an application to an Application Service Environment that is on a VNET.

azure azure-app-service azure-webapp continuous-deployment continuous-integration visual-studio-team-services

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-arm-terraform

This shows some examples of ARM and Terraform templates along with a feature comparison.

azure azure-arm azure-arm-template azure-arm-templates terraform-azure terraform-templates

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-shipyard-with-infiniband-and-intel-mpi

Lightning fast performance in Azure with InfiniBand, Azure Storage and Intel MPI

azure azure-batch azure-shipyard azure-storage infiniband rdma

Last synced: 09 Sep 2025

https://github.com/adampaternostro/azure-tomcat-web-app-container

Creates a Docker container with Tomcat installed behind Apache which acts as a reverse proxy so Tomcat can be warmed up before being added to the Azure load balancer. Solves the problems of web apps needing time to warm-up as well as locking of WAR files that can occur on Azure Window Web Apps.

apache azure azure-webapp docker tomcat

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-databricks-ci-cd-initial-token

How to do CI/CD with Azure Databricks and get the initial Databricks token.

azure azure-databricks azure-devops ci-cd databricks vsts

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-databricks-external-hive-and-adls

Shows how to use an External Hive (SQL Server) along with ADLS Gen 1 as part of a Databricks initialization script that runs when the cluster is created.

azure azure-data-lake azure-databricks hive-metastore

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-get-all-storage-accounts-with-public-blob-containers

Loops through all your subscriptions and checks each storage account for public blob containers.

azure azure-powershell azure-storage blob-container storage-account

Last synced: 29 Jul 2025

https://github.com/adampaternostro/azure-verify-required-tags

Checks to see if resources and/or resource groups have required tags.

azure azure-tags-remediation governance powershell

Last synced: 26 Jun 2025

https://github.com/adampaternostro/azure-docker-shipyard

Demo of using Docker contatiners in Azure Batch (using Shipyard)

azure azure-batch containers docker

Last synced: 21 Aug 2025

https://github.com/adampaternostro/azure-devops-common-templates

Stores common re-usable YAML files for Azure Pipelines across an enterprise.

azure-devops

Last synced: 26 Oct 2025

https://github.com/adampaternostro/azure-spark-livy-application-insights-external-dependency

Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

application-insights azure azure-data-lake hdinsight java livy spark spark2

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-sql-database-backup-restore-cli

Shows how to backup and restore a SQL Database using Azure CLI. Performs the restore process in a loop (optional) for restoring over several destinations in an easy manner.

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-ea-billing-data-for-budget-alerts

Uses PowerShell to download your EA billing data. It then creates a CSV by Resource Group so you can then trigger alerts at this level.

azure azure-billing governance powershell

Last synced: 13 Oct 2025

https://github.com/adampaternostro/azure-datalake-folder-upload

Upload a folder to Azure Data Lake Store

azure azure-data-lake powershell

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-create-hdinsight-service-principle

Creates a PFX for HDInsights. Also, creates the Azure Application.

azure azure-hdinsight azure-powershell hdinsight-service-principle

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-big-data-dev-ops

A set of Azure ARM templates for big data architectures in Azure

azure azure-arm azure-arm-template azure-devops

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-adls-blob-data-copy

Queues up files to copy from one ADLS account to be copied to another ADLS account. You can also use this for on-prem and/or blob.

azure azure-blob azure-data-lake file-copy powershell

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-synapse-rest-api

A REST API for Azure Synapse (SQL DW).

Last synced: 23 Jun 2025

https://github.com/adampaternostro/github-azure-function-proxy-for-arm-template

Allows you to use your private GitHub repo for Azure Linked ARM templates.

azure azure-arm azure-functions github

Last synced: 03 Oct 2025

https://github.com/adampaternostro/azure-create-well-named-vms

Create a well named set of Azure VMs instead of letting Azure give default names to your Azure disks and NIC cards

azure azure-cli azure-vm

Last synced: 21 Aug 2025

https://github.com/adampaternostro/azure-devops-integration

Tests using a YAML template that resides in a different repository.

azure-devops

Last synced: 06 Jan 2026

https://github.com/adampaternostro/azure-hdinsight-arm-template

Creates an HDInsight cluster that has an external Hive metastore and access to Azure Data Lake Store

azure-arm-templates azure-data-lake hdinsight hdinsight-service-principle

Last synced: 12 Jun 2025

https://github.com/adampaternostro/azure-databricks-auto-sklearn

Shows how to install auto-sklearn on an Azure Databricks cluster

auto-sklearn azure azure-databricks data-science

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-datafactory-rest-call

This Node.js script shows how to call a Data Factory on demand via REST

azure azure-data-factory nodejs

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-blob-concurrency

Docker container that runs on Azure blob using Alpine Linux with Azure Python SDK to put a load on Azure Storage to see the download times.

alpine-linux azure azure-batch azure-shipyard docker dockerfile python

Last synced: 14 Oct 2025

https://github.com/adampaternostro/azure-hdi-distcp

Creates a HDInsight cluster then runs distcp remotely to copy data between blob and/or data lake (ADLS)

azure azure-data-lake azure-storage distcp file-copy hadoop hdinsight

Last synced: 26 Oct 2025

https://github.com/adampaternostro/azure-blob-concurrency-java

Blob concurrency test using Java and Docker

Last synced: 12 Oct 2025

https://github.com/adampaternostro/azure-blob-upload-download

Upload and download using the storage keys

azure azure-powershell azure-storage-blob

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-billing

This script gets the Azure billing information and places it as a tag on each resource group.

azure azure-billing nodejs subscription

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-big-data-and-machine-learning-architecture-adf

The Azure Data Factory repo for the Azure-Big-Data-and-Machine-Learning-Architecture.

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-lock-all-data-lake-stores

Places a resource lock on your ADLS resources so you cannot accidently delete.

azure azure-data-lake azure-powershell

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-tomcat-war-deploy

Shows how to deploy a WAR file to Azure Web App and avoid the WAR file locking issue.

azure azure-web ci-cd java tomcat

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-databricks-jar-devops

Compile and deploy a custom JAR file to Databricks using Azure DevOps

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-storage-c-plus-plus

How to compile the Azure C++ Storage library on Linux

azure azure-sdk azure-storage c-plus-plus docker linux multi-stage

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-datalakecopy

Powershell to copy data lake file from local computer

azure azure-data-lake azure-powershell

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-get-base64-from-pfx

Gets a base 64 encoding from a PFX. Useful for when you have a service principle in Azure and need to put the base 64 in an ARM template

azure hdinsight hdinsight-service-principle pfx powershell service-principal

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-databricks-import-csv-hive-table

Import data from a CSV into a Hive partitioned and non-partitioned table

azure-databricks

Last synced: 05 Jan 2026

https://github.com/adampaternostro/azure-turn-on-blob-encryption-for-all-storage-accounts

Turns on blob encrpytion for all storage accounts where encryption is currently off

azure azure-storeage encryption

Last synced: 26 Mar 2025

https://github.com/adampaternostro/demo-azure-web-app-slots

Demo with Azure Dev Ops that uses .NET core with Web App slots

Last synced: 15 Sep 2025

https://github.com/adampaternostro/databricks

Sample Databricks files for Azure via Git Integration

Last synced: 14 Sep 2025

https://github.com/adampaternostro/azure-spark-livy

Run a job in Spark 2.x with HDInsight and submit the job through Livy

azure azure-data-lake hdinsight livy spark spark-sql

Last synced: 26 Mar 2025

https://github.com/adampaternostro/azure-install-oms-agent

Installs the agent on Windows and Linux ARM computers (not VM scaleset or compute types)

azure linux oms powershell windows

Last synced: 11 Sep 2025

https://github.com/adampaternostro/azure-adf-publish-issue

Used to demonstrate how ADF overwrite the adb_publish files upon branching

Last synced: 06 Jan 2026

https://github.com/adampaternostro/azure-vm-network-bandwidth

Determine the network bandwidth of an Azure VM

azure azure-bandwidth bandwidth

Last synced: 11 Jun 2025

https://github.com/adampaternostro/azure-blob-adls-recursive-file-listing

Gets all the blobs in a container along with their file sizes and saves them to tab delaminated files. Handles continuation tokens (aka next markers).

Last synced: 26 Mar 2025