https://github.com/lenisha/catalog-scanner

Babylon scanning setup and results retrieval samples
https://github.com/lenisha/catalog-scanner

Last synced: 7 months ago
JSON representation

Babylon scanning setup and results retrieval samples

• Host: GitHub
• URL: https://github.com/lenisha/catalog-scanner
• Owner: lenisha
• Created: 2020-04-17T20:33:00.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T10:18:56.000Z (over 3 years ago)
• Last Synced: 2024-10-18T06:16:18.851Z (over 1 year ago)
• Language: C#
• Homepage:
• Size: 2 MB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
## Detect Database Classifications using Atlas API and Setup Scans with Babylon API

This repo contains two samples

- [catalog-scan-trigger](./catalog-scan-trigger) sample .net core app that calls Babylon API to setup DataSource and schedule the scan or run it immediately

- [catalog-results-scanner](./catalog-results-scanner) sample .net core app that calls Atlas API to find classified columns in the tables on Azure SQL server databases ( results of the scheduled or runed scans)

- [rest-apis](./rest-apis) - open API (swagger) specifications for Babylon and Atlas APIs and generated calsses in C# and Java

For sample API calls JSON see Postman collection in this directory 

## Catalog Setup

- provision Babylon account - ARM template in this directory - and take note of API Urls

![docs](./catalog-scan-trigger/docs/portalurl.png)

Solution works without the need for service principals ( only locally for debugging) and leverages MSI for all connections

- create User Managed Idenity and bind it to K8S Pod using AAD Pod Identity, it will be used to get Token to invoke Atlas and Babylon API. Add it to Babylon Catalog Adminstrators

![docs](./catalog-scan-trigger/docs/sp.png)

- Babylon Catalog is provisioned with system assigned Identity, add it to Azure SQL Server admin group to give it access to scan databases. To find the system identity Id navigate to Babylon account properties

![docs](./catalog-scan-trigger/docs/CatalogMI.png)