https://github.com/frajdouglas/Data-Catalogger

Create a File Metadata Summary for your Azure File Shares
https://github.com/frajdouglas/Data-Catalogger

azure pandas pickle

Last synced: 4 months ago
JSON representation

Create a File Metadata Summary for your Azure File Shares

• Host: GitHub
• URL: https://github.com/frajdouglas/Data-Catalogger
• Owner: frajdouglas
• License: mit
• Created: 2021-07-09T11:21:01.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2022-05-03T12:48:11.000Z (almost 3 years ago)
• Last Synced: 2024-08-14T07:09:18.331Z (8 months ago)
• Topics: azure, pandas, pickle
• Language: Python
• Homepage:
• Size: 63.5 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• jimsghstars - frajdouglas/Data-Catalogger - Create a File Metadata Summary for your Azure File Shares (Python)

README

        
# Data Catalogger

This script will produce a summary excel spreadsheet for your file metadata. It is capable of collating data from your local files or your Azure File Share.

Metadata includes file path, size, type, created date and modified date. It will also identify current, new and deleted files since the last run.

Scheduling the script to run daily will keep an up to date summary of all your files. Use the "run_catalogger.bat" file as a template.

## Example Outputs

![](Screenshots_for_readme/output_example_current_files.png?raw=true "Output Example")

![](Screenshots_for_readme/output_example_sheets.png?raw=true)

## Instructions for Setup

The minimum version of Python required is: 3.0.

main.py requires inputs of file share paths and credentials and also the save path for all output files.

## Process Flow (For Azure File Catalogging)

![](Screenshots_for_readme/process_flow.png?raw=true)