https://github.com/mikeghen/metadata

Pulls data from Socrata open data portals
https://github.com/mikeghen/metadata

bigquery python socrata

Last synced: about 1 month ago
JSON representation

Pulls data from Socrata open data portals

• Host: GitHub
• URL: https://github.com/mikeghen/metadata
• Owner: mikeghen
• Created: 2018-09-11T01:20:34.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2018-09-11T01:21:03.000Z (over 6 years ago)
• Last Synced: 2024-11-07T09:41:46.443Z (3 months ago)
• Topics: bigquery, python, socrata
• Language: Python
• Size: 2.93 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Metadata

Extract, Load, and perform metanalysis on the data from Socrata open data portals.

# Architecture

## Extractor Module

Pulls data from open data portals.

## Loader

Loads data from the extractor into BigQuery.

## Analyzer

Analyses table names, descriptions, and data set metadata to identify potential insights.