https://github.com/mikeghen/metadata

Pulls data from Socrata open data portals
https://github.com/mikeghen/metadata

bigquery python socrata

Last synced: about 2 months ago
JSON representation

Pulls data from Socrata open data portals

• Host: GitHub
• URL: https://github.com/mikeghen/metadata
• Owner: mikeghen
• Created: 2018-09-11T01:20:34.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2018-09-11T01:21:03.000Z (almost 8 years ago)
• Last Synced: 2024-12-27T20:49:34.842Z (over 1 year ago)
• Topics: bigquery, python, socrata
• Language: Python
• Size: 2.93 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Metadata

Extract, Load, and perform metanalysis on the data from Socrata open data portals.

# Architecture

## Extractor Module

Pulls data from open data portals.

## Loader

Loads data from the extractor into BigQuery.

## Analyzer

Analyses table names, descriptions, and data set metadata to identify potential insights.