awesome-safegraph-datascience
A community-supported list of awesome data science resources relevant to SafeGraph data
https://github.com/SafeGraphInc/awesome-safegraph-datascience
Last synced: 18 days ago
JSON representation
-
Code
-
Python Code, Tools, Tutorials
- safegraph_py - - a Python library designed to make your experiece with SafeGraph data as easy as possible. From [Ryan Fox Squire](https://github.com/ryanfoxsquire) (SafeGraph), [Jack Lindsay](https://github.com/Trippl7777) and community members. Please contribute!
- Python Library for wrangling Open Census Data for Demographic Analysis
- Unfolded SQL-Query Helper for directly querying Unfolded in Python
- SafeGraph Core Places Starter Notebook -- CoLab - - Brand new to SafeGraph Places data? This will help you get oriented.
- Simple Outlier Filtering -- CoLab Notebook - - Python Google CoLab Notebook showing simple IQR\*k based outlier filtering
- Connecting Safegraph_place_id to Census Block Groups (CBGs) -- CoLab notebook
- Quickly visualize SafeGraph data on a map with python -- CoLab Notebook
- Convert SafeGraph geometry CSV files to ESRI Shapefile (.shp) format -- CoLab notebook
- Download from Wasabi with Boto3
- Calculate area / square footage from SafeGraph Geometry polygon_wkt using geopandas
- Matching CBGs to ZCTAS (Zip code tabulation areas) using geopandas for Covid-19 research
- CBG to zip code/ZCTA merge - A notebook showing how to make a master dataset that includes a cross reference for nearly all CBG to ZCTA to Zip code conversion
- Automated Download and Filtering, Prep for Normalization (Monthly Patterns) - A notebook to easily filter monthly patterns to your desired POIs, and prepare data for use with [SafeGraph's normalization best practices](https://colab.research.google.com/drive/16BELpcum4TKoH-5wg8Xym_CGgIGgpu1I?usp=sharing), allowing you to start analyzing more quickly from [Ryan Kruse](https://github.com/kruser1)
- Aggregate social distancing metrics visits from origin CBG to destination CBG at the county level
- Demo for getting started with SafeGraph Open Census Data Google CoLab Notebook
- Demo for getting started with Monthly Patterns Data in Jupyter Notebook with SQLite
- Demo for getting started with Social Distancing Data in Jupyter Notebook with SQLite
- Merging patterns with core_places - a short notebook displaying how you can merge the weekly patterns to the core places data
- Visualizing Catchment Analysis with SafeGraph Patterns
- Identifying CBGs with Anomalously High Number of Devices Residing - dawidowicz).
-
R
- SafeGraphR github repo - - Package for reading and analyzing SafeGraph foot traffic data
- Sample Raster Codes
- The Stanford Future Bay Initiative: Covid-19 Rapid Response Projects - - a collection of R functions and documentation for processing, normalizing, and analyzing SafeGraph foot-traffic data
- Demonstration
- map census tracts to zip codes
- Spatial crosswalks
- Sync SafeGraph data
-
SQL/ Snowflake
-
Awesome Python Analysis Projects
- Demo for using PPP loan data and Core SafeGraph data - a CoLab notebook showing how the SafeGraph core places data can be used as a master list of certain NAICS codes.
- Databricks Python Notebook: Simple Demo of Analyzing Starbuck's visitors from SafeGraph Patterns
-
-
Analysis Frameworks
-
STATA
- Analyzing Top Brands in SafeGraph Neighborhood Patterns Data - - A NLP approach to SafeGraph Top Brand analysis.
- Simple Methods for Normalizing SafeGraph Patterns Data Over Time - chong) (SafeGraph)
- Advanced Methods for Correlating SafeGraph Patterns With Other Datasets Across Time
- Macro and Micro approaches to estimating true counts from SafeGraph data
- Memo - tGy4/edit?usp=sharing) for Simple Example of "Micro" CBG-based Normalization to estimate "True Visits" by day -- from [Ryan Fox Squire](https://github.com/ryanfoxsquire) (SafeGraph)
- Details on The Covid19 Commerce Patterns Dashboard from SafeGraph
- Data Analysis Methodology for the SafeGraph Stay-At-Home Index
- SafeGraph's Shelter-in-place index Appendix: Bayesian Hierarchical Models and Empirical Bayes
- Measuring and Correcting Sampling Bias in Safegraph Patterns for More Accurate Demographic Analysis
- Calculate Statistics and Confidence Intervals from SafeGraph Patterns
- SafeGraph's Visit Attribution Whitepaper - - How does SafeGraph combine GPS data and point-of-interest polygon data to measure visits.
- Covid-19 Case Count Forecasting using SafeGraph data
- A weekly fatality counts prediction model
-
-
What is SafeGraph?
- SafeGraph - of-Interest (POI) data, business listings, & store visitor insights data for commercial places in the U.S." Here is a full list of [SafeGraph data sets](https://docs.safegraph.com/docs/places-schema) which you can search in the [SafeGraph Data Bar](https://shop.safegraph.com/) (use coupon `AwesomeDataScience` for $100 free data).
-
Results, Dashboards, and Visualizations (Inspiration)
-
STATA
- SafeGraph Data Publications - - Full list of all publications using SafeGraph data. If you see something is missing, please let SafeGraph know by emailing datastories AT safegraph DOT com
- The SafeGraph Covid-19 Re-opening Dashboard - - built with plot.ly and Dash
- SafeGraph Weekly Patterns Disaster Response Map - - built with Arcgis Online
- Social Distancing Compliance Dashboard for City of San Jose
- Covid-19 Cases and Point-of-interest Visit correlation dashboard
- UT Austin Covid-19 Forecasting using SafeGraph data
- SafeGraph Places Comparison Dashboard - - A dashboard that allows you to compare two different (sets of) POIs in terms of where they get their visitors from, and what the characteristics of those places are. Currently uses Harris County (Houston) example data but could easily be redone with a different area. Code in the [GitHub Repo](https://github.com/NickCH-K/SafeGraphCompareDashboard).
- ODT Flow Explorer - destination (OD) flows derived from SafeGraph data and Twitter data at various geographic scales (from local to global).
-
-
Recommended Licensed Software Tools
-
Helpful Free Software / Websites
-
STATA
- SafeGraph Free Point-of-interest Matching Tool
- How to Join X with Y
- SafeGraph USA census block group lookup and visualization - - want to quickly see the shape of a CBG on a map?
- Movable-type Geohashes page
- arthur-e polygon WKT visualization
- Google CoLab - - FREE cloud-hosted python notebooks
-
-
SafeGraph Documentation
-
STATA
- SafeGraph Docs page
- SafeGraph data science resources page - Lots of notebooks and demos using SafeGraph data produced by SafeGraph
- SafeGraph FAQ
- SafeGraph Places Manual
- SafeGraph Monthly Release Notes
-
-
SafeGraph Community
Programming Languages
Categories