https://github.com/urbaninstitute/pulse_covid_feature_phase2
https://github.com/urbaninstitute/pulse_covid_feature_phase2
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/urbaninstitute/pulse_covid_feature_phase2
- Owner: UrbanInstitute
- Created: 2020-09-28T17:54:35.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2023-03-21T20:12:23.000Z (about 2 years ago)
- Last Synced: 2024-04-16T01:08:28.753Z (about 1 year ago)
- Language: R
- Size: 119 KB
- Stars: 7
- Watchers: 11
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Pulse Covid Feature: Questionnaire Two
**Note:** This entry includes the code for analyzing data from phases 2, 3, 3.1, 3.2, 3.3, 3.4, and 3.5 of the federal Household Pulse Survey. The Household Pulse Survey introduced questionnaire two with its second round of data collection between August 19 and October 26, 2020, and completed its third round of data collection between October 28, 2020, and March 29, 2021. A continuation of the third round (phase 3.1) began on April 14 and ended on July 5, 2021, a second continuation of the third round (phase 3.2) began on July 21 and ended on October 11, 2021, a third continuation of the third round (phase 3.3) began on December 1, 2021 and ended on February 7, 2022, a fourth continuation of the third round (phase 3.4) began on March 2, 2022 and ended on May 9, 2022, and a fifth continuation of the third round (phase 3.5) began on June 1, 2022. **We stopped publishing new data on July 11, 2022.** Both the second and third rounds collected biweekly data from US adults regarding the effects of the COVID-19 pandemic on themselves and their households, with phase 3.3 moving to a two-weeks-on, two-weeks-off data collection schedule that continues in phases 3.4 and 3.5. The first phase of the Household Pulse Survey ran from April 23 to July 21, 2020. The code for analyzing the phase 1 data can be found [here](https://github.com/UrbanInstitute/pulse_covid_feature).
This repository contains the code and data needed to calculate estimates of
various COVID-19 impacts on US adults and their households by geography and
race/ethnicity as well as the corresponding standard errors and significance of
these estimates. The scripts read in data from the federal [Household Pulse
Survey public use
files](https://www.census.gov/programs-surveys/household-pulse-survey/datasets.html)
to estimate COVID-19 imppacts on few selected variables for the US, all 50 states and the District of
Columbia, and the 15 largest metropolitan statistical areas (MSAs). The output
data files of this repo power Urban's interactive [Tracking COVID-19’s Effects by
Race and Ethnicity: Questionnaire Two](https://www.urban.org/features/tracking-covid-19s-effects-race-and-ethnicity-questionnaire-two) data feature visualizing impacts of COVID-19 on US adults and
their households by geography and race/ethnicity. You can view the code for
creating the web application at this Github repo.
The output data (and data dictionaries) can also be accessed and downloaded on
the [Urban Data Catalog](https://datacatalog.urban.org/dataset/census-pulse-public-use-files-questionnaire-two).
These numbers are estimates and may not equal the actual totals in each
geography. We highly recommend interpreting these results as *relative impacts
of COVID-19* which can be used to inform race-conscious solutions that account for the pandemic's
disparate impacts by race and ethnicity.
For more information, see the [technical appendix](https://www.urban.org/sites/default/files/2022-08/Tracking%20COVID-19s%20Effects%20by%20Race%20and%20Ethnicity_appendix_Phase%203-5.pdf) from our interactive data feature.
## Required R Libraries:
- `tidyverse`
- `readxl`
- `testit`
- `tigris`
- `stringr`
- `httr`
- `here`
- `srvyr==1.0.0`
- `survey==4.0`
- `fastDummies`
- `aws.s3`
## Directory Structure:
- `scripts/` stores the relevant scripts
- `01_generate_weekly_puf_data.R`: Downloads Pulse Survey public use files, creates race/ethnicity variable and indicator variables, and appends replicate weights. The data produced from this file is stored on Urban's Data Portal.
- `02_generate_group_vs_avg_standard_errors.R`: Calculates means and standard errors for each indicator/geography/week/race combination and significance of difference between each population and subgroup mean. Outputs data file that powers the Tracking COVID-19’s Effects by Race and Ethnicity: Questionnaire Two feature.
- `03_upload_to_s3.R`: Uploads data and metadata to AWS S3 bucket.
- `04_perform_qc_checks.R`: Conducts quality control checks on the results output from scripts 02 and 03.
- `data/` stores the data
- `raw-data/`: stores the raw Pulse Survey public use files including the data, replicate weights, and data dictionary.
- `intermediate-data/`: stores the processed public use data and the intermediate outputs of the standard error calculations.
- `final-data/`: stores the final data file produced by `02_generate_group_vs_avg_standard_errors.R` that powers the data feature.
## Contact
Contact Alena Stern at astern [at] urban.org