https://github.com/jzebedee/uscis
Daily datasets of USCIS form processing times
https://github.com/jzebedee/uscis
citizenship foia immigration sqlite uscis
Last synced: about 7 hours ago
JSON representation
Daily datasets of USCIS form processing times
- Host: GitHub
- URL: https://github.com/jzebedee/uscis
- Owner: jzebedee
- Created: 2022-03-20T14:51:11.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2026-01-07T05:25:13.000Z (17 days ago)
- Last Synced: 2026-01-08T01:11:15.525Z (17 days ago)
- Topics: citizenship, foia, immigration, sqlite, uscis
- Language: Shell
- Homepage:
- Size: 72.3 KB
- Stars: 7
- Watchers: 0
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: changelog-template.txt
- Funding: .github/FUNDING.yml
Awesome Lists containing this project
README
# USCIS Dataset [](https://github.com/sponsors/jzebedee)
[](https://github.com/jzebedee/uscis/actions/workflows/build_db.yml)
Daily datasets of USCIS form processing times
## About
The U.S. Citizenship and Immigration Services (USCIS) provides estimated [case processing times](https://egov.uscis.gov/processing-times/more-info) and [information request processing times](https://first.uscis.gov/#/check-status) that vary by form and service center. These estimates include both an estimate of the case adjudication time as well as the _case inquiry date_, which determines when an applicant may contact USCIS regarding a case that is outside of normal processing times.
Unfortunately, these estimates are updated silently without any notification or record, sometimes multiple times per day. This project is an attempt to provide transparency for applicants who may be surprised to find that their case inquiry date was changed without their knowledge.
## How it works
The dataset releases are produced on a daily cron schedule that scrapes the USCIS case processing time API and compiles the results into a SQLite database.
The raw JSON results are also collected into a [SQLite archive](https://www.sqlite.org/sqlar.html) and published as an artifact, in the case of debugging or if there's additional information to extract. These artifacts are _not_ a permanent collection and will be removed eventually based on the [artifact retention period](https://docs.github.com/en/organizations/managing-organization-settings/configuring-the-retention-period-for-github-actions-artifacts-and-logs-in-your-organization).
## Changelog
### v0.5 - 2025-02-23
* We now collect FOIA processing times.
#### Schema
##### `forms` table
```sql
CREATE TABLE forms(
name TEXT PRIMARY KEY,
description_en TEXT,
description_es TEXT
) WITHOUT ROWID
```
##### `offices` table
```sql
CREATE TABLE offices(
"code" TEXT PRIMARY KEY,
"description" TEXT
) WITHOUT ROWID
```
##### `foia_processing_time` table
```sql
CREATE TABLE "foia_processing_time" (
"id" INTEGER,
"metricTimestamp" TEXT,
"metricName" TEXT,
"metricValue" INTEGER,
"trackId" INTEGER,
"officeId" INTEGER,
"officeCode" TEXT,
PRIMARY KEY("id")
) WITHOUT ROWID
```
##### `processing_time` table
```sql
CREATE TABLE processing_time(
"form_name" TEXT,
"office_code" TEXT,
"form_note_en" TEXT,
"form_note_es" TEXT,
"form_subtype" TEXT,
"publication_date" TEXT,
"range_upper" REAL,
"range_upper_unit" TEXT,
"range_lower" REAL,
"range_lower_unit" TEXT,
"service_request_date" TEXT,
"subtype_info_en" TEXT,
"subtype_info_es" TEXT,
"subtype_note_en" TEXT,
"subtype_note_es" TEXT,
PRIMARY KEY("form_name","office_code","form_subtype")
) WITHOUT ROWID
```
##### `form_types` table
```sql
CREATE TABLE form_types(
form_name TEXT,
form_key TEXT,
form_type TEXT,
description_en TEXT,
description_es TEXT,
offices JSON,
PRIMARY KEY("form_name","form_key")
) WITHOUT ROWID
```
##### `selftest` table
Used for [SQLite database integrity self-tests](https://www.sqlite.org/cli.html#database_content_self_tests)
### v0.4 - 2025-02-03
* USCIS has begun aggressively blocking scraping requests and significantly limited who can reach their website. Collecting form processing times now requires us to go through a much more time and resource intensive process using residential proxy servers. I've added a link to my [funding page](https://github.com/sponsors/jzebedee) if you'd like to support the project.
### v0.3 - 2023-07-29
* Release notes are now generated with `sqldiff` output to compare daily changes
### v0.2 - 2022-05-05
* Office data is now grouped by form subtype in the `form_types` table
* JSON result artifacts are now published in each action run
#### Schema
##### `forms` table
```sql
CREATE TABLE forms(
name TEXT PRIMARY KEY,
description_en TEXT,
description_es TEXT
) WITHOUT ROWID
```
##### `offices` table
```sql
CREATE TABLE offices(
code TEXT PRIMARY KEY,
description TEXT
) WITHOUT ROWID
```
##### `processing_time` table
```sql
CREATE TABLE processing_time(
"form_name" TEXT,
"office_code" TEXT,
"form_note_en" TEXT,
"form_note_es" TEXT,
"form_subtype" TEXT,
"publication_date" TEXT,
"range_upper" REAL,
"range_upper_unit" TEXT,
"range_lower" REAL,
"range_lower_unit" TEXT,
"service_request_date" TEXT,
"subtype_info_en" TEXT,
"subtype_info_es" TEXT,
"subtype_note_en" TEXT,
"subtype_note_es" TEXT,
PRIMARY KEY("form_name","office_code","form_subtype")
) WITHOUT ROWID
```
##### `form_types` table
```sql
CREATE TABLE form_types(
form_name TEXT,
form_key TEXT,
form_type TEXT,
description_en TEXT,
description_es TEXT,
offices JSON,
PRIMARY KEY("form_name","form_key")
) WITHOUT ROWID
```
##### `selftest` table
Used for [SQLite database integrity self-tests](https://www.sqlite.org/cli.html#database_content_self_tests)
### v0.1 - 2022-03-21
* Initial release
#### Schema
##### `forms` table
```sql
CREATE TABLE forms(
name TEXT PRIMARY KEY,
description_en TEXT,
description_es TEXT,
offices JSON
) WITHOUT ROWID
```
##### `offices` table
```sql
CREATE TABLE offices(
code TEXT PRIMARY KEY,
description TEXT
) WITHOUT ROWID
```
##### `processing_time` table
```sql
CREATE TABLE processing_time(
"form_name" TEXT,
"office_code" TEXT,
"form_note_en" TEXT,
"form_note_es" TEXT,
"form_subtype" TEXT,
"publication_date" TEXT,
"range_upper" REAL,
"range_upper_unit" TEXT,
"range_lower" REAL,
"range_lower_unit" TEXT,
"service_request_date" TEXT,
"subtype_info_en" TEXT,
"subtype_info_es" TEXT,
"subtype_note_en" TEXT,
"subtype_note_es" TEXT,
PRIMARY KEY("form_name","office_code","form_subtype")
) WITHOUT ROWID
```
##### `selftest` table
Used for [SQLite database integrity self-tests](https://www.sqlite.org/cli.html#database_content_self_tests)