https://github.com/nycdb/nycdb
Database of NYC Housing Data
https://github.com/nycdb/nycdb
civic-data data database housing nyc open-data psql python3
Last synced: 8 months ago
JSON representation
Database of NYC Housing Data
- Host: GitHub
- URL: https://github.com/nycdb/nycdb
- Owner: nycdb
- License: agpl-3.0
- Created: 2016-08-27T16:47:43.000Z (over 9 years ago)
- Default Branch: main
- Last Pushed: 2025-04-04T14:17:51.000Z (10 months ago)
- Last Synced: 2025-04-22T02:14:29.222Z (9 months ago)
- Topics: civic-data, data, database, housing, nyc, open-data, psql, python3
- Language: Python
- Homepage:
- Size: 12.1 MB
- Stars: 218
- Watchers: 27
- Forks: 55
- Open Issues: 94
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Security: SECURITY.md
Awesome Lists containing this project
README
# nycdb
Let's research the landlord! New York City is in a housing crisis. Some [landlords](https://youtu.be/o1SzKHXz8tU) leave their buildings in despair and let their tenants suffer without heat in winter. Others evict their tenants, legally or illegally, in order to flip buildings and profit off of gentrification. Affordable housing is a scarce resource.
Residents, lawyers, tenants, and organizers who want to use data in their struggle turn to proprietary databases and resources, like PropertyShark, designed for real estate or contend with CSV and printouts from city websites. _nycdb_ aims to give technologists and researchers who want to volunteer their time helping community groups who are defending the city against the real estate industry a leg up by providing a ready-to-use database filled with housing data.
**nycdb** is a python program that downloads, processes, and loads the following public datasets into postgres:
- [Department of City Planning's PLUTO](https://github.com/nycdb/nycdb/wiki/Dataset:-PLUTO) (Includes the [latest version via Open Data](https://data.cityofnewyork.us/City-Government/Primary-Land-Use-Tax-Lot-Output-PLUTO-/64uk-42ks), and many other specific versions. See documentatino for details)
- [DOB Job Filings](https://github.com/nycdb/nycdb/wiki/Dataset:-DOB-Job-Filings)
- [DOB Complaints](https://github.com/nycdb/nycdb/wiki/Dataset:-DOB-Complaints)
- [DOB Vacate Orders](https://github.com/nycdb/nycdb/wiki/Dataset:-DOB-Vacate-Orders) - From [FOIA request by Jennah Gosciak](https://github.com/jennahgosciak/dob_vacate_orders)
- [DOB Violations](https://github.com/nycdb/nycdb/wiki/Dataset:-DOB-Violations)
- [DOB Certificate of Occupancy](https://github.com/nycdb/nycdb/wiki/Dataset:-DOB-Certificate-of-Occupancy)
- [HPD Violations](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Violations)
- [HPD Litigations](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Litigations)
- [HPD Registrations](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Registrations)
- [HPD Complaints](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Complaints)
- [HPD Charges](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Charges)
- [HPD Repair and Vacate Orders](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Vacate-Orders)
- [HPD Affordable Production (Building and Project)](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Affordable-Production)
- [HPD Local Law 44 - housing projects with City financial assistance)](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Local-Law-44)
- [HPD Certificate of No Harassment](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Certificate-of-No-Harassment)
- [HPD Alternative Enforcement Program (AEP)](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Alternative-Enforcement-Program-(AEP))
- [HPD Underlying Conditions Program](https://github.com/nycdb/nycdb/wiki/Dataset:-HPD-Underlying-Conditions-Program)
- [Department of Finance Rolling Sales](https://github.com/nycdb/nycdb/wiki/Dataset:-DOF-Rolling-Sales)
- [Department of Finance Annualized Sales](https://github.com/nycdb/nycdb/wiki/Dataset:-DOF-Annualized-Sales)
- [Department of Finance Property Tax Exemptions](https://github.com/nycdb/nycdb/wiki/Dataset:-DOF-Exemptions)
- [Tax bills - Rent Stabilization Unit Counts](https://github.com/nycdb/nycdb/wiki/Dataset:-Rent-Stabilized-Buildings) ([John Krauss](https://github.com/talos/nyc-stabilization-unit-counts) and [Atul Varma's](https://github.com/JustFixNYC/nyc-doffer) data)
- [DOF Tax Lien Sale List](https://github.com/nycdb/nycdb/wiki/Dataset:-DOF-Tax-Lien-Sale-List)
- [ACRIS](https://github.com/nycdb/nycdb/wiki/Dataset:-ACRIS)
- [Executed Evictions](https://github.com/nycdb/nycdb/wiki/Dataset:-Executed-Evictions) - Direct from Open Data
- [Marshal Evictions](https://github.com/nycdb/nycdb/wiki/Dataset:-Marshal-Evictions) - From [DOI](https://data.cityofnewyork.us/City-Government/Evictions/6z8x-wfk4) via ANHD's [Displacement Alert Project](https://github.com/ANHD-NYC-CODE/anhd-council-backend) and [API](https://api.displacementalert.org/docs/) (built by [Jade Ahking](https://github.com/0xStarcat))
- [ECB Violations](https://github.com/nycdb/nycdb/wiki/Dataset:-ECB-Violations)
- [Oath Hearings](https://github.com/nycdb/nycdb/wiki/Dataset:-OATH-Hearings)
- [Property Address Directory](https://github.com/nycdb/nycdb/wiki/Dataset:-Property-Address-Directory-(PAD))
- [J-51 Exemptions](https://github.com/nycdb/nycdb/wiki/Dataset:-J-51-Exemptions)
- [OCA Housing Court Records](https://github.com/nycdb/nycdb/wiki/Dataset:-OCA-Housing-Court-Records) (zipcode)
- [BBLs of NYC Housing Authority (NYCHA) Developments](https://github.com/nycdb/nycdb/wiki/Dataset:-NYCHA-BBLs) — From NYCHA via [JustFix's scraper tool](https://github.com/JustFixNYC/nycha-scraper)
- [Speculation Watch List](https://github.com/nycdb/nycdb/wiki/Dataset:-Speculation-Watch-List)
- [DCP Housing Database](https://github.com/nycdb/nycdb/wiki/Dataset:-DCP-Housing-Database)
- [Major Capital Improvements (MCI) Applications](https://github.com/nycdb/nycdb/wiki/Dataset:-Major-Capital-Improvements-(MCI)-Applications) - From [FOIL request by Winnie Shen](https://github.com/wshenyc/nyc_mci_map)
- [DOB Safety Violations](https://data.cityofnewyork.us/Housing-Development/DOB-Safety-Violations/855j-jady)
- [DHS Daily Shelter Census](https://www.nyc.gov/assets/dhs/downloads/pdf/dailyreport.pdf) - From [scraping by Adrian Nesta and Patrick Spauster](https://github.com/anesta95/nyc_shelter_count/tree/main)
- [DOHMH Rodent Inspections](https://github.com/nycdb/nycdb/wiki/Dataset:-DOHMH-Rodent-Inspections)
- [NYU Furman Center's Subsidized Housing Database](https://github.com/nycdb/nycdb/wiki/Dataset:-Subsidized-Housing-Database)
- [NY Department of State Active Corporations](https://github.com/nycdb/nycdb/wiki/Dataset:-DOS-Active-Corporations)
- [NYC Political/Administrative/Census Boundaries (DCP)](https://github.com/nycdb/nycdb/wiki/Dataset:-Boundaries-(Political,-Administrative,-Census))
- [NYC Zip Code Boundaries (Archive)](https://github.com/nycdb/nycdb/wiki/Dataset:-Zipcodes)
## Using the database
### Create your own copy
Go to [src/README.md](src/README.md) for documentation on how to create your own copy of the database locally.
### Use the Housing Data Coalition's instance
The Housing Data Coalition hosts their own copy ("instance") of nycdb. If you are not a member of HDC and would like to use it, please contact housingdatacoalition@gmail.com
### Acknowledgments
- [Heatseek](https://heatseek.org/) for ongoing support of the project and for their amazing work.
- [@talos](https://github.com/talos) for his [tax bill scraping](https://github.com/talos/nyc-stabilization-unit-counts) to get counts of rent-stabilization units
- NYCDB's [programmers](https://github.com/nycdb/nycdb/graphs/contributors)
- [Housing Data Coalition](https://www.housingdatanyc.org/) for their support and for hosting nycdb workshops
#### License: AGPLv3
```
NYCDB - Postgres database of NYC housing data
Copyright (C) 2016-2020 ziggy & contributors
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU Affero General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU Affero General Public License for more details.
```
The database files provided on this page are licensed [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode).