https://github.com/evancarroll/db-trec-texas-real-estate-commission

Importing mechanism for the Texas Real Estate Commission TREC "High Value Data Sets" into PostgreSQL
https://github.com/evancarroll/db-trec-texas-real-estate-commission

database etl government moose opendata postgresql-database postgresql-database-dump real-estate realtors texas trec

Last synced: 3 months ago
JSON representation

Importing mechanism for the Texas Real Estate Commission TREC "High Value Data Sets" into PostgreSQL

• Host: GitHub
• URL: https://github.com/evancarroll/db-trec-texas-real-estate-commission
• Owner: EvanCarroll
• License: agpl-3.0
• Created: 2019-04-14T04:38:47.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2019-04-15T03:07:07.000Z (about 6 years ago)
• Last Synced: 2025-02-25T02:05:47.414Z (3 months ago)
• Topics: database, etl, government, moose, opendata, postgresql-database, postgresql-database-dump, real-estate, realtors, texas, trec
• Language: Shell
• Homepage:
• Size: 19.1 MB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

        
Texas Real Estate Commission (TREC)

===

Currently we download from [TREC](https://www.trec.texas.gov/) the following ["High Value Data Sets"](https://www.trec.texas.gov/public/high-value-data-sets)

* Broker and Sales Agent License Holder Information

* Inspector License Holder Information

* Easement or Right-Of-Ways agents License Holder Information

You can find the [data and field definitions on the TREC High Value Data Sets Instructions page](https://www.trec.texas.gov/public/trec-public-information-files-instructions)

Rationale 

---

I'm looking for a broker that is independent in my area, that

1. Won't charge me a desking fee.

2. Doesn't want a percentage cut.

3. Preferably local and clever.

Thus...

	SELECT *

	FROM trec.view_all_licenses

	WHERE license_type = 'Individual Broker'

		AND license_status     = 'Current and active'

		AND mailing_county     = 'HARRIS'

		AND physical_county    = 'HARRIS'

		AND addr_mailing_city  = 'KINGWOOD'

		AND addr_physical_city = 'KINGWOOD';

And, I can go broker shopping.

Instructions

---

Inside this repo, you'll find a script called `init.sh`. Running that script should download and convert the raw data to a format for ingestion. This scripts calls `runall.sql` which handles the creation of the schema and loading the data into PostgreSQL.

Requirements

---

* PostgreSQL

* iconv (to convert from CP850 to UTF-8)

* sed to remove \x00's from the feed.

* curl to download the raw data files.

Fund work and integration

---

Want to use this technology for an application or need help developing an idea,

integration or further work with the data set? Shoot me an email for a quote.