{"id":21723576,"url":"https://github.com/chrismuir/zillow","last_synced_at":"2025-08-21T11:33:11.868Z","repository":{"id":43114295,"uuid":"55027964","full_name":"ChrisMuir/Zillow","owner":"ChrisMuir","description":"Zillow Scraper for Python using Selenium","archived":false,"fork":false,"pushed_at":"2019-06-09T00:49:36.000Z","size":49,"stargazers_count":163,"open_issues_count":4,"forks_count":75,"subscribers_count":18,"default_branch":"master","last_synced_at":"2024-12-10T00:26:41.511Z","etag":null,"topics":["chromedriver","python","scraper","selenium","web-scraping","zillow"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ChrisMuir.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-03-30T03:02:52.000Z","updated_at":"2024-11-23T05:24:24.000Z","dependencies_parsed_at":"2022-09-06T15:51:58.889Z","dependency_job_id":null,"html_url":"https://github.com/ChrisMuir/Zillow","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisMuir%2FZillow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisMuir%2FZillow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisMuir%2FZillow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisMuir%2FZillow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ChrisMuir","download_url":"https://codeload.github.com/ChrisMuir/Zillow/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":230511479,"owners_count":18237657,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chromedriver","python","scraper","selenium","web-scraping","zillow"],"created_at":"2024-11-26T02:40:24.520Z","updated_at":"2024-12-19T23:13:43.148Z","avatar_url":"https://github.com/ChrisMuir.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"Zillow Scraping with Python\n===========================\n\n## ATTENTION:\nAs of 2019, this code no longer works for most users. Zillow is now able to \ndetect the use of all/most automated webdrivers, and will display an \nunlimited number of CAPTCHA's when the site is launched in a webdriver. \nI have no interest in putting more work into this project, but am leaving \nit up to serve as an example of how to webscrape using Selenium with Python.\n\nWARNING: Use this code at your own risk, scraping is against Zillow's TOC\n-------------------------------------------------------------------------\n\nBasic tool for scraping current home listings from Zillow, written in Python \nusing Selenium.  The code takes as input search terms that would normally be \nentered on the Zillow home page.  It creates 11 variables on each home listing \nfrom the data, saves them to a dataframe, and then writes the df to a CSV file \nthat gets saved to your working directory. Using zip codes as search terms \nseems to yield the best results, the scraper works at a rate of about 75 \nzip codes per hour (compared to the Zillow API limit of 1000 homes per 24h).\n\nThere are two files, `zillow_runfile.py` and `zillow_functions.py`. Clone this \nrepo to your working directory, open the runfile and step through the code \nline-by-line. The zillow functions are sourced at the top of the runfile.\n\nThis tool uses a for loop to iterate over a list of input search terms, scrape \nthe listings of each, and append the results to a dataframe. Function `zipcodes_list()` \nallows the user to compile a large list of zip codes to use as search terms, \nusing the package [zipcode](https://pypi.python.org/pypi/zipcode). For example, \n`st = zipcodes_list(['10', '11', '770'])` \nwill yield every US zip code that begins with '10', '11', or '770' as a single \nlist. Object `st` could then be passed to the scraper.\n\nSome things to keep in mind\n---------------------------\n- You will need to edit the input parameter of function `init_driver` within `zillow_runfile.py` \nto point to the local path of your web driver program (required by Selenium).\n- The max return for each search term (i.e. each zip code) is 520 home listings.\n- Zillow will periodically throw up a CAPTCHA page. The script is designed to \npause scraping indefinitely until the user has manually completed the CAPTCHA \nrequirements (at which point it should resume scraping).\n- There tends to be a small amount of NA's on every search, however foreclosure \nproperties seem to be more likely to return NA's. So the more foreclosures \nthere are in a search, the more NA's there will be.\n\nSoftware Requirements/Info\n--------------------------\n- This code was written using [Python 3.5](https://www.python.org/downloads/).\n- [Selenium](http://www.seleniumhq.org/download/) (this can be PIP installed, written using v3.0.2).\n- The Selenium package requires a webdriver program. This code was written \nusing [Chromedriver](https://sites.google.com/a/chromium.org/chromedriver/downloads) v2.25.\n\nExample of the output dataframe\n-------------------------------\n\n```py\ndf.head(n = 6)\n```\n\n```\n                 address     city state    zip    price  sqft bedrooms  \\\n0      3011 Bissonnet St  Houston    TX  77005   575000  1820        3   \n1          4229 Drake St  Houston    TX  77005   615000  2611        3   \n2        2237 Wroxton Rd  HOUSTON    TX  77005  2095000  5492        4   \n3      4318 Childress St  Houston    TX  77005   540000  2438        4   \n4       2708 Werlein Ave  Houston    TX  77005  1449000  3905        4   \n5  5402 Buffalo Speedway  Houston    TX  77005  1995000  4658        3   \n\n  bathrooms days_on_zillow           sale_type  \\\n0         2             NA      House For Sale   \n1         3             NA   For Sale by Owner   \n2         5             NA      House For Sale   \n3         4              2  Townhouse For Sale   \n4         5              1      House For Sale   \n5         4              5      House For Sale   \n\n                                                 url  \n0  http://www.zillow.com/homes/for_sale//homedeta...  \n1  http://www.zillow.com/homes/for_sale//homedeta...  \n2  http://www.zillow.com/homes/for_sale//homedeta...  \n3  http://www.zillow.com/homes/for_sale//homedeta...  \n4  http://www.zillow.com/homes/for_sale//homedeta...  \n5  http://www.zillow.com/homes/for_sale//homedeta...  \n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrismuir%2Fzillow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchrismuir%2Fzillow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrismuir%2Fzillow/lists"}