{"id":13501674,"url":"https://github.com/gilsondev/buscaimoveis-scraper","last_synced_at":"2025-03-29T09:31:05.676Z","repository":{"id":28132549,"uuid":"116410896","full_name":"gilsondev/buscaimoveis-scraper","owner":"gilsondev","description":"Projeto que coleta anúncios de imóveis a venda em grandes plataformas como OLX, Zap Imóveis, etc","archived":true,"fork":false,"pushed_at":"2021-11-16T21:11:45.000Z","size":34,"stargazers_count":38,"open_issues_count":2,"forks_count":12,"subscribers_count":10,"default_branch":"master","last_synced_at":"2024-10-31T20:40:44.266Z","etag":null,"topics":["mongodb","pymongo","python3","scrapy"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gilsondev.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-01-05T17:39:29.000Z","updated_at":"2024-10-12T20:36:08.000Z","dependencies_parsed_at":"2022-08-07T13:15:22.507Z","dependency_job_id":null,"html_url":"https://github.com/gilsondev/buscaimoveis-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gilsondev%2Fbuscaimoveis-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gilsondev%2Fbuscaimoveis-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gilsondev%2Fbuscaimoveis-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gilsondev%2Fbuscaimoveis-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gilsondev","download_url":"https://codeload.github.com/gilsondev/buscaimoveis-scraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246167091,"owners_count":20734379,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["mongodb","pymongo","python3","scrapy"],"created_at":"2024-07-31T22:01:45.983Z","updated_at":"2025-03-29T09:31:05.394Z","avatar_url":"https://github.com/gilsondev.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# Busca Imóveis Scraper\n\nProjeto voltado para raspagem de anúncios de imóveis a venda nas plataformas conhecidas como por exemplo OLX e ZAP Imóveis.\n\n## Instalação\n\n1. Faça o checkout do projeto:\n\n```shell\n$ git clone https://github.com/gilsondev/buscaimoveis-scraper.git\n```\n\n2. Crie o ambiente virtual e instale as dependências:\n\n```shell\n$ cd buscaimoveis-scraper\n$ python3 -m venv .venv\n```\n\n```shell\n$ source .venv/bin/activate\n$ pip install -r requirements.txt\n```\n\n3. Rode o spider desejado. Nesse exemplo irei buscar vendas na OLX.\n\n```shell\n$ scrapy crawl olx\n```\n\nOBS.: Por enquanto é raspado vendas de imóveis no Distrito Federal somente, mas em breve estará flexível para outros estados.\n\nOs dados coletados segue a estrutura de exemplo abaixo:\n\n```json\n{\n  \"_id\": \"\u003cid do documento\u003e\",\n  \"url\": \"http://df.olx.com.br/distrito-federal-e-regiao/imoveis/setor-total-ville-433892765\",\n  \"type\": \"Venda - apartamento padrão\",\n  \"tax\": \"R$ 100,00\",\n  \"garage\": 1,\n  \"price\": \" R$ 97.000,00\",\n  \"created_at\": \"ISODate('2018-01-04T16:56:42.669Z')\",\n  \"rooms\": 2,\n  \"posted_at\": \"4 Janeiro às 16:15\",\n  \"image\": \"http://img.olx.com.br/images/35/357804005117894.jpg\",\n  \"district\": \"Santa Maria\",\n  \"cep\": \"72505-222\",\n  \"area\": \"\",\n  \"title\": \"Setor Total Ville\",\n  \"description\": \"Descrição do anúncio\",\n  \"owner\": \"Nome do Dono do imóvel\"\n  \"city\": \"Brasília\",\n  \"phone\": \"(61) 99999-9999\"\n}\n```\n\n## Como Contribuir\nVeja mais no arquivo `CONTRIBUTING.md`, as formas de ajudar com o projeto, e o `AUTHORS.md` para saber quem estão a frente e que pode te auxiliar.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgilsondev%2Fbuscaimoveis-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgilsondev%2Fbuscaimoveis-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgilsondev%2Fbuscaimoveis-scraper/lists"}