{"id":29722640,"url":"https://github.com/datalopes1/report_fortal","last_synced_at":"2026-05-16T18:36:38.401Z","repository":{"id":296296626,"uuid":"988570096","full_name":"datalopes1/report_fortal","owner":"datalopes1","description":"Radar Imobiliário Mensal de Fortaleza/CE","archived":false,"fork":false,"pushed_at":"2025-07-01T18:22:49.000Z","size":10744,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-07-24T21:11:56.441Z","etag":null,"topics":["analytics","real-estate","streamlit"],"latest_commit_sha":null,"homepage":"https://radarimob-fortal.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datalopes1.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-05-22T18:38:26.000Z","updated_at":"2025-07-01T14:18:26.000Z","dependencies_parsed_at":"2025-05-29T23:34:43.849Z","dependency_job_id":"94eb89df-9de4-416a-a0a3-2b83c0c85929","html_url":"https://github.com/datalopes1/report_fortal","commit_stats":null,"previous_names":["datalopes1/report_fortal"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/datalopes1/report_fortal","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datalopes1%2Freport_fortal","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datalopes1%2Freport_fortal/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datalopes1%2Freport_fortal/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datalopes1%2Freport_fortal/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datalopes1","download_url":"https://codeload.github.com/datalopes1/report_fortal/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datalopes1%2Freport_fortal/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33114552,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-16T04:41:52.686Z","status":"ssl_error","status_checked_at":"2026-05-16T04:41:52.009Z","response_time":115,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["analytics","real-estate","streamlit"],"created_at":"2025-07-24T17:35:30.376Z","updated_at":"2026-05-16T18:36:38.374Z","avatar_url":"https://github.com/datalopes1.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🏡 Radar Imobiliário Mensal de Fortaleza/CE\n\n## 📜Sumário\n1. 📌 [Sobre o Projeto](#-sobre-o-projeto)\n2. ⚙️ [Tecnologias Utilizadas](#️-tecnologias-utilizadas)\n3. 🚀 [Como Executar](#-como-executar)\n4. 📊 [Estrutura do Projeto](#-estrutura-do-projeto)\n5. 🗒️ [Licença](#️-licença)\n6. 📞 [Contato](#-contato)\n\n## 📌 Sobre o Projeto\nCom a ideia de dar um próximo passo no meu projeto de web scraping de dados imobiliários decidi criar um report mensal com dados colhidos de anúncios em diversos sites para entregar um paranorâma mensal do mercado imobiliário residencial da capital cearense.\n\n### Próximo passos\n- [x] Maio/2025 - Criação de um Data Warehouse.\n- [ ] Junho/2025 - Orquestração com Airflow.\n- [ ] Julho/2025 - Pipeline CI/CD Completo.\n\n## ⚙️ Tecnologias Utilizadas\nEste projeto foi desenvolvido utilizando:\n\n- 🐍 Python 3.11.8+\n- 📊 Streamlit (Interface)\n- 🦆 DuckDB \u0026 dbt (Armazenamento e transformação dos dados)\n- 🔢 Pandas \u0026 NumPy (Manipulação de Dados e Armazenamento)\n- 🕸️ Scrapy (Web Scraping)\n- 📈 Plotly (Visualização de Dados)\n\n### Arquitetura da solução\n\n![img](img/arq.png)\n\n## 🚀 Como Executar\nAcesse a aplicação web no [Streamlit Cloud](https://radarimob-fortal.streamlit.app/).\n\n#### Execução\n1️⃣ **Clone o repositório**\n```bash\ngit clone https://github.com/datalopes1/report_fortal.git\ncd report_fortal\n```\n\n2️⃣ **Crie e ative um ambiente virtual (recomendado)**\n ```bash\npython -m venv .venv\nsource .venv/bin/activate  # Mac e Linux\n.venv\\Scripts\\activate  # Windows\n ```\n\n3️⃣ **Instale as dependências**\n```bash\npip install -r requirements.txt\n```\n\n4️⃣ **Execute o projeto**\n```bash\nstreamlit run src/dashboard/app.py\n```\n## 📊 Estrutura do Projeto\n```plain_text\nreport_fortal/\n│-- .streamlit/                 # Arquivos de configuração do Streamlit\n|-- data/\n|   └── processed/              # Dados processados\n|   └── raw/                    # Arquivos brutos extraídos\n|   └── database.duckdb         # Banco de Dados \n|-- dwh/                        # Modelos do Data Warehouse\n|-- img/                        # Imagens utilizadas na documentação\n|-- src/                \n|   └── dashboard/              # Script do Streamlit\n|   └── extract/                # Scripts de extração dos dados\n|   └── load/                   # Scripts de ingestão dos dados\n|-- LICENSE.md                  # Licença do projeto\n|-- poetry.lock                 # Lock do Poetry\n|-- pyproject.toml              # Dependências do projeto\n|-- README.md                   \n└── requirements.txt              \n\n```\n\n## 🗒️ Licença\nEste projeto está licenciado sob a MIT License - veja o arquivo [LICENSE](LICENSE.md) para mais detalhes.\n\n## 📞 Contato\n- 📬 datalopes1@proton.me\n- 🖱️ https://datalopes1.github.io/\n- 📱 +55 88 99993-4237","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatalopes1%2Freport_fortal","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatalopes1%2Freport_fortal","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatalopes1%2Freport_fortal/lists"}