{"id":23527323,"url":"https://github.com/arv-anshul/99acres-scrape","last_synced_at":"2025-07-25T13:37:22.623Z","repository":{"id":181420757,"uuid":"666741858","full_name":"arv-anshul/99acres-scrape","owner":"arv-anshul","description":"Scrape 99scrape.com with python using curl command and export data as CSV.","archived":false,"fork":false,"pushed_at":"2024-06-06T12:50:26.000Z","size":246,"stargazers_count":6,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-29T16:01:39.985Z","etag":null,"topics":["99acres","api","asyncio","curl-parser","curler","project","python3","real-estate","real-estate-website","streamlit","web-scraping"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arv-anshul.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-07-15T12:26:44.000Z","updated_at":"2025-02-05T15:34:12.000Z","dependencies_parsed_at":"2024-01-20T08:41:40.845Z","dependency_job_id":"a38bee42-05c9-4e30-a99a-b5729821c2f8","html_url":"https://github.com/arv-anshul/99acres-scrape","commit_stats":null,"previous_names":["arv-anshul/99acres-scrape"],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arv-anshul%2F99acres-scrape","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arv-anshul%2F99acres-scrape/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arv-anshul%2F99acres-scrape/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arv-anshul%2F99acres-scrape/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arv-anshul","download_url":"https://codeload.github.com/arv-anshul/99acres-scrape/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250256963,"owners_count":21400625,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["99acres","api","asyncio","curl-parser","curler","project","python3","real-estate","real-estate-website","streamlit","web-scraping"],"created_at":"2024-12-25T20:13:59.108Z","updated_at":"2025-04-22T14:24:49.760Z","avatar_url":"https://github.com/arv-anshul.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Scrape 99Acres\n\n\u003e \\[!CAUTION\\]\n\u003e\n\u003e **Message from Author:** I ([Anshul Raj Verma](https://github.com/arv-anshul)) am not\n\u003e able to scrape 99acres website using this streamlit app due to some unathorization\n\u003e issue.\n\u003e\n\u003e BTW, you can use and try to scrape the website and if you are able to scrape, please\n\u003e raise a issue to discuss the problem. Thanks!\n\n\u003e [!IMPORTANT]\n\u003e\n\u003e **DISCLAIMER:** This project is only for education purpose.\n\n### Why this project?\n\nI am working on a real estate project. So I need real-time data for that so I write a program to gather the data for this project and convert it into a web-app using streamlit.\n\nCheck out my Data Analysis on the scrapped data [here](https://github.com/arv-anshul/campusx-project-notebooks).\n\n### Datasets\n\nI've scrape and uploaded some cities data in my Kaggle profile you can download that\nand practice. It contains **more than 40k+** properties details from different Indian cities.\n\nDataset on Kaggle:\n[**Indian Real Estate - 99acres.com**](https://www.kaggle.com/datasets/arvanshul/gurgaon-real-estate-99acres-com)\n\n### Documentation\n\nDocumentation for this project is available in [🗒️ wiki](https://github.com/arv-anshul/99acres-scrape/wiki) section.\n\nIn order to see the EDA process on the data fetched by this app goto [📁 campusx-project-notebooks](https://github.com/arv-anshul/campusx-project-notebooks).\n\n### Techs\n\n1. Python\u003e=3.11\n2. Asynchronous Programming\n3. Streamlit\n4. Http Requests\n5. Pydantic\n\n### Setup\n\n1. Install all the required packages.\n\n```sh\npip install -r requirements.txt\n```\n\n### Usage\n\n1. Run the streamlit app.\n\n```sh\nstreamlit run app.py\n```\n\n2. Goto URL `http://localhost:8501/`.\n3. Fill the form: **Select the city** which you want to scrape and submit.\n4. After some backend processing; **a download button** will appear, click it to download the scrapped data.\n\n### Disclaimer\n\nAs I wanted to scrape the data from 99Acres website. I am ensuring that I am not performing any illegal activity using this data. I used this data in my project to build some ML model and perform some data analysis.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farv-anshul%2F99acres-scrape","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farv-anshul%2F99acres-scrape","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farv-anshul%2F99acres-scrape/lists"}