https://github.com/ggyll/scrape_compass_agents
Web scraper for Compass.com Agents directory, from my Youtube tutorial.
https://github.com/ggyll/scrape_compass_agents
Last synced: about 1 year ago
JSON representation
Web scraper for Compass.com Agents directory, from my Youtube tutorial.
- Host: GitHub
- URL: https://github.com/ggyll/scrape_compass_agents
- Owner: GGyll
- Created: 2024-06-12T11:36:55.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-12T11:57:55.000Z (almost 2 years ago)
- Last Synced: 2025-01-21T07:11:12.574Z (about 1 year ago)
- Language: Python
- Size: 3.91 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## This script allows you to scrape real estate agents from compass.com
The script can easily be changed to scrape other agent websites by changing the CSS and XPath selector
See the Youtube tutorial for more instructions:
https://youtube.com/shorts/Kux7Kro4eGA
### How to run the script
Clone the repository or download the ZIP and extract it.
Ensure you have Python 3 installed, then open up your terminal/command prompt, navigate to the directory of the script and run:
```
pip install -r requirements.txt
python scrape_agents.py
```
Your console should print out the extracted agent data. You can modify the script to write it to a CSV as well