https://github.com/mominurr/web-scraping-projects
https://github.com/mominurr/web-scraping-projects
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/mominurr/web-scraping-projects
- Owner: mominurr
- Created: 2023-10-22T20:31:34.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-08T12:01:36.000Z (about 1 year ago)
- Last Synced: 2024-05-08T13:26:04.939Z (about 1 year ago)
- Size: 13.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Web Scraping Projects
Welcome to my Web Scraping Projects repository! Here, you can find a list of web scraping projects I’ve shared. These projects are hosted in my private GitHub repositories. If you need access to the code or have specific scraping tasks in mind, feel free to contact me.
## Total Scraping Projects Shared : 35
At the moment, I have completed **250+** web scraping projects. This list is continually growing as I add new projects upon completion.
## Scraping & Automation Projects Lists
1. **zillow-com-scraper**
- Website: [zillow.com](https://www.zillow.com)
- Description: This project scrapes property data and agent information from zillow.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/zillow-properties-data.json)
2. **domain-com-au-scraper**
- Website: [domain.com.au](https://www.domain.com.au/)
- Description: This project scrapes property data and agent information from domain.com.au.
3. **realtor-com-scraper**
- Website: [realtor.com](https://www.realtor.com/)
- Description: This project scrapes property data and agent information from realtor.com.
4. **ebay-com-scraper**
- Website: [ebay.com](https://www.ebay.com/)
- Description: This project scrapes product information from ebay.com.
5. **gsmarena-com-scraper**
- Website: [gsmarena.com](https://www.gsmarena.com/)
- Description: This project scrapes product information from gsmarena.com.
6. **amazon-com-scraper**
- Website: [amazon.com](https://www.amazon.com/)
- Description: This project scrapes product information and review information from amazon.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/amazon.com-data.xlsx)
7. **partnertele-com-scraper**
- Website: [partnertele.com](https://partnertele.com)
- Description: This project scrapes product information from partnertele.com.
8. **tuning-tec-com-scraper**
- Website: [tuning-tec.com](https://tuning-tec.com/)
- Description: This project scrapes product information from tuning-tec.com.
9. **witson-com-scraper**
- Website: [witson.com](https://witson.com/)
- Description: This project scrapes product information from witson.com.
10. **after55-com-scraper**
- Website: [after55.com](https://www.after55.com)
- Description: This project scrapes property data from after55.com.
11. **socialbook-io-and-youtube-email-scraper**
- Website: [socialbook.io](https://socialbook.io/youtube_email_extraction_rok) [youtube.com](https://www.youtube.com/)
- Description: This project scrape email from youtube channel and this email submit socialbook.io website. But for this project you must need many gmail account and channel and also need [vpn](https://nordvpn.com/). I am suggesting nordvpn.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/youtube-Data.xlsx)
12. **realtor-ca-scraper**
- Website: [realtor.ca](https://www.realtor.ca/)
- Description: This project scrapes property data and agent information from realtor.ca.
13. **ajpes.si-scraper**
- Website: [ajpes.si](https://www.ajpes.si/RNO/Ajpes.RNO/RNO/vstop)
- Description: This project scrapes this [url](https://www.ajpes.si/RNO/Ajpes.RNO/RNO/vstop) detail information.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/ajpes.si-data.xlsx)
14. **allhomes.com.au-scraper**
- Website: [allhomes.com.au](https://www.allhomes.com.au/auction-results/)
- Description: This project scrapes property data from this [url](https://www.allhomes.com.au/auction-results/).
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/allhomes.com.au-data.xlsx)
15. **zango.com.au-scraper**
- Website: [zango.com.au](https://zango.com.au/auction-results/latest/)
- Description: This project scrapes property data from this [url](https://zango.com.au/auction-results/latest/).
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/zango.com.au-data.xlsx)
16. **empireflippers.com-scraper**
- Website: [empireflippers.com](https://empireflippers.com/marketplace/)
- Description: This project scrapes product data from empireflippers.com.
17. **arbk.rks-gov.net-scraper**
- Website: [arbk.rks-gov.net](https://arbk.rks-gov.net/)
- Description: This project scrapes business data from arbk.rks-gov.net.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/arbk.rks-gov.net-data.xlsx)
18. **copart.co.uk-scraper**
- Website: [copart.co.uk](https://www.copart.co.uk/)
- Description: This project scrapes product data from copart.co.uk.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/copart.co.uk-data.csv)
19. **kmotorshop.com-scraper**
- Website: [kmotorshop.com](https://www.kmotorshop.com)
- Description: This project scrapes product data from kmotorshop.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/kmotorshop.com-data.xlsx)
20. **facebook.com-scraper**
- Website: [facebook.com](https://www.facebook.com)
- Description: This project scrapes public group post data with comment from facebook.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/group-post-data.csv)
21. **addinol.de-scraper**
- Website: [addinol.de](https://www.addinol.de)
- Description: This project scrapes product infromation from addinol.de.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/addinol-sample-data.xlsx)
22. **aftermarket.schaeffler.com-scraper**
- Website: [addinol.de](https://aftermarket.schaeffler.com)
- Description: This project scrapes product infromation from aftermarket.schaeffler.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/aftermarket-data.json)
23. **agrodoctor.eu-scraper**
- Website: [agrodoctor.eu](https://agrodoctor.eu)
- Description: This project scrapes product infromation from agrodoctor.eu.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/agrodoctor.data.json)
24. **bizi.si-scraper**
- Website: [bizi.si](https://agrodoctor.eu)
- Description: This project scrapes product infromation from bizi.si.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/bizi-data.xlsx)
25. **discoverisc.com-scraper**
- Website: [discoverisc.com](https://www.discoverisc.com)
- Description: This project scrapes product infromation from discoverisc.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/discoverisc-sample-data.xlsx)
26. **cars.com-scraper**
- Website: [cars.com](https://www.cars.com)
- Description: This project scrapes product infromation from cars.com.
- Data: [Sample File](https://github.com/mominurr/cars.com/blob/main/cars_data_2024_09_25.csv)
- Github: [cars.com:scraper](https://github.com/mominurr/cars.com)
27. **vfsglobal.com-scraper**
- Website: [vfsglobal.com](https://www.vfsglobal.com/en/individuals/index.html)
- Description: This bot automates the process of checking for available visa appointments on the VFS Global website.
- Github: [visa.vfsglobal.com:appoinment automation bot](https://github.com/mominurr/visa.vfsglobal.com)
28. **selfridges.com-scraper**
- Website: [selfridges.com](https://www.selfridges.com)
- Description: This project scrapes product infromation from selfridges.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/date_20-09-2024__time_09-10-05.xlsx)
29. **cosmetis.pt-scraper**
- Website: [cosmetis.pt](https://www.cosmetis.pt)
- Description: This project scrapes product infromation from cosmetis.pt.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/date_26-09-2024__time_12-33-13.xlsx)
30. **harrods.com-scraper**
- Website: [harrods.com](https://www.harrods.com)
- Description: This project scrapes product infromation from harrods.com.
- Data: [Sample File](https://github.com/mominurr/DATA-SAMPLE-FILE/blob/main/new_harrods_sample_data.xlsx)
31. **realself.com-scraper**
- Website: [realself.com](https://www.realself.com/)
- Description: Extracts doctor profiles and reviews while bypassing security.
- Blog Post: [RealSelf Data Collection](https://mominur.dev/posts/posts_7.html)
- Github: [realSelf.com_scraper](https://github.com/mominurr/realSelf.com_scraper)
- Data: [Sample File](https://github.com/mominurr/realSelf.com_scraper/blob/main/realself_sample_data.json)
32. **walmart.com-scraper**
- Website: [walmart.com](https://www.walmart.com/)
- Description: Extracts doctor profiles and reviews while bypassing security.
- Blog Post: [Walmart Data Collection](https://mominur.dev/posts/posts_8.html)
- Github: [Walmart.com_scraper](https://github.com/mominurr/Walmart-Data-Scraping)
- Data: [Sample File](https://github.com/mominurr/Walmart-Data-Scraping/blob/main/walmart.com_sample_data.json)
33. **Real Estate Web Scraping**
- Website: Many websites, including realtor.com, zillow.com, domain.com.au and others.
- Description: This project scrapes real estate data from multiple websites.
- GitHub: [Real Estate Web Scraping](https://github.com/mominurr/Real-Estate-Web-Scraping)
- Data: [Sample File](https://github.com/mominurr/Real-Estate-Web-Scraping)
34. **Social Media Scraping**
- Website: Many websites, including tiktok.com, facebook.com, instagram.com and others.
- Description: This project scrapes social media data from multiple websites.
- GitHub: [Social Media Scraping](https://github.com/mominurr/Social-Media-Scraping)
- Data: [Sample File](https://github.com/mominurr/Social-Media-Scraping)
35. **Yellow Pages Data Scraping**
- Website: [yellowpages.com](https://www.yellowpages.com/) [yellowpages.com.au](https://www.yellowpages.com.au/)
- Description: This project scrapes yellow pages data from multiple websites.
- GitHub: [Yellow Pages Data Scraping](https://github.com/mominurr/Yellow-Pages-Data-Scraping)
- Data: [Sample File](https://github.com/mominurr/Yellow-Pages-Data-Scraping)
## Contact Me
If you have specific scraping tasks in mind or would like access to any of the projects listed here, please don't hesitate to contact me:
- **Email:** [email protected]
- **LinkedIn:** [LinkedIn Profile](https://www.linkedin.com/in/mominur-rahman-145461203/)
- **Twitter:** [Twitter Profile](https://twitter.com/mominur_rahma_n)
- **Facebook:** [Facebook Profile](https://www.facebook.com/profile.php?id=100076787314573)
- **Instagram:** [Instagram Profile](https://www.instagram.com/mominur_rahma_n)
- **Github:** [Github Profile](https://github.com/mominurr)
- **Website:** [Portfolio](https://mominur.dev/)
I'm responsive and open to inquiries related to web scraping. Feel free to reach out via email, LinkedIn, or Facebook.
Please note that my scraping code is stored in private repositories.
Thank you for your interest in my Web Scraping Projects!