https://github.com/ojas-arora/web-scrapping-using-selenium

Easily scrape dynamic, JavaScript-driven sites with Selenium! This repo guides you through 🌍 automated navigation, 📝 data extraction from complex page elements, and ⚠️ error handling to manage loading delays. Just install Selenium, 🔧 set up the WebDriver, and dive into the example scripts to get started! 🚀📊
https://github.com/ojas-arora/web-scrapping-using-selenium

machine-learning selenium selenium-webdriver webscraping webscraping-python webscraping-selenium

Last synced: about 12 hours ago
JSON representation

Easily scrape dynamic, JavaScript-driven sites with Selenium! This repo guides you through 🌍 automated navigation, 📝 data extraction from complex page elements, and ⚠️ error handling to manage loading delays. Just install Selenium, 🔧 set up the WebDriver, and dive into the example scripts to get started! 🚀📊

• Host: GitHub
• URL: https://github.com/ojas-arora/web-scrapping-using-selenium
• Owner: Ojas-Arora
• Created: 2024-11-04T17:21:22.000Z (4 days ago)
• Default Branch: main
• Last Pushed: 2024-11-04T17:33:45.000Z (4 days ago)
• Last Synced: 2024-11-04T18:28:19.389Z (4 days ago)
• Topics: machine-learning, selenium, selenium-webdriver, webscraping, webscraping-python, webscraping-selenium
• Language: Jupyter Notebook
• Homepage: https://medium.com/@ojas.arora14/unleashing-the-power-of-selenium-for-%EF%B8%8Fweb-scraping-5cc6ac4a965e
• Size: 189 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# 🔍 Unleashing the Power of Selenium for 🕸️Web Scraping

![image](https://github.com/user-attachments/assets/a450e79c-deae-4968-975f-bbcb6804396e)

**🖥️ Selenium** is basically a Web Browser Automation Tool, which simulates a user surfing the Internet. It allows —

1. 🖱️ Clicking buttons

2. ⌨️ Entering information in forms

3. 🔍 Searching for specific information on the web pages

**🖥️ Selenium** came into existence to overcome the limitations 🚫 of Beautiful Soup, allowing for interaction with dynamic content and JavaScript-heavy websites.

## 🛠️ Prerequisites

Before we begin, make sure you have the following tools set up 🔧:

1. Python 🐍

2. Selenium WebDriver 🕵️‍♀️

3. Browser Driver (e.g., ChromeDriver) 🌐

- To install Selenium, use the following command:

     **pip install selenium**

- 🔧Remeber to download the appropriate WebDriver for your browser from here 🖥️.

- ⬇️ Download the appropriate version of ChromeDriver 🛠️ compatible with your Chrome browser 🌐 version.