https://github.com/smahesh29/web-scraping-python

It contains some web scraping examples implemented using Python.
https://github.com/smahesh29/web-scraping-python

beautifulsoup beautifulsoup4 flipkart-scraper-python flipkart-selenium google-images-crawler google-images-downloader internshala internships pandas pandas-dataframe python selenium selenium-python web-scapping web-scraping webscraping webscraping-search webscrapper youtube-scraper youtube-video

Last synced: 4 months ago
JSON representation

It contains some web scraping examples implemented using Python.

• Host: GitHub
• URL: https://github.com/smahesh29/web-scraping-python
• Owner: smahesh29
• License: mit
• Created: 2019-12-05T20:00:07.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-02-05T15:25:33.000Z (about 2 years ago)
• Last Synced: 2024-09-28T03:21:24.293Z (5 months ago)
• Topics: beautifulsoup, beautifulsoup4, flipkart-scraper-python, flipkart-selenium, google-images-crawler, google-images-downloader, internshala, internships, pandas, pandas-dataframe, python, selenium, selenium-python, web-scapping, web-scraping, webscraping, webscraping-search, webscrapper, youtube-scraper, youtube-video
• Language: Python
• Size: 5.95 MB
• Stars: 29
• Watchers: 3
• Forks: 11
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Web-Scraping-Python  

It contains some web scraping examples implemented using Python.

1. Internshala :

Python codes for Scraping Internship from Internshala


Additional Python Libraries Required :




  
BeautifulSoup

  

      pip install beautifulsoup4





  
Pandas

  

      pip install pandas





  
Requests

  

      pip install requests



Usage :

This directory contains 2 python files :



  
1. python_django_internship.py :

  
This program is used to get details of all the Python/Django category internships from first page. It will store the details in python_django_internship.xlsx sheet. To Run the program :

    


         
Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.

         
Use Command :

  

                        python python_django_internship.py

                  

   



  
2. keyword_internship.py :

  
This program is used to get details of all the internship of specified Keyword. The keyword should be specified during the execution of program. The program will ask for keyword, after running it. It will store the details in keyword_internship.xlsx sheet. To Run the program :

    


         
Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.

         
Use Command :

  

                      python keyword_internship.py

                  

   





2. Google image Downloader :

A Python program for downloading images from a Google Search.


Additional Python Libraries Required :




  
BeautifulSoup

  

      pip install beautifulsoup4





  
Requests

  

      pip install requests



Usage :


Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program. Type the following command in your CMD or Terminal:

     python image_downloader.py -n 50 -s "apples" -d "E:\images"

     

Here, change the following as per your needs:

-n: Number of Images to be downloaded (Default = 10).

-s: Search Query (Default = red roses).

-d: Directory where to save the images(Default = Download - the directory present with code).

3. Flipkart

A Python program to extract the Price, Name, and Rating of Laptops from Filpkart website.


Pre-requisites :

1. Additional Python Libraries Required :




  
Selenium

  

      pip install selenium





  
BeautifulSoup

  

      pip install beautifulsoup4





  
Pandas

  

      pip install pandas



2. chromedriver (For Windows operating system you can download the chromedriver from this repository)

Usage :



         
Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.

         
Use Command :

  

                      python laptop_details.py              





  
The laptops details will be stored in laptop_details.csv file.



4. Youtube :

A Python program to extract the information such as title, duration, channel, url, views, description, etc. of youtube trending videos.


Additional Python Libraries Required :




  
BeautifulSoup

  

      pip install beautifulsoup4





  
Pandas

  

      pip install pandas





  
Requests

  

      pip install requests



Usage :



         
Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.

         
Use Command :

  

                      python youtube_trending.py             





  
The videos details will be stored in youtube_trending.xlsx file.