Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/imvickykumar999/dark-web-scraping

https://www.upgrad.com/learn/
https://github.com/imvickykumar999/dark-web-scraping

beautifulsoup bs4 webscraping

Last synced: about 1 month ago
JSON representation

https://www.upgrad.com/learn/

Host: GitHub
URL: https://github.com/imvickykumar999/dark-web-scraping
Owner: imvickykumar999
Created: 2020-12-10T07:31:01.000Z (about 4 years ago)
Default Branch: main
Last Pushed: 2024-07-14T09:50:19.000Z (6 months ago)
Last Synced: 2024-07-14T10:56:24.703Z (6 months ago)
Topics: beautifulsoup, bs4, webscraping
Language: Jupyter Notebook
Homepage: https://imvickykumar999.github.io/Web-Scraping/
Size: 15.7 MB
Stars: 2
Watchers: 1
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

# `Web Scrapped`

![image](https://github.com/imvickykumar999/Web-Scraping/assets/50515418/c435df9c-fcda-4c93-8bfe-56dac5b9cb9d)

---------------

## [`Free UpGrad Study Material and Live Session Recording`](https://colab.research.google.com/drive/1rOyQ4pDIKGKBr_XE8uACBC-mzPYgM0YF?usp=sharing)

import requests
from bs4 import BeautifulSoup as bs

link = 'https://www.upgrad.com/learn/'
req = requests.get(link)
soup = bs(req.content, 'html5lib')

box = soup.findAll('div', attrs = {'class':'Carousel_item__UUZAx'})
len(box)

for i in box:
a = i.findAll('a')
b = i.findAll('div', attrs = {'class':'VerticalCard_content__hEtCn'})
print('- ', b[0].text)
print(a[0]['href'])
print()
print('- ', b[1].text)
print(a[1]['href'])
print()

----------------------

import requests
from bs4 import BeautifulSoup as bs

link = 'https://imvickykumar999.github.io/Web-Scraping/'
req = requests.get(link)
soup = bs(req.content, 'html5lib')

s2 = soup.findAll('td',
attrs = {'class':'s2'})

s3 = soup.findAll('td',
attrs = {'class':'s3'})

for i,j in zip(s2, s3):
print('- ', i.text)
print(j.a['href'])
print()

-------------

## [`Inshorts-news-scraping`](https://github.com/imvickykumar999/Inshorts-news-scraping/blob/main/inshorts%20news.ipynb)

THIS REPOSITORY contains different types of useful files like,
web file downloader, insta post downloader, eye alignment etc.

---------------------------------

## [`https://haveibeenpwned.com/PwnedWebsites`](https://haveibeenpwned.com/PwnedWebsites)

[![image](https://user-images.githubusercontent.com/50515418/225050010-05f44b21-c1d1-462f-b848-0fb04edae760.png)](https://haveibeenpwned.com/PwnedWebsites#DominosIndia)

----------------------------

import requests
from bs4 import BeautifulSoup as bs

link = 'https://haveibeenpwned.com/PwnedWebsites'
req = requests.get(link)

soup = bs(req.content, 'html5lib')
box = soup.findAll('div', attrs = {'class':'news-card z-depth-1'})

# len(box) == 667
print(link + box[0].findAll('p')[1].a['href'])

----------------------

## [`https://www.scrapethissite.com/pages/simple`](https://www.scrapethissite.com/pages/simple)

![image](https://user-images.githubusercontent.com/50515418/218786512-4b639301-4cec-4053-917f-075b630d98ee.png)

------------

- Supply Chain ManagementA supply chain is a mechanism through which raw materials from the suppliers are first converted and then placed in the hands of the customers in the form of finished goods.
https://www.upgrad.com/learn/supply-chain-management/what-is-supply-chain-5274-31522-187492-576396-2949699/