{"id":22135776,"url":"https://github.com/imvickykumar999/dark-web-scraping","last_synced_at":"2026-03-04T09:01:46.110Z","repository":{"id":108859055,"uuid":"320194129","full_name":"imvickykumar999/Dark-Web-Scraping","owner":"imvickykumar999","description":"https://www.upgrad.com/learn/","archived":false,"fork":false,"pushed_at":"2024-07-14T09:50:19.000Z","size":16429,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-01T14:44:02.425Z","etag":null,"topics":["beautifulsoup","bs4","webscraping"],"latest_commit_sha":null,"homepage":"https://imvickykumar999.github.io/Web-Scraping/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/imvickykumar999.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-12-10T07:31:01.000Z","updated_at":"2024-07-14T09:50:35.000Z","dependencies_parsed_at":"2024-07-14T10:51:30.896Z","dependency_job_id":"7cba2582-c3e5-4736-97bd-688adcbe9f56","html_url":"https://github.com/imvickykumar999/Dark-Web-Scraping","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/imvickykumar999/Dark-Web-Scraping","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/imvickykumar999%2FDark-Web-Scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/imvickykumar999%2FDark-Web-Scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/imvickykumar999%2FDark-Web-Scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/imvickykumar999%2FDark-Web-Scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/imvickykumar999","download_url":"https://codeload.github.com/imvickykumar999/Dark-Web-Scraping/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/imvickykumar999%2FDark-Web-Scraping/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30076935,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-04T08:01:56.766Z","status":"ssl_error","status_checked_at":"2026-03-04T08:00:42.919Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","bs4","webscraping"],"created_at":"2024-12-01T19:17:08.386Z","updated_at":"2026-03-04T09:01:46.094Z","avatar_url":"https://github.com/imvickykumar999.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# `Web Scrapped`\n\n![image](https://github.com/imvickykumar999/Web-Scraping/assets/50515418/c435df9c-fcda-4c93-8bfe-56dac5b9cb9d)\n\n---------------\n\n## [`Free UpGrad Study Material and Live Session Recording`](https://colab.research.google.com/drive/1rOyQ4pDIKGKBr_XE8uACBC-mzPYgM0YF?usp=sharing)\n\n    import requests\n    from bs4 import BeautifulSoup as bs\n    \n    link = 'https://www.upgrad.com/learn/'\n    req = requests.get(link)\n    soup = bs(req.content, 'html5lib')\n    \n    box = soup.findAll('div', attrs = {'class':'Carousel_item__UUZAx'})\n    len(box)\n\n\u003cbr\u003e\n\n    for i in box:\n      a = i.findAll('a')\n      b = i.findAll('div', attrs = {'class':'VerticalCard_content__hEtCn'})\n      print('- ', b[0].text)\n      print(a[0]['href'])\n      print()\n      print('- ', b[1].text)\n      print(a[1]['href'])\n      print()\n\n----------------------\n\n    import requests\n    from bs4 import BeautifulSoup as bs\n    \n    link = 'https://imvickykumar999.github.io/Web-Scraping/'\n    req = requests.get(link)\n    soup = bs(req.content, 'html5lib')\n    \n    s2 = soup.findAll('td', \n            attrs = {'class':'s2'})\n    \n    s3 = soup.findAll('td', \n            attrs = {'class':'s3'})\n\n\u003cbr\u003e\n\n    for i,j in zip(s2, s3):\n      print('- ', i.text)\n      print(j.a['href'])\n      print()\n\n-------------\n\n## [`Inshorts-news-scraping`](https://github.com/imvickykumar999/Inshorts-news-scraping/blob/main/inshorts%20news.ipynb)\n\n    THIS REPOSITORY contains different types of useful files like, \n    web file downloader, insta post downloader, eye alignment etc.\n\n---------------------------------\n\n## [`https://haveibeenpwned.com/PwnedWebsites`](https://haveibeenpwned.com/PwnedWebsites)\n\n[![image](https://user-images.githubusercontent.com/50515418/225050010-05f44b21-c1d1-462f-b848-0fb04edae760.png)](https://haveibeenpwned.com/PwnedWebsites#DominosIndia)\n\n----------------------------\n\n    import requests\n    from bs4 import BeautifulSoup as bs\n\n    link = 'https://haveibeenpwned.com/PwnedWebsites'\n    req = requests.get(link)\n\n    soup = bs(req.content, 'html5lib')\n    box = soup.findAll('div', attrs = {'class':'news-card z-depth-1'})\n    \n    # len(box) == 667\n    print(link + box[0].findAll('p')[1].a['href']) \n    \n----------------------\n\n## [`https://www.scrapethissite.com/pages/simple`](https://www.scrapethissite.com/pages/simple)\n\n![image](https://user-images.githubusercontent.com/50515418/218786512-4b639301-4cec-4053-917f-075b630d98ee.png)\n\n------------\n\n-  Supply Chain ManagementA supply chain is a mechanism through which raw materials from the suppliers are first converted and then placed in the hands of the customers in the form of finished goods.\nhttps://www.upgrad.com/learn/supply-chain-management/what-is-supply-chain-5274-31522-187492-576396-2949699/\n\n\n        More Upgrad Videos\n    \n\u003cdetails\u003e\n    \n-  Organisational Behaviour and Human ResourcesLearn Organisational Behaviour and Human Resources concepts at upGrad learn platform.\nhttps://www.upgrad.com/learn/organisational-behaviour-and-human-resources/introduction-to-strategy-5414-32461-192522-592678-3027654/\n\n-  Product ManagementProduct Management mainly deals with the overall supervision of a product.\nhttps://www.upgrad.com/learn/product-managment-tutorial/responsbilites-of-a-product-manager-5275-31523-187495-576402-2949714/\n\n-  BlockchainThis module will set the foundation of all Blockchain concepts that you will learn going forward.\nhttps://www.upgrad.com/learn/blockchain/introduction-to-blockchain-technology-5416-32467-192536-592703-3027711/\n\n-  Object Oriented ProgrammingGet introduced to the Object-Oriented Paradigm of software development\nhttps://www.upgrad.com/learn/object-oriented-programming-tutorial/what-is-module-in-ooad-an-overview-5405-32425-192323-592193-3025965/\n\n-  Content MarketingLearn about content marketing and why it is important for businesses.\nhttps://www.upgrad.com/learn/content-marketing/introduction-to-content-marketing-5418-32473-192557-592745-3027825/\n\n-  Data Analytics In this segment you will understand how to read a typical data file and the structure of the Excel interface\nhttps://www.upgrad.com/learn/data-analytics/understanding-the-excel-interface-5406-32430-192355-592269-3026321/\n\n-  Problem SolvingWelcome to the  module on Problem-Solving. Understand the importance of problem-solving.\nhttps://www.upgrad.com/learn/problem-solving/introduction-to-problem-solving-5420-32483-192586-592808-3027972/\n\n-  JavaScriptLearn about the basics of JavaScript language in this module \u0026 understanding how to program in this language in general.\nhttps://www.upgrad.com/learn/javascript/what-is-variables-and-datatypes-in-javascript-5407-32437-192394-592369-3026695/\n\n-  EconomicsLearn micro \u0026 macro economics concepts at upGrad learn platform.\nhttps://www.upgrad.com/learn/economics/how-much-do-my-consumers-want-understanding-consumers-need-5422-324870-192600-592837-3028030/\n\n-  Data ScienceLearn data science concepts from the basic and upskill yourself.\nhttps://www.upgrad.com/learn/data-science/the-foundation-of-linear-algebra-vectors-5409-32583-193001-593870-3032391/\n\n-  HealthcareLearn healthcare concepts at upGrad learn platform\nhttps://www.upgrad.com/learn/healthcare/eskills-in-healthcare-overview-5423-32497-192633-592902-3028183/\n\n-  Marketing FundamentalsLearn marketing fundamentals concepts from the basic and upskill yourself.\nhttps://www.upgrad.com/learn/marketing-fundamentals/course-overview-marketing-fundamentals-5399-32534-192745-593167-3029038/\n\n-  Professional ImprovementLearn all the professional improvement concepts at upGrad learn platform.\nhttps://www.upgrad.com/learn/professional-improvement/what-is-stress-5425-32499-192639-592917-3028216/\n\n-  RegressionLearn regression concepts from the scratch and get expertise in statistical techniques.\nhttps://www.upgrad.com/learn/regression/introduction-to-simple-linear-regression-in-python-5400-32514-192679-593010-3028524/\n\n-  Emerging TechLearn all the emerging tech concepts at upGrad learn platform\nhttps://www.upgrad.com/learn/emerging-tech/basics-of-cloud-computing-5427-32511-192672-592989-3028466/\n\n-  PythonWelcome to the course on Python for Data Science. In this course, you will learn to write basic Python programs required for working with data.\nhttps://www.upgrad.com/learn/python/introduction-to-basics-of-python-5398-32506-192657-592955-3028352/\n\n-  AccountingLearn all the accounting related concepts at upGrad learn platform\nhttps://www.upgrad.com/learn/accounting/learning-note-accounting-fundamentals-5411-32446-192429-592448-3027043/\n\n-  Effective CommunicationLearn effective communication skills at upGrad learn platform and have a successful career.\nhttps://www.upgrad.com/learn/effective-communication/how-to-feel-comfortable-while-conversing-with-others-5397-32475-192566-592766-3027877/\n\n-  JournalismLearn all the journalism related concepts at upGrad learn platform\nhttps://www.upgrad.com/learn/journalism/development-journalism-brief-history-and-meaning-5415-32466-192533-592697-3027702/\n\n-  Social Media and Email MarketingLearn about some best practices to be followed while posting organic content on social platforms.\nhttps://www.upgrad.com/learn/social-media-and-email-marketing/linkedin-organic-content-best-practices-5413-32458-192506-592641-3027542/\n\n-  LawLearn all the law related concepts at upGrad platform\nhttps://www.upgrad.com/learn/law/why-soft-skills-matters-for-lawyers-5417-32479-192574-592783-3027900/\n\n-  Developing Logic in Programming\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190484/MU7CJTINhnselJfYn76fBgM6uoyBo1Xg.mp4\n\n-  Developing Logic in Programming\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190528/aDc6eNk7wJIEhnyB4V1LGoWdSSA0i2E7.mp4\n\n-  Hands-on Python Syntaxes\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190486/mXIZXnPcJ3KsaAATcLspjEUsMdiWq189.mp4\n\n-  Hands-on Python Syntaxes\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190487/rY4pofHwX5XZHJudvHb4wYZSPGesutVz.mp4\n\n-  Introduction to Python Data Structures - Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191474/gSrdsu4FxqdEgoWVTLaOtk82cpz591GV.mp4\n\n-  Introduction to Python Data Structures - Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191476/HoMZFyzUPgMQ1q42DSBj9UGB3N5yUYCg.mp4\n\n-  Hands-on Python Data Structures - Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191477/yshkhwezaxFl8oxqu02Xo338b9ijevxD.mp4\n\n-  Hands-on Python Data Structures - Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191475/EfNYfkht1vnthZMKvyY21pXqaMTh1drK.mp4\n\n-  Instructor-Led Coding Practice\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/192512/UYdAlQhS1H9IILW2uqoVYzH3pq9x7Xdh.mp4\n\n-  Instructor-Led Coding Practice\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/192511/kDwoGgJUyyiZC1fTNhXJxYTgGSR4ecCM.mp4\n\n-  Hands-on Numpy\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/193393/dX0AUcuGQMFg19rfPmZ6gnNBKhvMAfrX.mp4\n\n-  Hands-on Numpy\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/193394/Rj8PFWW0mAJwyCyGpWoBYoD0CIJQWGaa.mp4\n\n-  Hands-on Pandas\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/193396/TdJ3qF3kJAk9nzIOmjlrV4a7eQE12KQp.mp4\n\n-  Hands-on Pandas\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/193395/D7RGyQKaTgeGci8OwXXKyYP5Oa1TokeR.mp4\n\n-  Data Visualisation Theory Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/168524/5GXWNeKDOgxg7BWp4M2z8PtFOj0ryyl9.mp4\n\n-  Instructor-Led Live Coding Session on EDA\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/169975/QrFsCudTP5G9aQE2VTfd0otCuJo6yHn9.mp4\n\n-  EDA: Methodologies and Best Practices\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/170560/Te8mAOjxcCPehi75VsEWE3DaSsppxsGG.mp4\n\n-  EDA Career Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/170564/GMLStFa4W9OJDRaKKTRG6Wr925j1oKqi.mp4\n\n-  Credit EDA pre assignment session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/171965/gLArs1Szw12GjVuH8Kr9gs4LAm2DxIXn.mp4\n\n-  Theoretical Session on Inferential Statistics\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/173111/cl9qkCNpmrCHiFhP5RV869acqbX55y6S.mp4\n\n-  Whiteboard session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/175217/CdwMUD3vfbz9dMaNFdABgA6ns3EE7bb1.mp4\n\n-  Live Coding Session - SQL - A\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/176330/6Ujz7mQ3hMAKrCQ6o2xiigYJY19mxPec.mp4\n\n-  Live Coding Session - SQL - B\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/176331/K5A4q5wyNDv2WZSNEgxvqEHUC92IjJ8L.mp4\n\n-  Statistics Career Session - A\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/176334/QOOw4RQdHFLrt1B8f10XDCTHf1lS6oWK.mp4\n\n-  Statistics Career Session - B\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/176336/jQJoupNYTKDrCGAwwOETSWPA2851xIBM.mp4\n\n-  SQL Career Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/177546/oQ978LZZpT3AnellV9JNZGBTxoHXux5V.mp4\n\n-  SQL Career Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/177547/zXsoDHkGpoUZcjj9InI7Hmdpsc9q4Zi7.mp4\n\n-  Doubt Solving Session with Prof RC\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/177548/2NvmQaaulcQc0Odbj8O1Aefwc5NV4NJp.mp4\n\n-  SQL Case Study Pre-Assignment Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/179177/ZEzu2YLMYnq8Mv3alZuo3dJEf0aPgqg5.mp4\n\n-  SQL Case Study Pre-Assignment Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/179178/49XI2hsBHqo9sJf0NU3I3hhJ0nUd5ZUZ.mp4\n\n-  Course 1 Revision Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/179179/JLDJiBx3Kewnixjl6b0LkWjhuwP0pI84.mp4\n\n-  Course 1 Revision Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/179180/xdVSd6j0JCaItdnQIwG8f6X695n7pRVg.mp4\n\n-  Doubt Solving Session with Prof. RC\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/179549/KLyAhceQz0PGtKnT7NRNjOPvKtgLJblz.mp4\n\n-  Linear Regression Conceptual Session - Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/181608/xZOGX2sYWZAV1NczatovZ6PBO87hFC2e.mp4\n\n-  Linear Regression Conceptual Session - Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/181609/e2YoD2rrOKXFDNWnpiXgnjTejsOI5cJk.mp4\n\n-  Linear Regression Pre-Assignment Live Session - Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/184066/PaCVg9Acj6GNpCArbT7kBVFmthBZiT0v.mp4\n\n-  Linear Regression Pre-Assignment Live Session - Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/184783/P149jhQRbDjidESsFdUVnWsCtiDG0O40.mp4\n\n-  Adhoc Session - Linear Regression\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/184068/g2cNsGNApJlWmw78SaehwCkf3gcrW7it.mp4\n\n-  Whiteboard week\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/186803/DvztyiNKYz338prE4WnBWKu4kQlEDREv.mp4\n\n-  Working with Tree Models Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/188053/V9C6NWJPELw27MXuREt0QSqijqkbQVpD.mp4\n\n-  Working with Tree Models Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/188054/txx6Cqjp6NeGxrVR5ycQ6WJAvC50NXzI.mp4\n\n-  Clustering Live Coding Session Slot 1\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/189820/EilTquPVzBLw1pxG47bEIwTMmMEDGhNy.mp4\n\n-  Clustering Live Coding Session Slot 2\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/189381/VFxA7JL364VgrqAE9TZY9p0tStB4UnUN.mp4\n\n-  Working with Text Data\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190478/VJvYIsECOa3h4MYVUAIHvVsuQdAGCdZe.mp4\n\n-  Working with Text Data\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/190479/A36D04IpoUly0Xt3lPbNngYpja00YttZ.mp4\n\n-  ML Session with Hiring Manager\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191456/Wgx5ZxCF1neCghaqeOaGZNOcWhwj5Ozw.mp4\n\n-  ML Session with Hiring Manager\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/191457/kT7PCMnP9neYCbsKAmKbZXRa99GMZzt4.mp4\n\n-  Lead Scoring Case Study Pre-Assignment Live Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/192496/cs3m5DOjZKFwYTrDnejinBEpqh5R8Ys4.mp4\n\n-  Lead Scoring Case Study Pre-Assignment Live Session\nhttps://live-session-recording-service.s3.ap-south-1.amazonaws.com/production/192828/j9wRXrfl6xr4lyn2bazZSrO69aqSxOfb.mp4\n\n\u003c/details\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fimvickykumar999%2Fdark-web-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fimvickykumar999%2Fdark-web-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fimvickykumar999%2Fdark-web-scraping/lists"}