{"id":28739840,"url":"https://github.com/codingforentrepreneurs/supercharged-web-scraping-with-asyncio","last_synced_at":"2025-06-29T00:36:42.576Z","repository":{"id":52838111,"uuid":"284879815","full_name":"codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio","owner":"codingforentrepreneurs","description":"Scrape websites asynchronously with Python 3.8+, Asyncio, \u0026 arsenic (aka Selenium for Async).","archived":false,"fork":false,"pushed_at":"2021-04-17T00:11:07.000Z","size":345,"stargazers_count":56,"open_issues_count":2,"forks_count":22,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-06-27T04:14:57.888Z","etag":null,"topics":["arsenic","async","asynchronous","asyncio","python3","python38","selenium","tutorial","web-scraping"],"latest_commit_sha":null,"homepage":"https://www.codingforentrepreneurs.com/projects/supercharged-web-scraping-with-asyncio","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codingforentrepreneurs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-08-04T04:47:56.000Z","updated_at":"2025-05-22T06:26:31.000Z","dependencies_parsed_at":"2022-08-19T18:21:12.087Z","dependency_job_id":null,"html_url":"https://github.com/codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FSupercharged-Web-Scraping-with-Asyncio","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FSupercharged-Web-Scraping-with-Asyncio/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FSupercharged-Web-Scraping-with-Asyncio/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FSupercharged-Web-Scraping-with-Asyncio/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codingforentrepreneurs","download_url":"https://codeload.github.com/codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingforentrepreneurs%2FSupercharged-Web-Scraping-with-Asyncio/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262518105,"owners_count":23323301,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["arsenic","async","asynchronous","asyncio","python3","python38","selenium","tutorial","web-scraping"],"created_at":"2025-06-16T06:11:01.599Z","updated_at":"2025-06-29T00:36:42.548Z","avatar_url":"https://github.com/codingforentrepreneurs.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Superchaged Web Scraping with Asyncio Logo](https://static.codingforentrepreneurs.com/media/projects/supercharged-web-scraping-with-asyncio/images/share/Supercharged_Web_Scraping_with_Asyn.jpg)](https://www.codingforentrepreneurs.com/projects/supercharged-web-scraping-with-asyncio)\n\n# Supercharged Web Scraping with Asyncio\n\n\nWeb scraping is simply automatically opening up any website and grabbing the data you find important on that website. It's fundamental to the internet, search engines, Data Science, automation, machine learning, and much more.\n\n*Opening* websites and *extracting* data are only part of what makes web scraping great. It's the parsing of the data that's where the value is. \n\nThis project will cover:\n- Basic web scraping with Python\n- Web scraping with Selenium\n- Sync vs Async\n- Asynchronous Web scraping with Asyncio\n\n\nRequirements:\n- Python experience (at least the first 15 days of [this project](https://www.codingforentrepreneurs.com/projects/30-days-python-38/)).\n- Selenium \u0026 [chromedriver](https://chromedriver.chromium.org/) installed (watch how in [this one](https://www.codingforentrepreneurs.com/projects/30-days-python-38/day-16-use-selenium-scape-automate-behind-password)).\n\n#### [Watch the series](https://www.codingforentrepreneurs.com/projects/supercharged-web-scraping-with-asyncio)\n\n\n### To use this code:\n\n**1. Clone**\n```bash\ngit clone https://github.com/codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio supercharged\n```\n\n**2. Create Virtual Environment**\n```bash\ncd supercharged\npython3.6 -m venv .\n```\n\n**3. Activate virtual environment and install requirements**\nMac/Linux\n```\nsource bin/activate\n```\n\nWindows:\n```\n.\\Scripts\\activate\n```\n\n\u003e If using **pipenv**, run `pipenv shell` \u0026\u0026 `pipenv install`\n\n\n**Run jupyter**\n```\njupyter notebook\n```\nor\n```\npython -m jupyter notebook\n```\n\u003e If using **pipenv**, run `pipenv run jupyter notebook`","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingforentrepreneurs%2Fsupercharged-web-scraping-with-asyncio","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodingforentrepreneurs%2Fsupercharged-web-scraping-with-asyncio","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingforentrepreneurs%2Fsupercharged-web-scraping-with-asyncio/lists"}