{"id":13640029,"url":"https://github.com/davidteather/everything-web-scraping","last_synced_at":"2025-10-27T14:19:26.738Z","repository":{"id":42562533,"uuid":"502246639","full_name":"davidteather/everything-web-scraping","owner":"davidteather","description":"Learn everything web scraping with David Teather Codes on YouTube","archived":false,"fork":false,"pushed_at":"2023-07-31T04:48:02.000Z","size":7969,"stargazers_count":287,"open_issues_count":1,"forks_count":64,"subscribers_count":6,"default_branch":"main","last_synced_at":"2024-08-03T01:15:46.011Z","etag":null,"topics":["course","courses","everything","hacktoberfest","hacktoerfest","project-based-learning","project-based-learning-courses","project-based-tutorials","python","python-web-scraper","python3","reverse-engineering","web-scraping","web-scraping-python","web-scraping-tutorial","webscraping","youtube-series"],"latest_commit_sha":null,"homepage":"https://www.youtube.com/watch?v=KY3E-6wVOqA\u0026list=PLmRtxHvzkEE8Ofiy4hnnXSoxw7gs4HOHt\u0026index=1","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/davidteather.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null},"funding":{"custom":["https://www.paypal.me/dteather"],"github":"davidteather"}},"created_at":"2022-06-11T04:12:20.000Z","updated_at":"2024-07-31T19:51:42.000Z","dependencies_parsed_at":"2023-02-08T20:15:43.515Z","dependency_job_id":null,"html_url":"https://github.com/davidteather/everything-web-scraping","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davidteather%2Feverything-web-scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davidteather%2Feverything-web-scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davidteather%2Feverything-web-scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davidteather%2Feverything-web-scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/davidteather","download_url":"https://codeload.github.com/davidteather/everything-web-scraping/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223816347,"owners_count":17207842,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["course","courses","everything","hacktoberfest","hacktoerfest","project-based-learning","project-based-learning-courses","project-based-tutorials","python","python-web-scraper","python3","reverse-engineering","web-scraping","web-scraping-python","web-scraping-tutorial","webscraping","youtube-series"],"created_at":"2024-08-02T01:01:07.178Z","updated_at":"2025-10-27T14:19:26.633Z","avatar_url":"https://github.com/davidteather.png","language":"HTML","funding_links":["https://www.paypal.me/dteather","https://github.com/sponsors/davidteather"],"categories":["HTML"],"sub_categories":[],"readme":"# Everything Web Scraping\nLearn everything web scraping by [David Teather](https://twitter.com/david_teather) find the video series on [YouTube](https://youtube.com/playlist?list=PLmRtxHvzkEE8Ofiy4hnnXSoxw7gs4HOHt).\n\n[![LinkedIn](https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge\u0026logo=linkedin\u0026logoColor=white\u0026style=flat-square)](https://www.linkedin.com/in/davidteather/) [![Sponsor Me](https://img.shields.io/static/v1?label=Sponsor\u0026message=%E2%9D%A4\u0026logo=GitHub)](https://github.com/sponsors/davidteather) [![Discord Server](https://img.shields.io/discord/783108952111579166.svg?color=7289da\u0026logo=discord\u0026style=flat-square)](https://discord.gg/yyPhbfma6f) ![](https://visitor-badge.laobi.icu/badge?page_id=davidteather.web-scraping-by-reverse-engineering) [![Twitter URL](https://img.shields.io/twitter/url?style=social\u0026url=https%3A%2F%2Ftwitter.com%2Fdavid_teather)](https://twitter.com/david_teather)\n\n## Table Of Contents\n1. [Course Catalogue](#course-catalogue)\n2. [How To start The Mock Websites](#how-to-start-the-mock-websites)\n\n**Please** consider giving [Course Feedback](https://forms.gle/LjRwHoR34vD1knGa6)\n\n## Welcome!\n\nGlad you're here! If it's your first time check out the the [introduction](./000-introduction/README.md), if not welcome back!\n\nConsider [sponsoring me](https://github.com/sponsors/davidteather) on GitHub to make work like this possible\n\n### Supporting The Project\n* Star the repo 😎\n    * Maybe share it with some people new to web-scraping?\n* Consider [sponsoring](https://github.com/sponsors/davidteather) me on GitHub\n* Send me an email or a [LinkedIn](https://www.linkedin.com/in/davidteather/) message telling me what you enjoy in the course (and maybe what else you want to see in the future)\n* Submit PRs for suggestions/issues :)\n## Course Catalogue\n0. [Introduction To The Course](/000-introduction/)\n1. [Introduction To Forging API Requests](/001-introduction-to-forging-api-requests/)\n2. [Proxies](/002-proxies)\n3. [Beautiful Soup Scraping With Static and Server Side Rendered Sites](/003-beautiful-soup-with-static-site-and-server-side-rendered-web-scraping)\n\n\n## How To Start The Mock Websites\n\n[Video Walkthrough](https://youtu.be/WmeDXK7KRKE)\n\n### With GitHub Codespaces (Recommended)\n\nIf you don't want to deal with installing and configuring software, I've set up this repository so that a GitHub Codespace can do all of that for you.\n\n\u003e Note: A free GitHub account comes with 60 hours of Codespaces free each month, and if you're a student you can get 90 hours free each month with GitHub Pro through the [GitHub Student Developer Pack](https://education.github.com/pack) ([source](https://github.com/features/codespaces))\n\n#### Creating A Codespace\n\u003e If you want to save your solutions, [create a fork](https://github.com/davidteather/everything-web-scraping/fork) then create a Codespace from your own repo, then you'll be able to use git to save your changes as normal.\n\nCreate a Codespace using the instructions below or [here](https://github.com/codespaces/new)\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"./assets/codespaces-new-with-options.png\"\u003e\n  \u003cp\u003eSelect Code -\u003e Codespaces Tab -\u003e The + Icon -\u003e New With Options\u003c/p\u003e\n  \u003cp\u003eOr click \u003ca href=\"https://github.com/codespaces/new?hide_repo_select=true\u0026ref=main\u0026repo=579266275\"\u003ehere\u003c/a\u003e\u003c/p\u003e\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"./assets/codespaces-select-configuration.png\"\u003e\n  \u003cp\u003eSelect the configuration of the lesson you're on, and after hitting create a Codespace\u003c/p\u003e\n  \u003cp\u003eVS Code editor will open in the browser and start all programs needed for the activity!\u003c/p\u003e\n\u003c/div\u003e\n\n#### Cleaning Up\n\nAfter finishing each lesson you can visit the [GitHub Codespaces](https://github.com/codespaces) menu and delete the Codespace so you don't get charged while you're not using it.\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"./assets/delete-codespace.png\"\u003e\n  \u003cp\u003eDelete a Codespace with the 3 dots -\u003e Delete\u003c/p\u003e\n  \u003cp\u003eThis will delete any changes you've made\u003c/p\u003e\n\u003c/div\u003e\n\n\u003e Note: If you enjoy GitHub Codespaces consider checking out my ~30 minute [LinkedIn Learning Course](https://www.linkedin.com/learning/github-codespaces-for-students/why-use-github-codespaces) on Codespaces, you can get free 24h access through [my LinkedIn post](https://www.linkedin.com/feed/update/urn:li:activity:7069391759281147905/) and feel free to send a connection request while you're over there 🤠\n\n### With Docker\n\nRun `docker-compose up` while in a lesson directory, when it says development server started open `localhost:3000` in your browser to check that it's working properly.\n\nWhen done with this lesson you can `control + c` to shut down your docker containers.\n\n#### Cleaning Up\n##### With Docker Desktop\n\n1. Navigate to the containers tab on the side, find the lesson you want to delete and click the trashcan icon to remove it.\n2. Navigate to the images tab on the side, find the images starting with the course name to delete and hit the trash can.\n\n##### With Command line\n\n1. To remove containers, `docker rm $(docker ps -a -q --filter name=XXX)`, where XXX is the lesson number you want removed (ex: 001).\n2. To remove images, `docker rmi $(docker images --filter label=lesson.number=X -a -q)`, where X is the number you want removed (ex: 1, ex: 10)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavidteather%2Feverything-web-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdavidteather%2Feverything-web-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavidteather%2Feverything-web-scraping/lists"}