{"id":20195239,"url":"https://github.com/amssdias/python-web-scrapping","last_synced_at":"2025-10-30T04:20:22.056Z","repository":{"id":128478987,"uuid":"332887527","full_name":"amssdias/python-web-scrapping","owner":"amssdias","description":"Web Scrapping with Python using Beautifulsoup4 and Selenium.","archived":false,"fork":false,"pushed_at":"2021-03-03T11:25:01.000Z","size":59,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-01-13T19:24:24.258Z","etag":null,"topics":["beautifulsoup4","requests","selenium-python","web-scraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/amssdias.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-01-25T21:23:32.000Z","updated_at":"2022-08-23T14:24:42.000Z","dependencies_parsed_at":"2023-03-20T15:17:11.499Z","dependency_job_id":null,"html_url":"https://github.com/amssdias/python-web-scrapping","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/amssdias%2Fpython-web-scrapping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/amssdias%2Fpython-web-scrapping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/amssdias%2Fpython-web-scrapping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/amssdias%2Fpython-web-scrapping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/amssdias","download_url":"https://codeload.github.com/amssdias/python-web-scrapping/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241629773,"owners_count":19993710,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","requests","selenium-python","web-scraping"],"created_at":"2024-11-14T04:16:22.226Z","updated_at":"2025-10-30T04:20:17.002Z","avatar_url":"https://github.com/amssdias.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Python Web Scrapping\n\nThis is a practice repository for Web Scraping. We are scrapping few websites in different ways.\n\n## Pre requisites\n\n * [Python](https://www.python.org/downloads/) - 3.8.4 or up\n\n\n## Pipfile and Pipfile.Lock\n\nInside the Pipfile there's all the modules name needed for the projects in the folders.\nDownload Pipenv through the terminal window (make sure you have Python installed), just type `pip install pipenv`.\n\nAfter installing pipenv all you have to do is to download these two files and in terminal window, got to the folder with these files and run `pipenv install` and automatically will install this modules.\n\nThis will create a virtual environment with the modules `beautifulsoup4`, `selenium` and `requests`.\n\nTo run this virtual environment all you must do is run `pipenv shell` and to close the virtual environment `exit`.\n\nIf any doubts here's a link to some more explanations:\n\n- [Pipenv](https://pipenv-fork.readthedocs.io/en/latest/basics.html)\n\n\n## Projects\n\n- [Capterra](https://github.com/amssdias/python-web-scrapping/tree/master/Capterra)\n- [Quotes](https://github.com/amssdias/python-web-scrapping/tree/master/Scrape%20Quotes)\n- [Books](https://github.com/amssdias/python-web-scrapping/tree/master/scraping_books_bs4)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Famssdias%2Fpython-web-scrapping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Famssdias%2Fpython-web-scrapping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Famssdias%2Fpython-web-scrapping/lists"}