{"id":21189832,"url":"https://github.com/kanugurajesh/amazon-scraper","last_synced_at":"2025-06-21T21:06:34.909Z","repository":{"id":179223856,"uuid":"662896650","full_name":"kanugurajesh/Amazon-Scraper","owner":"kanugurajesh","description":"This is a amzon scraper which is used to scrape amazon products","archived":false,"fork":false,"pushed_at":"2023-12-03T10:53:59.000Z","size":65860,"stargazers_count":16,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-05T10:05:25.343Z","etag":null,"topics":["open-source","python","scraper","selenium"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kanugurajesh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-07-06T06:00:01.000Z","updated_at":"2025-02-25T17:51:14.000Z","dependencies_parsed_at":"2023-12-03T10:21:19.146Z","dependency_job_id":"5ba800ca-6eb2-45a9-8cc5-ca62f198c79c","html_url":"https://github.com/kanugurajesh/Amazon-Scraper","commit_stats":null,"previous_names":["rajesh604/amazon-scraper","kanugurajesh/amazon-scraper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/kanugurajesh/Amazon-Scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kanugurajesh%2FAmazon-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kanugurajesh%2FAmazon-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kanugurajesh%2FAmazon-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kanugurajesh%2FAmazon-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kanugurajesh","download_url":"https://codeload.github.com/kanugurajesh/Amazon-Scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kanugurajesh%2FAmazon-Scraper/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261193100,"owners_count":23122906,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["open-source","python","scraper","selenium"],"created_at":"2024-11-20T18:54:09.576Z","updated_at":"2025-06-21T21:06:29.893Z","avatar_url":"https://github.com/kanugurajesh.png","language":"Python","funding_links":["https://www.buymeacoffee.com/kanugurajen"],"categories":[],"sub_categories":[],"readme":"# Amazon Scraper\n\nThis is a amazon scraper build using selenium it can scrape product data from the website and write it to a csv file i have used selenium because it resembles a bit like human and it is a advanced testing frameworks which offers many advantages for scraping and i also used beautiful soup to extract data from the scraped data\n\n# Project Setup\n\n1.The code is same for both windows and linux you need to install seperate chromedriver for seperate environments you can install chromedriver at \u003ccode\u003ehttps://chromedriver.chromium.org/downloads\u003c/code\u003e The chromedriver file should be placed at root folder\n\u003cbr\u003e\n2.setup a python environment using the command \u003ccode\u003epython -m venv myenv\u003c/code\u003e\n\u003cbr\u003e\n3.activate the python virtual environment for windows \u003ccode\u003emyenv/Scripts/activate.ps1\u003c/code\u003e and for linux \u003ccode\u003esource myenv/bin/activate\u003c/code\u003e\n\u003cbr\u003e\n4.install the python modules in the python virtual environment using the command \u003ccode\u003epip install -r requirements.txt\u003c/code\u003e\n\u003cbr\u003e\n\n# Usage\n\n1. simply run the project in windows \u003ccode\u003epython amazon_scraper.py\u003c/code\u003e and in linux \u003ccode\u003epython3 amazon_scraper.py\u003c/code\u003e\n1.To run project in windows run the command \u003ccode\u003epython amazon_scraper.py\u003c/code\u003e\n2.To run the project in linux run the command \u003ccode\u003epython3 amazon_scraper.py\u003c/code\u003e\n\n# Project Working\n\n1.When you first run the project the selenium will scrape the product and write each product source code into html fiels in the products directory\n\u003cbr\u003e\n2.In the next step the data is extracted from the html files and written to output.csv file\n\n# Project Files\n\n1.\u003ccode\u003eamazon-scraper.py\u003c/code\u003e is the main python file which scrapes and writes data to the csv files\n\u003cbr\u003e\n2.\u003ccode\u003erequirements.txt\u003c/code\u003e is the file which contains all the modules required by the project to function without errors\n\u003cbr\u003e\n3.\u003ccode\u003eautomate.bat\u003c/code\u003e is used to push code to github in windows\n\u003cbr\u003e\n4.\u003ccode\u003eautomate.sh\u003c/code\u003e is used to push code to github in linux\n\n# Project Working Video\n\n\u003ccode\u003ehttps://drive.google.com/file/d/1xS28dAszifytomf69G2MfKjBfMia_it8/view?usp=sharing\u003c/code\u003e\n\n## Contributing\n\nThis project loves to accept contributions from everyone\n\n## Technologies Used\n\n- HTML\n- CSS\n- JavaScript\n\n## 🔗 Links\n[![portfolio](https://img.shields.io/badge/my_portfolio-000?style=for-the-badge\u0026logo=ko-fi\u0026logoColor=white)](https://rajeshportfolio.me/)\n[![linkedin](https://img.shields.io/badge/linkedin-0A66C2?style=for-the-badge\u0026logo=linkedin\u0026logoColor=white)](https://www.linkedin.com/in/rajesh-kanugu-aba8a3254/)\n[![twitter](https://img.shields.io/badge/twitter-1DA1F2?style=for-the-badge\u0026logo=twitter\u0026logoColor=white)](https://twitter.com/exploringengin1)\n\n## Authors\n\n- [@kanugurajesh](https://github.com/kanugurajesh)\n\n## Support\n\nFor support, you can buy me a coffee\n\n\u003ca href=\"https://www.buymeacoffee.com/kanugurajen\" target=\"_blank\"\u003e\u003cimg src=\"https://cdn.buymeacoffee.com/buttons/default-orange.png\" alt=\"Buy Me A Coffee\" height=\"41\" width=\"174\"\u003e\u003c/a\u003e\n\n## License\n\nThis project license is MIT LICENSE\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkanugurajesh%2Famazon-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkanugurajesh%2Famazon-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkanugurajesh%2Famazon-scraper/lists"}