{"id":22591344,"url":"https://github.com/kirolos00daniel/amazon-web-scraping","last_synced_at":"2026-05-18T19:02:04.295Z","repository":{"id":261951408,"uuid":"885808087","full_name":"Kirolos00Daniel/Amazon-Web-Scraping","owner":"Kirolos00Daniel","description":null,"archived":false,"fork":false,"pushed_at":"2024-11-09T13:30:10.000Z","size":890,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-31T13:05:08.715Z","etag":null,"topics":["amazon","jupiter-notebook","python","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Kirolos00Daniel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-09T13:01:37.000Z","updated_at":"2024-11-09T13:35:50.000Z","dependencies_parsed_at":"2024-11-09T14:20:39.298Z","dependency_job_id":"5e662d69-a743-4308-83ae-7c1a81965bc5","html_url":"https://github.com/Kirolos00Daniel/Amazon-Web-Scraping","commit_stats":null,"previous_names":["kirolos00daniel/amazon-web-scraping"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Kirolos00Daniel/Amazon-Web-Scraping","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Kirolos00Daniel%2FAmazon-Web-Scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Kirolos00Daniel%2FAmazon-Web-Scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Kirolos00Daniel%2FAmazon-Web-Scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Kirolos00Daniel%2FAmazon-Web-Scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Kirolos00Daniel","download_url":"https://codeload.github.com/Kirolos00Daniel/Amazon-Web-Scraping/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Kirolos00Daniel%2FAmazon-Web-Scraping/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":280943394,"owners_count":26417747,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-25T02:00:06.499Z","response_time":81,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amazon","jupiter-notebook","python","webscraping"],"created_at":"2024-12-08T09:12:16.760Z","updated_at":"2025-10-25T11:06:42.506Z","avatar_url":"https://github.com/Kirolos00Daniel.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Amazon Web Scraping Project\n\n**Overview**  \nThis project involves web scraping Amazon's product listings for \"PlayStation 4\" to collect data on various listings, including product names, prices, ratings, and availability. The extracted data is stored in a CSV file for further analysis and research purposes.\n\n## Table of Contents\n- [Overview](#overview)\n- [Getting Started](#getting-started)\n- [Prerequisites](#prerequisites)\n- [Installation](#installation)\n- [Usage](#usage)\n- [Project Structure](#project-structure)\n- [Data Extraction](#data-extraction)\n- [Visualizations](#visualizations)\n- [Contributing](#contributing)\n- [License](#license)\n- [Contact](#contact)\n\n## Getting Started\nThese instructions will guide you on setting up the project and running the code on your local machine.\n\n## Prerequisites\n- **Python 3.7+**\n- **Jupyter Notebook** or any compatible IDE to run `.ipynb` files\n- **Libraries**: `requests`, `BeautifulSoup`, `pandas`\n  - Install these libraries using:\n    ```bash\n    pip install requests beautifulsoup4 pandas\n    ```\n\n## Installation\n1. **Clone the repository**:\n   ```bash\n   git clone https://github.com/your-username/amazon-web-scraping.git\n   ```\n2. **Navigate to the project directory**:\n   ```bash\n   cd amazon-web-scraping\n   ```\n3. **Open the Jupyter Notebook**:\n   - Use Jupyter Notebook to open `Amazon Web Scraping.ipynb` or `Amazon Web Scraping Sample.ipynb` files.\n\n## Usage\n1. **Run the Notebook**:\n   - Execute the cells in the notebook to scrape the Amazon product page and extract data for \"PlayStation 4\" listings.\n2. **Data Extraction**:\n   - The scraped data will be saved in a CSV file named `amazon_data.csv`, which includes columns like product name, price, rating, and availability.\n\n## Project Structure\n- `Amazon Web Scraping.ipynb`: Main Jupyter Notebook for scraping data.\n- `Amazon Web Scraping Sample.ipynb`: Sample notebook demonstrating the scraping process.\n- `amazon_data.csv`: Output CSV file containing the scraped data.\n- `image.png`: Screenshot of the Amazon search results page.\n- ![Screenshot 2024-11-09 150014](https://github.com/user-attachments/assets/9a9030ea-edb6-44f2-9091-b329db8e93a1)\n\n\n## Data Extraction\n- **Data Fields**: The following fields are extracted for each product:\n  - **Product Name**\n  - **Price**\n  - **Rating**\n  - **Availability**\n\n- **CSV Output**: The extracted data is stored in `amazon_data.csv`, making it easy to analyze and visualize the information.\n\n## Visualizations\nThe following visualizations were created to provide insights into the data:\n\n### Distribution of Product Ratings\n\n![output](https://github.com/user-attachments/assets/a640d24c-4a74-4ec2-af28-1ed0f744e593)\n\n\n### Distribution of Product Prices\n\n![output](https://github.com/user-attachments/assets/429c3d6b-e254-4802-9928-c8934d1a2294)\n\n### Scatter Plot of Price vs Rating\n\n![output](https://github.com/user-attachments/assets/d9a1dd5b-2449-481f-97cf-e19d9f58c217)\n\n\n\n## Contributing\n1. **Fork the repository**\n2. **Create a feature branch** (`git checkout -b feature/YourFeature`)\n3. **Commit your changes** (`git commit -m 'Add feature'`)\n4. **Push to the branch** (`git push origin feature/YourFeature`)\n5. **Create a Pull Request**\n\n## License\nThis project is licensed under the MIT License.\n\n## Contact\nFor questions or support, please reach out to:\n- **Your Name** Kirolos Daniel\n- **Email**: kiroemad2389@gmail.com\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkirolos00daniel%2Famazon-web-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkirolos00daniel%2Famazon-web-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkirolos00daniel%2Famazon-web-scraping/lists"}