https://github.com/jaybfn/shopify_webscraping

https://github.com/jaybfn/shopify_webscraping

Last synced: 10 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/jaybfn/shopify_webscraping
• Owner: jaybfn
• License: mit
• Created: 2022-02-09T08:55:11.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2022-03-01T12:57:16.000Z (over 4 years ago)
• Last Synced: 2025-08-23T06:06:19.263Z (10 months ago)
• Language: Python
• Size: 366 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Shopify_WebScraping

Web scraping (sometimes called web data extraction or data scraping) is a technique that allows users to automatically acquire structured web data. Web scraping is a useful alternative if the public website you want to get data from doesn't have an API, or if it has but just allows you limited access to the data.

**This code is only used for shopify based websites

![alt picture](https://github.com/jaybfn/Shopify_WebScraping/blob/main/web_scrapping.jpg)

image credit source https://www.loginworks.com/blogs/web-scraping-breakthrough-data-harvesting/

### Scraping the web is a multi-step process:

1. Go to the webpage you want to scrape and make an HTTP request.

2. The target webpage's HTML content is returned by the server in response to the request.

3. Parse the HTML content in step two.

4. To generate a layered structure of HTML data, you'll need a parser.

5. Extract data from HTML

6. To extract and save data, we use Python libraries like Json and Beautiful Soup and database libraries.

### Tech requirements:

1. requests

2. json

3. dataset

4. logging

5. python 3.9