https://github.com/syedissambukhari/alibaba-scrapper-using-nodejs
A react web application for Alibaba product scrapping
https://github.com/syedissambukhari/alibaba-scrapper-using-nodejs
alibaba-scraper nodejs-scraping scraping scraping-node scraping-websites
Last synced: 3 months ago
JSON representation
A react web application for Alibaba product scrapping
- Host: GitHub
- URL: https://github.com/syedissambukhari/alibaba-scrapper-using-nodejs
- Owner: syedissambukhari
- Created: 2023-12-02T15:12:14.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-12-02T15:36:37.000Z (over 1 year ago)
- Last Synced: 2025-01-13T19:40:31.507Z (5 months ago)
- Topics: alibaba-scraper, nodejs-scraping, scraping, scraping-node, scraping-websites
- Language: JavaScript
- Homepage:
- Size: 21.4 MB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Alibaba-scrapper-using-NodeJs
A react web application for Alibaba product scrapping
# Alibaba Scraper using Node.js
## Overview
This project is a web scraper built with Node.js for the backend. It is designed to scrape data from Alibaba, providing a convenient way to gather information from the platform.
## Features
- **Web Scraping:** The application uses a headless browser to scrape data from Alibaba. It can extract information such as product details, prices, and ratings.
- **Node.js Backend:** The backend is powered by Node.js, handling the scraping logic and serving the data.
## Prerequisites
Before running the project, ensure that you have the following installed:
- Node.js and npm
## Installation
1. Clone the repository:
```bash
git clone https://github.com/syedissambukhari/Alibaba-scrapper-using-NodeJs.git
1.Navigate to the project folder:
cd Alibaba-scrapper-using-NodeJs
2.Install dependencies:
npm install
# Configuration
1.Web Scraper Settings:
Open config.js and configure the scraper settings such as the URL to scrape, selectors, etc.
javascript
module.exports = {
url: 'your-alibaba-url',
// Other configuration options
};
Modify the configuration according to your scraping requirements.
2.Run the Application:
Start the Node.js server:
npm start
The application should now be running. Access it at http://localhost:3000 in your web browser.
# Usage
Open the application in your web browser.
Enter the necessary parameters or click the "Scrape" button to initiate the scraping process.
View the scraped data on the console or modify the application to display it on a web interface.