https://github.com/shhiivvaam/barsaati

Web scraping with Selenium and ProxyMesh, storing the data in MongoDB, showing a list on a webpage.
https://github.com/shhiivvaam/barsaati

mongodb proxymesh selenium selenium-webdriver

Last synced: 11 days ago
JSON representation

Web scraping with Selenium and ProxyMesh, storing the data in MongoDB, showing a list on a webpage.

• Host: GitHub
• URL: https://github.com/shhiivvaam/barsaati
• Owner: shhiivvaam
• Created: 2024-06-03T19:48:03.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-06-03T20:16:36.000Z (8 months ago)
• Last Synced: 2024-06-04T22:04:59.889Z (8 months ago)
• Topics: mongodb, proxymesh, selenium, selenium-webdriver
• Language: JavaScript
• Homepage:
• Size: 23 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Barsaati

## Overview

Barsaati is a project aimed at scraping Twitter trends using Selenium WebDriver. This README provides detailed instructions on setting up the project, including resolving issues related to ChromeDriver installation and configuration.

## Prerequisites

- Node.js (v12 or later)

- npm (Node Package Manager)

- Google Chrome browser

## Installation

1. **Clone the Repository**:

   ```

   git clone https://github.com/shhiivvaam/barsaati.git

   cd barsaati

   ```

2. **Install Dependencies**:

   ```

   npm install

   ```

3. **Download ChromeDriver**:

   - Go to the [ChromeDriver download page](https://sites.google.com/a/chromium.org/chromedriver/downloads).

   - Download the version of ChromeDriver that matches your Google Chrome version.

   - Extract the downloaded file and note the path to `chromedriver.exe`.

4. **Set ChromeDriver Path**:

   - Add the path to `chromedriver.exe` to your system's PATH environment variable, or

   - Specify the path directly in your code (see Configuration section).

## Configuration

### Selenium WebDriver Configuration

In your Selenium script (e.g., `selenium-script.js`), configure the path to ChromeDriver:

```javascript

const {Builder, By, Key, until} = require('selenium-webdriver');

const chrome = require('selenium-webdriver/chrome');

let service = new chrome.ServiceBuilder('path/to/your/chromedriver.exe').build();

chrome.setDefaultService(service);

let driver = new Builder().forBrowser('chrome').build();

```

## Running the Application

1. **Start the Server** :









node backend/index.js

   



1. **Access the Application** :

   Open your browser and navigate to `http://localhost:3000`.

Thankyou for visiting!!