https://github.com/arman2409/datafalcon

Web crawler
https://github.com/arman2409/datafalcon

crawler extract-data

Last synced: about 2 months ago
JSON representation

Web crawler

• Host: GitHub
• URL: https://github.com/arman2409/datafalcon
• Owner: Arman2409
• Created: 2024-01-21T12:15:10.000Z (about 1 year ago)
• Default Branch: develop
• Last Pushed: 2024-06-07T05:24:22.000Z (8 months ago)
• Last Synced: 2024-10-27T23:39:28.778Z (3 months ago)
• Topics: crawler, extract-data
• Language: TypeScript
• Homepage:
• Size: 1.62 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 4
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Data Falcon

Web Crawler whcih can extracts data  like images, links, title, description, etc from websites. It also measures time which was taken to fetch the website. 

### Getting started

1. Install NodeJS and npm if you haven't already: https://nodejs.org

2. Clone the repository using

 ```bash 

 git clone [email protected]:Arman2409/DataFalcon.git

 ```

3. Navigate into the project directory from your terminal or command prompt

4. Run 

```javascript 

npm install

``` 

for both client and server folders in order to install all the dependencies for the application

5. Run 

```javascript 

npm run dev

``` 

 for both clientand server folders in order to start the client side and server side