https://github.com/osandadeshan/web-crawler

This is a simple application to crawl your web pages.
https://github.com/osandadeshan/web-crawler

app java8 maven selenium-webdriver swing-gui web-crawler web-crawling

Last synced: about 1 month ago
JSON representation

This is a simple application to crawl your web pages.

• Host: GitHub
• URL: https://github.com/osandadeshan/web-crawler
• Owner: osandadeshan
• Created: 2021-09-04T11:27:35.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2021-10-26T16:33:56.000Z (over 4 years ago)
• Last Synced: 2025-03-02T21:27:31.315Z (over 1 year ago)
• Topics: app, java8, maven, selenium-webdriver, swing-gui, web-crawler, web-crawling
• Language: Java
• Homepage:
• Size: 43.9 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Web Crawler

## Introduction

This is a Java Swing Application used to crawl web applications.

[![Web Crawler](https://user-images.githubusercontent.com/9147189/138921617-2acc4861-9ed5-4f04-bbe5-8db16994b899.png "Web Crawler")](https://user-images.githubusercontent.com/9147189/138921617-2acc4861-9ed5-4f04-bbe5-8db16994b899.png "Web Crawler")

## Prerequisites

* Java 8

* Maven

## Steps to use

1. Clone this project

2. Navigate to the project home directory

3. Open a command line/terminal

4. Run ***`mvn clean install`***

5. Navigate to "***/target***"

6. Double click on "***web-crawler-app.exe***"

7. Input web page URL and crawling count

8. Click on "***Submit***" button

![Successful Crawling](https://user-images.githubusercontent.com/9147189/138922129-4962f5c4-6e2a-4335-9344-40d8fae857ff.png)