https://github.com/dyzio18/java-web-bot-library

Java website crawler - library for analyze and testing websites
https://github.com/dyzio18/java-web-bot-library

crawler-engine web-bot website-crawler

Last synced: about 1 year ago
JSON representation

Java website crawler - library for analyze and testing websites

• Host: GitHub
• URL: https://github.com/dyzio18/java-web-bot-library
• Owner: Dyzio18
• Created: 2018-05-10T20:39:12.000Z (about 8 years ago)
• Default Branch: master
• Last Pushed: 2021-12-30T20:25:38.000Z (over 4 years ago)
• Last Synced: 2024-12-26T23:26:35.234Z (over 1 year ago)
• Topics: crawler-engine, web-bot, website-crawler
• Language: Java
• Homepage: https://github.com/Dyzio18/java-web-bot-library/blob/master/PDF-presentation-PL.pdf
• Size: 885 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 7
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# java-web-bot-library

An experimental, compact, universal Java API which allows 

you to create your own web-bot.

##### Presentation of technology

[Presentation](https://github.com/Dyzio18/java-web-bot-library/blob/master/PDF-presentation-PL.pdf)

## Getting started

##### WARNING! This project is still highly experimental and many aspects of it are subject to breaking changes, continue at your own risk.

This API allows you to create simple bot which can execute complex tasks.

If you're starting new project you can simple import web-bot package and create your

own website extractor. Which will extract date from websites under assigned url

and can display them in the form of for e.g complex web-site map (or graph).

Used algorithms allows to use different web-search depth adequate to user needs. 

## Example of extracted data

![Alt text](/img/demo-extracted-data.png)

## Example of usage with user interface

![Alt text](/img/demo-interface-prezentation.png)

###### @authors: 

###### Patryk Nizio

###### Bartłomiej Bolek

###### Rafał Aleksander