https://github.com/s-rb/open-proxy-parser

Parser for open proxies
https://github.com/s-rb/open-proxy-parser

Last synced: 24 days ago
JSON representation

Parser for open proxies

• Host: GitHub
• URL: https://github.com/s-rb/open-proxy-parser
• Owner: s-rb
• Created: 2020-05-24T04:14:50.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2024-01-25T20:08:12.000Z (12 months ago)
• Last Synced: 2024-11-05T21:16:53.281Z (2 months ago)
• Language: Java
• Size: 29.3 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# open-proxy-parser

Parser for open proxies.

Warning! Project is outdated, because of major changes of the source website (advanced.name)

![Java](https://img.shields.io/badge/-Java-05122A?style=flat&logo=Java&logoColor=FFA518) ![WebService](https://img.shields.io/badge/-WebService-05122A?style=flat) ![Parser](https://img.shields.io/badge/-Parser-05122A?style=flat) ![Spring](https://img.shields.io/badge/-Spring-05122A?style=flat&logo=Spring&logoColor=71b23c) ![Springboot](https://img.shields.io/badge/-SpringBoot-05122A?style=flat&logo=Springboot&logoColor=71b23c) ![HTMLunit](https://img.shields.io/badge/-HtmlUnit-05122A?style=flat) ![Maven](https://img.shields.io/badge/-Maven-05122A?style=flat&logo=apachemaven&logoColor=fffffb) ![JSOUP](https://img.shields.io/badge/-JSOUP-05122A?style=flat) ![Thymeleaf](https://img.shields.io/badge/-Thymeleaf-05122A?style=flat&logo=Thymeleaf) ![REST](https://img.shields.io/badge/-REST-05122A?style=flat)

Parses open proxies from all pages of the Advanced.name website (generated by JS).

Applied:

* HtmlUnit

* Jsoup

* Springboot

* Thymeleaf

The application checks proxies for availability, ping, removes inaccessible ones, filters by type and returns by API:

* */index - all proxies

* */socks - SOCKS proxy

* */http - HTTP proxy

* */https - HTTPS proxy

Validation and parsing are run periodically in separate daemon threads.

Scan tasks are added to a pool with a fixed number of threads (number of processors - 2).

There is a timeout for checking each proxy, after which the transition to the next task.