https://github.com/ralgond/anti-spider

anti-spider service based on java, nginx and redis.
https://github.com/ralgond/anti-spider

anti-spider java mybatis netty nginx nginx-rate-limit rate-limit rate-limiter redis redis-cell spring

Last synced: 12 days ago
JSON representation

anti-spider service based on java, nginx and redis.

• Host: GitHub
• URL: https://github.com/ralgond/anti-spider
• Owner: ralgond
• License: apache-2.0
• Created: 2024-11-14T00:40:33.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-12-06T13:55:02.000Z (3 months ago)
• Last Synced: 2024-12-17T00:13:50.392Z (2 months ago)
• Topics: anti-spider, java, mybatis, netty, nginx, nginx-rate-limit, rate-limit, rate-limiter, redis, redis-cell, spring
• Language: Java
• Homepage:
• Size: 813 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# anti-spider

## Java Version

Java 21

## Architecture Image

![](images/Rate-Limit-System-Design-5.drawio.png)

## nginx rate limit request module

[Here](https://github.com/ralgond/ngx_http_rate_limit_request_module)

## Database

```bash

CREATE TABLE `rules` (

  `id` int NOT NULL AUTO_INCREMENT,

  `key_type` enum('IP','SI') NOT NULL,

  `method` char(10) NOT NULL,

  `path_pattern` varchar(1024) NOT NULL,

  `deleted` tinyint(1) NOT NULL,

  `create_time` date NOT NULL,

  `update_time` date NOT NULL,

  `burst` int NOT NULL,

  `token_count` int NOT NULL,

  `token_time_unit` int NOT NULL,

  PRIMARY KEY (`id`)

) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci

```

examples:

| id | key_type | method | path_pattern | deleted | create_time | update_time | burst | token_count | token_time_unit |

|----|----------|--------|--------------|---------|-------------|-------------|-------|-------------|-----------------|

|  1 | IP       | GET    | /.*          |       0 | 2024-11-13  | 2024-11-14  |    15 |          30 |              60 |

|  2 | SI       | POST   | /article/new |       0 | 2024-11-13  | 2024-11-13  |     3 |           3 |              60 |

|  3 | SI       | GET    | /article/\d+ |       0 | 2024-11-14  | 2024-11-14  |     5 |           5 |              60 |

## Flowchart

![](images/Rate-Limit-Server-Flowchart.drawio.png)