Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/elliotwutingfeng/tencentqqurlsec
Tencent QQ has an undocumented publicly-accessible real-time feed of malicious URLs. This repository extracts these URLs, at regular intervals, to a machine-readable .txt blocklist compatible with firewall applications like Pi-hole and pfBlockerNG. (Defunct w.e.f. 25 January 2024)
https://github.com/elliotwutingfeng/tencentqqurlsec
aiohttp blocklist dnsbl pfblockerng pihole python qq tencent
Last synced: 3 days ago
JSON representation
Tencent QQ has an undocumented publicly-accessible real-time feed of malicious URLs. This repository extracts these URLs, at regular intervals, to a machine-readable .txt blocklist compatible with firewall applications like Pi-hole and pfBlockerNG. (Defunct w.e.f. 25 January 2024)
- Host: GitHub
- URL: https://github.com/elliotwutingfeng/tencentqqurlsec
- Owner: elliotwutingfeng
- License: bsd-3-clause
- Created: 2022-02-23T11:17:22.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-25T01:59:24.000Z (3 months ago)
- Last Synced: 2024-08-25T02:47:14.508Z (3 months ago)
- Topics: aiohttp, blocklist, dnsbl, pfblockerng, pihole, python, qq, tencent
- Language: Python
- Homepage:
- Size: 156 KB
- Stars: 1
- Watchers: 0
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# TenCent QQ URLSec blocklist
[](LICENSE)
[](https://github.com/elliotwutingfeng/TencentQQURLSec/actions/workflows/scraper.yml)
Tencent QQ has an undocumented publicly-accessible [real-time feed](https://urlsec.qq.com/cgi/risk/getList) of malicious URLs.
This repository extracts these URLs, at regular intervals, to a machine-readable `.txt` blocklist compatible with firewall applications like [Pi-hole](https://pi-hole.net) and [pfBlockerNG](https://docs.netgate.com/pfsense/en/latest/packages/pfblocker.html).
The URLs in this blocklist are compiled by **Tencent QQ**.
**Disclaimer:** _This project is not sponsored, endorsed, or otherwise affiliated with Tencent._
## Blocklist download
| File | Download |
|:-:|:-:|
| blocklist.txt | [:floppy_disk:](blocklist.txt?raw=true) |
| blocklist_ABP.txt | [:floppy_disk:](blocklist_ABP.txt?raw=true) |
| blocklist_UBO.txt | [:floppy_disk:](blocklist_UBO.txt?raw=true) |
## Threat categories
Each URL is numerically categorised by threat type with the parameter `evilclass`. The `evilclass` number for each URL is provided in the blocklist after the `#` symbol.
Translations are provided as-follows
```python
# evilclass
{
'1' : '社工欺诈', # Phishing
'2' : '信息诈骗', # Scam
'3' : '虚假广告', # False Advertising
'4' : '恶意文件', # Malicious Files
'5' : '博彩网站', # Gambling
'6' : '色情内容', # Pornographic content
'7' : '垃圾信息', # Spam
'8' : '非法内容' # Illegal content (likely to contain politically censored websites)
}
```
Source: `https://github.com/flowerdown/tencent_url_safe_dump/blob/master/tencent_Dangerous_web.py`
More information (in chinese) on the parameter `evilclass` can be found at
`https://urlsec.qq.com/eviltype.html` and `https://urlsec.qq.com/wiki/#!md/SafeQueryHttp.md`
## Requirements
- Python 3.12+
## Setup instructions
`git clone` and `cd` into the project directory, then run the following
```bash
python3 -m venv venv
venv/bin/python3 -m pip install --upgrade pip
venv/bin/python3 -m pip install -r requirements.txt
```
## Usage
```bash
venv/bin/python3 scraper.py
```
These files are provided "AS IS", without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose and noninfringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, arising from, out of or in connection with the files or the use of the files.
Any and all trademarks are the property of their respective owners.