Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/elliotwutingfeng/united-states-sdn-list-websites
Machine-readable .txt blocklist of websites belonging to entities listed under the United States Specially Designated Nationals List (SDN List), updated once a day.
https://github.com/elliotwutingfeng/united-states-sdn-list-websites
dnsbl ofac ofac-sanctions-lists osint pfblockerng pfsense pihole sanctions terrorism us-government
Last synced: 4 months ago
JSON representation
Machine-readable .txt blocklist of websites belonging to entities listed under the United States Specially Designated Nationals List (SDN List), updated once a day.
- Host: GitHub
- URL: https://github.com/elliotwutingfeng/united-states-sdn-list-websites
- Owner: elliotwutingfeng
- License: bsd-3-clause
- Created: 2024-02-05T17:40:00.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-22T04:03:35.000Z (9 months ago)
- Last Synced: 2024-05-22T16:14:24.645Z (9 months ago)
- Topics: dnsbl, ofac, ofac-sanctions-lists, osint, pfblockerng, pfsense, pihole, sanctions, terrorism, us-government
- Language: Python
- Homepage: https://ofac.treasury.gov
- Size: 64.5 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
# United States SDN List Websites
[](LICENSE)
[](https://github.com/elliotwutingfeng/United-States-SDN-List-Websites/actions/workflows/scraper.yml)
Machine-readable `.txt` blocklist of websites belonging to entities listed under the [United States Specially Designated Nationals List (SDN List)](https://ofac.treasury.gov/specially-designated-nationals-list-data-formats-data-schemas), updated once a day.
**Disclaimer:** _This project is not sponsored, endorsed, or otherwise affiliated with the United States Government._
## Blocklist download
| File | Download |
|:-:|:-:|
| urls.txt | [:floppy_disk:](urls.txt?raw=true) |
| urls-ABP.txt | [:floppy_disk:](urls-ABP.txt?raw=true) |
| urls-UBO.txt | [:floppy_disk:](urls-UBO.txt?raw=true) |
| urls-UBL.txt | [:floppy_disk:](urls-UBL.txt?raw=true) |
| urls-pihole.txt | [:floppy_disk:](urls-pihole.txt?raw=true) |
| ips.txt | [:floppy_disk:](ips.txt?raw=true) |
## Requirements
- Python 3.12+
## Setup instructions
`git clone` and `cd` into the project directory, then run the following
```bash
python3 -m venv venv
venv/bin/python3 -m pip install --upgrade pip
venv/bin/python3 -m pip install -r requirements.txt
```
## Usage
```bash
venv/bin/python3 scraper.py
```
## Libraries/Frameworks used
- [defusedxml](https://github.com/tiran/defusedxml)
- [tldextract](https://github.com/john-kurkowski/tldextract)
## Feedback
Sanctioned entities may sometimes use generic email addresses or host their webpages on non-sanctioned websites such as free webhosts. This can cause false positives in the hostname-only lists like [urls-pihole.txt](urls-pihole.txt). You can report them [here](https://github.com/elliotwutingfeng/United-States-SDN-List-Websites/issues).
These files are provided "AS IS", without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose and noninfringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, arising from, out of or in connection with the files or the use of the files.
Any and all trademarks are the property of their respective owners.