https://github.com/nickserv/crediblock

Open source robots.txt denylist for uncredited AI crawlers
https://github.com/nickserv/crediblock

ai robots-txt

Last synced: 3 months ago
JSON representation

Open source robots.txt denylist for uncredited AI crawlers

• Host: GitHub
• URL: https://github.com/nickserv/crediblock
• Owner: nickserv
• License: gpl-3.0
• Created: 2024-05-23T03:59:23.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-25T07:11:44.000Z (about 1 year ago)
• Last Synced: 2025-03-10T11:07:50.164Z (4 months ago)
• Topics: ai, robots-txt
• Homepage: https://crediblock.vercel.app
• Size: 330 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Crediblock

Open source `robots.txt` denylist for uncredited AI crawlers

![a happy AI robot standing in front of an unhappy server and trying to access it from a computer](image.jpeg)

## Installation

Simply download `robots.txt` and upload it to the root of your domain.

## Rules

- Search engines, social networks, and free research databases are allowed

- AI crawlers must credit sources by default

- If a bot is sometimes used for uncredited AI crawlers, it's not allowed

- If a bot is never used for uncredited AI crawlers but another bot from the

  same company is, it's still allowed