https://github.com/zigmoon/robots.txt

AI Web Security with ROBOTS.TXT
https://github.com/zigmoon/robots.txt

Last synced: 5 months ago
JSON representation

AI Web Security with ROBOTS.TXT

• Host: GitHub
• URL: https://github.com/zigmoon/robots.txt
• Owner: zigmoon
• Created: 2025-01-28T08:09:50.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-01-29T08:27:59.000Z (over 1 year ago)
• Last Synced: 2025-06-14T02:38:59.205Z (about 1 year ago)
• Size: 7.81 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
HERE IS THE COMPOSITION OF MY LATEST 2025 ROBOTS.TXT FILE


it should always be placed at the root of your web server. In this new 2025 version, I have integrated all the AI ​​robots to prevent the various AI companies from exploring my site, my content, my images, ideas. Also this data crawling technique (Scraping your data) You can be compared to a new type of DDoS attack because your site will receive a huge overload and will become inaccessible during their visits. Also I strongly recommend that you read and install this robot at the root of all your website. 



https://zigmoon.com/2025/01/27/robots-txt-security/