https://github.com/botify-labs/robotstxt-net

https://github.com/botify-labs/robotstxt-net

Last synced: 5 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/botify-labs/robotstxt-net
• Owner: botify-labs
• License: apache-2.0
• Created: 2023-10-09T10:07:43.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-11-21T14:33:39.000Z (7 months ago)
• Last Synced: 2025-11-21T16:20:03.298Z (7 months ago)
• Language: C#
• Homepage:
• Size: 75.2 KB
• Stars: 1
• Watchers: 6
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# RobotsTxt

A quick and dirty C# port of [Google's robots.txt parser](https://github.com/google/robotstxt).

The methods not used by the example program and tests are not currently implemented.

## Notes

Please see the Notes section of the original.

## License

Like Google's robots.txt parser and matcher C++ library, this port is licensed under the terms of the

Apache license. See LICENSE for more information.