https://github.com/thomasleveil/pyrobots
python binding for Google robots.txt parser C++ library
https://github.com/thomasleveil/pyrobots
googlebot python robots-exclusion-protocol robots-parser robots-txt robotstxt
Last synced: 2 months ago
JSON representation
python binding for Google robots.txt parser C++ library
- Host: GitHub
- URL: https://github.com/thomasleveil/pyrobots
- Owner: thomasleveil
- Created: 2019-07-22T16:42:31.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2019-07-30T08:55:49.000Z (almost 6 years ago)
- Last Synced: 2025-02-01T13:21:21.223Z (4 months ago)
- Topics: googlebot, python, robots-exclusion-protocol, robots-parser, robots-txt, robotstxt
- Language: Python
- Homepage:
- Size: 11.7 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# /!\ Work in progress /!\
**Current status:** not working
# Python extension for Google Robots.txt Parser and Matcher Library
The repository contains the source code for a Python extension for
[Google's robots.txt parser and matcher as a C++ library](https://github.com/google/robotstxt).
## Notice
Being myself ignorant regarding C++ and pybind11, this repository is adapted from https://github.com/av8ramit/pybind_example.
Hopefully I did not copied over too much unrelevant code. PR are much welcome.
## Building
_This project depends on [Bazel](https://bazel.build/) as a build tool._
```sh
git clone https://github.com/thomasleveil/pyrobots.git
cd pyrobots
bazel test module:pyrobots_test
```