https://github.com/technicalparadox/docscraper
https://github.com/technicalparadox/docscraper
Last synced: 6 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/technicalparadox/docscraper
- Owner: TechnicalParadox
- Created: 2024-08-06T22:35:15.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-08-07T20:31:52.000Z (over 1 year ago)
- Last Synced: 2025-03-06T18:48:28.739Z (10 months ago)
- Language: Python
- Size: 6.84 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
### Installation Instructions:
`cd `
`pip install -r requirements.txt`
### Usage
Scrapes the entered URL and all subpages, downloads the text to installation directory.
### Made for [GeminiProjectAssistant](https://github.com/TechnicalParadox/GeminiProjectAssistant)
However, you can also use it manually.
`python ./docscraper.py`
And enter the URL you wish to scrape.