https://github.com/seanghay/wpget

⚡️wpget - A tool for downloading all posts from a WordPress website via public JSON API
https://github.com/seanghay/wpget

crawler wordpress wp-json

Last synced: about 2 months ago
JSON representation

⚡️wpget - A tool for downloading all posts from a WordPress website via public JSON API

• Host: GitHub
• URL: https://github.com/seanghay/wpget
• Owner: seanghay
• License: apache-2.0
• Created: 2024-07-28T04:55:18.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-07-28T06:25:10.000Z (6 months ago)
• Last Synced: 2024-10-29T04:49:10.309Z (2 months ago)
• Topics: crawler, wordpress, wp-json
• Language: Python
• Homepage: https://pypi.org/project/wpget/
• Size: 17.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# wpget

A tool for downloading all posts from a WordPress website via public JSON API

```shell

pip install wpget

wpget -u "https://example.com" -j 8 -o data.jsonl

```

### Options

```

usage: wpget [-h] -u URL [-o OUTPUT] [-w] [-j NPROC] [-r RETRY] [-p PER_PAGE]

Download all posts from a WordPress website via public JSON API.

optional arguments:

  -h, --help            show this help message and exit

  -u URL, --url URL     Base URL of the website.

  -o OUTPUT, --output OUTPUT

                        Output JSON file

  -w, --overwrite       Overwrite existing output file.

  -j NPROC, --nproc NPROC

                        Number of Processes

  -r RETRY, --retry RETRY

                        Max retries

  -p PER_PAGE, --per_page PER_PAGE

                        Per page

```