https://github.com/ricardobranco777/xget

xget gets the HTML from dynamic webpages where curl fails
https://github.com/ricardobranco777/xget

curl selenium-python wget

Last synced: 1 day ago
JSON representation

xget gets the HTML from dynamic webpages where curl fails

• Host: GitHub
• URL: https://github.com/ricardobranco777/xget
• Owner: ricardobranco777
• License: mit
• Created: 2020-11-12T12:09:35.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2024-07-06T08:56:11.000Z (6 months ago)
• Last Synced: 2024-07-06T09:58:01.785Z (6 months ago)
• Topics: curl, selenium-python, wget
• Language: Python
• Homepage:
• Size: 67.4 KB
• Stars: 2
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![Build Status](https://github.com/ricardobranco777/xget/actions/workflows/ci.yml/badge.svg)

# xget

xget gets content from dynamic webpages where curl & wget fail

Docker image available at `ghcr.io/ricardobranco777/xget:latest`

## Usage:

```

usage: xget [-h] [--debug] [--insecure] [-O OUTPUT] [-t TIMEOUT] [-U USER_AGENT] [--version] url [url ...]

positional arguments:

  url

options:

  -h, --help            show this help message and exit

  --debug               enable debug (default: False)

  --insecure            allow insecure server connections when using SSL (default: False)

  -O OUTPUT, --output OUTPUT

                        output file (default: None)

  -t TIMEOUT, --timeout TIMEOUT

                        timeout in seconds (default: 5)

  -U USER_AGENT, --user-agent USER_AGENT

                        user agent (default: None)

  --version             show program's version number and exit

```

## Requirements

- Docker or Podman for the Docker image

Otherwise:

- Tested on Python 3.10+

- [Selenium](https://pypi.org/project/selenium/)

- Latest [geckodriver](https://github.com/mozilla/geckodriver/releases)