https://github.com/tuvimen/xvideos-scraper

A bash script for scraping xvideos videos metadata in json
https://github.com/tuvimen/xvideos-scraper

json scraping xvideos

Last synced: 11 months ago
JSON representation

A bash script for scraping xvideos videos metadata in json

• Host: GitHub
• URL: https://github.com/tuvimen/xvideos-scraper
• Owner: TUVIMEN
• License: gpl-3.0
• Created: 2023-11-21T14:53:05.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2024-05-30T14:22:03.000Z (about 2 years ago)
• Last Synced: 2024-05-31T11:40:40.632Z (about 2 years ago)
• Topics: json, scraping, xvideos
• Language: Shell
• Homepage:
• Size: 76.2 KB
• Stars: 2
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# xvideos-scraper

A bash script for scraping xvideos videos, profiles, channels and pornstars metadata in json.

## Requirements

 - [reliq](https://github.com/TUVIMEN/reliq)

 - [jq](https://github.com/stedolan/jq)

## Installation

    install -m 755 xvideos-scraper /usr/bin

## Json format

Here's example of a [video](video-example.json) and [profile](profile-example.json).

## Usage

Profiles, channels and pornstars have the same format and are treated the same way.

Data is saved into files named by the sha256sum of their url.

Download metadata of video to DIR

    xvideos-scraper -d DIR -v URL -v URL -v URL

    xvideos-scraper -d DIR URL URL URL

Download metadata of profile, channel or pornstar using 8 threads

    xvideos-scraper -t 8 -p URL -p URL -p URL

    xvideos-scraper -t 8 URL URL URL

Download metadata of all profiles, channels and pornstars from sitemap

    xvideos-scraper -P

Pass video URLS into the recursive spider

    xvideos-scraper -V URL URL URL

Get some help

    xvideos-scraper -h