https://github.com/tuvimen/tube8-scraper

A bash script for archiving tube8 pages in json
https://github.com/tuvimen/tube8-scraper

bash json reliq scraper scraping tube8

Last synced: about 2 months ago
JSON representation

A bash script for archiving tube8 pages in json

• Host: GitHub
• URL: https://github.com/tuvimen/tube8-scraper
• Owner: TUVIMEN
• License: gpl-3.0
• Created: 2024-05-02T07:11:30.000Z (about 2 years ago)
• Default Branch: master
• Last Pushed: 2025-03-20T05:05:04.000Z (over 1 year ago)
• Last Synced: 2025-03-20T06:20:09.283Z (over 1 year ago)
• Topics: bash, json, reliq, scraper, scraping, tube8
• Language: Shell
• Homepage:
• Size: 21.5 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# tube8-scraper

A bash script for archiving tube8 videos, channels and pornstars metadata in json.

## Requirements

 - [reliq](https://github.com/TUVIMEN/reliq)

 - [jq](https://github.com/stedolan/jq)

## Installation

    install -m 755 tube8-scraper /usr/bin

## Json format

Here's example of a [video](video-example.json), [channel](channel-example.json) and [pornstar](pornstar-example.json).

## Usage

Results will be saved in files named by sha256 hash of their urls.

Download metadata of videos in DIR

    tube8-scraper -v DIR

Download metadata of videos to DIR

    tube8-scraper -d DIR -v URL -v URL -v URL

    tube8-scraper -d DIR URL URL URL

Download metadata of pornstars using 8 threads

    tube8-scraper -t 8 -p URL -p URL -p URL

    tube8-scraper -t 8 URL URL URL

Download metadata of channels into DIR using 8 threads

    tube8-scraper -t 8 -d DIR -c URL -c URL -c URL

    tube8-scraper -t 8 -d DIR URL URL URL

Download metadata of all pornstars from sitemap

    tube8-scraper -P

Download metadata of all videos from sitemap

    tube8-scraper -V

Download metadata of all channels from sitemap

    tube8-scraper -C

Get some help

    tube8-scraper -h