https://github.com/tuvimen/hclips-scraper

A bash script for archiving hclips videos and users metadata in json
https://github.com/tuvimen/hclips-scraper

bash hclips json relliq scraper scraping

Last synced: about 2 months ago
JSON representation

A bash script for archiving hclips videos and users metadata in json

• Host: GitHub
• URL: https://github.com/tuvimen/hclips-scraper
• Owner: TUVIMEN
• License: gpl-3.0
• Created: 2024-05-02T07:06:38.000Z (about 2 years ago)
• Default Branch: master
• Last Pushed: 2024-05-02T07:07:13.000Z (about 2 years ago)
• Last Synced: 2025-01-31T08:33:01.399Z (over 1 year ago)
• Topics: bash, hclips, json, relliq, scraper, scraping
• Language: Shell
• Homepage:
• Size: 17.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# hclips-scraper

A bash script for archiving hclips videos and users metadata in json.

## Requirements

 - [reliq](https://github.com/TUVIMEN/reliq)

 - [jq](https://github.com/stedolan/jq)

## Installation

    install -m 755 hclips-scraper /usr/bin

## Json format

Here's example of a [videos](videos-example.json) and [users](users-example.json).

## Usage

Results will be saved in files named by their sha256 hash of urls and placed in DIR, files contain multiple results.

Download metadata of videos in DIR using 8 threads

    hclips-scraper -t 8 -v DIR

Download metadata of users in DIR

    hclips-scraper -u DIR