https://github.com/tomholford/media-downloader
CLI tool written in Deno to scrape URLs and download linked media files
https://github.com/tomholford/media-downloader
cli deno media-downloader
Last synced: 6 months ago
JSON representation
CLI tool written in Deno to scrape URLs and download linked media files
- Host: GitHub
- URL: https://github.com/tomholford/media-downloader
- Owner: tomholford
- Created: 2020-06-19T06:31:51.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2024-10-23T14:56:05.000Z (12 months ago)
- Last Synced: 2025-03-27T04:51:16.521Z (7 months ago)
- Topics: cli, deno, media-downloader
- Language: TypeScript
- Size: 36.1 KB
- Stars: 13
- Watchers: 2
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# media-downloader
A basic media downloading tool written in Typescript for
[Deno](https://deno.land). Pass in a URL, select which filetypes you're
interested in, and it will scrape the HTML and download all the linked files
that match the filter.
## Prerequisites
- [Deno](https://deno.land) 2.0+
## Usage
- `-u` - **(required)** the URL to scrape for media links
- `-p` - _(optional)_ the output path for writing files; defaults to `./output/`
- `-t` - _(optional)_ the filetype(s) to download; defaults to several common
image formats
- `-R` - _(optional)_ after finishing downloading, scan the output directory and
remove duplicates
### Example
```sh
deno run --allow-net --allow-write --allow-read --unstable media_downloader.ts -t jpg -t png -u https://dribbble.com/shots
```
## Install
1. Clone this repo
1. Run this command
```sh
deno install --allow-net --allow-write --allow-read --unstable --name media-downloader main.ts
```
1. Then, use it like so:
```sh
media-downloader -u https://example.com
```
### macOS
You will also need to add the `deno` executables path to your `bash_profile`:
```sh
export PATH="/Users/[your username]/.deno/bin:$PATH"
```
## Supported Sites
This tool has been confirmed to work with imageboards [e.g.,
[4chan](https://4chan.org)) and [thisvid](https://thisvid.space). Feel free to
open a PR to contribute more sites to this list.
## Roadmap
- Support `![]()
` tags
- Multiple parallel requests
- progress bar
- CI
- release binaries
- tests