Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-datahoarder
An Awesome & curated list of links and tools used for Data Hoarding!
https://github.com/grokskookum/awesome-datahoarder
Last synced: about 17 hours ago
JSON representation
-
Utility Scripts
-
Download automation
- Backblaze B2 sync backup script
- rclone_dirsize
- rm_empty_subdir - directories on Windows
- youtube-dl_soundcloud - dl to download soundcloud playlists
- Misc download scripts
- void-cat-uploader
- flac2mp3_V0.py - threaded python script to convert all flac files to mp3 V0 while keeping the directory structure
-
-
Download utilities
-
Web Archiving
-
General
- aria2 - protocol & multi-source command-line download utility
- wget - interactive download of files from the Web.
- annie - DL alternative written in Golang
- CrowLeer
- curl
- news-crawl
- Plowshare - line tool to manage file-sharing site
- Rclone
- wpull - compatible web downloader and crawler
- you-get
- Youtube-DL - line program to download videos from YouTube and a few hundred more sites
-
Application-specific
- floatplane_ripper
- Scribd-Downloader
- BBCSoundDownloader
- ChanThreadWatch - style boards and checks for updates until the thread dies
- comics-downloader - line tool to download comicsand manga in pdf/epub/cbz/cbr from supported sites
- gallery-dl
- Discord-Channel-Scraper
- dzi-dl
- FanFicFare
- FicSave
- flickr_download
- Google Images Download
- iiif-dl - line tile downloader/assembler for IIIF endpoints/manifests
- imgbrd-grabber
- instaloader
- InstaLooter - less Instagram pictures and videos downloader.
- Instagram Scraper - scraper is a command-line application written in Python that scrapes and downloads an instagram user's photos and videos. Use responsibly.
- RedditDownloader
- snscrape
- RipMe
- tumblr-utils
- Youtube-MA
- PyInstaLive
-
Download automation
-
-
Compression
-
Download automation
- peazip
- PIGZ - threaded gzip
- WinRAR
- KGB Archiver
-
-
Network
-
Download automation
-
-
Content sharing
-
Data curation
-
APIs & Online tools
-
Hardware / Monitoring
-
Download automation
- CrystalDiskInfo
- Hard Drive Sentinel - OS SSD and HDD monitoring and analysis software
- smartmontools
-
-
Data recovery
-
Local Media
-
Download automation
- MakeMKV - platform DVD ripper that supports recent blu ray DVDs. It's mostly open source, but the blu ray secret sauce is still hidden.
- Handbrake
- whipper - DA ripper preferring accuracy over speed. Generates .flac, .cue, and .log by default and automatically fetches metadata from musicbrainz. EAC log plugin is available.
-
-
File systems
-
Download automation
-
-
File conversion
Categories
Sub Categories
Keywords
python
15
downloader
10
warc
4
go
4
scraper
4
tumblr
4
cli
4
music
3
golang
3
torrent
3
ebook
3
instagram
3
rss
3
crawler
3
linux
3
web-archiving
3
epub
3
instagram-scraper
2
backup
2
java
2
musicbrainz
2
command-line-tool
2
archiver
2
ftp
2
download
2
reddit
2
sonarr
2
calibre
2
fanfiction
2
radarr
2
twitter
2
self-hosted
2
audio
2
flickr
2
deviantart
2
danbooru
2
terminal
2
youtube
2
heritrix
2
sftp
2
windows
2
commoncrawl
1
openstack-swift
1
backblaze-b2
1
fuse-filesystem
1
cloud-storage
1
onedrive
1
azure-files
1
news
1
storm-crawler
1