Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-datahoarder
An Awesome & curated list of links and tools used for Data Hoarding!
https://github.com/grokskookum/awesome-datahoarder
- ArchiveBox - hosted web archive. Takes browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- Collect
- grab-site
- Heritrix - scale, archival-quality web crawler
- HTTrack
- wail - Click User Instigated Preservation
- webrecorder - fidelity, ISO-compliant web archives in a user-friendly interface, providing access to archived content, and sharing collections
- wikiteam
- annie - DL alternative written in Golang
- aria2 - protocol & multi-source command-line download utility
- CrowLeer
- curl
- httpie
- news-crawl
- Plowshare - line tool to manage file-sharing site
- Rclone
- wget - interactive download of files from the Web.
- wpull - compatible web downloader and crawler
- you-get
- Youtube-DL - line program to download videos from YouTube and a few hundred more sites
- BBCSoundDownloader
- ChanThreadWatch - style boards and checks for updates until the thread dies
- comics-downloader - line tool to download comicsand manga in pdf/epub/cbz/cbr from supported sites
- floatplane_ripper
- gallery-dl
- Discord-Channel-Scraper
- dzi-dl
- FanFicFare
- FicSave
- flickr_download
- Google Images Download
- iiif-dl - line tile downloader/assembler for IIIF endpoints/manifests
- imgbrd-grabber
- instaloader
- InstaLooter - less Instagram pictures and videos downloader.
- Instagram Scraper - scraper is a command-line application written in Python that scrapes and downloads an instagram user's photos and videos. Use responsibly.
- PyInstaLive
- RedditDownloader
- Scribd-Downloader
- snscrape
- RipMe
- tumblr-utils
- yt-mango
- Youtube-MA
- bazarr
- FlexGet
- Jackett
- Lidarr
- Mylar
- Sick-Beard
- Radarr
- Sonarr
- KGB Archiver
- peazip
- PIGZ - threaded gzip
- WinRAR
- NetLimiter
- httpdirfs
- mergerfs
- NTFS drivers for MacOS
- AAXtoMP3
- html2warc
- warcat
- Backblaze B2 sync backup script
- flac2mp3_V0.py - threaded python script to convert all flac files to mp3 V0 while keeping the directory structure
- Misc download scripts
- rclone_dirsize
- rm_empty_subdir - directories on Windows
- void-cat-uploader
- youtube-dl_soundcloud - dl to download soundcloud playlists
- h5ai
- ipfs - addressable, peer-to-peer method of storing and sharing hypermedia in a distributed file system
- opds
- baobab
- beets
- Calibre
- DeepSort
- diskover
- Everything
- FileBot
- fucking-weeb
- grepWin
- jdupes
- MediaElch
- MediaInfo
- Mp3tag - to-use tool to edit metadata of audio files (Windows/Mac)
- phockup
- picard
- TeraCopy
- tree
- WinDirStat
- sist2 - fast file system indexer and search tool
- SyncToy
- iqdb - service reverse image search
- thetvdb
- CrystalDiskInfo
- Hard Drive Sentinel - OS SSD and HDD monitoring and analysis software
- smartmontools
- PhotoRec
- TestDisk
- whipper - DA ripper preferring accuracy over speed. Generates .flac, .cue, and .log by default and automatically fetches metadata from musicbrainz. EAC log plugin is available.
- Exact Audio Copy
- MakeMKV - platform DVD ripper that supports recent blu ray DVDs. It's mostly open source, but the blu ray secret sauce is still hidden.
- Handbrake
- CommonCrawl
- Blockyarchive
- par2cmdline
Keywords
python
14
downloader
9
linux
4
cli
4
epub
3
windows
3
tumblr
3
ebook
3
backup
3
torrent
3
warc
3
scraper
3
instagram
3
reddit
2
musicbrainz
2
command-line-tool
2
music
2
go
2
archiver
2
instagram-scraper
2
danbooru
2
deviantart
2
movie
2
flickr
2
radarr
2
twitter
2
macos
2
fanfiction
2
sonarr
2
calibre
2
terminal
2
couchpotato
2
rss
2
movies
2
c
2
archive
2
audio
2
crawler
2
web-archiving
2
java
2
heritrix
2
image-gallery
1
image-processing
1
image-scraper
1
image-search
1
python-script
1
wayback
1
pyinstaller
1
android
1
booru
1