Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists by ArchiveTeam

A curated list of projects in awesome lists by ArchiveTeam .

https://github.com/ArchiveTeam/grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

archiving crawl crawler spider warc

Last synced: 06 Nov 2024

https://github.com/archiveteam/grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

archiving crawl crawler spider warc

Last synced: 15 Oct 2024

https://github.com/ArchiveTeam/wpull

Wget-compatible web downloader and crawler.

Last synced: 05 Nov 2024

https://github.com/ArchiveTeam/parler-grab

Archiving Parler.

Last synced: 02 Oct 2024

https://github.com/ArchiveTeam/Ubuntu-Warrior

Scripts to build and boot warrior virtual machine containing Docker

Last synced: 04 Nov 2024

https://github.com/ArchiveTeam/IA.BAK

We back up a lot of stuff from around the web; now it's time to back up the Internet Archive, just in case.

Last synced: 29 Oct 2024

https://github.com/ArchiveTeam/wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

archiveteam archiving crawl crawler crawlers crawling downloader ftp lua scraper scraping spider warc webarchiving wget wget-lua zstd

Last synced: 06 Aug 2024

https://github.com/ArchiveTeam/terroroftinytown

URLTeam's second generation of URL shortener archiving tools

Last synced: 04 Nov 2024

https://github.com/ArchiveTeam/NewsGrabber

Grabbing all news.

Last synced: 06 Aug 2024

https://github.com/ArchiveTeam/reddit-grab

Grabbing everything from reddit.

Last synced: 29 Oct 2024

https://github.com/ArchiveTeam/yahooanswers-grab

Saving all questions and answers from Yahoo! Answers.

Last synced: 31 Oct 2024

https://github.com/ArchiveTeam/universal-tracker

A configurable, reusable tracker with dashboard

Last synced: 04 Nov 2024

https://github.com/ArchiveTeam/youtube-dislikes-grab

Archiving general youtube video metadata through innertube for dislikes removal.

Last synced: 14 Aug 2024

https://github.com/ArchiveTeam/flickr-grab

Grabbing Flickr images.

Last synced: 04 Nov 2024

https://github.com/ArchiveTeam/wikis-grab

Grabbing all wikis.

Last synced: 04 Nov 2024

https://github.com/ArchiveTeam/wikis-items

Managing items for wikis-grab.

Last synced: 03 Nov 2024

https://github.com/ArchiveTeam/flickr-items

Managing items for flickr-grab.

Last synced: 04 Nov 2024