https://github.com/carlos-a-g-h/abusiv

Recursive web downloader for websites that serve static files using an autoindexing frontend
https://github.com/carlos-a-g-h/abusiv

apache2 autoindex downloader h5ai leecher recursive

Last synced: about 1 month ago
JSON representation

Recursive web downloader for websites that serve static files using an autoindexing frontend

• Host: GitHub
• URL: https://github.com/carlos-a-g-h/abusiv
• Owner: carlos-a-g-h
• Created: 2023-05-26T18:13:41.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-10-17T21:27:54.000Z (about 1 year ago)
• Last Synced: 2023-10-17T22:29:55.738Z (about 1 year ago)
• Topics: apache2, autoindex, downloader, h5ai, leecher, recursive
• Language: Python
• Homepage:
• Size: 47.9 KB
• Stars: 0
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# ABUSIV

## What is this?

ABUSIV is a recursive downloader for websites that do static file serving with autoindexing

## Usage

```$ abusiv {BaseDir} {AType} {URL}```

- The **BaseDir** argument is the local directory where all the files/folders will be downloaded. THe base directory cannot match the program's directory

- The **AType** argument is the type of autoindex that is used by the website

- The **URL** argument is the starting URL, this URL cannot be a direct link from a file, it has to be a directory that leads to other files and/or directories

## Available Autoindex types

- apache2

- h5ai

## Changelog

### 2023-05-29

- Made some rewrites (said bye bye to some mutable shared states) and changed some names

- Added some logging: The log file is saved in the base directory and any download failures will be logged as errors

- The output directory for all the downloaded content will be the initial directory (the initial directory name is taken from the initial URL) inside the base directory instead of the base directory itself

- While downloading a file or a page, you can hit Ctrl+C to skip it. In the case of skipping a file, the partially downloaded file will be eliminated and logged as an error

### 2023-05-27

- Bugfixes and added some guardrails

- Added support for Apache2's default autoindex

### 2023-05-26

- First release