Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/rfalke/fufzig
Fufzig is a flexible url fetcher like wget written in Erlang
https://github.com/rfalke/fufzig
Last synced: about 16 hours ago
JSON representation
Fufzig is a flexible url fetcher like wget written in Erlang
- Host: GitHub
- URL: https://github.com/rfalke/fufzig
- Owner: rfalke
- Created: 2013-04-21T13:05:44.000Z (over 11 years ago)
- Default Branch: master
- Last Pushed: 2013-06-27T19:31:37.000Z (over 11 years ago)
- Last Synced: 2023-03-15T14:25:25.897Z (over 1 year ago)
- Language: Erlang
- Size: 336 KB
- Stars: 1
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
fufzig
======Fufzig is a flexible url fetcher like wget written in Erlang
## Usage
``` bash
$ make
```## Usage
``` bash
$ ./fufzig
fufzig [-o DIR] [-r|-r+|-r++] [-i PATTERNS] [-p THREADS] URL
-o DIR set the output directory [defaults to '.']
-r limit recursive download to the sub directory of the initial URL
-r+ limit recursive download to host of the initial URL
-r++ do not limit the recursive download
-i PATTERNS only visit urls which match PATTERNS
-p THREADS download with THREADS in parallelPATTERNS consists of a delimeter char and a list of positive and negative
patterns separated by the delimter char. The url is matched against each
pattern and the first match decided (i.e. the url is accepted or rejected).
Empty parts mean no match.
Example: -i ',/good,/subdir/bad,/subdir'
means accept urls containing '/good' and '/subdir' but not if they
also contain '/subdir/bad'.
```# Examples
* Download single file
``` bash
$ ./fufzig www.example.com
```* Dive into sub directories
``` bash
$ ./fufzig -o output_dir -r http://www.example.com/some/path
```* Fetch all references files from the host
``` bash
$ ./fufzig -o output_dir -r+ http://www.example.com/some/path
```* Fetch all references files from all hosts
``` bash
$ ./fufzig -o output_dir -r++ http://www.example.com/some/path
```