https://github.com/fortio/multicurl

Fetch same url from all the IPs available
https://github.com/fortio/multicurl

Last synced: 4 months ago
JSON representation

Fetch same url from all the IPs available

Host: GitHub
URL: https://github.com/fortio/multicurl
Owner: fortio
License: apache-2.0
Created: 2023-01-27T18:29:08.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2025-04-18T21:54:06.000Z (6 months ago)
Last Synced: 2025-04-19T09:05:57.198Z (6 months ago)
Language: Go
Homepage:
Size: 185 KB
Stars: 9
Watchers: 3
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

[![codecov](https://codecov.io/github/fortio/multicurl/branch/main/graph/badge.svg?token=LONYZDFQ7C)](https://codecov.io/github/fortio/multicurl)

# multicurl

Fetches a URL from all the IPs of a given host. Optionally repeat until an expected result code is obtained from all addresses.
It will also print information about certificates, including the shortest expiration found.

## Installation

If you have a recent go installation already:
```shell
CGO_ENABLED=0 go install fortio.org/multicurl@latest
```

Or get on of the [binary releases](https://github.com/fortio/multicurl/releases)

Or using the docker image
```shell
docker run fortio/multicurl http://debug.fortio.org/test
```

Or using brew (mac)
```shell
brew install fortio/tap/multicurl
```

## Usage

multicurl https://debug.fortio.org/test

Use `-4` for ipv4 only, `-6` for ipv6 only, otherwise it'll try all of them.

```
flags:
-4 Use only IPv4
-6 Use only IPv6
-H key:value
Additional http header(s). Multiple key:value pairs can be passed using multiple -H.
-I file
IP address file to use instead of resolving the URL, use - for stdin
-X string
HTTP method to use, default is GET unless -d is set which defaults to POST
-cacert file
Path to a custom CA certificate file to use instead of system ones.
-cert file
Path to a custom client certificate file for mTLS.
-cert-expiry days
Certificate expiry error threshold in days (default 7)
-d string
Payload to POST, use @filename to read from file
-expected int
Expected HTTP return code, 0 means any and non 200s will be warning otherwise if
set any different code is an error
-i Include response headers in output
-insecure
Skip verification of server certificate (insecure TLS)
-json
JSON output of summary results
-key file
Path to a custom client key file for mTLS.
-logger-force-color
Force color output even if stderr isn't a terminal
-logger-no-color
Prevent colorized output even if stderr is a terminal
-loglevel level
log level, one of [Debug Verbose Info Warning Error Critical Fatal] (default Info)
-n int
Max number of IPs to use/try (0 means all the ones found)
-nobar
Disable display of progress bar (or spinner when no content-length)
-o file name pattern
Output file name pattern, e.g "out-%.html" where % will be replaced by the ip,
default is stdout, use "none" for no output (in combination with -json for instance)
-quiet
Quiet mode, sets loglevel to Error (quietly) to reduces the output
-relookup
Re-lookup the URL between each repeat
-repeat int
Max number of times to retry on errors if positive, default is 0 (no retry),
negative is retry until -total-timeout
-repeat-delay duration
Delay between retries (default 5s)
-request-timeout duration
HTTP method (default 3s)
-total-timeout duration
HTTP method (default 30s)
```

Note that `-relookup` works better on CGO_ENABLED=0 built binary, otherwise the OS library caches the results.

Note that `-H Host:xxx https://yyyy/` is a special header and using that will be the same as querying `https://xxx/` using the IPs of `yyy` (convenient to test a virtual host against a LoadBalancer or ingress name before the DNS is updated)

See also [multicurl.txtar](multicurl.txtar) for examples (tests)

### Example

#### Regular
```
$ multicurl -expected 301 -repeat 2 -n 2 -relookup debug.fortio.org
11:49:20 I Fortio multicurl dev go1.19.5 arm64 darwin, using resolver ip, GET debug.fortio.org
11:49:20 I Resolved ip debug.fortio.org:http to port 80 and 6 addresses [18.222.136.83 192.9.142.5 192.9.227.83 2600:1f16:9c6:b400:282c:a766:6cab:4e82 2603:c024:c00a:d144:6663:5896:7efb:fbf3 2603:c024:c00a:d144:7cd0:4951:7106:96b8] - keeping first 2
11:49:20 E 1: Status 200 "200 OK" from 18.222.136.83
Φορτίο version 1.40.1 h1:D1H+5aOnauTr4WTnopHl1MhSZt/l0Asi3ZEqkpBwT0c= go1.19.5 arm64 linux (in fortio.org/proxy 1.8.1)
Debug server on a1 up for 37h43m3s
Request from 216.194.105.159:4496

GET / HTTP/1.1

headers: