https://github.com/robinst/curlall

Simple curl-like CLI tool to automatically page through APIs
https://github.com/robinst/curlall

cli curl http requests rust

Last synced: about 2 months ago
JSON representation

Simple curl-like CLI tool to automatically page through APIs

• Host: GitHub
• URL: https://github.com/robinst/curlall
• Owner: robinst
• License: apache-2.0
• Created: 2020-06-07T04:35:30.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2020-07-07T00:09:44.000Z (over 4 years ago)
• Last Synced: 2024-10-12T22:31:45.850Z (2 months ago)
• Topics: cli, curl, http, requests, rust
• Language: Rust
• Size: 2.43 MB
• Stars: 25
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE-APACHE

Awesome Lists containing this project

README

        
curlall

=======

[![crates.io](https://img.shields.io/crates/v/curlall.svg)](https://crates.io/crates/curlall)

[![ci](https://github.com/robinst/curlall/workflows/ci/badge.svg)](https://github.com/robinst/curlall/actions?query=workflow%3Aci)

Have you ever used an API and wanted to get all results, but it had

paging and it was too hard to do multiple `curl` calls?

That's what `curlall` is for: A curl-like command to automatically page

through APIs.

* Works with APIs that return pages of JSON objects (e.g. GitHub or Bitbucket APIs)

* Prints the results, one line for each JSON object; ideal for piping to [`jq`](https://stedolan.github.io/jq/)

![demo](https://raw.githubusercontent.com/robinst/curlall/c03c9bf94d0c4d33a6c659896fe681cf8546c10c/demo.svg)

Tested with GitHub and Bitbucket APIs. Other websites will have

different ways to do paging, so let me know if it doesn't work for yours

and we can add support.

## Examples

Print all repository names on bitbucket.org/atlassian:

    curlall https://api.bitbucket.org/2.0/repositories/atlassian | jq -r .full_name

Limit to first 100:

    curlall --limit 100 https://api.bitbucket.org/2.0/repositories/atlassian | jq -r .full_name

Print all URLs for users who starred github.com/rust-lang/rust:

    curlall --user 'username:token' https://api.github.com/repos/rust-lang/rust/stargazers | jq -r .login

## Installation

1. Install Rust: https://www.rust-lang.org/tools/install

2. Install curlall: `cargo install curlall`

## Contributing

Pull requests, issues and comments welcome!

## License

curlall is distributed under the terms of both the MIT license and the Apache License (Version 2.0).

See LICENSE-APACHE and LICENSE-MIT for details. Opening a pull requests is assumed to signal agreement with these licensing terms.