https://github.com/alecmocatta/reqwest_resume

Wrapper that uses the `Range` HTTP header to resume get requests.
https://github.com/alecmocatta/reqwest_resume

http-range reqwest retry rust

Last synced: 18 days ago
JSON representation

Wrapper that uses the `Range` HTTP header to resume get requests.

• Host: GitHub
• URL: https://github.com/alecmocatta/reqwest_resume
• Owner: alecmocatta
• License: apache-2.0
• Created: 2018-08-15T12:09:27.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2021-07-23T05:28:22.000Z (over 3 years ago)
• Last Synced: 2024-10-13T15:24:58.391Z (about 1 month ago)
• Topics: http-range, reqwest, retry, rust
• Language: Rust
• Size: 50.8 KB
• Stars: 8
• Watchers: 3
• Forks: 5
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE-APACHE.txt

Awesome Lists containing this project

README

        
# reqwest_resume

[![Crates.io](https://img.shields.io/crates/v/reqwest_resume.svg?maxAge=86400)](https://crates.io/crates/reqwest_resume)

[![MIT / Apache 2.0 licensed](https://img.shields.io/crates/l/reqwest_resume.svg?maxAge=2592000)](#License)

[![Build Status](https://dev.azure.com/alecmocatta/reqwest_resume/_apis/build/status/tests?branchName=master)](https://dev.azure.com/alecmocatta/reqwest_resume/_build?definitionId=15)

[📖 Docs](https://docs.rs/reqwest_resume) | [💬 Chat](https://constellation.zulipchat.com/#narrow/stream/213236-subprojects)

Wrapper that uses the `Range` HTTP header to resume get requests.

It's a thin wrapper around [`reqwest`](https://github.com/seanmonstar/reqwest). It's a work in progress – wrapping functionality is copied across on an as-needed basis. Feel free to open a PR/issue if you need something.

## Example

```rust

use async_compression::futures::bufread::GzipDecoder;

use futures::{io::BufReader, AsyncBufReadExt, StreamExt, TryStreamExt};

use std::io;

#[tokio::main]

async fn main() {

    let url = "http://commoncrawl.s3.amazonaws.com/crawl-data/CC-MAIN-2018-30/warc.paths.gz";

    let body = reqwest_resume::get(url.parse().unwrap()).await.unwrap();

    // Content-Encoding isn't set, so decode manually

    let body = body

        .bytes_stream()

        .map_err(|e| io::Error::new(io::ErrorKind::Other, e));

    let body = BufReader::new(body.into_async_read());

    let mut body = GzipDecoder::new(body); // Content-Encoding isn't set, so decode manually

    body.multiple_members(true);

    let mut lines = BufReader::new(body).lines();

    while let Some(line) = lines.next().await {

        println!("{}", line.unwrap());

    }

}

```

## License

Licensed under either of

 * Apache License, Version 2.0, ([LICENSE-APACHE.txt](LICENSE-APACHE.txt) or http://www.apache.org/licenses/LICENSE-2.0)

 * MIT license ([LICENSE-MIT.txt](LICENSE-MIT.txt) or http://opensource.org/licenses/MIT)

at your option.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.