https://github.com/fanchengyan/data-downloader
Make downloading scientific data much easier
https://github.com/fanchengyan/data-downloader
downloader hyp3 licsar sentinel-1
Last synced: 7 months ago
JSON representation
Make downloading scientific data much easier
- Host: GitHub
- URL: https://github.com/fanchengyan/data-downloader
- Owner: Fanchengyan
- License: mit
- Created: 2020-05-15T13:50:59.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2024-08-13T09:41:15.000Z (about 1 year ago)
- Last Synced: 2025-03-17T22:54:49.371Z (7 months ago)
- Topics: downloader, hyp3, licsar, sentinel-1
- Language: Python
- Homepage: https://data-downloader.readthedocs.io/en/latest/
- Size: 4.91 MB
- Stars: 10
- Watchers: 1
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
![]()
[](https://pepy.tech/project/data_downloader) [](https://pypi.org/project/data_downloader/) [](https://data-downloader.readthedocs.io/en/latest/?badge=latest)
Make downloading scientific data much easier
## Introduction
DataDownloader is a user-friendly package for downloading files using HTTP/HTTPS. It currently includes a `downloader` module for downloading files, a `parse_urls` module for parsing URLs, and a `services` module for managing well-known online services.
## Highlight Features
DataDownloader has several features to make retrieving files easy, including:
* **Resumable**: You can resume aborted downloads automatically when you re-execute the code if website support resuming (status code is 216 or 416 when send a HEAD request to the server supplying a Range header)
* **Asynchronous**: Can download multiple files at the same time when download a single file very slow.
* **Convenient**: Provide a easy way to manage your username and password and parse urls from different sources:
* **netrc**: Provide a convenient way to manage your username and password via ``.netrc`` file, avoiding providing your login information over and over again.
* **parse_urls**: Provide various methods to parse urls from different sources. See sections :ref:`parse_urls` for more details
* **services**: Provide a convenient way to manage well-known online services, currently support: HyP3, LiCSAR, Sentinel-1 orbit.## Installation
You can install `DataDownloader` via pip from [PyPI](https://pypi.org/project/data_downloader/):
```bash
pip install data_downloader
```or you can install the latest version from [GitHub](https://github.com/Fanchengyan/data-downloader):
```bash
pip install git+hhttps://github.com/Fanchengyan/data-downloader.git
```
## UsageThe detailed documentation is available at: .
> [!TIP]
> We provide some examples to help you get started quickly :