Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bookstairs/bookhunter
A download tools for clawing the ebooks from internets.
https://github.com/bookstairs/bookhunter
epub golang spider
Last synced: 14 days ago
JSON representation
A download tools for clawing the ebooks from internets.
- Host: GitHub
- URL: https://github.com/bookstairs/bookhunter
- Owner: bookstairs
- License: mit
- Created: 2022-04-08T15:26:36.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2024-09-05T08:26:08.000Z (2 months ago)
- Last Synced: 2024-09-06T13:32:24.511Z (2 months ago)
- Topics: epub, golang, spider
- Language: Go
- Homepage:
- Size: 420 KB
- Stars: 844
- Watchers: 6
- Forks: 56
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- my-awesome - bookstairs/bookhunter - 09 star:0.9k fork:0.1k A download tools for clawing the ebooks from internets. (Go)
README
# ⏬ bookhunter
[![LICENSE](https://img.shields.io/github/license/bookstairs/bookhunter)](https://github.com/bookstairs/bookhunter/blob/main/LICENSE)
[![Language](https://img.shields.io/badge/Language-Go-blue.svg)](https://golang.org/)
[![Go Report Card](https://goreportcard.com/badge/github.com/bookstairs/bookhunter)](https://goreportcard.com/report/github.com/bookstairs/bookhunter)
![](https://img.shields.io/github/stars/bookstairs/bookhunter.svg)
![](https://img.shields.io/github/forks/bookstairs/bookhunter.svg)
![Release](https://github.com/bookstairs/bookhunter/workflows/release/badge.svg)Downloading books from [talebook](https://github.com/talebook/talebook),
[SoBooks](https://sobooks.cc)
[中小学教材](https://basic.smartedu.cn/tchMaterial)
and Telegram Channels. This is a totally
rewritten fork compared to its [original version](https://github.com/hellojukay/dl-talebook).## 🚧 Development
1. [Go Releaser](https://github.com/goreleaser/goreleaser) is used for releasing and local building
2. [golangci-lint](https://github.com/golangci/golangci-lint) is used for code style.
3. [pre-commit](https://pre-commit.com/) is used for checking code before committing.## 💾 Install
### 🍎 Homebrew (for macOS, Linux)
```shell
brew tap bookstairs/tap
brew install bookhunter
```### 💻 Scope (for Windows)
```shell
scoop bucket add bookstairs https://github.com/bookstairs/scoop-bucket.git
scoop install bookstairs/bookhunter
```### 🛠 Manually
Download the latest release in [release page](https://github.com/bookstairs/bookhunter/releases). Choose related tarball
by your running environment.## 📚 Usage
| Website | Address | Direct Download | [Aliyun](https://www.aliyundrive.com/) | [Lanzou](https://www.lanzou.com/) | [Telecom](https://cloud.189.cn/) |
|--------------------------------------------------|----------------------------------------|-----------------|----------------------------------------|-----------------------------------|----------------------------------|
| [智慧教育平台](#download-textbooks-for-kids) | | ✅ | ❌ | ❌ | ❌ |
| [Talebook](#download-books-from-talebook) | | ✅ | ❌ | ❌ | ❌ |
| [SoBooks](#download-books-from-sobooks) | | ✅ | ❌ | ✅ | ❌ |
| [Telegram](#download-books-from-telegram-groups) | | ✅ | ❌ | ❌ | ❌ |
| [Hsu Life](#download-books-from-hsu-life) | | ✅ | ❌ | ❌ | ❌ |### Login Aliyundrive to get the `refreshToken`
We would show a QR code at the first time. And cache the `refreshToken` after successfully login.
```shell
bookhunter aliyun
```### Download textbooks for Kids
```text
Usage:
bookhunter k12 [flags]Flags:
-d, --download string The book directory you want to use (default ".")
-h, --help help for k12
--ratelimit int The allowed requests per minutes for every thread (default 30)
-t, --thread int The number of download thead (default 1)Global Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```### Register account in Talebook
```text
Usage:
bookhunter talebook register [flags]Flags:
-e, --email string The talebook email
-h, --help help for register
-p, --password string The talebook password
-u, --username string The talebook username
-w, --website string The talebook linkGlobal Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```### Download books from Talebook
```text
Usage:
bookhunter talebook download [flags]Flags:
-d, --download string The book directory you want to use (default ".")
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for download
-i, --initial int The book id you want to start download (default 1)
-p, --password string The talebook password
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)
-u, --username string The talebook username
-w, --website string The talebook linkGlobal Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```### Download books from SoBooks
```text
Usage:
bookhunter sobooks [flags]Flags:
--code string The secret code for SoBooks (default "244152")
-d, --download string The book directory you want to use (default ".")
-e, --extract Extract the archive file for filtering
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for sobooks
-i, --initial int The book id you want to start download (default 1)
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)Global Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```### Download books from Telegram groups
Example command: `bookhunter telegram --appID ****** --appHash ****** --thread 4 --proxy http://127.0.0.1:7890 --channelID https://t.me/sharebooks4you`
Please refer [Creating your Telegram Application](https://core.telegram.org/api/obtaining_api_id) to obtain your `appID`
and `appHash`.```text
Usage:
bookhunter telegram [flags]Flags:
--appHash string The app hash for telegram
--appID int The app id for telegram
--channelID string The channel id for telegram
-d, --download string The book directory you want to use (default ".")
-e, --extract Extract the archive file for filtering
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for telegram
-i, --initial int The book id you want to start download (default 1)
--mobile string The mobile number, we will add +86 as default zone code
--ratelimit int The allowed requests per minutes for every thread (default 30)
--refresh Refresh the login session
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)Global Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```### Download books from Hsu Life
Example command: `bookhunter hsu --username ****** --password ******`
```text
Usage:
bookhunter hsu [flags]Flags:
-d, --download string The book directory you want to use (default ".")
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for hsu
-i, --initial int The book id you want to start download (default 1)
-p, --password string The hsu.life password
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)
-u, --username string The hsu.life usernameGlobal Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```