Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/bookstairs/bookhunter

A download tools for clawing the ebooks from internets.
https://github.com/bookstairs/bookhunter

epub golang spider

Last synced: 6 days ago
JSON representation

A download tools for clawing the ebooks from internets.

Host: GitHub
URL: https://github.com/bookstairs/bookhunter
Owner: bookstairs
License: mit
Created: 2022-04-08T15:26:36.000Z (over 2 years ago)
Default Branch: master
Last Pushed: 2024-09-05T08:26:08.000Z (2 months ago)
Last Synced: 2024-09-06T13:32:24.511Z (about 2 months ago)
Topics: epub, golang, spider
Language: Go
Homepage:
Size: 420 KB
Stars: 844
Watchers: 6
Forks: 56
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

my-awesome - bookstairs/bookhunter - 09 star:0.9k fork:0.1k A download tools for clawing the ebooks from internets. (Go)

README

# ⏬ bookhunter

[![LICENSE](https://img.shields.io/github/license/bookstairs/bookhunter)](https://github.com/bookstairs/bookhunter/blob/main/LICENSE)
[![Language](https://img.shields.io/badge/Language-Go-blue.svg)](https://golang.org/)
[![Go Report Card](https://goreportcard.com/badge/github.com/bookstairs/bookhunter)](https://goreportcard.com/report/github.com/bookstairs/bookhunter)
![](https://img.shields.io/github/stars/bookstairs/bookhunter.svg)
![](https://img.shields.io/github/forks/bookstairs/bookhunter.svg)
![Release](https://github.com/bookstairs/bookhunter/workflows/release/badge.svg)

Downloading books from [talebook](https://github.com/talebook/talebook),
[SoBooks](https://sobooks.cc)
[中小学教材](https://basic.smartedu.cn/tchMaterial)
and Telegram Channels. This is a totally
rewritten fork compared to its [original version](https://github.com/hellojukay/dl-talebook).

## 🚧 Development

1. [Go Releaser](https://github.com/goreleaser/goreleaser) is used for releasing and local building
2. [golangci-lint](https://github.com/golangci/golangci-lint) is used for code style.
3. [pre-commit](https://pre-commit.com/) is used for checking code before committing.

## 💾 Install

### 🍎 Homebrew (for macOS, Linux)

```shell
brew tap bookstairs/tap
brew install bookhunter
```

### 💻 Scope (for Windows)

```shell
scoop bucket add bookstairs https://github.com/bookstairs/scoop-bucket.git
scoop install bookstairs/bookhunter
```

### 🛠 Manually

Download the latest release in [release page](https://github.com/bookstairs/bookhunter/releases). Choose related tarball
by your running environment.

## 📚 Usage

| Website | Address | Direct Download | [Aliyun](https://www.aliyundrive.com/) | [Lanzou](https://www.lanzou.com/) | [Telecom](https://cloud.189.cn/) |
|--------------------------------------------------|----------------------------------------|-----------------|----------------------------------------|-----------------------------------|----------------------------------|
| [智慧教育平台](#download-textbooks-for-kids) | | ✅ | ❌ | ❌ | ❌ |
| [Talebook](#download-books-from-talebook) | | ✅ | ❌ | ❌ | ❌ |
| [SoBooks](#download-books-from-sobooks) | | ✅ | ❌ | ✅ | ❌ |
| [Telegram](#download-books-from-telegram-groups) | | ✅ | ❌ | ❌ | ❌ |
| [Hsu Life](#download-books-from-hsu-life) | | ✅ | ❌ | ❌ | ❌ |

### Login Aliyundrive to get the `refreshToken`

We would show a QR code at the first time. And cache the `refreshToken` after successfully login.

```shell
bookhunter aliyun
```

### Download textbooks for Kids

```text
Usage:
bookhunter k12 [flags]

Flags:
-d, --download string The book directory you want to use (default ".")
-h, --help help for k12
--ratelimit int The allowed requests per minutes for every thread (default 30)
-t, --thread int The number of download thead (default 1)

Global Flags:
-c, --config string The config path for bookhunter
-k, --keyword strings The keywords for books
--proxy string The request proxy
--retry int The retry times for a failed download (default 3)
-s, --skip-error Continue to download the next book if the current book download failed (default true)
--verbose Print all the logs for debugging
```

### Register account in Talebook

```text
Usage:
bookhunter talebook register [flags]

Flags:
-e, --email string The talebook email
-h, --help help for register
-p, --password string The talebook password
-u, --username string The talebook username
-w, --website string The talebook link

### Download books from Talebook

```text
Usage:
bookhunter talebook download [flags]

Flags:
-d, --download string The book directory you want to use (default ".")
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for download
-i, --initial int The book id you want to start download (default 1)
-p, --password string The talebook password
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)
-u, --username string The talebook username
-w, --website string The talebook link

### Download books from SoBooks

```text
Usage:
bookhunter sobooks [flags]

Flags:
--code string The secret code for SoBooks (default "244152")
-d, --download string The book directory you want to use (default ".")
-e, --extract Extract the archive file for filtering
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for sobooks
-i, --initial int The book id you want to start download (default 1)
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)

### Download books from Telegram groups

Example command: `bookhunter telegram --appID ****** --appHash ****** --thread 4 --proxy http://127.0.0.1:7890 --channelID https://t.me/sharebooks4you`

Please refer [Creating your Telegram Application](https://core.telegram.org/api/obtaining_api_id) to obtain your `appID`
and `appHash`.

```text
Usage:
bookhunter telegram [flags]

Flags:
--appHash string The app hash for telegram
--appID int The app id for telegram
--channelID string The channel id for telegram
-d, --download string The book directory you want to use (default ".")
-e, --extract Extract the archive file for filtering
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for telegram
-i, --initial int The book id you want to start download (default 1)
--mobile string The mobile number, we will add +86 as default zone code
--ratelimit int The allowed requests per minutes for every thread (default 30)
--refresh Refresh the login session
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)

### Download books from Hsu Life

Example command: `bookhunter hsu --username ****** --password ******`

```text
Usage:
bookhunter hsu [flags]

Flags:
-d, --download string The book directory you want to use (default ".")
-f, --format strings The file formats you want to download (default [epub,azw3,mobi,pdf,zip])
-h, --help help for hsu
-i, --initial int The book id you want to start download (default 1)
-p, --password string The hsu.life password
--ratelimit int The allowed requests per minutes for every thread (default 30)
-r, --rename Rename the book file by book id
-t, --thread int The number of download thead (default 1)
-u, --username string The hsu.life username