https://github.com/zzy/rust-async-spider

Just a clean boilerplate for crawling website & scrapping data with async-std, surf, scraper, colored.
https://github.com/zzy/rust-async-spider

async-std colored rust-async-crawler scraper surf

Last synced: 6 months ago
JSON representation

Just a clean boilerplate for crawling website & scrapping data with async-std, surf, scraper, colored.

• Host: GitHub
• URL: https://github.com/zzy/rust-async-spider
• Owner: zzy
• License: mit
• Created: 2021-04-12T01:48:46.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2024-11-01T08:01:31.000Z (11 months ago)
• Last Synced: 2025-03-27T09:40:21.422Z (7 months ago)
• Topics: async-std, colored, rust-async-crawler, scraper, surf
• Language: Rust
• Homepage: https://blog.budshome.com/budshome/shi-yong-rust-zuo-yi-bu-shu-ju-cai-ji-de-shi-jian
• Size: 42 KB
• Stars: 5
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# rust-async-spider

Just a clean boilerplate for crawling website & scrapping data with: 

- async-std

- surf

- scraper

- colored

## How to use?

``` bash

git clone git@github.com:zzy/rust-async-spider.git

cd rust-async-spider

cargo build

cargo run

```

## References

- [mjs2600/hn](https://github.com/mjs2600/hn)