https://github.com/pop-os/url-scraper

Rust crate for scraping URLs from HTML pages
https://github.com/pop-os/url-scraper

Last synced: about 1 month ago
JSON representation

Rust crate for scraping URLs from HTML pages

• Host: GitHub
• URL: https://github.com/pop-os/url-scraper
• Owner: pop-os
• License: mit
• Created: 2018-10-04T19:47:09.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2020-07-02T20:26:06.000Z (over 4 years ago)
• Last Synced: 2024-10-28T02:17:49.220Z (about 2 months ago)
• Language: Rust
• Size: 4.88 KB
• Stars: 38
• Watchers: 11
• Forks: 7
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-rust-cn - pop-os/url-scraper
• awesome-rust - pop-os/url-scraper
• awesome-rust-zh - pop-os/url-scraper - 从 HTML 页面中，截取 URL (库 / 网络编程)

README

        
# url-scraper

Rust crate for scraping URLs from HTML pages.

## Example

```rust

extern crate url_scraper;

use url_scraper::UrlScraper;

fn main() {

    let directory = "http://phoronix.com/";

    let scraper = UrlScraper::new(directory).unwrap();

    for (text, url) in scraper.into_iter() {

        println!("{}: {}", text, url);

    }

}

```