Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ductnn/curls
Simple tool crawler URLs form domain
https://github.com/ductnn/curls
colly crawler domain golang scanning url
Last synced: 1 day ago
JSON representation
Simple tool crawler URLs form domain
- Host: GitHub
- URL: https://github.com/ductnn/curls
- Owner: ductnn
- License: mit
- Created: 2022-07-29T17:47:28.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2022-07-30T11:05:10.000Z (over 2 years ago)
- Last Synced: 2024-06-20T22:34:10.864Z (8 months ago)
- Topics: colly, crawler, domain, golang, scanning, url
- Language: Go
- Homepage:
- Size: 9.77 KB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: license
Awesome Lists containing this project
README
# cUrls
[](https://github.com/ductnn/cUrls/pulls)
[](LICENSE)
**cUrls** is a simple tool crawl urls from domain using [colly](https://github.com/gocolly/colly)
library.
## Installation
First, install [golang](https://go.dev/doc/install)
Then, clone from soure code and install:
```sh
git clone https://github.com/ductnn/cUrls.git
cd cUrls
go get
```
## Usage
Run command:
```
go run curls.go > sub.txt
# Enter domain you want to crawl.
# Example
http://httpbin.org/
```
Check results in file *sub.txt*:
```txt
Visiting http://httpbin.org/
Link found: "\n \n \n \n \n \n " -> https://github.com/requests/httpbin
Link found: "the developer - Website" -> https://kennethreitz.org
Link found: "Send email to the developer" -> mailto:[email protected]
Link found: "Flasgger" -> https://github.com/rochacbruno/flasgger
Link found: "HTML form" -> /forms/post
```
So done !!! =))))
### Show your support
Give a ⭐ if you like this application ❤️
## Contribution
Contributions are more than welcome in this project!
## License
The MIT License (MIT). Please see [LICENSE](license) for more information.