Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ganzerli/crowler-for-words
Crowling domain, cut style, script and all HTML tags, gets words and links, following all links and printing all the words found into a file separated by space
https://github.com/ganzerli/crowler-for-words
c crowler curl-library https-client libcurl
Last synced: 29 days ago
JSON representation
Crowling domain, cut style, script and all HTML tags, gets words and links, following all links and printing all the words found into a file separated by space
- Host: GitHub
- URL: https://github.com/ganzerli/crowler-for-words
- Owner: ganzerli
- License: mit
- Created: 2023-01-07T18:01:58.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-09-13T19:42:06.000Z (about 1 year ago)
- Last Synced: 2024-10-02T06:41:31.594Z (about 1 month ago)
- Topics: c, crowler, curl-library, https-client, libcurl
- Language: C
- Homepage:
- Size: 11.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# All words from all links found in a domain are saved into a file
Using lcurl, you need to install first lcurlCrowling domain:
-cuts all style
-cuts all script
-cuts all HTML tags
-gets all words
-gets all links
-formats all links
-calls all links
-saves all words found in the html into a fileCompile in linux with:
gcc -o crowler crowler.c -lcurl