Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ganzerli/crowler-for-words

Crowling domain, cut style, script and all HTML tags, gets words and links, following all links and printing all the words found into a file separated by space
https://github.com/ganzerli/crowler-for-words

c crowler curl-library https-client libcurl

Last synced: 29 days ago
JSON representation

Crowling domain, cut style, script and all HTML tags, gets words and links, following all links and printing all the words found into a file separated by space

Awesome Lists containing this project

README

        

# All words from all links found in a domain are saved into a file
Using lcurl, you need to install first lcurl

Crowling domain:
-cuts all style
-cuts all script
-cuts all HTML tags
-gets all words
-gets all links
-formats all links
-calls all links
-saves all words found in the html into a file

Compile in linux with:
gcc -o crowler crowler.c -lcurl