https://github.com/kshru9/web-crawler
A multithreaded web crawler using two mechanism - single lock and thread safe data structures
https://github.com/kshru9/web-crawler
concurrency concurrent-data-structure cpp crawler data-structures html-parser lock multithreading openssl pagerank pthread reader-writer-lock search-engine socket threading threadsafe webcrawler website-downloader
Last synced: about 1 month ago
JSON representation
A multithreaded web crawler using two mechanism - single lock and thread safe data structures
- Host: GitHub
- URL: https://github.com/kshru9/web-crawler
- Owner: kshru9
- Created: 2020-10-26T09:24:24.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-03-22T10:41:01.000Z (about 4 years ago)
- Last Synced: 2025-03-18T20:05:01.757Z (about 1 month ago)
- Topics: concurrency, concurrent-data-structure, cpp, crawler, data-structures, html-parser, lock, multithreading, openssl, pagerank, pthread, reader-writer-lock, search-engine, socket, threading, threadsafe, webcrawler, website-downloader
- Language: C++
- Homepage:
- Size: 4.39 MB
- Stars: 33
- Watchers: 1
- Forks: 12
- Open Issues: 0