https://github.com/suddencollection/crawler
web crawler with graph rendering
https://github.com/suddencollection/crawler
cpp crawler fmt lexbor libcurl ogdf web-crawler
Last synced: 3 months ago
JSON representation
web crawler with graph rendering
- Host: GitHub
- URL: https://github.com/suddencollection/crawler
- Owner: suddencollection
- License: mit
- Created: 2025-07-25T18:57:57.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2025-07-26T02:30:27.000Z (3 months ago)
- Last Synced: 2025-07-26T04:45:52.321Z (3 months ago)
- Topics: cpp, crawler, fmt, lexbor, libcurl, ogdf, web-crawler
- Language: C++
- Homepage:
- Size: 4.19 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# 🌐 Web Crawler Grapher
A simple **web crawler** written in modern C++, which extracts hyperlinks and builds **visual graphs** of the web.
# Building
Before building the project, make sure the following dependencies are installed on your system:
- [CMake](https://cmake.org/download/) ≥ 3.23
- [Conan](https://conan.io/), the C++ package manager
- **C++20 compiler**
To verify installation:
$ g++ --version
$ cmake --version
$ conan --version
Then build and run:
$ sh/build
$ sh/run
# Demonstration
