An open API service indexing awesome lists of open source software.

https://github.com/axelhahn/ahcrawler

crawler for a searchengine on your website and website analytics
https://github.com/axelhahn/ahcrawler

crawler http-header http-header-check link-checker multilanguage-support php search-engine ssl-certificate-check website-analytics webui

Last synced: 12 days ago
JSON representation

crawler for a searchengine on your website and website analytics

Awesome Lists containing this project

README

          

# AH CRAWLER

## Description

AhCrawler is a search engine for your website and analytics tool.

This is free software and Open Source
GNU General Public License (GNU GPL) version 3

๐Ÿ‘ค Author: Axel Hahn\
๐Ÿงพ Source: \
๐Ÿ“œ License: GNU GPL 3.0\
๐Ÿ“— Docs: see

- - -
It is written in PHP and consists of
- crawler (spider) and indexer
- search for your website
- website analyzer with
- ssl certificate check
- saved cookies
- http response header check
- linkchecker (http status check of all links, css, images, ...)

It runs on PHP - up to version 8.5 (maybe it runs on PHP 8.0 - but this is an already outdated version).
It uses PDO to store indexed data. So far sqlite and mysql were tested.

This is not a version 1.x yet ... let me do some more work :-)

## Screenshot

![Screenshot: backend](docs/images/usage-03-analysis-start.png)