https://github.com/athlan/biai-crawler
https://github.com/athlan/biai-crawler
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/athlan/biai-crawler
- Owner: athlan
- Created: 2013-04-12T16:42:14.000Z (about 13 years ago)
- Default Branch: master
- Last Pushed: 2013-04-13T10:24:56.000Z (about 13 years ago)
- Last Synced: 2025-01-29T16:26:32.312Z (over 1 year ago)
- Language: PHP
- Size: 281 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
biai-crawler
============
## Requirements
- PHP 5.4 or above
- PHP PDO extension (with PostgreSQL connector) `php_pdo_pgsql` `php_pgsql` extensions
- PHP CURL support `php_curl` extension
- PostgreSQL 9.1 or above
## Usage
Type help to get usage info
```
php app.php help
```
The application generates a lot of cache files, bewaring of multiple and frequent requests to the same URL's. To flush this cache just type:
```
rm -R ./data/cahce/zfcache*
```
## Installation
1 . Clone the git project
```
git clone https://github.com/athlan/biai-crawler.git
```
2 . Set database connection
```
cp config/autoload/local.php.dist config/autoload/local.php
vim config/autoload/local.php
```
3 . Install dependencies
```
php composer.phar install
```
4 . Set permissions to files
```
chmod -R 0777 ./data/cache/
```
5 . Create database schema
```
php vendor/doctrine/doctrine-module/bin/doctrine-module.php orm:schema-tool:update --verbose --force
```
or
```
cd scripts
chmod +x doctrine-db-update.sh
./doctrine-db-update.sh
cd ..
```
6 . That's all! Just use:
```
php app.php help
```