Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ph4r05/php_aho_corasick
Aho-Corasick string search algorithm PHP extension implementation.
https://github.com/ph4r05/php_aho_corasick
aho-corasick algorithm automata hacktoberfest pecl php php-extension php5 php7 string-matching
Last synced: 3 months ago
JSON representation
Aho-Corasick string search algorithm PHP extension implementation.
- Host: GitHub
- URL: https://github.com/ph4r05/php_aho_corasick
- Owner: ph4r05
- License: lgpl-3.0
- Created: 2012-12-24T02:52:11.000Z (about 12 years ago)
- Default Branch: master
- Last Pushed: 2020-10-08T14:51:25.000Z (about 4 years ago)
- Last Synced: 2024-09-29T19:21:22.296Z (3 months ago)
- Topics: aho-corasick, algorithm, automata, hacktoberfest, pecl, php, php-extension, php5, php7, string-matching
- Language: C
- Homepage:
- Size: 165 KB
- Stars: 49
- Watchers: 9
- Forks: 15
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-php-extensions - php_aho_corasick - Aho-Corasick 算法做字符串匹配 (字符串处理)
README
# php_aho_corasick
[](https://travis-ci.org/ph4r05/php_aho_corasick)
[](https://scan.coverity.com/projects/ph4r05-php_aho_corasick)
PHP extension implementing Aho-Corasick pattern matching algorithm (more on [wiki]).
Is especially effective if there is a large database of needles (=strings to be searched, for example virus signatures).
Another advantage is that built search structure is initialized before search in separate call thus it can be called
more times with different haystack, saving time.
Computing Aho-Corasick in th native code (PHP extension) rather than in a pure PHP manner gives this implementation
significant performance boost.
## Dependencies
This project is simple PHP wrapper of (or interface to) another project: [MultiFast]. Sources include MultiFast library v 2.0.
No extra dependencies are required. [MultiFast] library is wrapped as PHP extension loadable to PHP.
Source of inspiration for this project was a great [tutorial].
Compatible with PHP 5.3+ and PHP 7.0+.
## PECL & Licensing
The original project [MultiFast] is licensed under LGPLv3 so this PHP wrapper is also licensed under LGPLv3.
Thanks to the [author] of the [MultiFast], Kamiar Kanani, who gave me a [permission] to license the code under PHP License 3.01 for the purpose
of adding this extension to PECL repository.
https://pecl.php.net/package/ahocorasick
Pecl installation:
```bash
pecl install channel://pecl.php.net/ahocorasick-0.0.7
```
Note the `php-dev` (or `php-devel`, depends on your distribution) is required for pecl package to compile.
## Build
```bash
phpize
./configure --enable-ahocorasick
make
```
## Docker build
```bash
$ docker build -t="ahoc" .
$ docker run -i -t ahoc
$ php -d extension=modules/ahocorasick.so -f examples/test.php
```
Install debugging tools, remote debugging
```bash
$ docker build -t="ahoc" --build-arg DEVEL_TOOLS=1 .
$ docker run -i --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -t ahoc
$ docker run -i --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --mount type=bind,src=`pwd`,dst=/aho -t ahoc
```
Recompiling, or cache busting:
```bash
$ docker build -t="ahoc" --build-arg DIR_BUSTER=`date`.
```
## Usage
This extension is case sensitive, thus if you want case insensitive, convert every string input to this algorithm to
lowercase (use mb_strtolower() for example).
For more usage examples, see provided testing examples.
`examples/test.php`:
```php
$data = array(
array('key'=>'ab', 'value'=>'alfa'),
array('key'=>'ac', 'value'=>'beta'),
array('key'=>'ad', 'value'=>'gamma', 'aux'=>array(1)),
array('key'=>'ae', 'value'=>'delta'),
array('id'=>0, 'value'=>'zeta'),
array('key'=>'ag', 'value'=>'omega'),
array('value'=>'lfa')
);
// initialize search , returns resourceID for search structure
$c = ahocorasick_init($data);
// perform search
$d1 = ahocorasick_match("alFABETA gamma zetaomegaalfa!", $c);
// deinitialize search structure (will free memory)
ahocorasick_deinit($c);
var_dump($d1);
```
Call with:
```bash
php -d extension=modules/ahocorasick.so -f examples/test.php
```
Results with:
```
array(5) {
[0]=>
array(5) {
["pos"]=>
int(14)
["key"]=>
string(2) "ad"
["aux"]=>
array(1) {
[0]=>
int(1)
}
["start_postion"]=>
int(9)
["value"]=>
string(5) "gamma"
}
[1]=>
array(4) {
["pos"]=>
int(19)
["keyIdx"]=>
int(0)
["start_postion"]=>
int(15)
["value"]=>
string(4) "zeta"
}
[2]=>
array(4) {
["pos"]=>
int(24)
["key"]=>
string(2) "ag"
["start_postion"]=>
int(19)
["value"]=>
string(5) "omega"
}
[3]=>
array(4) {
["pos"]=>
int(28)
["key"]=>
string(2) "ab"
["start_postion"]=>
int(24)
["value"]=>
string(4) "alfa"
}
[4]=>
array(3) {
["pos"]=>
int(28)
["start_postion"]=>
int(25)
["value"]=>
string(3) "lfa"
}
}
```
## Benchmark
In this repo you can find `examples/benchmark.php` file, with this you can perform your own benchmark and measure speed up.
My setup generates random haystacks and needles from alphabet="abcdef". There is performed 5 measurements of time spent by search and average is computed.
Search structure construction is conted to time measurements.
Script generates:
* 256 random haystacks of size 8192 characters
* 2048 needles with 16 characters.
Principle:
* Naive approach simply iterates over haystacks and needles, search is performed with strpos().
* Aho-Corasick approach constructs search structure, then all haystacks are searched for needles.
Results:
```
$> php -d extension=modules/ahocorasick.so -f examples/benchmark.php
Classic search; sampleCount: 10; keySize: 2048; timeAvg: 13.060877
AhoCorasick search; sampleCount: 10; keySize: 2048; timeAvg: 0.174326 s, totalTime: 1.743264 s, memory increase: 272 B
AhoCorasick pattern matching is 74.921962 times faster than naive approach
```
Speedup: 74x compared to the naive approach.
## API
Documentation writing is in progress.
Basic ideas of the API:
* AhoCorasick pattern matching engine has to be initialized (`ahocorasick_init()`) before use and deinitialized (`ahocorasick_deinit()`)
after use so memory is handled properly.
* Engine has to be fed with pattern matching rules, given as array of rules, either to initialization function (`ahocorasick_init()`)
or later (`ahocorasick_add_patterns()`).
* After engine is finalized (`ahocorasick_finalize()`) or a first matching is performed (`ahocorasick_match()`) no further patterns are
allowed, as underlying searching trie is finalized.
* When matching finishes, it returns array of matched results. Each entry determines position of the found occurrence and pattern
that was matched.
* Modifications made during the php 7 migration:
** 'value' is the default key when adding patterns.
** 'start_postion' field added to the results. The original algorithm returns the end position of the matched patterns.
Rules:
* Simplest pattern looks like:
```php
array('lorem')
```
* Pattern can be identified, so it is easier to process result from match call. Either by string
```php
array('key'=>'ae', 'value'=>'delta')
```
or integer
```php
array('id'=>0, 'value'=>'zeta')
```
* Pattern can carry an arbitrary object
```php
array('key'=>'ad', 'value'=>'gamma', 'aux'=>array(1))
```
## Development
```
# Create package for distribution
pear package
```
### OSX Mojave
Since Mojave the PHP module needs to be codesigned in order to be loaded to the process.
https://developer.apple.com/library/archive/technotes/tn2206/_index.html
Donating
========
This implementation is an open source. If you like the code or you do find it useful please feel free to donate to the
author whatever amount you would like by clicking on the paypal button below.
And if you don't feel like donating, that's OK too.
[](https://www.paypal.com/cgi-bin/webscr?cmd=_donations&business=XK6RLD768RGGJ&lc=SK&item_name=ph4r05&item_number=php_aho_corasick%2egit¤cy_code=EUR&bn=PP%2dDonationsBF%3abtn_donateCC_LG%2egif%3aNonHosted)
Bitcoin:
`1Gh3TC55L4FjCyS2y5WKc4EGMYBYa6qvDw`
Monero:
```
89bF7TFrhdyczkz6JmUzXx57yQa3fb28tbyT8nXLpj3bVFfQEE6cpjxec1gAJVSWHBBG7ex2XBj7u6BLrgKBaEmuSzWgdcn
```
[wiki]: http://en.wikipedia.org/wiki/Aho%E2%80%93Corasick_string_matching_algorithm
[MultiFast]: http://sourceforge.net/projects/multifast/?source=dlp
[tutorial]: http://devzone.zend.com/446/extension-writing-part-iii-resources/
[permission]: https://sourceforge.net/p/multifast/discussion/1317362/thread/dc5b4a1e/#a0a2
[author]: https://sourceforge.net/u/kamiark/