https://github.com/kapitanluffy/sunny-crawler

That moment when I tried learning things about "Big Data" and "Inverted Indexes"
https://github.com/kapitanluffy/sunny-crawler

big-data crawler inverted-index php search

Last synced: about 1 month ago
JSON representation

That moment when I tried learning things about "Big Data" and "Inverted Indexes"

• Host: GitHub
• URL: https://github.com/kapitanluffy/sunny-crawler
• Owner: kapitanluffy
• License: apache-2.0
• Created: 2013-11-15T17:31:31.000Z (about 11 years ago)
• Default Branch: master
• Last Pushed: 2013-11-26T14:25:10.000Z (about 11 years ago)
• Last Synced: 2024-05-01T22:48:28.563Z (9 months ago)
• Topics: big-data, crawler, inverted-index, php, search
• Language: PHP
• Homepage:
• Size: 207 KB
• Stars: 2
• Watchers: 3
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
sunny-crawler

=============

a.k.a. drunken-dubstep

edit the following files first:

- sunny.php

- lib/database.php

then run

```php

php -f sunny.php

```

create more crawlers for specific websites and put it in the *plugins* directory!

##### todo sites:

- mp3skull.com

- musicaddict.com

- beemp3.com

- tumblr.com