https://github.com/euskadi31/robots

A PHP 5.3+ framework for Robots.txt
https://github.com/euskadi31/robots

Last synced: 3 months ago
JSON representation

A PHP 5.3+ framework for Robots.txt

• Host: GitHub
• URL: https://github.com/euskadi31/robots
• Owner: euskadi31
• Created: 2012-01-02T15:36:25.000Z (over 13 years ago)
• Default Branch: master
• Last Pushed: 2013-07-19T20:08:55.000Z (almost 12 years ago)
• Last Synced: 2025-01-19T18:49:03.122Z (5 months ago)
• Language: PHP
• Size: 466 KB
• Stars: 2
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.markdown

Awesome Lists containing this project

README

        
# Robots.txt [![Build Status](https://travis-ci.org/euskadi31/Robots.png)](https://travis-ci.org/euskadi31/Robots)

## Test with [Atoum](https://github.com/atoum/atoum)

	cd Robots/

	curl -s https://getcomposer.org/installer | php

    php composer.phar install --dev

	./vendor/atoum/atoum/bin/atoum --glob Tests/Units/

	

## Reader

``` php

parse(

	file_get_contents(Robots\Reader::url('http://www.robotstxt.org'))

));

?>

```

Output

	Array(

		[User-agent] => Array(

			[0] => Array(

				[Name] => *

			)

			[1] => Array(

				[Name] => litefinder

				[Disallow] => Array(

					[0] => /

				)

			)

			[2] => Array(

				[Name] => Slurp

				[Disallow] => Array(

					[0] => /

				)

			)

			[3] => Array(

				[Name] => Baidu

				[Disallow] => Array(

					[0] => /

				)

			)

		)

	)