Download the PHP package diggin/diggin-robotrules without Composer
On this page you can find all versions of the php package diggin/diggin-robotrules. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Please rate this library. Is it a good library?
Informations about the package diggin-robotrules
Diggin_RobotRules
PHP parser/handler for Robots Exclusion Protocol (robots.txt and more..)
Features
-
implements http://www.robotstxt.org/norobots-rfc.txt
- [DONE] "3.2.2 The Allow and Disallow lines" - as test-case
- [DONE] "4.Examples" as test-case
- passing Nutch's test code
ref
- [DONE] @see tests/Diggin/RobotRules/Imported/NutchTest.php
- parsing & handling html-meta
ToDos
- handle Crawl-Delay
- sync or testing a little pattern w/ Google Test robots.txt tool
- rewrite with PHPPEG.(because current preg* base parser makes difficulty.)
- more test, refactoring on and on..
USAGE
INSTALL
Diggin_RobotRules is following PSR-0, so to register namespace Diggin\RobotRules into your ClassLoader.
To install via composer
- $php composer.phar require diggin/diggin-robotrules "dev-master"
License
Diggin_RobotRules is licensed under new-bsd.
Reference & alternatives in others language.
- Perl
- Python
- Ruby
All versions of diggin-robotrules with dependencies
PHP Build Version
Package Version
Requires
php Version
>=5.3.4
The package diggin/diggin-robotrules contains the following files
Loading the files please wait ....