Letter P

perl-WWW-RobotRules-Parser - Just Parse robots.txt

Website: http://search.cpan.org/dist/WWW-RobotRules-Parser/
License: GPL or Artistic
Description:
WWW::RobotRules::Parser allows you to simply parse robots.txt files as
described in http://www.robotstxt.org/wc/norobots.html. Unlike
WWW::RobotRules (which is very cool), this module does not take into
consideration your user agent name when parsing. It just parses the
structure and returns a hash containing the whole set of rules. You can
then use this to do whatever you like with it.

Packages

perl-WWW-RobotRules-Parser-0.04001-14m.mo8.noarch [9 KiB] Changelog by NARITA Koichi (2011-10-05):
- (0.04001-14m)
- rebuild against perl-5.14.2

Listing created by Repoview-0.6.6-1m.mo8