| Index | index by Group | index by Distribution | index by Vendor | index by creation date | index by Name | Mirrors | Help | Search |
| Name: perl-WWW-RobotRules | Distribution: OpenMandriva Lx |
| Version: 6.20.0 | Vendor: OpenMandriva |
| Release: 10 | Build date: Tue Mar 22 09:30:25 2022 |
| Group: Development/Perl | Build host: huaweiomv5.rosalinux.ru |
| Size: 26078 | Source RPM: perl-WWW-RobotRules-6.20.0-10.src.rpm |
| Packager: bero_massbuild <bero+massbuild@lindev.ch> | |
| Url: http://search.cpan.org/dist/WWW-RobotRules | |
| Summary: Parse /robots.txt file | |
This module parses _/robots.txt_ files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html> Webmasters can use the _/robots.txt_ file to forbid conforming robots from accessing parts of their web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. The same WWW::RobotRules object can be used for one or more parsed _/robots.txt_ files on any number of hosts. The following methods are provided:
GPLv2+ or Artistic
/usr/share/doc/perl-WWW-RobotRules /usr/share/doc/perl-WWW-RobotRules/Changes /usr/share/doc/perl-WWW-RobotRules/META.yml /usr/share/doc/perl-WWW-RobotRules/README /usr/share/man/man3/WWW::RobotRules.3pm.zst /usr/share/man/man3/WWW::RobotRules::AnyDBM_File.3pm.zst /usr/share/perl5/vendor_perl/WWW /usr/share/perl5/vendor_perl/WWW/RobotRules /usr/share/perl5/vendor_perl/WWW/RobotRules.pm /usr/share/perl5/vendor_perl/WWW/RobotRules/AnyDBM_File.pm
Generated by rpm2html 1.8.1
Fabrice Bellet, Tue Jul 9 22:51:51 2024