Database of robots.txt-derived permissions
49.50 KB
built 2026-10-17 02:32:01 GMT
Description
This module parses /robots.txt files as specified in "A Standard for Robot
Exclusion", at <https://www.robotstxt.org/robotstxt.html>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.
Dependencies
21 totalRequires18
- coreutils
- make
- perl(:VERSION) >= 5.8.1
- perl(AnyDBM_File)
- perl(Carp)
- perl(DB_File)
- perl(ExtUtils::MakeMaker) >= 6.76
- perl(Fcntl)
- perl(File::Spec)
- perl(File::Temp)
- perl(Test::More)
- perl(URI) >= 1.10
- perl(strict)
- perl(vars)
- perl-generators
- perl-interpreter
- rpmlib(CompressedFileNames) <= 3.0.4-1
- rpmlib(FileDigests) <= 4.6.0-1
Provides3
- perl-WWW-RobotRules = 6.03-3.fc45
- perl-WWW-RobotRules-DB_File = 6.03-3.fc45
- perl-WWW-RobotRules-tests = 6.03-3.fc45
ObsoletesNo Obsoletes
ConflictsNo Conflicts
RecommendsNo Recommends
SuggestsNo Suggests
SupplementsNo Supplements
EnhancesNo Enhances
Files
2Name  |
Size |
|---|---|
| WWW-RobotRules-6.03.tar.gz | 28.57 KB |
| perl-WWW-RobotRules.spec | 9.83 KB |
Files 1–2 of 2
Component of
buildroots that installed this RPMNo Buildroots