Library for detecting bot HTTP UA headers
105.34 KB
built 2026-10-17 13:23:28 GMT
Description
robot_detection is a python module to detect if a given HTTP User Agent is a web
crawler. It uses the list of registered robots from http://www.robotstxt.org:
[Robots Database](http://www.robotstxt.org/db.html).
Dependencies
15 totalRequires14
- pyproject-rpm-macros
- python3-devel
- python3-devel
- python3-setuptools
- python3dist(packaging)
- python3dist(pip) >= 19
- python3dist(pytest)
- python3dist(setuptools) >= 40.8
- python3dist(six)
- python3dist(tox)
- python3dist(tox-current-env) >= 0.0.16
- rpmlib(CompressedFileNames) <= 3.0.4-1
- rpmlib(DynamicBuildRequires) <= 4.15.0-1
- rpmlib(FileDigests) <= 4.6.0-1
Provides1
- python3-robot-detection = 0.4-21.fc45
ObsoletesNo Obsoletes
ConflictsNo Conflicts
RecommendsNo Recommends
SuggestsNo Suggests
SupplementsNo Supplements
EnhancesNo Enhances
Files
2Name  |
Size |
|---|---|
| python-robot-detection.spec | 4.46 KB |
| robot-detection-0.4.tar.gz | 79.19 KB |
Files 1–2 of 2
Component of
buildroots that installed this RPMNo Buildroots