Implementation of today's most used tokenizers in Rust
8.09 KB
built 2026-10-21 11:40:41 GMT
Description
Provides an implementation of today's most used tokenizers, with a focus
on performances and versatility.
This package contains library source intended for building other packages which
use the "indicatif" feature of the "tokenizers" crate.
Dependencies
11 totalRequires9
- (crate(indicatif/default) >= 0.18.0 with crate(indicatif/default) < 0.19.0~)
- cargo
- crate(tokenizers) = 0.23.1
- rpmlib(CompressedFileNames) <= 3.0.4-1
- rpmlib(FileDigests) <= 4.6.0-1
- rpmlib(PayloadFilesHavePrefix) <= 4.0-1
- rpmlib(PayloadIsZstd) <= 5.4.18-1
- rpmlib(RichDependencies) <= 4.12.0-1
- rpmlib(TildeInVersions) <= 4.10.0-1
Provides2
- crate(tokenizers/indicatif) = 0.23.1
- rust-tokenizers+indicatif-devel = 0.23.1-1.fc45
ObsoletesNo Obsoletes
ConflictsNo Conflicts
RecommendsNo Recommends
SuggestsNo Suggests
SupplementsNo Supplements
EnhancesNo Enhances
Files
1
Files 1–1 of 1
Component of
buildroots that installed this RPMNo Buildroots
