Wed, 18 Nov 2026 03:31:52 UTC Log in
Implementation of today's most used tokenizers in Rust 8.08 KB built 2026-10-21 11:40:41 GMT

Description

Provides an implementation of today's most used tokenizers, with a focus on performances and versatility. This package contains library source intended for building other packages which use the "esaxx_fast" feature of the "tokenizers" crate.

Dependencies

11 total
Requires9
  • (crate(esaxx-rs/cpp) >= 0.1.10 with crate(esaxx-rs/cpp) < 0.2.0~)
  • cargo
  • crate(tokenizers) = 0.23.1
  • rpmlib(CompressedFileNames) <= 3.0.4-1
  • rpmlib(FileDigests) <= 4.6.0-1
  • rpmlib(PayloadFilesHavePrefix) <= 4.0-1
  • rpmlib(PayloadIsZstd) <= 5.4.18-1
  • rpmlib(RichDependencies) <= 4.12.0-1
  • rpmlib(TildeInVersions) <= 4.10.0-1
Provides2
  • crate(tokenizers/esaxx_fast) = 0.23.1
  • rust-tokenizers+esaxx_fast-devel = 0.23.1-1.fc45
ObsoletesNo Obsoletes
ConflictsNo Conflicts
RecommendsNo Recommends
SuggestsNo Suggests
SupplementsNo Supplements
EnhancesNo Enhances

Files

1
Files 1–1 of 1

Component of

buildroots that installed this RPM

No Buildroots