tiktoken is a fast BPE tokeniser for use with OpenAI's models
70.78 KB
built 2026-10-20 16:01:14 GMT
Description
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Dependencies
28 totalRequires25
- (crate(bstr/default) >= 1.13.0 with crate(bstr/default) < 2.0.0~)
- (crate(fancy-regex/default) >= 0.16.0 with crate(fancy-regex/default) < 0.20.0~)
- (crate(pyo3) >= 0.29.2 with crate(pyo3) < 0.30.0~)
- (crate(pyo3/extension-module) >= 0.29.2 with crate(pyo3/extension-module) < 0.30.0~)
- (crate(pyo3/macros) >= 0.29.2 with crate(pyo3/macros) < 0.30.0~)
- (crate(regex/default) >= 1.13.1 with crate(regex/default) < 2.0.0~)
- (crate(rustc-hash/default) >= 2.0.0 with crate(rustc-hash/default) < 3.0.0~)
- (python3dist(tomli) if python3-devel < 3.11)
- cargo-rpm-macros >= 24
- pyproject-rpm-macros
- python3-devel
- python3-devel
- python3dist(packaging)
- python3dist(pip) >= 19
- python3dist(regex)
- python3dist(requests)
- python3dist(setuptools) >= 62.4
- python3dist(setuptools-rust) >= 1.5.2
- python3dist(wheel)
- rpmlib(CompressedFileNames) <= 3.0.4-1
- rpmlib(DynamicBuildRequires) <= 4.15.0-1
- rpmlib(FileDigests) <= 4.6.0-1
- rpmlib(RichDependencies) <= 4.12.0-1
- rpmlib(TildeInVersions) <= 4.10.0-1
- rust >= 1.85
Provides3
- python-tiktoken-debuginfo = 0.14.0-2.fc45
- python-tiktoken-debugsource = 0.14.0-2.fc45
- python3-tiktoken = 0.14.0-2.fc45
ObsoletesNo Obsoletes
ConflictsNo Conflicts
RecommendsNo Recommends
SuggestsNo Suggests
SupplementsNo Supplements
EnhancesNo Enhances
Files
3Name ![]() |
Size |
|---|---|
| python-tiktoken.spec | 5.80 KB |
| tiktoken-0.14.0.tar.gz | 37.99 KB |
| tiktoken-fix-metadata.diff | 407.00 B |
Files 1–3 of 3
Component of
buildroots that installed this RPMNo Buildroots
