tokenizers-cpp

Public

Universal cross-platform tokenizers binding to HF and sentencepiece

Apache License 2.0

Updated Jan 22, 2026

Created Jun 11, 2025

1 stars

1 forks

0 watchers

0 open issues

Languages

Codebase composition by bytes

Top Contributors

9 commits

6 commits

5 commits

3 commits

2 commits

2 commits

1 commits

1 commits

1 commits

1 commits

Recent Stargazers

RR rrg92

19 days ago

Repository Complexity

Approximate file count and repository size.

Files-

Size (KB)84

Issues & Activity

Open vs closed issues and recent activity peak.

Open Issues 0Closed Issues 0

Open Issues0

Activity Peak

Most recent day with highest activityJan 22, 2026 • 3 events

Stars & Forks Over Time

Cumulative stars and forks based on recent history.

GitHub Analytics

tokenizers-cpp