extra credit Search 85,062 technologies ⌘K Download for Mac

tokenizers

Fastest implementation of the most used tokenizers in AI.

Category
Rust crates
cargo add tokenizers
↑↓ move ↵ open