extra credit Search 85,062 technologies ⌘K Download for Mac

@huggingface/tokenizers

🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers

npm install @huggingface/tokenizers
↑↓ move ↵ open