tokenizers

Extra Credit builds an outline of tokenizers's docs the first time your work uses it. Until then, start at the official documentation.

• opentelemetry-exporter-otlp-proto-http OpenTelemetry Collector Protobuf over HTTP Exporter
• tiktoken tiktoken is a fast BPE tokeniser for use with OpenAI's models
• threadpoolctl threadpoolctl
• isodate An ISO 8601 date/time/duration parser and formatter
• pyopenssl Python wrapper module around the OpenSSL library
• nodeenv Node.js virtual environment builder
• cloudpickle Pickler class to extend the standard pickle.Pickler functionality
• python-discovery Python interpreter discovery
• pynacl Python binding to the Networking and Cryptography (NaCl) library
• websocket-client WebSocket client for Python with low level API options
• mypy Optional static typing for Python
• joblib Lightweight pipelining with Python functions