transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Tra
- Category
- Python packages
pip install transformers-stream-generator Official docs outline
transformers-stream-generator.readthedocs.ioExtra Credit builds an outline of transformers-stream-generator's docs the first time your work uses it. Until then, start at the official documentation.
More in Python packages
All 9,553- aws-cdk.aws-s3tables-alpha CDK Constructs for S3 Tables
- arviz-plots ArviZ-plots provides ready to use and composable plots for Bayesian Workflow.
- quart-cors A Quart extension to provide Cross Origin Resource Sharing, access control, support
- rapids-logger Logging framework for RAPIDS built around spdlog
- python-amazon-sp-api Python wrapper for the Amazon Selling-Partner API
- ummalqura Python Hijri Ummalqura
- python-etcd A python client for etcd
- frida-tools Frida CLI tools
- crochet Use Twisted anywhere!
- pysolr Lightweight Python client for Apache Solr
- mypy-boto3-timestream-query Type annotations for boto3 TimestreamQuery 1.43.0 service generated with mypy-boto3-builder 8.12.0
- common Common tools and data structures implemented in pure python.