auto-round
Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs
- Category
- Python packages
pip install auto-round Official docs outline
auto-round.readthedocs.ioExtra Credit builds an outline of auto-round's docs the first time your work uses it. Until then, start at the official documentation.
More in Python packages
All 9,553-
numpydantic Type and shape validation and serialization for arbitrary array types in pydantic models
-
djangorestframework-xml XML support for Django REST Framework
-
django-hosts Dynamic and static host resolving for Django. Maps hostnames to URLconfs.
-
mpld3 D3 Viewer for Matplotlib
-
deap Distributed Evolutionary Algorithms in Python
-
pysignalr Modern, reliable and async-ready client for SignalR protocol
-
typer-config Utilities for working with configuration files in typer CLIs.
-
session-info session_info outputs version information for modules loaded in the current session, Python, and the OS.
-
inotify An adapter to Linux kernel support for inotify directory-watching.
-
bech32 Reference implementation for Bech32 and segwit addresses.
-
segmentation-models-pytorch Image segmentation models with pre-trained backbones. PyTorch.
-
llama-index-llms-openai-like llama-index llms openai like integration