trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML.
pip install trafilatura More in Python packages
All 9,553- logfire Pydantic Logfire Python SDK and command-line interface
- skops A set of tools, related to machine learning in production.
- ctranslate2 Fast inference engine for Transformer models
- parameterized Parameterized testing with any Python test framework
- pyogrio Vectorized spatial vector file format I/O using GDAL/OGR
- pyyaml-env-tag A custom YAML tag for referencing environment variables in YAML files.
- huey A little task queue
- yt-dlp A feature-rich command-line audio/video downloader
- courlan Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters.
- python-gnupg A wrapper for the Gnu Privacy Guard (GPG or GnuPG)
- drf-spectacular Sane and flexible OpenAPI 3 schema generation for Django REST framework
- fastspec Dynamic OpenAPI, Discovery, and GraphQL spec client for Python — turn any API spec into a fully-typed async client with attribute…