extra credit Search 85,062 technologies ⌘K Download for Mac

Parquet

Category
Databases and data
Docs outline
12 sections

Official docs outline

parquet.apache.org
  1. Overview

    Parquet as a columnar storage format and its goals.

  2. Motivation

    Why columnar storage, compression and encoding.

  3. Concepts

    File, row group, column chunk and page.

  4. File Format

    Layout of files, footer and metadata.

  5. Types and Logical Types

    Physical types and logical type annotations.

  6. Nested Encoding

    Repetition and definition levels for nested data.

  7. Data Pages and Encodings

    Page types and encodings such as RLE, dictionary and delta.

  8. Compression

    Codecs such as Snappy, GZIP, ZSTD and LZ4.

  9. Page Index

    Column and offset indexes for predicate pushdown.

  10. Bloom Filters

    Split block bloom filters for point lookups.

  11. Modular Encryption

    Column-level encryption and integrity.

  12. Metadata

    Footer, row group and column chunk metadata.

Each section links to the official page. Titles and summaries by Extra Credit; the docs belong to their authors.

All 78
↑↓ move ↵ open