Databricks
Official docs outline
15 sections- Lakehouse Architecture
Lakehouse concept, unified data and AI platform, architecture principles and workspace overview.
- Medallion Architecture
Bronze, silver and gold layers and incremental data quality.
- Delta Lake
ACID transactions, transaction log, time travel, schema enforcement and evolution, MERGE and table features.
- Delta Optimization: OPTIMIZE, Z-order, Liquid Clustering
File compaction, Z-ordering, liquid clustering, VACUUM, data skipping and small files.
- Unity Catalog
Metastore, catalogs, schemas, tables, volumes, privileges, lineage and governance.
- Compute and Clusters
All-purpose and job clusters, serverless compute, autoscaling, policies and runtime versions.
- SQL Warehouses
Serverless, pro and classic SQL warehouses, sizing, scaling and Databricks SQL.
- Photon and Performance Optimization
Photon engine, adaptive query execution, skew handling and query tuning.
- Disk Cache and Caching
Delta disk cache, Spark cache, query result cache and when each helps.
- Jobs and Workflows
Tasks, schedules, triggers, task dependencies, retries and orchestration with Lakeflow Jobs.
- Data Ingestion and Auto Loader
Auto Loader, COPY INTO, incremental file ingestion and connectors.
- Lakeflow Declarative Pipelines
Declarative ETL, streaming tables, materialized views and data quality expectations.
- Structured Streaming
Streaming reads and writes, triggers, checkpoints, watermarks and stateful processing.
- Delta Sharing
Open protocol for sharing data across organizations and platforms.
- MLflow and Machine Learning
Experiment tracking, model registry, model serving and the ML lifecycle.
Each section links to the official page. Titles and summaries by Extra Credit; the docs belong to their authors.