Cataloging and Discovery

Data nobody can find is data nobody uses. The Glue Data Catalog as the shared metadata layer, crawlers and classifiers and where they get schema wrong, partition indexes and why a query gets slower as the table grows, Lake Formation as the permissions layer over the catalog, and DataZone for discovery across teams.

Content current as of 2026-10.

Lessons

  1. The Glue Data Catalog
  2. Crawlers, classifiers, and bad schemas
  3. Partitions and partition indexes
  4. Lake Formation and DataZone

Sources