Project Notes (full article to be written)
- Implementation of data catalogue for a large luxury company
- Tool selection and evaluation of data catalogue solution (Data catalogue solution)
- Challenge of establishing common business definitions and alignment between technical and business definitions
- Data Catalogue: Data catalogue solution (or Datahub/Alation)
- Data Warehouse: BigQuery (500+ tables catalogued)
- Metadata Extraction: Automated crawlers
- Business Glossary: Custom glossary definitions
- Data Lineage: Automated from SQL queries
- Implementation process and team adoption strategy
- Improved data discoverability and data quality
- Business glossary with canonical definitions for top 50 business terms
- Self-service data discovery interface
- 500+ tables catalogued with automated metadata
- Data discovery time: 2 hours → 5 minutes
- 50% time saved on "where is X?" questions
- Top 50 business terms standardized
- Onboarding speed: 2 months → 2 weeks