Skip to content

Adoption hardening for internal teams

Problem

The profiling pipeline was built and validated against a single team's BigQuery warehouse during the M1 pilot. Expanding to multiple internal teams and first design partners exposes assumptions that don't generalize: different warehouse dialects (Snowflake, Redshift) may produce incomplete statistics, schemas with hundreds of tables exceed current memory and timeout limits, permission models vary across organizations, and the inspect.json cache format may not handle multi-user concurrent writes. Without hardening the pipeline for diverse warehouse environments, varied schema scales, and multi-team usage patterns, adoption beyond the initial pilot team will produce confusing failures and erode trust in the tool.

Context

Possible Solutions

Plan

Implementation Progress

Review Feedback

  • Review cleared