Schema Validation

How It Works

The schema engine checks the output schema of every node against the expected input schema of every downstream node. It validates column names, data types, nullability constraints, and format requirements. Validation happens in real time as you build, giving instant feedback on every connection.

Schema Registry

Schemas are stored in an immutable registry. Once registered, a schema version can never be modified. Updates create new version entries, preserving a complete audit history. This guarantees reproducible pipeline behavior across environments.

Validation Results

Each node shows its validation status in real time. Green indicates all connections are compatible. Red indicates a schema mismatch with details about which columns or types are incompatible. Yellow indicates a warning that may need attention. Nodes with no connections show a neutral state.

PII Detection

The schema engine automatically detects columns containing personally identifiable information (PII) in registered schemas. Nodes processing PII data are flagged with a PII badge, helping compliance teams track sensitive data flows through pipelines.