Currently, the dry runner requires you to pass in the schema columns of external tables created via dbt. Could this be made optional if the external table already exists? In our case, it's simply not practical to include the entire schema in the table config, and the schema changes over time.
This is the error we're getting:
[base] Node source.user_analytics__snowplow_events_data_product.idp.events failed with exception:
[base] Schema not specified in `columns` attribute in metadata
2025-04-10T10:05:12.807998120Z
[base] Total 1 failures:
[base] 1 : source.user_analytics__snowplow_events_data_product.idp.events : InvalidColumnSpecification : ERROR
[base] DRY RUN FAILURE!
Currently, the dry runner requires you to pass in the schema columns of external tables created via dbt. Could this be made optional if the external table already exists? In our case, it's simply not practical to include the entire schema in the table config, and the schema changes over time.
This is the error we're getting: