Skip to content

Transformation via DBT connector(hive/Impala) doesn't display rows afffected #168

@tpatel-16

Description

@tpatel-16

Hello,

The dbt-hive and dbt-impala currently doesn't support displaying the number of rows processed or fetched after executing transformations Missing “rows processed/fecthed” information in dbt-hive and dbt-impala query output.

Observed behavior:

Transformations complete successfully, but no row count is shown in console output.

HiveServer2 and Impala both return a successful completion status, but cursor.rowcount may be -1.

Environment details:

CDP 7.1.9 SP1 (on-prem)

dbt-hive and dbt-impala built from:

https://github.com/cloudera/dbt-hive
https://github.com/cloudera/dbt-impala

Has this functionality been considered or planned in the adapters?
If not, is there any recommended way to extend the adapter to capture job counters or query profiles to surface row counts in dbt output?

This feature would improve transparency for validation and debugging during transformation runs.

Thank you !

dbt_issue.txt

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions