Skip to content

Snapshot and DUPLICATE_COLUMN #438

Open
@silentsokolov

Description

@silentsokolov

Describe the bug

re-running the command results in an error

Code: 15. DB::Exception: Column dbt_change_type specified more than once. (DUPLICATE_COLUMN) (version 24.8.9.95 (official build))

Steps to reproduce

  1. Create snapshot
{% snapshot name %}

{{
    config(
      unique_key="id",
      strategy="check",
      check_cols=["all"],
    )
}}

select * from mysql(ACCESS, table = 'NAME')

{% endsnapshot %}
  1. Run dbt snapshot
  2. Run dbt snapshot

Expected behaviour

Success update

dbt and/or ClickHouse server logs

10:05:45  Running with dbt=1.8.9
10:05:45  Registered adapter: clickhouse=1.8.9
10:05:45  Unable to do partial parsing because saved manifest not found. Starting full parse.
10:05:51  Found N models -----
10:05:51
10:05:54  Concurrency: 1 threads (target='ci')
10:05:54
10:05:54  1 of 1 START snapshot `db`.`name` .................................. [RUN]
10:06:00  1 of 1 ERROR snapshotting `db`.`name` .............................. [ERROR in 5.79s]
10:06:00
10:06:00
10:06:00  Finished running 1 snapshot, 1 project hook in 0 hours 0 minutes and 9.23 seconds (9.23s).
10:06:00
10:06:00  Completed with 1 error and 0 warnings:
10:06:00
10:06:00    Database Error in snapshot name (snapshots/name.sql)
  HTTPDriver for http://***:8123 received ClickHouse error code 15
   Code: 15. DB::Exception: Column dbt_change_type specified more than once. (DUPLICATE_COLUMN) (version 24.8.9.95 (official build))
10:06:00
10:06:00  Done. PASS=0 WARN=0 ERROR=1 SKIP=0 TOTAL=1

Configuration

Environment

  • dbt version: 1.8.9
  • dbt-clickhouse version: 1.8.9
  • clickhouse-connect version (if using http): 0.8.16
  • Python version: 3.11
  • Operating system: Ubuntu / MacOS

ClickHouse server

  • ClickHouse Server version: 24.8.9.95

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions