Skip to content

log-based replication not setting state bookmarks as expected #608

Open
@bdewilde

Description

@bdewilde

Hi! I've been struggling to get log-based replication to work for this tap, and am wondering if it's user error or something else...

If I spin up a fresh source db and put a bunch of records into it, then log-based replication works as expected -- but only the first time. If I remove the pipeline's record from the state table and start fresh, meltano correctly notes that "No state was found, complete import.", but then it doesn't actually import any records, and adds a state record with null bookmarks, like

2025-04-04T16:02:13.661207Z [info     ] Emitting completed target state {"bookmarks": {"STREAM1": {}, "STREAM2": {}, ...}}

The same thing happens if I use the --full-refresh flag.

I do have multiple instances of tap-postgres (because I'm trying to smoothly migrate from the pipelinewise variant to this one), so possibly I'm getting hit by issue #321 ? This is all pretty weird, and I'm not sure what additional info would be helpful to diagnose. Thanks in advance for your help!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions