Skip to content

COPY command fails with FORMAT AS JSON 'auto' #58

@peterlitvak

Description

@peterlitvak

The following command:

COPY event1f0fbc67_3680_46e8_a19f_09948950d2be FROM 's3://test-redshift/event/e30aef8d-996a-404e-8a5a-899dc00d1364' 
CREDENTIALS '...' 
TIMEFORMAT 'YYYY-MM-DD HH:MI:SS'
ENCODING UTF16LE
FORMAT AS JSON 'auto';

Fails with:

jp.ne.opt.redshiftfake.FakeAmazonSQLException: Row List(Column(Some({))) has different value count then Vector(ColumnDefinition(id,Varchar), ...)

I've checked in a debugger and content is read from S3 successfully but then when it comes to:

case CopyFormat.Json(Some(jsonpathsLocation))

the execution skips it and goes to the manifest case.
It appears that only JSONPaths JSON format is supported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions