Skip to content

[Bug] [connector-jdbc-kingbase]Error in Jdbc Source with Kingbase8: Unsupported Field Data Types (e.g., smallint) during Catalog Table Lookup #8866

Open
@t1234849

Description

@t1234849

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:213)
at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineExample.main(SeaTunnelEngineExample.java:43)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'Jdbc'.
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:101)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:375)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:209)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:114)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:182)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:160)
... 2 more
Caused by: org.apache.seatunnel.common.exception.SeaTunnelRuntimeException: ErrorCode:[COMMON-20], ErrorDescription:['UNKNOWN' table 'select * from test.user' unsupported get catalog table with field data types '{"id":"smallint"}']
at org.apache.seatunnel.common.exception.CommonError.getCatalogTableWithUnsupportedType(CommonError.java:174)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:298)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.utils.CatalogUtils.getCatalogTable(CatalogUtils.java:255)
at org.apache.seatunnel.connectors.seatunnel.jdbc.utils.JdbcCatalogUtils.getCatalogTable(JdbcCatalogUtils.java:373)
at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource.readCatalogTable(JdbcSource.java:186)

SeaTunnel Version

seatunnel2.3.9

SeaTunnel Config

env {
    execution.parallelism = 1
    job.mode = "BATCH"
}

source {
    Jdbc {
        result_table_name = "ac640242cc8b4459ca7a356ecf33f3674"
        driver = "com.kingbase8.Driver"
        url = "jdbc:kingbase8://***:10015/test"
        user = *
        password = *
        query = "select * from test.user"
    }
}

transform {
    FieldMapper {
        source_table_name = "ac640242cc8b4459ca7a356ecf33f3674"
        result_table_name = "a68480cfa21d94da6a960c5b8fea9858c"
        field_mapper = {
            name = name
        }
    }
}

sink {
    MongoDB {
        result_table_name = "a68480cfa21d94da6a960c5b8fea9858c"
        uri = "mongodb://root:***@ip:10013/mydb?authSource=admin"
        database = "mydb"
        collection = users
        schema {
            fields {
                name = STRING
            }
        }
    }
}

Running Command

./seatunnel.sh --config kingbase.conf

Error Exception

ErrorCode:[COMMON-20], ErrorDescription:['UNKNOWN' table 'select * from test.user' unsupported get catalog table with field data types '{"id":"smallint"}']

Zeta or Flink or Spark Version

No response

Java or Scala Version

java8

Screenshots

Image

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions