Skip to content

Table Write Stage failing with fte mode enabled #25590

Open
@BalaMahesh

Description

@BalaMahesh

Hello All, I am trying to enable FTE on our etl trino cluster. I am facing challenges particularly with the TableWriter stage of the query. Number of tasks created in FTE mode are huge than non-fte and all of them were failing with hive metastore error.

"taskStatus":{"taskId":"20250416_010518_00012_p2fu8.1.1.0","taskInstanceId":"972393db-d958-4274-9175-c263b9106900","version":2,"state":"FAILED","self":"<http://10.205.41.134:8080/v1/task/20250416_010518_00012_p2fu8.1.1.0>","nodeId":"ocd-trino-engg-worker-85476956f-2qvvn","speculative":false,"failures":[{"type":"io.trino.spi.TrinoException","message":"Failed connecting to Hive metastore: [10.204.35.3:9083]","cause":{"type":"org.apache.thrift.TException","message":"Failed connecting to Hive metastore: [10.204.35.3:9083]","cause":{"type":"org.apache.thrift.transport.TTransportException","message":"10.204.35.3:9083: java.net.SocketTimeoutException: Connect timed out","cause":{"type":"org.apache.thrift.transport.TTransportException","message":"java.net.SocketTimeoutException: Connect timed out","cause":{"type":"<http://java.net|java.net>.SocketTimeoutException","message":"Connect timed out","suppressed":[],"stack":["java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:546)","java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:592)","java.base/java.net.Socket.connect(Socket.java:760)","io.trino.plugin.hive.metastore.thrift.Transport.createRaw(Transport.java:75)","io.trino.plugin.hive.metastore.thrift.Transport.create(Transport.java:47)"

Image Image

Without fte mode, same query is finishing without any problems.

Image

Slack Message

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions