Skip to content

Spark Job getting stuck after upgrading to Snappydata 1.3.0 #1568

@parimalaadinarayan

Description

@parimalaadinarayan

val windowSpec: WindowSpec = Window.partitionBy("imsi").orderBy($"epochTime".asc) df = df.withColumn("Data", udf(SuspiciousActivityDetection.datUsageDetection(_: String, _: String, broadcastDataUsageEventToSubEventList)).apply($"subevent", $"event")) df.select().write.mode(SaveMode.Append).saveAsTable(tableName)
1.Above code used to work in Snappydata 1.1.0, after upgrading to 1.3.0 same code does not work.
2.Executors itself are not getting launched.
3.Where as after adding persist in between the code, it seems to work with newer version.
Please let us know why saveAsTable is not triggering any action?
And also why job is getting stuck?
Are there any new overloaded methods to saveAsTable that we are supposed to use?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions