Skip to content

Conversation

@gary-mguo
Copy link
Collaborator

@gary-mguo gary-mguo commented Apr 3, 2021

This PR includes the following changes:

  • Properly handle exceptions during task start and make sure remaining tasks can continue to start
  • fix checkstyle issue for the existing code
  • update logging statement to comply with better coding practice
  • fix the py3 support the commit-msg git hook
  • add docker support and also update scripts to enable debug via parameters
  • add metrics for jdbc connector tasks (throughput of processed rows, and success/failures for task startup)

Dockerfile Outdated
@@ -0,0 +1,16 @@
FROM adoptopenjdk/openjdk8
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would create a "docker" directory and store this file inside that directory.

For the JDK, you could also use this image: "wayfair/maven-openjdk8:0.9.2"

});
_committingCheckpoint = checkpoint;
}
recordJdbcTaskMetrics(arrayRecords, METRIC_NUMBER_OF_ROWS_PROCESSED);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move to line 26 and add an else statement

this.poll();
} catch (Exception e) {
_logger.warn("Failed poll. {}", e);
_logger.warn("Failed poll. id: {}, url: {}, topic: {}",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be "error" instead of "warm"?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add data stream name into the logger.

Copy link
Collaborator

@r2d2li r2d2li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants