Skip to content

Conversation

@pikato2022
Copy link

@pikato2022 pikato2022 commented Feb 12, 2023

Signed-off-by:

Pre-Checklist

Note: Please complete ALL items in the following checklist.

  • I have read through the CONTRIBUTING.md documentation.
  • My code has the necessary comments and documentation (if needed).
  • I have added relevant tests.

Purpose

close [BitSail][Feature] Support byte in type system

Approaches

Some description about how this PR achives the purpose.
Add Byte Type to TypeInfoBridge map

Related Issues

Close #246

New Behavior (screenshots if needed)

N/A

@pikato2022
Copy link
Author

@BlockLiu Please help me review this pull request!
Thank you!

} else if (BasicTypeInfo.BOOLEAN_TYPE_INFO.getTypeClass().equals(typeClass) || BasicTypeInfo.INT_TYPE_INFO.getTypeClass().equals(typeClass) ||
}
else if (BasicTypeInfo.BYTE_TYPE_INFO.getTypeClass().equals(typeClass)) {
converter =
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We define check style in tools/maven/checkstyle.xml, and unfortunately it's not satisfied here.
You can reference this page to see if checkstyle is satisfied in IDEA.

private static final Logger LOG = LoggerFactory.getLogger(Fake2HudiITCase.class);
private static final String TEST_SCHEMA =
"[{\"name\":\"id\",\"type\":\"string\"},{\"name\":\"text\",\"type\":\"string\"},{\"name\":\"timestamp\",\"type\":\"string\"}]";
"[{\"name\":\"id\",\"type\":\"string\"},{\"name\":\"text\",\"type\":\"string\"},{\"name\":\"age\",\"type\":\"byte\"},{\"name\":\"timestamp\",\"type\":\"string\"}]";
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually the ITCase test will fail because byte type is not supported in com.bytedance.bitsail.connector.legacy.fake.source.FakeSource.
So I suggest focusing on FakeSource because it is a basic connenctor and widely used in various tests, and the modification to hudi connector can be ignored.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Noted, will update PR accordingly

@pikato2022
Copy link
Author

Hi @BlockLiu please help me review my pull request! Thank you!

Copy link
Member

@healchow healchow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BitSail][Feature] Support byte in type system.

3 participants