Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BitSail][Feature] Support byte in type system #382

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

pikato2022
Copy link

@pikato2022 pikato2022 commented Feb 12, 2023

Signed-off-by:

Pre-Checklist

Note: Please complete ALL items in the following checklist.

  • I have read through the CONTRIBUTING.md documentation.
  • My code has the necessary comments and documentation (if needed).
  • I have added relevant tests.

Purpose

close [BitSail][Feature] Support byte in type system

Approaches

Some description about how this PR achives the purpose.
Add Byte Type to TypeInfoBridge map

Related Issues

Close #246

New Behavior (screenshots if needed)

N/A

@pikato2022
Copy link
Author

@BlockLiu Please help me review this pull request!
Thank you!

} else if (BasicTypeInfo.BOOLEAN_TYPE_INFO.getTypeClass().equals(typeClass) || BasicTypeInfo.INT_TYPE_INFO.getTypeClass().equals(typeClass) ||
}
else if (BasicTypeInfo.BYTE_TYPE_INFO.getTypeClass().equals(typeClass)) {
converter =
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We define check style in tools/maven/checkstyle.xml, and unfortunately it's not satisfied here.
You can reference this page to see if checkstyle is satisfied in IDEA.

@@ -39,7 +39,7 @@
public class Fake2HudiITCase {
private static final Logger LOG = LoggerFactory.getLogger(Fake2HudiITCase.class);
private static final String TEST_SCHEMA =
"[{\"name\":\"id\",\"type\":\"string\"},{\"name\":\"text\",\"type\":\"string\"},{\"name\":\"timestamp\",\"type\":\"string\"}]";
"[{\"name\":\"id\",\"type\":\"string\"},{\"name\":\"text\",\"type\":\"string\"},{\"name\":\"age\",\"type\":\"byte\"},{\"name\":\"timestamp\",\"type\":\"string\"}]";
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually the ITCase test will fail because byte type is not supported in com.bytedance.bitsail.connector.legacy.fake.source.FakeSource.
So I suggest focusing on FakeSource because it is a basic connenctor and widely used in various tests, and the modification to hudi connector can be ignored.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Noted, will update PR accordingly

@pikato2022
Copy link
Author

Hi @BlockLiu please help me review my pull request! Thank you!

Copy link
Member

@healchow healchow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BitSail][Feature] Support byte in type system.
3 participants