Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [dinky-admin] org.dinky.shaded.paimon.codegen.CodeGeneratorImpl cannot be loaded properly in local mode #3354

Closed
3 tasks done
sgsdehen opened this issue Apr 3, 2024 · 2 comments
Labels
Bug Something isn't working

Comments

@sgsdehen
Copy link
Contributor

sgsdehen commented Apr 3, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

org.dinky.shaded.paimon.codegen.CodeGeneratorImpl 在local模式下不能正常加载,日志会持续抛出如下异常:
[dinky] 2024-04-03 20:27:27 CST ERROR org.dinky.context.MetricsContextHolder 79 lambda$sendAsync$1 - send metrics async error java.util.concurrent.CompletionException: java.lang.RuntimeException: java.lang.RuntimeException: Found 0 classes implementing org.dinky.shaded.paimon.codegen.CodeGenerator. They are:
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_321]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_321]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1643) ~[?:1.8.0_321]
at java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1632) ~[?:1.8.0_321]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) ~[?:1.8.0_321]
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067) ~[?:1.8.0_321]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703) ~[?:1.8.0_321]
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172) ~[?:1.8.0_321]
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Found 0 classes implementing org.dinky.shaded.paimon.codegen.CodeGenerator. They are:
at org.dinky.utils.PaimonUtil.write(PaimonUtil.java:170) ~[dinky-admin-1.0.1-SNAPSHOT.jar:?]
at org.dinky.context.MetricsContextHolder.lambda$sendAsync$0(MetricsContextHolder.java:70) ~[dinky-admin-1.0.1-SNAPSHOT.jar:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_321]
... 5 more
Caused by: java.lang.RuntimeException: Found 0 classes implementing org.dinky.shaded.paimon.codegen.CodeGenerator. They are:

at org.dinky.shaded.paimon.codegen.CodeGenLoader.getCodeGenerator(CodeGenLoader.java:46) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.codegen.CodeGenUtils.generateRecordComparator(CodeGenUtils.java:57) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.utils.KeyComparatorSupplier.<init>(KeyComparatorSupplier.java:39) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.KeyValueFileStore.<init>(KeyValueFileStore.java:90) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.table.PrimaryKeyFileStoreTable.store(PrimaryKeyFileStoreTable.java:110) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.table.PrimaryKeyFileStoreTable.newWrite(PrimaryKeyFileStoreTable.java:185) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.table.PrimaryKeyFileStoreTable.newWrite(PrimaryKeyFileStoreTable.java:178) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.table.PrimaryKeyFileStoreTable.newWrite(PrimaryKeyFileStoreTable.java:56) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.shaded.paimon.table.sink.BatchWriteBuilderImpl.newWrite(BatchWriteBuilderImpl.java:61) ~[dinky-shaded-paimon-1.0.1.jar:?]
at org.dinky.utils.PaimonUtil.write(PaimonUtil.java:127) ~[dinky-admin-1.0.1-SNAPSHOT.jar:?]
at org.dinky.context.MetricsContextHolder.lambda$sendAsync$0(MetricsContextHolder.java:70) ~[dinky-admin-1.0.1-SNAPSHOT.jar:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_321]
... 5 more

What you expected to happen

监控数据PaimonUtil.write()正常执行并落盘

How to reproduce

使用如下sql 执行查询,会触发此bug
CREATE TABLE source_datagen(
id BIGINT,
money BIGINT
) WITH(
'connector' = 'datagen',
'rows-per-second' = '1',
'fields.id.min' = '1',
'fields.id.max' = '100000',
'fields.money.min' = '1',
'fields.money.max' = '100000'
);
print source_datagen ;

Anything else

No response

Version

dev

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@sgsdehen sgsdehen added Bug Something isn't working Waiting for reply Waiting for reply labels Apr 3, 2024
sgsdehen pushed a commit to sgsdehen/dinky that referenced this issue Apr 3, 2024
sgsdehen pushed a commit to sgsdehen/dinky that referenced this issue Apr 3, 2024
@aiwenmo aiwenmo removed the Waiting for reply Waiting for reply label Apr 3, 2024
@Zzm0809 Zzm0809 closed this as completed Apr 5, 2024
@shuai1998
Copy link

我也遇到了,怎么解决的

@sgsdehen
Copy link
Contributor Author

sgsdehen commented Apr 8, 2024

我也遇到了,怎么解决的

#3355

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants