Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dinky1.2 flink1.5X problem #4058

Closed
3 tasks done
zhaixinying521 opened this issue Dec 17, 2024 · 3 comments
Closed
3 tasks done

dinky1.2 flink1.5X problem #4058

zhaixinying521 opened this issue Dec 17, 2024 · 3 comments
Labels
Bug Something isn't working

Comments

@zhaixinying521
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Caused by: java.lang.RuntimeException: Unsupported parser type for getCalciteParserSupplier: org.apache.flink.table.planner.delegation.ParserImpl
at org.dinky.parser.CustomParserImpl.getCalciteParserSupplier(CustomParserImpl.java:57) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.parser.CustomParserImpl.(CustomParserImpl.java:47) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.(CustomTableEnvironmentImpl.java:128) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:185) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:134) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.createCustomTableEnvironment(LocalStreamExecutor.java:72) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.Executor.init(Executor.java:180) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.(LocalStreamExecutor.java:67) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildLocalExecutor(ExecutorFactory.java:52) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildExecutor(ExecutorFactory.java:44) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.init(JobManager.java:217) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.buildPlanMode(JobManager.java:201) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.lambda$getJobManager$2b450759$1(StudioServiceImpl.java:215) ~[dinky-admin-1.2.0-rc5.jar:?]
at cn.hutool.core.lang.func.Func0.callWithRuntimeException(Func0.java:36) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:137) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:120) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.Cache.get(Cache.java:78) ~[hutool-all-5.8.31.jar:5.8.31]
at org.dinky.service.impl.StudioServiceImpl.getJobManager(StudioServiceImpl.java:213) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.getMSCatalogs(StudioServiceImpl.java:157) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl$$FastClassBySpringCGLIB$$2cea1b8b.invoke() ~[dinky-admin-1.2.0-rc5.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.31.jar:5.3.31]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.2.0-rc5.jar:?]
... 111 more

What you expected to happen

解决

How to reproduce

Caused by: java.lang.RuntimeException: Unsupported parser type for getCalciteParserSupplier: org.apache.flink.table.planner.delegation.ParserImpl
at org.dinky.parser.CustomParserImpl.getCalciteParserSupplier(CustomParserImpl.java:57) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.parser.CustomParserImpl.(CustomParserImpl.java:47) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.(CustomTableEnvironmentImpl.java:128) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:185) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:134) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.createCustomTableEnvironment(LocalStreamExecutor.java:72) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.Executor.init(Executor.java:180) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.(LocalStreamExecutor.java:67) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildLocalExecutor(ExecutorFactory.java:52) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildExecutor(ExecutorFactory.java:44) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.init(JobManager.java:217) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.buildPlanMode(JobManager.java:201) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.lambda$getJobManager$2b450759$1(StudioServiceImpl.java:215) ~[dinky-admin-1.2.0-rc5.jar:?]
at cn.hutool.core.lang.func.Func0.callWithRuntimeException(Func0.java:36) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:137) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:120) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.Cache.get(Cache.java:78) ~[hutool-all-5.8.31.jar:5.8.31]
at org.dinky.service.impl.StudioServiceImpl.getJobManager(StudioServiceImpl.java:213) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.getMSCatalogs(StudioServiceImpl.java:157) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl$$FastClassBySpringCGLIB$$2cea1b8b.invoke() ~[dinky-admin-1.2.0-rc5.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.31.jar:5.3.31]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.2.0-rc5.jar:?]
... 111 more

Anything else

Caused by: java.lang.RuntimeException: Unsupported parser type for getCalciteParserSupplier: org.apache.flink.table.planner.delegation.ParserImpl
at org.dinky.parser.CustomParserImpl.getCalciteParserSupplier(CustomParserImpl.java:57) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.parser.CustomParserImpl.(CustomParserImpl.java:47) ~[dinky-client-base-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.(CustomTableEnvironmentImpl.java:128) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:185) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.CustomTableEnvironmentImpl.create(CustomTableEnvironmentImpl.java:134) ~[dinky-client-1.15-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.createCustomTableEnvironment(LocalStreamExecutor.java:72) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.Executor.init(Executor.java:180) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.LocalStreamExecutor.(LocalStreamExecutor.java:67) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildLocalExecutor(ExecutorFactory.java:52) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.executor.ExecutorFactory.buildExecutor(ExecutorFactory.java:44) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.init(JobManager.java:217) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.job.JobManager.buildPlanMode(JobManager.java:201) ~[dinky-core-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.lambda$getJobManager$2b450759$1(StudioServiceImpl.java:215) ~[dinky-admin-1.2.0-rc5.jar:?]
at cn.hutool.core.lang.func.Func0.callWithRuntimeException(Func0.java:36) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:137) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.impl.AbstractCache.get(AbstractCache.java:120) ~[hutool-all-5.8.31.jar:5.8.31]
at cn.hutool.cache.Cache.get(Cache.java:78) ~[hutool-all-5.8.31.jar:5.8.31]
at org.dinky.service.impl.StudioServiceImpl.getJobManager(StudioServiceImpl.java:213) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl.getMSCatalogs(StudioServiceImpl.java:157) ~[dinky-admin-1.2.0-rc5.jar:?]
at org.dinky.service.impl.StudioServiceImpl$$FastClassBySpringCGLIB$$2cea1b8b.invoke() ~[dinky-admin-1.2.0-rc5.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.31.jar:5.3.31]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.2.0-rc5.jar:?]
... 111 more

Version

1.2.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@zhaixinying521 zhaixinying521 added Bug Something isn't working Waiting for reply Waiting for reply labels Dec 17, 2024
@github-actions github-actions bot changed the title dinky1.2 flink1.5X问题 dinky1.2 flink1.5X problem Dec 17, 2024
@naah69
Copy link

naah69 commented Dec 30, 2024

we had the same problem

@naah69
Copy link

naah69 commented Dec 30, 2024

已解决:要配置这个
image

@aiwenmo
Copy link
Contributor

aiwenmo commented Dec 30, 2024

Starting from Flink 1.15, the distribution contains two planners:

  • flink-table-planner_2.12-1.20.0.jar, in /opt, contains the query planner
  • flink-table-planner-loader-1.20.0.jar, loaded by default in /lib, contains the query planner hidden behind an isolated classpath (you won’t be able to address any io.apache.flink.table.planner directly)
    The two planner JARs contain the same code, but they are packaged differently. In the first case, you must use the same Scala version of the JAR. In second case, you do not need to make considerations about Scala, since it is hidden inside the JAR.

By default,flink-table-planner-loader is used by the distribution. If you need to access and use the internals of the query planner, you can swap the JARs (copying and pasting flink-table-planner_2.12.jar in the distribution /lib folder). Be aware that you will be constrained to using the Scala version of the Flink distribution that you are using.

@aiwenmo aiwenmo removed the Waiting for reply Waiting for reply label Dec 30, 2024
@aiwenmo aiwenmo closed this as completed Dec 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants