Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: Livy Scala Api #70

Open
jdcohen220 opened this issue Aug 23, 2021 · 1 comment
Open

Question: Livy Scala Api #70

jdcohen220 opened this issue Aug 23, 2021 · 1 comment

Comments

@jdcohen220
Copy link

What version of scala/spark do client applications need to use?
The image says Spark 3.0.1 but Livy api requires Scala 2.11 which only works with earlier versions of Spark.

I am getting a ClassNotFound error when trying to submit a job:
00:20 WARN: [kryo] Unable to load class org.apache.livy.scalaapi.LivyScalaClient$$anon$1 with kryo's ClassLoader. Retrying with current..
21/08/23 19:14:12 INFO JobWrapper: Failed to run job b3353a3c-2140-4d4c-94c2-520473152ec2
org.apache.livy.shaded.kryo.kryo.KryoException: Unable to find class: org.apache.livy.scalaapi.LivyScalaClient$$anon$1

@jahstreet
Copy link
Collaborator

Hi @jdcohen220 , sorry for the late reply, getting back to this project only now 🙏 .

Is it still an issue for you? Happy to guide you through the resolution in case you provide me the details on reproducing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants