Upgrade project repos to support the latest Spark and Kubernetes versions

[jahstreet]

In the scope of this issue all the artifacts of the project will be upgraded to the latest stable versions.

[josechudev]

Hi! I am trying to run the helm chart in aks kubernetes 1.24, but I am struggling with the ingress controller and getting this error

How can I update this?

Thanks.

[vishakn]

@jahstreet any update on the timeline for this would be very much appreciated.

[josechudev]

@vishakn I found this fork. It works well as far as I tested.

[bntv-config]

Hi I am trying to Start the Livy with helm chart provided here https://github.com/JahstreetOrg/spark-on-kubernetes-helm/tree/master/charts/livy

But The livy pod is not coming up. I am using EKS cluster with k8s 1.27 version. The Pod is not gving any logs also.

Please suggest and help. @jahstreet

[josechudev]

@bntv-config I used this fork for 1.24, maybe it could work for you.