Add In-cluster support for k8

[venkatajagannath]

No description provided.

[pankajastro]

Hey @venkatajagannath, could you please provide a description and outline the limitations for this issue? Thanks!

[venkatajagannath]

Not a limitation as such.

Users can still use the same k8 cluster for OSS Airflow and Ray. In the current implementation, they would have to provide the kubeconfig manually.

To enable a feature within the connector where a user can select 'InCluster=True', we need to pass the kubeconfig as a file to the bash command that installs the kuberay operator.

[VinSnowski]

Hey, I have just stumbled upon this because I am running Airflow and Ray inside the same cluster. I was wondering if there is a reason that Ray Provider does not use the config.load_incluster_config() from kubernetes package to get the kubeconfig in the same way that the cnfc.kubernetes Provider in Airflow use? Is this simply something that is not implemented yet?