[VL][GLUTEN-8020] Remove the libhdfs3 installation script required for static linking

[JkSelf]

What changes were proposed in this pull request?

We will only retain the dynamic libraries libhdfs.so or libhdfs3.so at runtime based on this benchmark here. So there is no need to keep the libhdfs3 installation script required for static linking.

How was this patch tested?

Existing compile scripts.

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

[PHILO-HE]

@JkSelf, can we also remove ENABLE_HDFS option from some build scripts?

[zhouyuan]

@JkSelf could you please help to link with the right Issue?

[github-actions]

#8020

[PHILO-HE]

@JkSelf, can we also remove ENABLE_HDFS option from some build scripts?

Seems we still need it for deciding whether to register hdfs filesystem.

[JkSelf]

@JkSelf, can we also remove ENABLE_HDFS option from some build scripts?

Seems we still need it for deciding whether to register hdfs filesystem.

Yes. We also need to pass the enable_hdfs to velox compile scripts.

[FelixYBW]

@JkSelf is document updated?

[yabinma]

The changes is helpful for #7977 , libhdfs3 compile issue found during the test. I will bypass the libhdfs3.