[VL] Add a docker build job and reuse pre-built arrow libs

[PHILO-HE]

1. Add a docker build job with the help of GHA. The DOCKERHUB_USER & DOCKERHUB_TOKEN secrets already set are used to login docker hub and push docker image. But these secrets are not available in pr from forked repo, which makes this pr's docker build job red.
2. Use the new docker in CI checks. As arrow libs (static lib, jar) are installed in docker image, build_arrow option can be turned off.

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

[zhztheplayer]

Are we planning to do the same on centos 8 build?

[PHILO-HE]

@zhztheplayer, yes, it would be better to also do this for centos-8 build. At least, those libs generated by arrow build (cpp/java) can be cached in docker to accelerate CI job when the current folder based cache miss happens.

[zhouyuan]

can we reuse the binary on centos 7?

[PHILO-HE]

@zhouyuan, I will try this.

[GlutenPerfBot]

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query	log/native_master_08_15_2024_time.csv	log/native_master_08_14_2024_1b619a0388_time.csv	difference	percentage
q1	40.51	39.02	-1.496	96.31%
q2	30.39	29.62	-0.770	97.46%
q3	53.23	51.65	-1.572	97.05%
q4	44.25	42.92	-1.331	96.99%
q5	102.93	103.89	0.968	100.94%
q6	12.09	11.18	-0.906	92.51%
q7	116.78	115.76	-1.020	99.13%
q8	117.10	115.92	-1.181	98.99%
q9	169.16	168.25	-0.910	99.46%
q10	66.73	65.66	-1.075	98.39%
q11	26.55	25.87	-0.683	97.43%
q12	30.12	30.71	0.591	101.96%
q13	51.22	51.84	0.623	101.22%
q14	24.79	26.31	1.518	106.12%
q15	54.28	53.60	-0.675	98.76%
q16	18.18	18.19	0.007	100.04%
q17	130.17	130.87	0.694	100.53%
q18	196.71	196.20	-0.510	99.74%
q19	27.00	28.20	1.195	104.43%
q20	47.52	43.48	-4.041	91.50%
q21	376.64	384.72	8.076	102.14%
q22	15.77	15.41	-0.367	97.67%
total	1752.12	1749.25	-2.867	99.84%

[zhouyuan]

can you please help to add one doc on how to use this?

[PHILO-HE]

@zhouyuan, I will do that. Thanks!

[zhouyuan]

Initially this is kept in case someone is using this script from a clean centos 7 image

[PHILO-HE]

@zhouyuan, maybe we can just tell user to refer weekly build job for building from clean image. centos-7/8/9, ubuntu-20.04/22.04 are covered in that job. I will document this guide. Thanks!