Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-6887][VL] Daily Update Velox Version (2024_08_21) #6946

Merged
merged 1 commit into from
Aug 21, 2024

Conversation

GlutenPerfBot
Copy link
Contributor

Upstream Velox's New Commits:

82bad7944 by rui-mo, Add Spark query runner (10357)
b140bb7b1 by rui-mo, Pass aggregate pool to query runner's constructor (10568)
59025aa34 by Christian Zentgraf, Fix error on multiple inclusions of FindArrow CMake (10723)
55888da7e by Jialiang Tan, Release excessively reserved memory in HashBuild even if non-reclaimable (10782)
9e48da678 by Ke, Fix approxPercentile compact function for float and double (10786)
e461d52bc by Jimmy Lu, Schema evolution support for reader value hooks (10755)
e2c2f2519 by Jimmy Lu, Fix filter on missing field (10777)
4810dc3b8 by Jialiang Tan, Make memory pool dbg message more readable (10778)

Copy link

#6887

@zhouyuan
Copy link
Contributor

@GlutenPerfBot benchmark

@GlutenPerfBot
Copy link
Contributor Author

ACK, will benchmark TPCH/DS on this pull request

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6946_time.csv log/native_master_08_20_2024_11a236dd86_time.csv difference percentage
q1 39.78 40.11 0.327 100.82%
q2 30.33 30.06 -0.269 99.11%
q3 53.45 51.48 -1.965 96.32%
q4 43.64 42.79 -0.849 98.06%
q5 102.17 104.90 2.726 102.67%
q6 11.10 13.17 2.066 118.61%
q7 114.03 116.23 2.204 101.93%
q8 115.09 114.60 -0.489 99.58%
q9 169.30 170.51 1.212 100.72%
q10 64.30 66.72 2.423 103.77%
q11 27.18 27.42 0.232 100.85%
q12 30.42 29.40 -1.016 96.66%
q13 51.71 51.67 -0.043 99.92%
q14 26.74 25.66 -1.078 95.97%
q15 56.74 55.42 -1.323 97.67%
q16 19.51 18.68 -0.830 95.74%
q17 129.63 129.49 -0.142 99.89%
q18 197.56 196.79 -0.770 99.61%
q19 30.24 26.43 -3.802 87.42%
q20 40.14 43.34 3.199 107.97%
q21 384.99 375.24 -9.751 97.47%
q22 15.21 15.35 0.131 100.86%
total 1753.25 1745.45 -7.806 99.55%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6946_time.csv log/native_master_08_20_2024_11a236dd86_time.csv difference percentage
q1 14.31 14.25 -0.053 99.63%
q2 13.87 14.04 0.169 101.22%
q3 4.27 4.56 0.290 106.79%
q4 70.61 71.77 1.155 101.64%
q5 7.47 9.38 1.910 125.57%
q6 2.28 3.59 1.307 157.34%
q7 7.18 4.78 -2.407 66.49%
q8 3.50 5.32 1.826 152.23%
q9 23.92 24.50 0.576 102.41%
q10 10.16 9.92 -0.234 97.69%
q11 38.71 38.51 -0.200 99.48%
q12 1.39 1.38 -0.012 99.17%
q13 6.47 6.51 0.035 100.53%
q14a 44.88 46.89 2.010 104.48%
q14b 41.70 43.62 1.928 104.62%
q15 2.77 2.50 -0.273 90.14%
q16 46.24 46.35 0.113 100.24%
q17 5.22 5.00 -0.220 95.79%
q18 8.22 8.62 0.399 104.85%
q19 2.26 2.11 -0.150 93.34%
q20 1.48 1.51 0.027 101.85%
q21 1.18 1.07 -0.117 90.10%
q22 7.95 7.77 -0.182 97.72%
q23a 103.30 104.27 0.970 100.94%
q23b 128.40 126.59 -1.811 98.59%
q24a 110.92 105.12 -5.801 94.77%
q24b 111.77 118.20 6.432 105.75%
q25 4.04 4.31 0.271 106.71%
q26 3.14 3.13 -0.019 99.39%
q27 4.10 4.68 0.582 114.18%
q28 32.42 34.42 1.997 106.16%
q29 11.13 12.40 1.269 111.41%
q30 4.91 5.82 0.905 118.42%
q31 7.46 7.03 -0.431 94.23%
q32 1.35 1.20 -0.152 88.74%
q33 4.29 4.34 0.052 101.21%
q34 4.17 3.75 -0.422 89.88%
q35 9.05 7.92 -1.123 87.59%
q36 4.68 4.77 0.088 101.87%
q37 5.69 4.91 -0.779 86.30%
q38 14.28 13.48 -0.802 94.39%
q39a 3.41 3.11 -0.298 91.25%
q39b 2.58 2.88 0.297 111.50%
q40 4.01 3.92 -0.088 97.81%
q41 0.66 0.67 0.014 102.18%
q42 0.98 0.96 -0.023 97.69%
q43 4.68 4.65 -0.033 99.30%
q44 10.11 10.08 -0.024 99.76%
q45 3.18 3.35 0.177 105.57%
q46 3.76 3.63 -0.130 96.54%
q47 18.57 18.61 0.032 100.17%
q48 5.41 5.28 -0.135 97.50%
q49 8.92 9.01 0.090 101.01%
q50 21.41 21.62 0.216 101.01%
q51 10.34 9.97 -0.367 96.45%
q52 1.10 1.06 -0.046 95.85%
q53 2.49 2.47 -0.020 99.19%
q54 3.98 3.88 -0.097 97.55%
q55 1.15 1.42 0.266 123.10%
q56 4.17 4.35 0.183 104.39%
q57 11.38 11.39 0.002 100.02%
q58 2.44 2.45 0.010 100.40%
q59 11.43 11.01 -0.425 96.28%
q60 4.01 4.11 0.101 102.51%
q61 4.14 4.15 0.011 100.26%
q62 4.42 4.59 0.169 103.83%
q63 2.32 2.45 0.132 105.71%
q64 63.19 60.37 -2.814 95.55%
q65 17.57 18.96 1.394 107.93%
q66 4.31 4.13 -0.182 95.77%
q67 393.38 381.80 -11.575 97.06%
q68 4.73 3.65 -1.085 77.08%
q69 6.13 5.47 -0.662 89.21%
q70 11.75 11.77 0.019 100.17%
q71 2.68 2.54 -0.145 94.59%
q72 215.41 215.14 -0.263 99.88%
q73 2.47 2.36 -0.112 95.47%
q74 23.32 23.43 0.111 100.48%
q75 26.86 27.04 0.179 100.67%
q76 11.62 11.08 -0.541 95.35%
q77 2.18 2.19 0.007 100.33%
q78 49.53 52.27 2.741 105.54%
q79 4.01 3.79 -0.218 94.57%
q80 12.80 12.45 -0.354 97.24%
q81 4.87 4.86 -0.012 99.75%
q82 7.15 7.45 0.303 104.23%
q83 1.81 1.64 -0.166 90.81%
q84 2.67 2.91 0.238 108.92%
q85 7.18 7.50 0.322 104.49%
q86 4.00 4.16 0.157 103.93%
q87 13.93 13.78 -0.156 98.88%
q88 21.99 21.90 -0.081 99.63%
q89 3.79 3.78 -0.007 99.82%
q90 3.25 3.50 0.248 107.62%
q91 2.13 2.41 0.279 113.11%
q92 1.31 1.26 -0.042 96.81%
q93 34.50 39.13 4.625 113.41%
q94 24.40 25.60 1.199 104.91%
q9 87.45 90.71 3.263 103.73%
q5 2.98 2.73 -0.246 91.74%
q96 17.41 17.33 -0.077 99.56%
q97 1.92 1.94 0.027 101.43%
q98 10.65 10.59 -0.067 99.37%
q99 10.65 10.59 -0.067 99.37%
total 2187.55 2192.99 5.446 100.25%

@zhouyuan zhouyuan merged commit be35d57 into apache:main Aug 21, 2024
41 checks passed
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
Upstream Velox's New Commits:

82bad7944 by rui-mo, Add Spark query runner (10357)
b140bb7b1 by rui-mo, Pass aggregate pool to query runner's constructor (10568)
59025aa34 by Christian Zentgraf, Fix error on multiple inclusions of FindArrow CMake (10723)
55888da7e by Jialiang Tan, Release excessively reserved memory in HashBuild even if non-reclaimable (10782)
9e48da678 by Ke, Fix approxPercentile compact function for float and double (10786)
e461d52bc by Jimmy Lu, Schema evolution support for reader value hooks (10755)
e2c2f2519 by Jimmy Lu, Fix filter on missing field (10777)
4810dc3b8 by Jialiang Tan, Make memory pool dbg message more readable (10778)

Signed-off-by: glutenperfbot <[email protected]>
Co-authored-by: glutenperfbot <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants