Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CH-247] support async reader when reading parquet from hdfs #248

Open
wants to merge 670 commits into
base: clickhouse_backend
Choose a base branch
from
Open

[CH-247] support async reader when reading parquet from hdfs #248

wants to merge 670 commits into from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Dec 14, 2021

  1. Merge pull request ClickHouse#32284 from ClickHouse/backport/21.9/32117 

    Backport ClickHouse#32117 to 21.9: Dictionaries custom query condition fix
    @kitaisreal
    kitaisreal authored Dec 14, 2021
    Configuration menu
    Copy the full SHA
    8d53407 View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#32712 from ClickHouse/backport/21.9/32359 

    Backport ClickHouse#32359 to 21.9: Fix usage of non-materialized skip indexes
    @CurtizJ
    CurtizJ authored Dec 14, 2021
    Configuration menu
    Copy the full SHA
    6a734ad View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2021

  1. Backport ClickHouse#32755 to 21.9: fix crash fuzzbits with multiply s… 

    …ame fixedstring
    robot-clickhouse committed Dec 15, 2021
    Configuration menu
    Copy the full SHA
    3bb99f5 View commit details
    Browse the repository at this point in the history

  2. Update Dockerfile

    @kssenii
    kssenii authored Dec 15, 2021
    Configuration menu
    Copy the full SHA
    324833a View commit details
    Browse the repository at this point in the history

  3. add benchmark code

    neng.liu committed Dec 15, 2021
    Configuration menu
    Copy the full SHA
    7d607a7 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'ch/21.9' into backport/21.9/32201

    @tavplubix
    tavplubix committed Dec 15, 2021
    Configuration menu
    Copy the full SHA
    2466173 View commit details
    Browse the repository at this point in the history

  5. Merge pull request ClickHouse#31954 from ClickHouse/backport/21.9/31859 

    Backport ClickHouse#31859 to 21.9: keeper session timeout doesn't work
    @alesapin
    alesapin authored Dec 15, 2021
    Configuration menu
    Copy the full SHA
    ab49415 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2021

  1. Merge pull request ClickHouse#32718 from ClickHouse/backport/21.9/27822 

    Backport ClickHouse#27822 to 21.9: Fix data race in ProtobufSchemas
    Vitaly Baranov authored Dec 16, 2021
    Configuration menu
    Copy the full SHA
    750cdda View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#32541 from ClickHouse/backport/21.9/32201 

    Backport ClickHouse#32201 to 21.9: Try fix 'Directory tmp_merge_<part_name>' already exists
    @tavplubix
    tavplubix authored Dec 16, 2021
    Configuration menu
    Copy the full SHA
    a203597 View commit details
    Browse the repository at this point in the history

  3. Merge pull request ClickHouse#32790 from ClickHouse/backport/21.9/32755 

    Backport ClickHouse#32755 to 21.9: fix crash fuzzbits with multiply same fixedstring
    @alesapin
    alesapin authored Dec 16, 2021
    Configuration menu
    Copy the full SHA
    a6b6067 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2021

  1. fix memory error

    neng.liu committed Dec 17, 2021
    Configuration menu
    Copy the full SHA
    99c9b95 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2021

  1. init code of Q6

    neng.liu committed Dec 22, 2021
    Configuration menu
    Copy the full SHA
    0d74c6e View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2021

  1. support filter and aggregate

    neng.liu committed Dec 27, 2021
    Configuration menu
    Copy the full SHA
    0972cb4 View commit details
    Browse the repository at this point in the history

  2. fix benchmark error

    neng.liu committed Dec 27, 2021
    Configuration menu
    Copy the full SHA
    6ddfb92 View commit details
    Browse the repository at this point in the history

  3. add agg benchmark

    neng.liu committed Dec 27, 2021
    Configuration menu
    Copy the full SHA
    643dd25 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2021

  1. support Q6 benchmark

    neng.liu committed Dec 28, 2021
    Configuration menu
    Copy the full SHA
    1cbe87e View commit details
    Browse the repository at this point in the history

  2. fix ut errors

    neng.liu committed Dec 28, 2021
    Configuration menu
    Copy the full SHA
    bdca247 View commit details
    Browse the repository at this point in the history

  3. support type date

    neng.liu committed Dec 28, 2021
    Configuration menu
    Copy the full SHA
    387e53b View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2021

  1. upgrade substrait

    Neng Liu committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    45ebf02 View commit details
    Browse the repository at this point in the history

  2. print test result

    neng.liu committed Dec 29, 2021
    Configuration menu
    Copy the full SHA
    8a9e4a1 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2021

  1. upgrade substrait

    neng.liu committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    2aff015 View commit details
    Browse the repository at this point in the history

  2. fix read rel

    neng.liu committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    110eb99 View commit details
    Browse the repository at this point in the history

  3. add rpm config

    neng.liu committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    6c04e84 View commit details
    Browse the repository at this point in the history

  4. add rpm config

    neng.liu committed Dec 30, 2021
    Configuration menu
    Copy the full SHA
    e97fa5c View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2022

  1. add rpm config

    neng.liu committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    72348ed View commit details
    Browse the repository at this point in the history

  2. add rpm config

    neng.liu committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    76b6623 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2022

  1. remove runtime dependency

    neng.liu committed Jan 5, 2022
    Configuration menu
    Copy the full SHA
    f2ad0e3 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2022

  1. support equal to

    neng.liu committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    d8365fb View commit details
    Browse the repository at this point in the history

  2. fix ut fail

    neng.liu committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    c1c365f View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2022

  1. Fix start index

    @zzcclp
    zzcclp committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    7e18c9a View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2022

  1. Merge pull request ClickHouse#1 from liuneng1994/fix_start_index 

    Fix start index
    @liuneng1994
    liuneng1994 authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    9c989c7 View commit details
    Browse the repository at this point in the history

  2. support duckdb parquet reader

    neng.liu committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    ddc9ee3 View commit details
    Browse the repository at this point in the history

  3. support date

    neng.liu committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    67b93aa View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2022

  1. some optimize

    neng.liu committed Jan 24, 2022
    Configuration menu
    Copy the full SHA
    553f246 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2022

  1. Unify JNI interfaces

    @zzcclp
    zzcclp committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    433aa9a View commit details
    Browse the repository at this point in the history

  2. Remove plan.txt

    @zzcclp
    zzcclp committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    d5314e1 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2022

  1. add merge tree test

    neng.liu committed Jan 27, 2022
    Configuration menu
    Copy the full SHA
    33dd0b8 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2022

  1. add filter benchmark

    neng.liu committed Jan 28, 2022
    Configuration menu
    Copy the full SHA
    bd643e7 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2022

  1. fix cmake error when one shared

    neng.liu committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    1e24593 View commit details
    Browse the repository at this point in the history

  2. add shared config

    neng.liu committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    7d9bf86 View commit details
    Browse the repository at this point in the history

  3. add merge tree support

    neng.liu committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    af5a333 View commit details
    Browse the repository at this point in the history

  4. Merge pull request ClickHouse#2 from liuneng1994/unify_jni_interfaces 

    Unify JNI interfaces
    @liuneng1994
    liuneng1994 authored Feb 21, 2022
    Configuration menu
    Copy the full SHA
    1cb3d10 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'local-engine-with-substrait' of https://github.com/liun… 

    …eng1994/ClickHouse into local-engine-with-substrait
    neng.liu committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    8aac850 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'local-engine-with-substrait' into local-engine-with-mer… 

    …getree

# Conflicts:
#	utils/local-engine/CMakeLists.txt
    neng.liu committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    c6ca1b8 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2022

  1. support mergetree on jni

    neng.liu committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    a199571 View commit details
    Browse the repository at this point in the history

  2. add part selection

    neng.liu committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    e43b06f View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2022

  1. remove jni

    neng.liu committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    f49e9bc View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. change so dependency in rpm

    neng.liu committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    67a0759 View commit details
    Browse the repository at this point in the history

  2. remove java

    neng.liu committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    48fc1a4 View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2022

  1. fix error on object release

    @liuneng1994
    liuneng1994 committed Feb 25, 2022
    Configuration menu
    Copy the full SHA
    7680515 View commit details
    Browse the repository at this point in the history

  2. chang init order

    @liuneng1994
    liuneng1994 committed Feb 25, 2022
    Configuration menu
    Copy the full SHA
    2089d4b View commit details
    Browse the repository at this point in the history

  3. add default constructor

    @liuneng1994
    liuneng1994 committed Feb 25, 2022
    Configuration menu
    Copy the full SHA
    8bf7422 View commit details
    Browse the repository at this point in the history

  4. remove local server instead of map configuration

    @liuneng1994
    liuneng1994 committed Feb 25, 2022
    Configuration menu
    Copy the full SHA
    a9cae44 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2022

  1. optimize merge tree load parts

    neng.liu committed Feb 28, 2022
    Configuration menu
    Copy the full SHA
    0024cfb View commit details
    Browse the repository at this point in the history

  2. add benchmark for executor create

    neng.liu committed Feb 28, 2022
    Configuration menu
    Copy the full SHA
    eb3f68a View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2022

  1. optimize mergetree

    @liuneng1994
    liuneng1994 committed Mar 1, 2022
    Configuration menu
    Copy the full SHA
    7d6a5f0 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2022

  1. add logger

    @liuneng1994
    liuneng1994 committed Mar 2, 2022
    Configuration menu
    Copy the full SHA
    d7e2686 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2022

  1. optimize cmake

    neng.liu committed Mar 4, 2022
    Configuration menu
    Copy the full SHA
    5ef6435 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2022

  1. refactor code

    neng.liu committed Mar 8, 2022
    Configuration menu
    Copy the full SHA
    0dc2318 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2022

  1. change config

    @liuneng1994
    liuneng1994 committed Mar 10, 2022
    Configuration menu
    Copy the full SHA
    fce9414 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2022

  1. add splitter

    @liuneng1994
    liuneng1994 committed Mar 16, 2022
    Configuration menu
    Copy the full SHA
    86f8fd4 View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2022

  1. Update version to 22.3.2.1

    @Felixoid
    Felixoid committed Mar 17, 2022
    Configuration menu
    Copy the full SHA
    0f01267 View commit details
    Browse the repository at this point in the history

  2. Fix bug in push_to_artifactory.py, create a necessary dir

    @Felixoid
    Felixoid committed Mar 17, 2022
    Configuration menu
    Copy the full SHA
    89a6216 View commit details
    Browse the repository at this point in the history

  3. Update version to 22.3.3.2

    @Felixoid
    Felixoid committed Mar 17, 2022
    Configuration menu
    Copy the full SHA
    2ac3789 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2022

  1. Backport ClickHouse#35378 to 22.3: Fix possible deadlock in cache

    robot-clickhouse committed Mar 18, 2022
    Configuration menu
    Copy the full SHA
    2c43d76 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2022

  1. Backport ClickHouse#35388 to 22.3: Slightly better performance of ins… 

    …erts to `Object` type
    robot-clickhouse committed Mar 19, 2022
    Configuration menu
    Copy the full SHA
    8f62ade View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#35424 from ClickHouse/backport/22.3/35388 

    Backport ClickHouse#35388 to 22.3: Slightly better performance of inserts to `Object` type
    @CurtizJ
    CurtizJ authored Mar 19, 2022
    Configuration menu
    Copy the full SHA
    e80d55c View commit details
    Browse the repository at this point in the history

  3. Merge pull request ClickHouse#35415 from ClickHouse/backport/22.3/35378 

    Backport ClickHouse#35378 to 22.3: Fix possible deadlock in cache
    @kssenii
    kssenii authored Mar 19, 2022
    Configuration menu
    Copy the full SHA
    48160b8 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2022

  1. Backport ClickHouse#35409 to 22.3: Fix race in data type Object

    robot-clickhouse committed Mar 20, 2022
    Configuration menu
    Copy the full SHA
    09ee073 View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#35441 from ClickHouse/backport/22.3/35409 

    Backport ClickHouse#35409 to 22.3: Fix race in data type `Object`
    @CurtizJ
    CurtizJ authored Mar 20, 2022
    Configuration menu
    Copy the full SHA
    1ca455f View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2022

  1. add reader

    @liuneng1994
    liuneng1994 committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    475cd9a View commit details
    Browse the repository at this point in the history

  2. Backport ClickHouse#35512 to 22.3: Fix crash with enabled `optimize_f… 

    …unctions_to_subcolumns`
    robot-clickhouse committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    26a2636 View commit details
    Browse the repository at this point in the history

  3. Merge pull request ClickHouse#35542 from ClickHouse/backport/22.3/35512 

    Backport ClickHouse#35512 to 22.3: Fix crash with enabled `optimize_functions_to_subcolumns`
    @CurtizJ
    CurtizJ authored Mar 23, 2022
    Configuration menu
    Copy the full SHA
    90c8cd0 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2022

  1. Backport ClickHouse#35534 to 22.3: Fix cast into IPv4, IPv6 address i… 

    …n IN section
    robot-clickhouse committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    f3e2ad1 View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#35563 from ClickHouse/backport/22.3/35534 

    Backport ClickHouse#35534 to 22.3: Fix cast into IPv4, IPv6 address in IN section
    @kitaisreal
    kitaisreal authored Mar 24, 2022
    Configuration menu
    Copy the full SHA
    9a38aef View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2022

  1. add reader

    @liuneng1994
    liuneng1994 committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    390307d View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2022

  1. support columnar tpch q6

    @liuneng1994
    liuneng1994 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    951cc23 View commit details
    Browse the repository at this point in the history

  2. [GJ-75] Unify function names

    @zzcclp @liuneng1994
    zzcclp authored and liuneng1994 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    047f335 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2022

  1. Backport ClickHouse#35755 to 22.3: Fix bug in conversion from custom … 

    …types to string
    robot-clickhouse committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    9fa9e46 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2022

  1. shuffle init

    @liuneng1994
    liuneng1994 committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    53091b4 View commit details
    Browse the repository at this point in the history

  2. fix project error

    @liuneng1994
    liuneng1994 committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    871c660 View commit details
    Browse the repository at this point in the history

  3. fix shuffle error

    @liuneng1994
    liuneng1994 committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    d478fe7 View commit details
    Browse the repository at this point in the history

  4. Backport ClickHouse#35770 to 22.3: Fix enable LLVM for JIT compilatio… 

    …n in CMake
    robot-clickhouse committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    ea9bca1 View commit details
    Browse the repository at this point in the history

  5. Backport ClickHouse#35815 to 22.3: Fix cgroups cores detection

    robot-clickhouse committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    0c5d938 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2022

  1. fix release problem

    @liuneng1994
    liuneng1994 committed Apr 2, 2022
    Configuration menu
    Copy the full SHA
    40b698c View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#35783 from ClickHouse/backport/22.3/35755 

    Backport ClickHouse#35755 to 22.3: Fix bug in conversion from custom types to string
    @Avogar
    Avogar authored Apr 2, 2022
    Configuration menu
    Copy the full SHA
    a202398 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2022

  1. Merge pull request ClickHouse#35856 from ClickHouse/backport/22.3/35815 

    Backport ClickHouse#35815 to 22.3: Fix cgroups cores detection
    @alexey-milovidov
    alexey-milovidov authored Apr 3, 2022
    Configuration menu
    Copy the full SHA
    9049d5b View commit details
    Browse the repository at this point in the history

  2. Backport ClickHouse#35799 to 22.3: Fix extract function parser

    robot-clickhouse committed Apr 3, 2022
    Configuration menu
    Copy the full SHA
    2ae2121 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2022

  1. Fix path for assets upload

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    93204d6 View commit details
    Browse the repository at this point in the history

  2. Push LTS packages to both lts and stable repos

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    a5c469b View commit details
    Browse the repository at this point in the history

  3. Fix keeper client timeout bug

    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    c44cc2b View commit details
    Browse the repository at this point in the history

  4. Merge pull request ClickHouse#35855 from ClickHouse/backport/22.3/35770 

    Backport ClickHouse#35770 to 22.3: Fix enable LLVM for JIT compilation in CMake
    @kitaisreal
    kitaisreal authored Apr 4, 2022
    Configuration menu
    Copy the full SHA
    5e6a314 View commit details
    Browse the repository at this point in the history

  5. Manual backport of black formatter

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    925c433 View commit details
    Browse the repository at this point in the history

  6. Add black formatting check

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    80979f2 View commit details
    Browse the repository at this point in the history

  7. Adjust check-workflows to exit-on-errors

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    372895f View commit details
    Browse the repository at this point in the history

  8. Improve black check: show diff in the output

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    1b298db View commit details
    Browse the repository at this point in the history

  9. Fix version string update, fix ClickHouse#35518

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    046e742 View commit details
    Browse the repository at this point in the history

  10. Make GITHUB_RUN_URL variable and use it

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    3d43bce View commit details
    Browse the repository at this point in the history

  11. Add build-url label to built docker images

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    7b01fe2 View commit details
    Browse the repository at this point in the history

  12. Merge pull request ClickHouse#33664 from ClickHouse/release-steps 

    Refactor releasing process
    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    e93a06c View commit details
    Browse the repository at this point in the history

  13. Merge pull request ClickHouse#35533 from ClickHouse/simplify_strip 

    Simplify strip for new packages
    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    dec0ec8 View commit details
    Browse the repository at this point in the history

  14. Push only to the new CI DB

    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    5b06fba View commit details
    Browse the repository at this point in the history

  15. Remove outdated links from CI

    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    5a5a174 View commit details
    Browse the repository at this point in the history

  16. Merge pull request ClickHouse#35766 from ClickHouse/resurrect_officia… 

    …l_flag

Resurrect build hash
    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    8cd46fa View commit details
    Browse the repository at this point in the history

  17. Merge pull request ClickHouse#35774 from ClickHouse/ressurect_build_h… 

    …ash_v2

One more try to resurrect build hash
    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    f2e41bc View commit details
    Browse the repository at this point in the history

  18. Merge pull request ClickHouse#35308 from ClickHouse/clickhouse-keeper 

    New package clickhouse-keeper
    @alesapin @Felixoid
    alesapin authored and Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    9234a3c View commit details
    Browse the repository at this point in the history

  19. Merge pull request ClickHouse#35211 from ClickHouse/release-docker 

    Docker release and regular builds
    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    49bafdc View commit details
    Browse the repository at this point in the history

  20. Merge pull request ClickHouse#35854 from ClickHouse/docker-master-head 

    Fix automatic bucket prefix for master
    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    899d7f2 View commit details
    Browse the repository at this point in the history

  21. Backport tests/ci/upload_result_helper.py

    @Felixoid
    Felixoid committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    b03e8ca View commit details
    Browse the repository at this point in the history

  22. Backport ClickHouse#35733 to 22.3: Added settings for insert of inval… 

    …id IPv6, IPv4 values
    robot-clickhouse committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    b4cd668 View commit details
    Browse the repository at this point in the history

  23. Backport ClickHouse#35820 to 22.3: Avoid processing per-column TTL mu… 

    …ltiple times
    robot-clickhouse committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    c9a1d9c View commit details
    Browse the repository at this point in the history

  24. Merge pull request ClickHouse#35909 from ClickHouse/backport/22.3-rel… 

    …ease

Backport release to 22.3
    @Felixoid
    Felixoid authored Apr 4, 2022
    Configuration menu
    Copy the full SHA
    697dd21 View commit details
    Browse the repository at this point in the history

  25. Merge pull request ClickHouse#35881 from ClickHouse/backport/22.3/35799 

    Backport ClickHouse#35799 to 22.3: Fix extract function parser
    @alexey-milovidov
    alexey-milovidov authored Apr 4, 2022
    Configuration menu
    Copy the full SHA
    ad0a62d View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2022

  1. Merge pull request ClickHouse#35928 from ClickHouse/backport/22.3/35733 

    Backport ClickHouse#35733 to 22.3: Added settings for insert of invalid IPv6, IPv4 values
    @kitaisreal
    kitaisreal authored Apr 5, 2022
    Configuration menu
    Copy the full SHA
    82735cb View commit details
    Browse the repository at this point in the history

  2. Merge pull request ClickHouse#35938 from ClickHouse/backport/22.3/35820 

    Backport ClickHouse#35820 to 22.3: Avoid processing per-column TTL multiple times
    @CurtizJ
    CurtizJ authored Apr 5, 2022
    Configuration menu
    Copy the full SHA
    abb756d View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2022

  1. remove input rel and support java iter from local files

    @liuneng1994
    liuneng1994 committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    025a573 View commit details
    Browse the repository at this point in the history

  2. Update version to 22.3.4.44

    @Felixoid
    Felixoid committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    55da56d View commit details
    Browse the repository at this point in the history

  3. Tiny improvements to git and version helpers

    @Felixoid
    Felixoid committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    84020f5 View commit details
    Browse the repository at this point in the history

  4. Improve and fix edge cases for docker_server.py 

    - Allow define version as file
- Add inline cache
- Fix auto_release_type function
    @Felixoid
    Felixoid committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    0a43cfe View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2022

  1. add coalesce operator

    @liuneng1994
    liuneng1994 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    27ee3a4 View commit details
    Browse the repository at this point in the history

  2. fix memory double free

    @liuneng1994
    liuneng1994 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    574025a View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/21.9' into local_engine_with_col… 

    …umnar_shuffle
    @liuneng1994
    liuneng1994 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    b228517 View commit details
    Browse the repository at this point in the history

  4. fix compile error in benchmark

    @liuneng1994
    liuneng1994 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    507e81a View commit details
    Browse the repository at this point in the history

  5. fix metrics error

    @liuneng1994
    liuneng1994 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    131f6a6 View commit details
    Browse the repository at this point in the history

  6. Fix action for docker images build

    @Felixoid
    Felixoid committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    ee1b577 View commit details
    Browse the repository at this point in the history

  7. A temporary fix for artifactory push before multiple architectures

    @Felixoid
    Felixoid committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    7d6fd3d View commit details
    Browse the repository at this point in the history

  8. Add python unit tests to backport workflow

    @Felixoid
    Felixoid committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    e8168a1 View commit details
    Browse the repository at this point in the history

  9. Move version_arg to version_helper, add tests

    @Felixoid
    Felixoid committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    a365ef5 View commit details
    Browse the repository at this point in the history

  10. Merge pull request ClickHouse#36028 from ClickHouse/backport/fix-rele… 

    …ase-workflow

Backport/fix release workflow
    @Felixoid
    Felixoid authored Apr 7, 2022
    Configuration menu
    Copy the full SHA
    df57f8e View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2022

  1. add mergetree data generate tool

    @liuneng1994
    liuneng1994 committed Apr 8, 2022
    Configuration menu
    Copy the full SHA
    2cf5ddf View commit details
    Browse the repository at this point in the history

  2. change jni package name

    @liuneng1994
    liuneng1994 committed Apr 8, 2022
    Configuration menu
    Copy the full SHA
    04f61b8 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2022

  1. add new benchmark

    @liuneng1994
    liuneng1994 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    995a6fb View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/21.9' into local_engine_with_col… 

    …umnar_shuffle

# Conflicts:
#	CMakeLists.txt
#	cmake/autogenerated_versions.txt
#	debian/changelog
#	docker/client/Dockerfile
#	docker/server/Dockerfile
#	docker/test/Dockerfile
#	programs/client/CMakeLists.txt
#	src/Processors/Formats/Impl/ParquetBlockInputFormat.h
    @liuneng1994
    liuneng1994 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    8323fd6 View commit details
    Browse the repository at this point in the history

  3. fix cmake error for googlebenchmark

    @liuneng1994
    liuneng1994 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    2307ada View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2022

  1. fix rebase error

    @liuneng1994
    liuneng1994 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    59ebc57 View commit details
    Browse the repository at this point in the history

  2. change benchmark error column

    @liuneng1994
    liuneng1994 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    97c4bc2 View commit details
    Browse the repository at this point in the history

  3. add time print in transform

    @liuneng1994
    liuneng1994 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    401d6ec View commit details
    Browse the repository at this point in the history

  4. fix filter actionDag has useless column

    @liuneng1994
    liuneng1994 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    502c26c View commit details
    Browse the repository at this point in the history

  5. fix parse alias function failed

    @liuneng1994
    liuneng1994 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    a1c4e68 View commit details
    Browse the repository at this point in the history

  6. fix compile error in benchmark 

    (cherry picked from commit 507e81a)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    5ed3db3 View commit details
    Browse the repository at this point in the history

  7. fix metrics error 

    (cherry picked from commit 131f6a6)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    f212656 View commit details
    Browse the repository at this point in the history

  8. add mergetree data generate tool 

    (cherry picked from commit 2cf5ddf)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    69660e5 View commit details
    Browse the repository at this point in the history

  9. change jni package name 

    (cherry picked from commit 04f61b8)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    bafd8ff View commit details
    Browse the repository at this point in the history

  10. add new benchmark 

    (cherry picked from commit 995a6fb)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    f642f82 View commit details
    Browse the repository at this point in the history

  11. change benchmark error column 

    (cherry picked from commit 97c4bc2)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    95f5b44 View commit details
    Browse the repository at this point in the history

  12. add time print in transform 

    (cherry picked from commit 401d6ec)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    69a445f View commit details
    Browse the repository at this point in the history

  13. fix filter actionDag has useless column 

    (cherry picked from commit 502c26c)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    b9287b6 View commit details
    Browse the repository at this point in the history

  14. fix parse alias function failed 

    (cherry picked from commit a1c4e68)
    @liuneng1994 @zzcclp
    liuneng1994 authored and zzcclp committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    0d8fce3 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2022

  1. Revert "add time print in transform" 

    This reverts commit 401d6ec.
    @liuneng1994
    liuneng1994 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    43acb9b View commit details
    Browse the repository at this point in the history

  2. Merge branch '22.3' into local_engine_with_columnar_shuffle_no_rebase 

    # Conflicts:
#	.github/workflows/backport_branches.yml
#	.github/workflows/release_branches.yml
#	.gitmodules
#	base/base/unit.h
#	base/common/arithmeticOverflow.h
#	base/mysqlxx/Query.cpp
#	cmake/autogenerated_versions.txt
#	cmake/find/cxx.cmake
#	debian/changelog
#	docker/builder/Dockerfile
#	docker/client/Dockerfile
#	docker/images.json
#	docker/packager/binary/Dockerfile
#	docker/packager/deb/Dockerfile
#	docker/packager/packager
#	docker/packager/unbundled/Dockerfile
#	docker/server/Dockerfile
#	docker/test/Dockerfile
#	docker/test/base/Dockerfile
#	docker/test/codebrowser/Dockerfile
#	docker/test/coverage/Dockerfile
#	docker/test/fasttest/Dockerfile
#	docker/test/fasttest/run.sh
#	docker/test/fuzzer/Dockerfile
#	docker/test/integration/base/Dockerfile
#	docker/test/integration/kerberized_hadoop/Dockerfile
#	docker/test/integration/runner/Dockerfile
#	docker/test/integration/runner/compose/docker_compose_kerberized_hdfs.yml
#	docker/test/keeper-jepsen/Dockerfile
#	docker/test/performance-comparison/Dockerfile
#	docker/test/pvs/Dockerfile
#	docker/test/split_build_smoke_test/Dockerfile
#	docker/test/sqlancer/Dockerfile
#	docker/test/stateful/Dockerfile
#	docker/test/stateless/Dockerfile
#	docker/test/stateless/run.sh
#	docker/test/stateless_pytest/Dockerfile
#	docker/test/stateless_unbundled/Dockerfile
#	docker/test/stress/Dockerfile
#	docker/test/stress/README.md
#	docker/test/test_runner.sh
#	docker/test/testflows/runner/Dockerfile
#	docker/test/unit/Dockerfile
#	programs/keeper/CMakeLists.txt
#	programs/server/Server.cpp
#	src/Access/EnabledQuota.cpp
#	src/Access/ReplicatedAccessStorage.cpp
#	src/AggregateFunctions/AggregateFunctionAvg.h
#	src/Common/ConcurrentBoundedQueue.h
#	src/Common/LRUCache.h
#	src/Common/Stopwatch.h
#	src/Common/StringSearcher.h
#	src/Common/ZooKeeper/ZooKeeperImpl.cpp
#	src/Common/ZooKeeper/ZooKeeperImpl.h
#	src/Compression/LZ4_decompress_faster.cpp
#	src/Coordination/Changelog.cpp
#	src/Coordination/Changelog.h
#	src/Coordination/KeeperServer.h
#	src/Coordination/KeeperStateMachine.cpp
#	src/Coordination/KeeperStateMachine.h
#	src/Coordination/KeeperStorage.cpp
#	src/Coordination/KeeperStorage.h
#	src/Coordination/KeeperStorageDispatcher.cpp
#	src/Coordination/SessionExpiryQueue.cpp
#	src/Coordination/tests/gtest_coordination.cpp
#	src/Core/QualifiedTableName.h
#	src/Core/Settings.h
#	src/DataStreams/NativeBlockInputStream.cpp
#	src/Databases/DatabaseMemory.cpp
#	src/Databases/DatabaseOnDisk.cpp
#	src/Databases/PostgreSQL/DatabaseMaterializedPostgreSQL.cpp
#	src/Databases/PostgreSQL/fetchPostgreSQLTableStructure.cpp
#	src/Databases/PostgreSQL/fetchPostgreSQLTableStructure.h
#	src/Dictionaries/HashedDictionary.cpp
#	src/Disks/DiskEncrypted.cpp
#	src/Disks/HDFS/DiskHDFS.cpp
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/tests/gtest_disk_encrypted.cpp
#	src/Formats/MySQLSource.cpp
#	src/Formats/ProtobufSerializer.cpp
#	src/Functions/FunctionJoinGet.cpp
#	src/Functions/FunctionsJSON.h
#	src/Functions/ReplaceRegexpImpl.h
#	src/Functions/array/arrayCompact.cpp
#	src/Functions/array/arrayCumSumNonNegative.cpp
#	src/Functions/array/arrayDifference.cpp
#	src/Functions/formatRow.cpp
#	src/Functions/transform.cpp
#	src/IO/Bzip2ReadBuffer.cpp
#	src/IO/ZlibInflatingReadBuffer.cpp
#	src/Interpreters/AddDefaultDatabaseVisitor.h
#	src/Interpreters/Aggregator.cpp
#	src/Interpreters/Aggregator.h
#	src/Interpreters/Context.cpp
#	src/Interpreters/DDLWorker.cpp
#	src/Interpreters/DatabaseCatalog.h
#	src/Interpreters/DuplicateOrderByVisitor.cpp
#	src/Interpreters/ExpressionAnalyzer.cpp
#	src/Interpreters/ExternalDictionariesLoader.cpp
#	src/Interpreters/GlobalSubqueriesVisitor.h
#	src/Interpreters/InterpreterCreateQuery.cpp
#	src/Interpreters/InterpreterGrantQuery.cpp
#	src/Interpreters/JIT/CHJIT.cpp
#	src/Interpreters/LogicalExpressionsOptimizer.cpp
#	src/Interpreters/MergeJoin.cpp
#	src/Interpreters/MutationsInterpreter.cpp
#	src/Interpreters/PredicateRewriteVisitor.cpp
#	src/Interpreters/PredicateRewriteVisitor.h
#	src/Interpreters/Session.cpp
#	src/Interpreters/Session.h
#	src/Interpreters/SystemLog.h
#	src/Interpreters/TreeOptimizer.cpp
#	src/Interpreters/TreeRewriter.cpp
#	src/Interpreters/join_common.cpp
#	src/Parsers/ASTSelectIntersectExceptQuery.h
#	src/Parsers/ExpressionElementParsers.cpp
#	src/Processors/Formats/Impl/JSONEachRowWithProgressRowOutputFormat.h
#	src/Processors/Transforms/JoiningTransform.cpp
#	src/Processors/Transforms/TotalsHavingTransform.cpp
#	src/Processors/Transforms/WindowTransform.cpp
#	src/Server/GRPCServer.cpp
#	src/Server/KeeperTCPHandler.cpp
#	src/Server/TCPHandler.cpp
#	src/Storages/Distributed/DistributedSink.cpp
#	src/Storages/HDFS/HDFSCommon.cpp
#	src/Storages/HDFS/HDFSCommon.h
#	src/Storages/HDFS/StorageHDFS.cpp
#	src/Storages/MergeTree/BackgroundJobsExecutor.cpp
#	src/Storages/MergeTree/IMergeTreeDataPart.cpp
#	src/Storages/MergeTree/IMergeTreeDataPart.h
#	src/Storages/MergeTree/IMergeTreeReader.cpp
#	src/Storages/MergeTree/KeyCondition.cpp
#	src/Storages/MergeTree/MergeList.h
#	src/Storages/MergeTree/MergeTreeData.cpp
#	src/Storages/MergeTree/MergeTreeDataMergerMutator.cpp
#	src/Storages/MergeTree/MergeTreeDataMergerMutator.h
#	src/Storages/MergeTree/MergeTreeDataPartInMemory.cpp
#	src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
#	src/Storages/MergeTree/MergeTreeDataWriter.cpp
#	src/Storages/MergeTree/MergeTreeDataWriter.h
#	src/Storages/MergeTree/MergeTreeReaderCompact.cpp
#	src/Storages/MergeTree/MergeTreeWriteAheadLog.cpp
#	src/Storages/MergeTree/MergedBlockOutputStream.h
#	src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
#	src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	src/Storages/PostgreSQL/PostgreSQLReplicationHandler.cpp
#	src/Storages/PostgreSQL/PostgreSQLReplicationHandler.h
#	src/Storages/ProjectionsDescription.cpp
#	src/Storages/ProjectionsDescription.h
#	src/Storages/SelectQueryInfo.h
#	src/Storages/StorageDictionary.cpp
#	src/Storages/StorageDistributed.cpp
#	src/Storages/StorageFile.cpp
#	src/Storages/StorageJoin.cpp
#	src/Storages/StorageJoin.h
#	src/Storages/StorageLog.cpp
#	src/Storages/StorageLog.h
#	src/Storages/StorageMerge.cpp
#	src/Storages/StorageMerge.h
#	src/Storages/StorageMergeTree.cpp
#	src/Storages/StorageReplicatedMergeTree.cpp
#	src/Storages/StorageSet.cpp
#	src/Storages/StorageStripeLog.cpp
#	src/Storages/System/StorageSystemContributors.generated.cpp
#	src/Storages/tests/gtest_transform_query_for_external_database.cpp
#	tests/ci/ast_fuzzer_check.py
#	tests/ci/build_check.py
#	tests/ci/build_download_helper.py
#	tests/ci/build_report_check.py
#	tests/ci/ccache_utils.py
#	tests/ci/cherry_pick.py
#	tests/ci/cherry_pick_utils/backport.py
#	tests/ci/cherry_pick_utils/cherrypick.py
#	tests/ci/cherry_pick_utils/local.py
#	tests/ci/cherry_pick_utils/parser.py
#	tests/ci/cherry_pick_utils/query.py
#	tests/ci/ci_config.json
#	tests/ci/ci_config.py
#	tests/ci/clickhouse_helper.py
#	tests/ci/commit_status_helper.py
#	tests/ci/compatibility_check.py
#	tests/ci/compress_files.py
#	tests/ci/docker_images_check.py
#	tests/ci/docker_pull_helper.py
#	tests/ci/docs_check.py
#	tests/ci/docs_release.py
#	tests/ci/fast_test_check.py
#	tests/ci/finish_check.py
#	tests/ci/functional_test_check.py
#	tests/ci/get_robot_token.py
#	tests/ci/integration_test_check.py
#	tests/ci/metrics_lambda/app.py
#	tests/ci/pr_info.py
#	tests/ci/push_to_artifactory.py
#	tests/ci/report.py
#	tests/ci/rerun_helper.py
#	tests/ci/run_check.py
#	tests/ci/s3_helper.py
#	tests/ci/split_build_smoke_check.py
#	tests/ci/ssh.py
#	tests/ci/stopwatch.py
#	tests/ci/stress_check.py
#	tests/ci/style_check.py
#	tests/ci/tee_popen.py
#	tests/ci/termination_lambda/app.py
#	tests/ci/token_lambda/app.py
#	tests/ci/unit_tests_check.py
#	tests/ci/upload_result_helper.py
#	tests/ci/version_helper.py
#	tests/ci/workflow_approve_rerun_lambda/app.py
#	tests/clickhouse-test
#	tests/integration/ci-runner.py
#	tests/integration/helpers/client.py
#	tests/integration/helpers/cluster.py
#	tests/integration/helpers/network.py
#	tests/integration/runner
#	tests/integration/test_attach_partition_with_large_destination/configs/config.xml
#	tests/integration/test_attach_partition_with_large_destination/test.py
#	tests/integration/test_distributed_inter_server_secret/test.py
#	tests/integration/test_grpc_protocol/test.py
#	tests/integration/test_keeper_back_to_back/test.py
#	tests/integration/test_library_bridge/test.py
#	tests/integration/test_lost_part/test.py
#	tests/integration/test_lost_part_during_startup/test.py
#	tests/integration/test_materialized_mysql_database/materialize_with_ddl.py
#	tests/integration/test_materialized_mysql_database/test.py
#	tests/integration/test_partition/test.py
#	tests/integration/test_postgresql_replica_database_engine/test.py
#	tests/integration/test_replicated_merge_tree_compatibility/test.py
#	tests/integration/test_replicated_merge_tree_with_auxiliary_zookeepers/test.py
#	tests/integration/test_restart_server/test.py
#	tests/integration/test_sharding_key_from_default_column/configs/test_cluster.xml
#	tests/integration/test_sharding_key_from_default_column/test.py
#	tests/integration/test_storage_kafka/message_with_repeated_pb2.py
#	tests/integration/test_storage_kafka/test.py
#	tests/integration/test_storage_mysql/test.py
#	tests/queries/0_stateless/00825_protobuf_format_skipped_column_in_nested.reference
#	tests/queries/0_stateless/00825_protobuf_format_skipped_column_in_nested.sh
#	tests/queries/0_stateless/01020_function_array_compact.sql
#	tests/queries/0_stateless/01155_rename_move_materialized_view.sql
#	tests/queries/0_stateless/01165_lost_part_empty_partition.sql
#	tests/queries/0_stateless/01410_nullable_key_and_index.sql
#	tests/queries/0_stateless/01591_window_functions.reference
#	tests/queries/0_stateless/01591_window_functions.sql
#	tests/queries/0_stateless/01710_projection_vertical_merges.sql
#	tests/queries/0_stateless/01710_projection_with_mixed_pipeline.sql
#	tests/queries/0_stateless/01763_max_distributed_depth.sql
#	tests/queries/0_stateless/01915_json_extract_raw_string.reference
#	tests/queries/0_stateless/01915_json_extract_raw_string.sql
#	tests/queries/0_stateless/02013_zlib_read_after_eof.sh
#	tests/queries/0_stateless/02017_create_distributed_table_coredump.sql
#	tests/queries/0_stateless/02033_join_engine_deadlock_long.sh
#	tests/queries/0_stateless/02097_default_dict_get_add_database.sql
#	tests/queries/0_stateless/02100_replaceRegexpAll_bug.reference
#	tests/queries/0_stateless/02100_replaceRegexpAll_bug.sql
#	tests/queries/0_stateless/02114_hdfs_bad_url.sh
#	tests/queries/0_stateless/02125_constant_if_condition_and_not_existing_column.sql
#	tests/testflows/kerberos/kerberos_env/clickhouse-service.yml
#	tests/testflows/rbac/rbac_env/clickhouse-service.yml
    @liuneng1994
    liuneng1994 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    8c6bb93 View commit details
    Browse the repository at this point in the history

  3. fix rebase error

    @liuneng1994
    liuneng1994 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    c342630 View commit details
    Browse the repository at this point in the history

  4. fix rebase error

    @liuneng1994
    liuneng1994 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    3c99723 View commit details
    Browse the repository at this point in the history

  5. fix cmake rebase error

    @liuneng1994
    liuneng1994 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    2c22878 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2022

  1. fix rebase compile error

    @liuneng1994
    liuneng1994 committed Apr 16, 2022
    Configuration menu
    Copy the full SHA
    705001a View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2022

  1. add decompress benchmakr

    @liuneng1994
    liuneng1994 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    e4d2372 View commit details
    Browse the repository at this point in the history

  2. resolve conflicts

    @liuneng1994
    liuneng1994 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    8153afc View commit details
    Browse the repository at this point in the history

  3. Merge pull request ClickHouse#2 from liuneng1994/local_engine_with_co… 

    …lumnar_shuffle_no_rebase

Merge ClickHouse 22.3
    @liuneng1994
    liuneng1994 authored Apr 19, 2022
    Configuration menu
    Copy the full SHA
    b0cd49c View commit details
    Browse the repository at this point in the history

  4. Revert "add time print in transform" 

    This reverts commit 69a445f.
    @liuneng1994
    liuneng1994 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    74c6a7e View commit details
    Browse the repository at this point in the history

  5. Merge pull request ClickHouse#4 from liuneng1994/revert_time_print 

    Revert "add time print in transform"
    @liuneng1994
    liuneng1994 authored Apr 19, 2022
    Configuration menu
    Copy the full SHA
    04b4e51 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2022

  1. Support TPCH Q1 (ClickHouse#8) 

    * support tpch q1

* clean log

* disable background executors

* add storage cache evict

* enable function compile

* support jemalloc

* fix q6 benchmark failed

* remove shared unwind
    @liuneng1994
    liuneng1994 authored Apr 27, 2022
    Configuration menu
    Copy the full SHA
    ee7d3c8 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. fix hash partition error (ClickHouse#14)

    @liuneng1994
    liuneng1994 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    1d9ce86 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2022

  1. [CH-18] Supported substrait cast node (ClickHouse#19)

    @zzcclp
    zzcclp authored May 9, 2022
    Configuration menu
    Copy the full SHA
    c4cbcd6 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2022

  1. add blob and s3 read support (ClickHouse#20)

    @liuneng1994
    liuneng1994 authored May 10, 2022
    Configuration menu
    Copy the full SHA
    e4f0339 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2022

  1. Support join (ClickHouse#25) 

    * add inner join test

* support parse join

* fix agg argument type error

* support semi join

* fix join output order problem

* support multiple join key

* change file uri parse logic

* add in and not test

* add some function

* support sum case when, in, like
    @liuneng1994
    liuneng1994 authored May 25, 2022
    Configuration menu
    Copy the full SHA
    15db61f View commit details
    Browse the repository at this point in the history

  2. support tpch q14 (ClickHouse#26)

    @liuneng1994
    liuneng1994 authored May 25, 2022
    Configuration menu
    Copy the full SHA
    bfe7a84 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2022

  1. fix join use nulls and support post join filter (ClickHouse#27)

    @liuneng1994
    liuneng1994 authored Jun 1, 2022
    Configuration menu
    Copy the full SHA
    0ce6a3a View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2022

  1. Fix shuffle column error (ClickHouse#29) 

    * add final project at plan end

* handle empty block

* add hash column policy

* Revert "add hash column policy"

This reverts commit 968b1e3.
    @liuneng1994
    liuneng1994 authored Jun 6, 2022
    Configuration menu
    Copy the full SHA
    5c2784b View commit details
    Browse the repository at this point in the history

  2. add stacktrace log (ClickHouse#30)

    @liuneng1994
    liuneng1994 authored Jun 6, 2022
    Configuration menu
    Copy the full SHA
    a4cf20e View commit details
    Browse the repository at this point in the history

  3. Support extract and substring function (ClickHouse#31)

    @zzcclp
    zzcclp authored Jun 6, 2022
    Configuration menu
    Copy the full SHA
    f99279e View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2022

  1. add function result cast (ClickHouse#32)

    @liuneng1994
    liuneng1994 authored Jun 7, 2022
    Configuration menu
    Copy the full SHA
    4765f0b View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. add native c2r (ClickHouse#33)

    @liuneng1994
    liuneng1994 authored Jun 9, 2022
    Configuration menu
    Copy the full SHA
    fd77999 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Support broadCast join (ClickHouse#34) 

    * add broadcast join

* support broadCast hash join

* add uint64 support on c2r

* recover log level
    @liuneng1994
    liuneng1994 authored Jun 15, 2022
    Configuration menu
    Copy the full SHA
    5def534 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. a lot of optimization (ClickHouse#35) 

    * add broadCast memory limit

* support reuse exchange

* add join benchmark

* optimize byte array

* add build docker image

* support close embedded compiler

* change default buffer size

* remove cmake option

* support agg function cast result
    @liuneng1994
    liuneng1994 authored Jun 22, 2022
    Configuration menu
    Copy the full SHA
    391b322 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. Support new shuffle (ClickHouse#36) 

    * add new splitter

* add new writer

* Add compressed parameter to control whether compressing

Co-authored-by: Zhichao Zhang <[email protected]>
    @liuneng1994 @zzcclp
    liuneng1994 and zzcclp authored Jun 30, 2022
    Configuration menu
    Copy the full SHA
    4f14406 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2022

  1. fix mem leak (ClickHouse#37)

    @liuneng1994
    liuneng1994 authored Jul 1, 2022
    Configuration menu
    Copy the full SHA
    fa2eaa0 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. Using NewWeakGlobalRef instead of NewGlobalRef (ClickHouse#38)

    @zzcclp
    zzcclp authored Jul 12, 2022
    Configuration menu
    Copy the full SHA
    d59bc9f View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. fix join duplicate table error (ClickHouse#39) 

    * fix join duplicate table error

* fix join with duplicate key
    @liuneng1994
    liuneng1994 authored Jul 13, 2022
    Configuration menu
    Copy the full SHA
    c695853 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2022

  1. add context clean when unload lib (ClickHouse#40) 

    * add context clean and refactor jni code

* change init

* add broadcast clean
    @liuneng1994
    liuneng1994 authored Jul 14, 2022
    Configuration menu
    Copy the full SHA
    7abd83d View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2022

  1. Optimize clickhouse arrow parquet reader (ClickHouse#41) 

    * fix arrow parquet

* fix column pruning

* remove unused code

* remove duckdb

* remove timer
    @liuneng1994
    liuneng1994 authored Jul 22, 2022
    Configuration menu
    Copy the full SHA
    f4dfe2d View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. Support nullable datatype (ClickHouse#51) 

    * support nullable

* support parquet partition table

* support nullable in parquet partition table

* fix missing multi if column

* support nullable on CHColumnVector

* fix some issue

* convert nullable after is not null

* fix c2r error on nullable

* add merge aggregate support

* support partial column

* fix aggregate convert result type error

* fix project duplicate columns

* support aggregate function return nullable type

* better log
    @liuneng1994
    liuneng1994 authored Aug 18, 2022
    Configuration menu
    Copy the full SHA
    6aac94d View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2022

  1. support const column in c2r (ClickHouse#54)

    @liuneng1994
    liuneng1994 authored Aug 19, 2022
    Configuration menu
    Copy the full SHA
    b898c4b View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2022

  1. fix columnar shuffle split failed (ClickHouse#57)

    @liuneng1994
    liuneng1994 authored Aug 22, 2022
    Configuration menu
    Copy the full SHA
    f3d754d View commit details
    Browse the repository at this point in the history

  2. upgrade substrait (ClickHouse#59)

    @liuneng1994
    liuneng1994 authored Aug 22, 2022
    Configuration menu
    Copy the full SHA
    56c4bfc View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2022

  1. add BlockIterator to manage memory between java and cpp (ClickHouse#62) 

    * optimize memory allocate

* pre allocate column buffer

* better

* add default prefer size on ColumnsBuffer
    @liuneng1994
    liuneng1994 authored Aug 24, 2022
    Configuration menu
    Copy the full SHA
    1385675 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2022

  1. Support expr on broadcast (ClickHouse#64) 

    * support expr on broadcast join

* support three keys join
    @liuneng1994
    liuneng1994 authored Aug 25, 2022
    Configuration menu
    Copy the full SHA
    47b50f0 View commit details
    Browse the repository at this point in the history

  2. issue ClickHouse#48 Optimize Arrow Parquet Reader (ClickHouse#61)

    Hongbin Ma authored Aug 25, 2022
    Configuration menu
    Copy the full SHA
    169c1bb View commit details
    Browse the repository at this point in the history

  3. fix compile error (ClickHouse#66)

    @liuneng1994
    liuneng1994 authored Aug 25, 2022
    Configuration menu
    Copy the full SHA
    121d05a View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2022

  1. issue ClickHouse#48 fix null value case (ClickHouse#90)

    Hongbin Ma authored Aug 29, 2022
    Configuration menu
    Copy the full SHA
    c0f737e View commit details
    Browse the repository at this point in the history

  2. Support expr eval and Support NULL literal (ClickHouse#92) 

    * support expr eval

* support nullable literal
    @liuneng1994
    liuneng1994 authored Aug 29, 2022
    Configuration menu
    Copy the full SHA
    1df1d49 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2022

  1. [CH-87] fix min max on date32 (ClickHouse#96)

    Hongbin Ma authored Aug 30, 2022
    Configuration menu
    Copy the full SHA
    b14d26a View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. fix aggregate nullable boolean column failed (ClickHouse#99)

    @liuneng1994
    liuneng1994 authored Aug 31, 2022
    Configuration menu
    Copy the full SHA
    9feb3d2 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. support singular_or_list (ClickHouse#101)

    @liuneng1994
    liuneng1994 authored Sep 1, 2022
    Configuration menu
    Copy the full SHA
    086a081 View commit details
    Browse the repository at this point in the history

  2. skip empty block when read shuffle data (ClickHouse#102) 

    * better

* skip empty block on shuffle write
    @liuneng1994
    liuneng1994 authored Sep 1, 2022
    Configuration menu
    Copy the full SHA
    874ad45 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. remove unused column before filter (ClickHouse#103)

    @liuneng1994
    liuneng1994 authored Sep 2, 2022
    Configuration menu
    Copy the full SHA
    c635380 View commit details
    Browse the repository at this point in the history

  2. support select constant (ClickHouse#104)

    @liuneng1994
    liuneng1994 authored Sep 2, 2022
    Configuration menu
    Copy the full SHA
    4b36351 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2022

  1. [CH-107] Support Native RowToColumnar (ClickHouse#114)

    Hongbin Ma authored Sep 8, 2022
    Configuration menu
    Copy the full SHA
    6a40950 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2022

  1. 修复编译过程中的Warning (ClickHouse#106) 

    * fix some warnings

* fix more warnings

* fix warnings in ch_parquet

* fix check-style
    @taiyang-li
    taiyang-li authored Sep 14, 2022
    Configuration menu
    Copy the full SHA
    1643fd1 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. add check style (ClickHouse#122)

    @liuneng1994
    liuneng1994 authored Sep 15, 2022
    Configuration menu
    Copy the full SHA
    db56bf1 View commit details
    Browse the repository at this point in the history

  2. Multiple processes transfer parquet to mergetree (ClickHouse#110) 

    * multiple transfer and fix test cmakelists.txt

* add ch version check and change default schema
    @zhanglistar
    zhanglistar authored Sep 15, 2022
    Configuration menu
    Copy the full SHA
    dee2ac6 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. catch c++ exceptions and rethrow java exceptions (ClickHouse#126)

    @lgbo-ustc
    lgbo-ustc authored Sep 16, 2022
    Configuration menu
    Copy the full SHA
    2c0c4cc View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. fixed : cover more jni interfaces for catching c++ exceptions (ClickH… 

    …ouse#127)

fixed : cover more jni interfaces for catching c++ exceptions
    @lgbo-ustc
    lgbo-ustc authored Sep 20, 2022
    Configuration menu
    Copy the full SHA
    2706a4d View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. [CH-129][Followup] Support substrait SingularOrList (ClickHouse#131) 

    * [CH-129][Followup] Support substrait SingularOrList

use one SingularOrList.options to indicate one value for the `in` expression.

* better

Co-authored-by: LiuNeng <[email protected]>
    @zzcclp @liuneng1994
    zzcclp and liuneng1994 authored Sep 21, 2022
    Configuration menu
    Copy the full SHA
    0889631 View commit details
    Browse the repository at this point in the history

  2. Solve conflict symbols of DB::ParquetBlockInputFormat and add some be… 

    …nchmark of optimized parquet reading (ClickHouse#121)

* add benchmark for optimized parquet format

* commit again

* commit again
    @taiyang-li
    taiyang-li authored Sep 21, 2022
    Configuration menu
    Copy the full SHA
    c5ba2bf View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. Support functions for clickhouse backend: lower/upper/ltrim/rtrim (Cl… 

    …ickHouse#117)

* support more functions

* commit again

* remove function length

* fix as requested
    @taiyang-li
    taiyang-li authored Sep 22, 2022
    Configuration menu
    Copy the full SHA
    31a4432 View commit details
    Browse the repository at this point in the history

  2. Support conversion between spark timestamp and ch datetime64 (ClickHo… 

    …use#119)

* support timestamp -> datetime64

* fix bugs

* remove comments

* fix building error

* Revert log level
    @taiyang-li
    taiyang-li authored Sep 22, 2022
    Configuration menu
    Copy the full SHA
    f5909f2 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2022

  1. Reduce log output (ClickHouse#134) 

    * better log

* fix check style

* fix check style
    @liuneng1994
    liuneng1994 authored Sep 27, 2022
    Configuration menu
    Copy the full SHA
    3d1db97 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. refactor the file sources (ClickHouse#130) 

    * refactor the file sources

refactor the file source

1. support reading tables with multi partition columns
2. support reading files with different partition values
3. support only reading partition columns from tables

* rename files

* clear unused codes

* fixed : in the case of a file is splitted into parts, data is loaded duplicatly

* support reading splitted parquet files

* throw an exception on empty columns to read

* fixed compile errors

* fixed a bug in building nullable columns from const columns

* try to fixed compile bugs

* fixed a bug in ceate partition columns

* delete BatchParquetFileSource

* fixed code style
    @lgbo-ustc
    lgbo-ustc authored Sep 30, 2022
    Configuration menu
    Copy the full SHA
    198ba4e View commit details
    Browse the repository at this point in the history

  2. improve the performance of converting row batch to column batch (Clic… 

    …kHouse#136)

* improve the performance of converting row to column

improve the performance of converting row to column by reducing jvm calls

* try to release local jobject

* rename interface
    @lgbo-ustc
    lgbo-ustc authored Sep 30, 2022
    Configuration menu
    Copy the full SHA
    d6a6cc9 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2022

  1. improve: catch java exception in c++ (ClickHouse#143)

    @lgbo-ustc
    lgbo-ustc authored Oct 10, 2022
    Configuration menu
    Copy the full SHA
    1eed312 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2022

  1. Support loading setting from config file and improve logging. (ClickH… 

    …ouse#118)

* support config load

* fix building error

* fix bugs

* commit again

* improve function params, std::string -> const std::string&

* refinement configure loading

* fixed code style

Co-authored-by: lgbo-ustc <[email protected]>
    @taiyang-li @lgbo-ustc
    taiyang-li and lgbo-ustc authored Oct 12, 2022
    Configuration menu
    Copy the full SHA
    e3b48c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. revert log level to error (ClickHouse#148)

    @liuneng1994
    liuneng1994 authored Oct 13, 2022
    Configuration menu
    Copy the full SHA
    48322be View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2022

  1. [CH-123] Support short/byte/binary/decimal/array/map/struct (ClickHou… 

    …se#128)

* support calculate backing length of different types

* remove comment

* rename symbols

* apply BackingDataLengthCalculator

* support decimal from ch column to spark row

* fix decimal issue in ch column to spark row

* refactor SparkRowInfo

* fix building error

* wip

* implement demo

* dev map

* finish map and tuple

* fix building error

* finish writer dev

* fix code style

* ready to improve spark row to ch column

* wip

* finish array/map/tuple reader

* fix building error

* add some uts

* finish debug

* commit again

* finish plan convert

* add benchmark

* improve performance

* try to optimize spark row to ch column

* continue

* optimize SparkRowInfo::SparkRowInfo

* wrap functions

* improve performance

* improve from 360ms to 240 ms

* finish optimizeing performance

* add benchmark for BM_SparkRowTOCHColumn_Lineitem

* refactor spark row reader

* finish tests

* revert cmake

* fix code style

* fix code style

* fix memory leak

* fix build error

* fix building error in debug mode

* add test data file

* add build type, convert ch type to substrait type

* refactor jni interface: native column type

* fixbug of decimal

* replace decimal.parquet

* add data array.parquet

* add test data map.parquet

* add test data file

* finish debug

* wip

* fix logging

* fix address problem

* fix core dump

* fix code style
    @taiyang-li
    taiyang-li authored Oct 14, 2022
    Configuration menu
    Copy the full SHA
    729900c View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2022

  1. Revert "[CH-123] Support short/byte/binary/decimal/array/map/struct (C… 

    …lickHouse#128)" (ClickHouse#159)

This reverts commit 729900c.
    @liuneng1994
    liuneng1994 authored Oct 17, 2022
    Configuration menu
    Copy the full SHA
    8ba0bed View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2022

  1. support right semi join on substrait (ClickHouse#164)

    @liuneng1994
    liuneng1994 authored Oct 20, 2022
    Configuration menu
    Copy the full SHA
    04939a8 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. [CH-120] Support memory manager (ClickHouse#168) 

    * support memory manager

* integrate memory allocator

* fix error

* fix memory leak

* exclude broadcast memory allocation

* remove useless code
    @liuneng1994
    liuneng1994 authored Oct 21, 2022
    Configuration menu
    Copy the full SHA
    50f3be5 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. fixed a bug: coredump caused by transform a row batch with empty requ… 

    …ired columns into `DB::Block` (ClickHouse#141)

* fixed bug

the required columns could be empty in spark plan, and cause a coredump in SparkRowToCHColumn

* fixed a bug
    @lgbo-ustc
    lgbo-ustc authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    057f1e9 View commit details
    Browse the repository at this point in the history

  2. [ClickHouse#156]support sort op (ClickHouse#160) 

    * support sort op

* fixed null order

* fixed null ordering
    @lgbo-ustc
    lgbo-ustc authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    45d115f View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2022

  1. [CH-169] add reserve memory no exception (ClickHouse#173) 

    * add JNIEXPORT and JNICALL

* add a concurrentMap implementation

* add reserve no exception

* Revert "add JNIEXPORT and JNICALL"

This reverts commit 24f3f71.

* add reserve no exception

* change reserve function
    @liuneng1994
    liuneng1994 authored Oct 26, 2022
    Configuration menu
    Copy the full SHA
    1b53b64 View commit details
    Browse the repository at this point in the history

  2. add micro for jni env (ClickHouse#177)

    @liuneng1994
    liuneng1994 authored Oct 26, 2022
    Configuration menu
    Copy the full SHA
    17bdf88 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2022

  1. [CH-45]support count(*/count(1) (ClickHouse#175) 

    * support count(*)

support count(*)/count(1)

* fixed code style

* update variables' names
    @lgbo-ustc
    lgbo-ustc authored Oct 31, 2022
    Configuration menu
    Copy the full SHA
    844e7f5 View commit details
    Browse the repository at this point in the history

  2. [CH-180] Support non-HA mode for ClickHouse reading from HDFS (ClickH… 

    …ouse#181)

Support non-HA mode for ClickHouse reading from HDFS.

Close ClickHouse#180 .
    @zzcclp
    zzcclp authored Oct 31, 2022
    Configuration menu
    Copy the full SHA
    ce3bc0b View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2022

  1. fix concurrent problem in allocator (ClickHouse#183)

    @liuneng1994
    liuneng1994 authored Nov 2, 2022
    Configuration menu
    Copy the full SHA
    fc4843e View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2022

  1. [CH-170] Implement strings functions between spark and clickhouse: co… 

    …ncat/instr/char_length/replace/abs/chr/ceil/floor/exp/power (ClickHouse#172)

* add functions concat/char_length/instr

* drop functions related with clickhouse/clickhouse repo

* add function abs/chr/ceil/floor/exp/power/pmod

* adject function order

* swap args of function replace
    @taiyang-li
    taiyang-li authored Nov 3, 2022
    Configuration menu
    Copy the full SHA
    34245a0 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2022

  1. [CH-123] Support short/byte/binary/decimal/array/map/struct (ClickHou… 

    …se#163)

* support calculate backing length of different types

* remove comment

* rename symbols

* apply BackingDataLengthCalculator

* support decimal from ch column to spark row

* fix decimal issue in ch column to spark row

* refactor SparkRowInfo

* fix building error

* wip

* implement demo

* dev map

* finish map and tuple

* fix building error

* finish writer dev

* fix code style

* ready to improve spark row to ch column

* wip

* finish array/map/tuple reader

* fix building error

* add some uts

* finish debug

* commit again

* finish plan convert

* add benchmark

* improve performance

* try to optimize spark row to ch column

* continue

* optimize SparkRowInfo::SparkRowInfo

* wrap functions

* improve performance

* improve from 360ms to 240 ms

* finish optimizeing performance

* add benchmark for BM_SparkRowTOCHColumn_Lineitem

* refactor spark row reader

* finish tests

* revert cmake

* fix code style

* fix code style

* fix memory leak

* fix build error

* fix building error in debug mode

* add test data file

* add build type, convert ch type to substrait type

* refactor jni interface: native column type

* fixbug of decimal

* replace decimal.parquet

* add data array.parquet

* add test data map.parquet

* add test data file

* finish debug

* wip

* fix logging

* fix address problem

* fix core dump

* fix code style

* throw exception when complex types in substrait plan is in nullable

* make ch complex type nullable

* support nullable complex types

* add tests for parquet nullable

* add uts for all types

* debug gtest_parquet_read

* fix issue: Kyligence#166

* remove stdout log

* fix bug of binary null

* remove logs

* remove useless files
    @taiyang-li
    taiyang-li authored Nov 4, 2022
    Configuration menu
    Copy the full SHA
    d2b8933 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2022

  1. [CH-187]Support spark math functions (ClickHouse#188) 

    * support more math functions

* rename some functions

* add debug logging

* revert log level

* support function greatest and least

* support cast binary

* support quarter
    @taiyang-li
    taiyang-li authored Nov 11, 2022
    Configuration menu
    Copy the full SHA
    bc28ef0 View commit details
    Browse the repository at this point in the history

  2. [CH-184] support prewhere (ClickHouse#185) 

    * add prewhere support

* ignore delta directory

* fix prewhere parse error when has in funciton

* fix is_not_null result type error
    @liuneng1994
    liuneng1994 authored Nov 11, 2022
    Configuration menu
    Copy the full SHA
    1cbbf75 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2022

  1. [CH-190] enable tests in GlutenDataFrameAggregateSuite (ClickHouse#192) 

    * [CH-190] enable tests in GlutenDataFrameAggregateSuite

* [CH-190] fix review comments
    Hongbin Ma authored Nov 13, 2022
    Configuration menu
    Copy the full SHA
    4fda39e View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2022

  1. [CH-197] Fix bug when c2r with const columns (ClickHouse#198) 

    * close Kyligence#197

* fix gtest build error
    @taiyang-li
    taiyang-li authored Nov 18, 2022
    Configuration menu
    Copy the full SHA
    0fc2fae View commit details
    Browse the repository at this point in the history

  2. close Kyligence#199 (ClickHouse#200)

    @taiyang-li
    taiyang-li authored Nov 18, 2022
    Configuration menu
    Copy the full SHA
    af81cb0 View commit details
    Browse the repository at this point in the history

  3. change any to string value (ClickHouse#193)

    @liuneng1994
    liuneng1994 authored Nov 18, 2022
    Configuration menu
    Copy the full SHA
    f48541f View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2022

  1. fixed (ClickHouse#207)

    @lgbo-ustc
    lgbo-ustc authored Nov 21, 2022
    Configuration menu
    Copy the full SHA
    60e9258 View commit details
    Browse the repository at this point in the history

  2. [CH-204] Fixed a bug in initializing settings

    @lgbo-ustc
    lgbo-ustc authored Nov 21, 2022
    Configuration menu
    Copy the full SHA
    e225f47 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2022

  1. [CH-186] support RangePartitioning (ClickHouse#189) 

    * WIP

* two way to partition now

* WIP: use actions dag to compare is too slow

* WIP

* fixed code style

* remove debug codes

* fixed code style

* fixed header include

* fixed a bug in tcp q20

* support range partition in shuffle splitter

* remove unused headers

* support expresions caculate in range paritioning
    @lgbo-ustc
    lgbo-ustc authored Nov 22, 2022
    Configuration menu
    Copy the full SHA
    e5b7449 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2022

  1. finish shift left and right (ClickHouse#217)

    @taiyang-li
    taiyang-li authored Nov 30, 2022
    Configuration menu
    Copy the full SHA
    b67c21b View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2022

  1. fix failed ch ut in apache/incubator-gluten#620 (ClickHouse#224)

    @taiyang-li
    taiyang-li authored Dec 1, 2022
    Configuration menu
    Copy the full SHA
    294cd16 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2022

  1. support trim both (ClickHouse#211)

    @taiyang-li
    taiyang-li authored Dec 5, 2022
    Configuration menu
    Copy the full SHA
    97c3f4f View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2022

  1. finish debug (ClickHouse#209)

    @taiyang-li
    taiyang-li authored Dec 6, 2022
    Configuration menu
    Copy the full SHA
    ad6dc45 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2022

  1. [CH-225]Fix decimal bug cased by big-endian encoding in spark row. (C… 

    …lickHouse#228)

* fix bug in issue 225

* fix bug of issue 225

* finish debug
    @taiyang-li
    taiyang-li authored Dec 7, 2022
    Configuration menu
    Copy the full SHA
    79b4286 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. Improve: reducing the open operation for the same file when reading p… 

    …arquet files (ClickHouse#213)

* optimization for reading parquet files. reducing the open operation for the same file

* update
    @lgbo-ustc
    lgbo-ustc authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    0a7ccba View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2022

  1. [CH-191] Support generate exec (ClickHouse#194) 

    * support function explode

* gluten_191

* finish debug

* fix code style

* improve step desc

* remove useless code

* fix build error

* update pb

* remove empty line
    @taiyang-li
    taiyang-li authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    e571255 View commit details
    Browse the repository at this point in the history

  2. Add spark check_overflow function and cast toDecimal32/64/128 (ClickH… 

    …ouse#231)

* add spark check_overflow function and cast toDecimal32/64/128

* fix check overflow allow null
    @loneylee
    loneylee authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    dc9b918 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2022

  1. support map[key] and array[index] operator for gluten (ClickHouse#216)

    @taiyang-li
    taiyang-li authored Dec 15, 2022
    Configuration menu
    Copy the full SHA
    d5af5eb View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2022

  1. support orc format files (ClickHouse#214)

    @lgbo-ustc
    lgbo-ustc authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    0f5b2ac View commit details
    Browse the repository at this point in the history

  2. [CH-236] support split/pmod/factorial/rand/ascii/concat_ws function (C… 

    …lickHouse#237)

* implement function ascii

* implement function ascii

* Update src/Functions/ascii.cpp

Co-authored-by: Vladimir C <[email protected]>

* Update src/Functions/ascii.cpp

Co-authored-by: Vladimir C <[email protected]>

* merge master and fix conflict

* modify as requested

* change as requested

* register function ascii

* add mapping for ascii

* enable limits for functions using FunctionTokens

* fix comment

* reset to original solution

* rename  alphaTokens to SplitByAlphaImpl

* improve doc and uts

* fix bug

* add mapping for splitByRegexp

* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add notice

* fix typo

* fix typo

* fix bug

* fix ub error

* fix ub error

* pmod: compatibility with Spark, better documentation

* register function pmod

* add mapping for pmod

* add function factorial

* add missed file

* update as request

* extract test of function factorial

* modify return type from Int64 to UInt64

* fix doc

* fix doc

* register function factorial

* add mapping for factorial

* add function canonicalRand

* add perf test

* revert rand.xml

* register function canonicalRand

* add mapping for canonicalRand

* Add function concatWs

* fix code style

* rename function

* rename files

* add alias concat_ws

* revert CMakeLists

* register function concat_ws

* add mapping for concat_ws

Co-authored-by: Vladimir C <[email protected]>
Co-authored-by: Alexey Milovidov <[email protected]>
    @taiyang-li @vdimir @alexey-milovidov
    3 people authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    a9e77e2 View commit details
    Browse the repository at this point in the history

  3. Follow substrait's naming for bitwise functions (ClickHouse#238)

    @loneylee
    loneylee authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    f091941 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. [CH-219] Support rlike/regexp_replace/regexp_extract/coalesce/DATE_AD… 

    …D/DATE_SUB/DATEDIFF/modulo/concat_ws/collect_list/FROM_UNIXTIME (ClickHouse#230)

* support function remainder

* support collect_list

* support function from_unixtime partly

* support datediff

* support datediff

* Add support of Date32 arguments

* Add ToExtendedRelativeDayNumImpl

* Add transforms for other arguments lke year, quarter etc

* Add test 02457_datediff_via_unix_epoch

* Set UTC for 02457_datediff_via_unix_epoch

* Fix message about allowed argument types

* Fix Date32 argument in dispatchConstForSecondColumn

* Add 02458_datediff_date32 test

* Update documentation

* Use {} in error message formatting

* Add UTC for toDate32 in tests

* Add toStableRelativeHourNum

* Remove UTC from 02458_datediff_date32 and 02457_datediff_via_unix_epoch tests

* Remove toExtendedReplated; Add template argument is_extended_result

* Add toStableRelativeHourNum to gtest_DateLUTImpl.cpp

* Replace is_extended_result by ResultPrecision

* finish dev

* remove duplicated log

* finish dev

* support to_unixtimestamp and unixtimestamp function

Co-authored-by: Roman Vasin <[email protected]>
    @taiyang-li @rvasin
    taiyang-li and rvasin authored Dec 20, 2022
    Configuration menu
    Copy the full SHA
    11ecd0e View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2022

  1. fixed (ClickHouse#243)

    @lgbo-ustc
    lgbo-ustc authored Dec 26, 2022
    Configuration menu
    Copy the full SHA
    5ab0b59 View commit details
    Browse the repository at this point in the history

  2. support window (ClickHouse#235)

    @lgbo-ustc
    lgbo-ustc authored Dec 26, 2022
    Configuration menu
    Copy the full SHA
    de33c20 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2022

  1. [CH-247] support async reader when reading parquet from hdfs

    @binmahone
    binmahone committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    3d5b690 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2023

  1. not null

    @liuneng1994 @binmahone
    liuneng1994 authored and binmahone committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    c73ccc2 View commit details
    Browse the repository at this point in the history