Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize merge algorithm for data sizes equal or greater then 4M items with SLM cache usage #1937

Draft
wants to merge 80 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
cd477a3
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 14, 2024
c76ad72
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 14, 2024
cdf7d2b
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 14, 2024
e5ced86
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 14, 2024
99dfb4a
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
e79d00c
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
30b70b3
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
e9222aa
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
ed1a1b2
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
744bcdb
@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.…
SergeyKopienko Nov 15, 2024
2239811
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
4039c85
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
50f0445
extract function load_data_into_slm to load source data into SLM
SergeyKopienko Nov 15, 2024
3a0a862
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
ab38d96
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
cbbfb06
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
f73cf27
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
75f6e4a
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
15f5291
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
68f3d25
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
07d7143
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
6c852bf
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
64d856d
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 15, 2024
3d233dd
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
6a66b1b
@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.…
SergeyKopienko Nov 18, 2024
62bf5ce
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
bf5b8ce
@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.…
SergeyKopienko Nov 18, 2024
435259c
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
809c073
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
021dbb8
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
2fa0267
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
3f95ff1
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
0caf24c
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
b12eada
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
c2c66ac
Revert "@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_syc…
SergeyKopienko Nov 18, 2024
f55c36f
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
1b5f0a7
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
55169cc
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
9fac5b9
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
a3284b3
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
167490f
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
c72c92d
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
ba224e0
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
8bd40fa
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
f93fade
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 18, 2024
eab6cee
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 19, 2024
f3f8468
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 19, 2024
4bbeb50
remove usage of __merge_slm_helper
SergeyKopienko Nov 19, 2024
0e5c0d2
load_data_into_slm now working only with the same data types too
SergeyKopienko Nov 19, 2024
501e58e
remove __calc_wi_amount_for_data_reading function and it's usage
SergeyKopienko Nov 19, 2024
ebae707
modify load_data_into_slm
SergeyKopienko Nov 19, 2024
6459dac
@@@
SergeyKopienko Nov 19, 2024
e615d65
Revert "@@@"
SergeyKopienko Nov 19, 2024
38ad9f2
remove load_data_into_slm_impl and etc.
SergeyKopienko Nov 19, 2024
f9df4d4
restore __parallel_merge_submitter call
SergeyKopienko Nov 19, 2024
04feeb9
call __parallel_merge_submitter_large for 1Mb of merging data and more
SergeyKopienko Nov 19, 2024
1dd0f40
Merge branch 'dev/skopienko/optimize_merge_to_main_V21_fix_cache_load…
SergeyKopienko Nov 19, 2024
eb2de95
improvement of for-loop in loading data into SLM cache
SergeyKopienko Nov 19, 2024
3ec199d
improvement of for-loop in loading data into SLM cache
SergeyKopienko Nov 19, 2024
fde1797
Revert "include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_me…
SergeyKopienko Nov 19, 2024
5ba4cd5
rewrite cooperative data load into SLM
SergeyKopienko Nov 19, 2024
28e2e37
evalueate __chunk_of_data_reading through SLM bank size
SergeyKopienko Nov 19, 2024
00dcb1d
Using 2/3 of available SLM
SergeyKopienko Nov 19, 2024
144de4a
balance data load into SLM cache
SergeyKopienko Nov 19, 2024
1812dbb
balance data load into SLM cache
SergeyKopienko Nov 19, 2024
3fdd673
Using 4/5 of available SLM
SergeyKopienko Nov 19, 2024
0ca542a
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
b32c911
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
7cda3e4
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
253ca8d
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
952871e
@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.…
SergeyKopienko Nov 20, 2024
b6e1d1c
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
ef568f0
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
3dced51
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
39b68e4
Revert "@@@ include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_syc…
SergeyKopienko Nov 20, 2024
2da44ff
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 20, 2024
b04b25e
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 21, 2024
cc5f8f0
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 23, 2024
4ec32e6
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge_sort…
SergeyKopienko Nov 23, 2024
1810317
include/oneapi/dpl/pstl/hetero/dpcpp/parallel_backend_sycl_merge.h - …
SergeyKopienko Nov 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading