Skip to content
This repository has been archived by the owner on Aug 16, 2023. It is now read-only.

Commit

Permalink
[skip e2e] Add benchmark ref logs for glove test (#313)
Browse files Browse the repository at this point in the history 
Signed-off-by: yudong.cai <[email protected]>
  • Loading branch information
@cydrain
cydrain authored Jul 26, 2022
1 parent 0909810 commit 4944d0f
Show file tree
Hide file tree
Showing 43 changed files with 647 additions and 0 deletions.
34 changes: 34 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_annoy.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_ANNOY
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_ANNOY
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.289 s] Normalizing train dataset
[0.588 s] Loading test data
[0.590 s] Normalizing test dataset
[0.593 s] Loading ground truth data
2022-07-25 18:01:43,221 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 18:01:43,221 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.595 s] Creating CPU index "ANNOY"
[0.595 s] Reading index file: glove-200-angular_ANNOY_8.index
[0.595 s] Building all on 1183514 vectors
[21.936 s] Writing index file: glove-200-angular_ANNOY_8.index

[23.274 s] glove-200-angular | ANNOY | n_trees=8
================================================================================
search_k = 50, nq = 10000, k = 100, elapse = 0.053s, R@ = 0.0095
search_k = 100, nq = 10000, k = 100, elapse = 0.067s, R@ = 0.0148
search_k = 500, nq = 10000, k = 100, elapse = 0.245s, R@ = 0.0372
================================================================================
[23.827 s] Test 'glove-200-angular/ANNOY' done

[ OK ] Benchmark_knowhere_float.TEST_ANNOY (23878 ms)
[----------] 1 test from Benchmark_knowhere_float (23878 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (23878 ms total)
[ PASSED ] 1 test.
37 changes: 37 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_hnsw.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_HNSW
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_HNSW
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.295 s] Normalizing train dataset
[0.594 s] Loading test data
[0.596 s] Normalizing test dataset
[0.599 s] Loading ground truth data
2022-07-25 17:57:59,786 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:57:59,786 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.601 s] Creating CPU index "HNSW"
[0.601 s] Reading index file: glove-200-angular_HNSW_16_200.index
[0.601 s] Building all on 1183514 vectors
[211.034 s] Writing index file: glove-200-angular_HNSW_16_200.index

[212.299 s] glove-200-angular | HNSW | M=16 | efConstruction=200
================================================================================
ef = 16, nq = 10000, k = 100, elapse = 1.027s, R@ = 0.6288
ef = 32, nq = 10000, k = 100, elapse = 1.024s, R@ = 0.6288
ef = 64, nq = 10000, k = 100, elapse = 1.026s, R@ = 0.6288
ef = 128, nq = 10000, k = 100, elapse = 1.251s, R@ = 0.6627
ef = 256, nq = 10000, k = 100, elapse = 2.241s, R@ = 0.7423
ef = 512, nq = 10000, k = 100, elapse = 4.114s, R@ = 0.8052
================================================================================
[223.381 s] Test 'glove-200-angular/HNSW' done

[ OK ] Benchmark_knowhere_float.TEST_HNSW (223435 ms)
[----------] 1 test from Benchmark_knowhere_float (223435 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (223435 ms total)
[ PASSED ] 1 test.
32 changes: 32 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_idmap.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_IDMAP
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_IDMAP
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.601 s] Normalizing train dataset
[0.915 s] Loading test data
[0.926 s] Normalizing test dataset
[0.928 s] Loading ground truth data
2022-07-25 17:14:41,095 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:14:41,095 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.936 s] Creating CPU index "FLAT"
[0.936 s] Reading index file: glove-200-angular_FLAT.index
[0.936 s] Building all on 1183514 vectors
[1.287 s] Writing index file: glove-200-angular_FLAT.index

[2.337 s] glove-200-angular | FLAT
================================================================================
nq = 10000, k = 100, elapse = 60.460s, R@ = 1.0000
================================================================================
[62.871 s] Test 'glove-200-angular/FLAT' done

[ OK ] Benchmark_knowhere_float.TEST_IDMAP (62913 ms)
[----------] 1 test from Benchmark_knowhere_float (62913 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (62913 ms total)
[ PASSED ] 1 test.
41 changes: 41 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_ivf_flat_nm.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_IVF_FLAT_NM
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_IVF_FLAT_NM
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.314 s] Normalizing train dataset
[0.629 s] Loading test data
[0.632 s] Normalizing test dataset
[0.635 s] Loading ground truth data
2022-07-25 17:15:43,714 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:15:43,714 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.638 s] Creating CPU index "IVF_FLAT"
[0.638 s] Reading index file: glove-200-angular_IVF_FLAT_1024.index
[0.638 s] Building all on 1183514 vectors
[26.910 s] Writing index file: glove-200-angular_IVF_FLAT_1024.index

[27.478 s] glove-200-angular | IVF_FLAT | nlist=1024
================================================================================
nprobe = 1, nq = 10000, k = 100, elapse = 0.580s, R@ = 0.2937
nprobe = 2, nq = 10000, k = 100, elapse = 0.789s, R@ = 0.4115
nprobe = 4, nq = 10000, k = 100, elapse = 1.516s, R@ = 0.5253
nprobe = 8, nq = 10000, k = 100, elapse = 2.853s, R@ = 0.6252
nprobe = 16, nq = 10000, k = 100, elapse = 5.510s, R@ = 0.7136
nprobe = 32, nq = 10000, k = 100, elapse = 10.552s, R@ = 0.7927
nprobe = 64, nq = 10000, k = 100, elapse = 20.435s, R@ = 0.8617
nprobe = 128, nq = 10000, k = 100, elapse = 40.166s, R@ = 0.9197
nprobe = 256, nq = 10000, k = 100, elapse = 78.085s, R@ = 0.9652
nprobe = 512, nq = 10000, k = 100, elapse = 156.075s, R@ = 0.9926
================================================================================
[344.730 s] Test 'glove-200-angular/IVF_FLAT' done

[ OK ] Benchmark_knowhere_float.TEST_IVF_FLAT_NM (344771 ms)
[----------] 1 test from Benchmark_knowhere_float (344771 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (344771 ms total)
[ PASSED ] 1 test.
91 changes: 91 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_ivf_hnsw.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,91 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_IVF_HNSW
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_IVF_HNSW
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.288 s] Normalizing train dataset
[0.593 s] Loading test data
[0.595 s] Normalizing test dataset
[0.598 s] Loading ground truth data
2022-07-25 17:25:28,291 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:25:28,291 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.600 s] Creating CPU index "IVF_HNSW"
[0.600 s] Reading index file: glove-200-angular_IVF_HNSW_1024_16_200.index
[0.600 s] Building all on 1183514 vectors
[4.312 s] Writing index file: glove-200-angular_IVF_HNSW_1024_16_200.index

[5.894 s] glove-200-angular | IVF_HNSW nlist=1024 | M=16 | efConstruction=200
================================================================================
nprobe = 1, ef = 16, nq = 10000, k = 100, elapse = 0.432s, R@ = 0.2485
nprobe = 1, ef = 32, nq = 10000, k = 100, elapse = 0.442s, R@ = 0.2517
nprobe = 1, ef = 64, nq = 10000, k = 100, elapse = 0.454s, R@ = 0.2523
nprobe = 1, ef = 128, nq = 10000, k = 100, elapse = 0.479s, R@ = 0.2525
nprobe = 1, ef = 256, nq = 10000, k = 100, elapse = 0.527s, R@ = 0.2525
nprobe = 1, ef = 512, nq = 10000, k = 100, elapse = 0.590s, R@ = 0.2525
nprobe = 2, ef = 16, nq = 10000, k = 100, elapse = 0.827s, R@ = 0.3614
nprobe = 2, ef = 32, nq = 10000, k = 100, elapse = 0.839s, R@ = 0.3658
nprobe = 2, ef = 64, nq = 10000, k = 100, elapse = 0.847s, R@ = 0.3665
nprobe = 2, ef = 128, nq = 10000, k = 100, elapse = 0.872s, R@ = 0.3666
nprobe = 2, ef = 256, nq = 10000, k = 100, elapse = 0.914s, R@ = 0.3667
nprobe = 2, ef = 512, nq = 10000, k = 100, elapse = 0.978s, R@ = 0.3667
nprobe = 4, ef = 16, nq = 10000, k = 100, elapse = 1.586s, R@ = 0.4735
nprobe = 4, ef = 32, nq = 10000, k = 100, elapse = 1.585s, R@ = 0.4790
nprobe = 4, ef = 64, nq = 10000, k = 100, elapse = 1.602s, R@ = 0.4802
nprobe = 4, ef = 128, nq = 10000, k = 100, elapse = 1.615s, R@ = 0.4803
nprobe = 4, ef = 256, nq = 10000, k = 100, elapse = 1.704s, R@ = 0.4803
nprobe = 4, ef = 512, nq = 10000, k = 100, elapse = 1.759s, R@ = 0.4803
nprobe = 8, ef = 16, nq = 10000, k = 100, elapse = 3.029s, R@ = 0.5799
nprobe = 8, ef = 32, nq = 10000, k = 100, elapse = 3.026s, R@ = 0.5868
nprobe = 8, ef = 64, nq = 10000, k = 100, elapse = 3.011s, R@ = 0.5882
nprobe = 8, ef = 128, nq = 10000, k = 100, elapse = 3.041s, R@ = 0.5884
nprobe = 8, ef = 256, nq = 10000, k = 100, elapse = 3.083s, R@ = 0.5884
nprobe = 8, ef = 512, nq = 10000, k = 100, elapse = 3.224s, R@ = 0.5884
nprobe = 16, ef = 16, nq = 10000, k = 100, elapse = 5.772s, R@ = 0.6725
nprobe = 16, ef = 32, nq = 10000, k = 100, elapse = 5.791s, R@ = 0.6819
nprobe = 16, ef = 64, nq = 10000, k = 100, elapse = 5.765s, R@ = 0.6835
nprobe = 16, ef = 128, nq = 10000, k = 100, elapse = 5.749s, R@ = 0.6835
nprobe = 16, ef = 256, nq = 10000, k = 100, elapse = 5.804s, R@ = 0.6835
nprobe = 16, ef = 512, nq = 10000, k = 100, elapse = 5.839s, R@ = 0.6835
nprobe = 32, ef = 16, nq = 10000, k = 100, elapse = 10.972s, R@ = 0.7670
nprobe = 32, ef = 32, nq = 10000, k = 100, elapse = 11.017s, R@ = 0.7670
nprobe = 32, ef = 64, nq = 10000, k = 100, elapse = 11.042s, R@ = 0.7701
nprobe = 32, ef = 128, nq = 10000, k = 100, elapse = 10.944s, R@ = 0.7701
nprobe = 32, ef = 256, nq = 10000, k = 100, elapse = 10.959s, R@ = 0.7701
nprobe = 32, ef = 512, nq = 10000, k = 100, elapse = 10.994s, R@ = 0.7701
nprobe = 64, ef = 16, nq = 10000, k = 100, elapse = 21.139s, R@ = 0.8441
nprobe = 64, ef = 32, nq = 10000, k = 100, elapse = 21.083s, R@ = 0.8441
nprobe = 64, ef = 64, nq = 10000, k = 100, elapse = 21.057s, R@ = 0.8441
nprobe = 64, ef = 128, nq = 10000, k = 100, elapse = 21.062s, R@ = 0.8447
nprobe = 64, ef = 256, nq = 10000, k = 100, elapse = 20.951s, R@ = 0.8447
nprobe = 64, ef = 512, nq = 10000, k = 100, elapse = 21.012s, R@ = 0.8447
nprobe = 128, ef = 16, nq = 10000, k = 100, elapse = 41.010s, R@ = 0.9090
nprobe = 128, ef = 32, nq = 10000, k = 100, elapse = 41.028s, R@ = 0.9090
nprobe = 128, ef = 64, nq = 10000, k = 100, elapse = 41.051s, R@ = 0.9090
nprobe = 128, ef = 128, nq = 10000, k = 100, elapse = 41.094s, R@ = 0.9090
nprobe = 128, ef = 256, nq = 10000, k = 100, elapse = 40.865s, R@ = 0.9091
nprobe = 128, ef = 512, nq = 10000, k = 100, elapse = 40.824s, R@ = 0.9091
nprobe = 256, ef = 16, nq = 10000, k = 100, elapse = 80.438s, R@ = 0.9596
nprobe = 256, ef = 32, nq = 10000, k = 100, elapse = 80.401s, R@ = 0.9596
nprobe = 256, ef = 64, nq = 10000, k = 100, elapse = 80.452s, R@ = 0.9596
nprobe = 256, ef = 128, nq = 10000, k = 100, elapse = 80.424s, R@ = 0.9596
nprobe = 256, ef = 256, nq = 10000, k = 100, elapse = 80.380s, R@ = 0.9596
nprobe = 256, ef = 512, nq = 10000, k = 100, elapse = 80.183s, R@ = 0.9597
nprobe = 512, ef = 16, nq = 10000, k = 100, elapse = 158.422s, R@ = 0.9909
nprobe = 512, ef = 32, nq = 10000, k = 100, elapse = 158.393s, R@ = 0.9909
nprobe = 512, ef = 64, nq = 10000, k = 100, elapse = 158.229s, R@ = 0.9909
nprobe = 512, ef = 128, nq = 10000, k = 100, elapse = 158.389s, R@ = 0.9909
nprobe = 512, ef = 256, nq = 10000, k = 100, elapse = 158.341s, R@ = 0.9909
nprobe = 512, ef = 512, nq = 10000, k = 100, elapse = 158.213s, R@ = 0.9909
================================================================================
[1951.439 s] Test 'glove-200-angular/IVF_HNSW' done

[ OK ] Benchmark_knowhere_float.TEST_IVF_HNSW (1951484 ms)
[----------] 1 test from Benchmark_knowhere_float (1951484 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (1951484 ms total)
[ PASSED ] 1 test.
50 changes: 50 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_ivf_pq.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_IVF_PQ
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_IVF_PQ
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.291 s] Normalizing train dataset
[0.597 s] Loading test data
[0.599 s] Normalizing test dataset
[0.602 s] Loading ground truth data
2022-07-25 17:24:15,458 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:24:15,458 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.604 s] Creating CPU index "IVF_PQ"
[0.604 s] Reading index file: glove-200-angular_IVF_PQ_1024_8.index
[0.604 s] Building all on 1183514 vectors
[58.840 s] Writing index file: glove-200-angular_IVF_PQ_1024_8.index

[58.885 s] glove-200-angular | IVF_PQ | nlist=1024
================================================================================
nprobe = 1, nq = 10000, k = 100, elapse = 0.152s, R@ = 0.1351
nprobe = 2, nq = 10000, k = 100, elapse = 0.156s, R@ = 0.1545
nprobe = 4, nq = 10000, k = 100, elapse = 0.258s, R@ = 0.1654
nprobe = 8, nq = 10000, k = 100, elapse = 0.239s, R@ = 0.1707
nprobe = 16, nq = 10000, k = 100, elapse = 0.338s, R@ = 0.1733
nprobe = 32, nq = 10000, k = 100, elapse = 0.576s, R@ = 0.1750
nprobe = 64, nq = 10000, k = 100, elapse = 0.895s, R@ = 0.1757
nprobe = 128, nq = 10000, k = 100, elapse = 1.545s, R@ = 0.1758
nprobe = 256, nq = 10000, k = 100, elapse = 3.048s, R@ = 0.1758
nprobe = 512, nq = 10000, k = 100, elapse = 6.047s, R@ = 0.1758
================================================================================
[72.803 s] Test 'glove-200-angular/IVF_PQ' done

[72.803 s] Creating CPU index "IVF_PQ"
[72.803 s] Reading index file: glove-200-angular_IVF_PQ_1024_16.index
[72.803 s] Building all on 1183514 vectors
unknown file: Failure
C++ exception with description "Error in void faiss::ProductQuantizer::set_derived_values() at /home/caiyd/vec/knowhere/thirdparty/faiss/faiss/impl/ProductQuantizer.cpp:187: Error: 'd % M == 0' failed: The dimension of the vector (d) should be a multiple of the number of subquantizers (M)" thrown in the test body.
[ FAILED ] Benchmark_knowhere_float.TEST_IVF_PQ (72829 ms)
[----------] 1 test from Benchmark_knowhere_float (72829 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (72829 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] Benchmark_knowhere_float.TEST_IVF_PQ

1 FAILED TEST
41 changes: 41 additions & 0 deletions unittest/benchmark/ref_log/glove/benchmark_knowhere_float/test_knowhere_ivf_sq8.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
Running main() from /home/caiyd/vec/knowhere/cmake_build/thirdparty/gtest/googletest-src/googletest/src/gtest_main.cc
Note: Google Test filter = Benchmark_knowhere_float.TEST_IVF_SQ8
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from Benchmark_knowhere_float
[ RUN ] Benchmark_knowhere_float.TEST_IVF_SQ8
[0.000 s] Loading HDF5 file: glove-200-angular.hdf5
[0.000 s] Loading train data
[0.286 s] Normalizing train dataset
[0.585 s] Loading test data
[0.588 s] Normalizing test dataset
[0.590 s] Loading ground truth data
2022-07-25 17:21:28,447 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS expect simdType::AVX2
2022-07-25 17:21:28,447 INFO [default] [KNOWHERE][SetSimdType][benchmark_knowh] FAISS hook AVX2
faiss::distance_compute_blas_threshold: 16384
[0.593 s] Creating CPU index "IVF_SQ8"
[0.593 s] Reading index file: glove-200-angular_IVF_SQ8_1024.index
[0.593 s] Building all on 1183514 vectors
[27.960 s] Writing index file: glove-200-angular_IVF_SQ8_1024.index

[28.391 s] glove-200-angular | IVF_SQ8 | nlist=1024
================================================================================
nprobe = 1, nq = 10000, k = 100, elapse = 0.198s, R@ = 0.2936
nprobe = 2, nq = 10000, k = 100, elapse = 0.365s, R@ = 0.4112
nprobe = 4, nq = 10000, k = 100, elapse = 0.688s, R@ = 0.5247
nprobe = 8, nq = 10000, k = 100, elapse = 1.321s, R@ = 0.6241
nprobe = 16, nq = 10000, k = 100, elapse = 2.404s, R@ = 0.7118
nprobe = 32, nq = 10000, k = 100, elapse = 4.479s, R@ = 0.7899
nprobe = 64, nq = 10000, k = 100, elapse = 9.130s, R@ = 0.8579
nprobe = 128, nq = 10000, k = 100, elapse = 17.194s, R@ = 0.9145
nprobe = 256, nq = 10000, k = 100, elapse = 33.775s, R@ = 0.9577
nprobe = 512, nq = 10000, k = 100, elapse = 68.342s, R@ = 0.9807
================================================================================
[166.956 s] Test 'glove-200-angular/IVF_SQ8' done

[ OK ] Benchmark_knowhere_float.TEST_IVF_SQ8 (166986 ms)
[----------] 1 test from Benchmark_knowhere_float (166986 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (166986 ms total)
[ PASSED ] 1 test.
Loading

0 comments on commit 4944d0f

Please sign in to comment.