Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: [benchmark][cluster] queryNode sparse panic in concurrent dql & ddl scene #38295

Open
1 task done
wangting0128 opened this issue Dec 9, 2024 · 2 comments
Open
1 task done

[Bug]: [benchmark][cluster] queryNode sparse panic in concurrent dql & ddl scene #38295

wangting0128 opened this issue Dec 9, 2024 · 2 comments
Assignees
@zhengbuqian
Labels
kind/bug Issues or changes related a bug test/benchmark benchmark test triage/accepted Indicates an issue or PR is ready to be actively worked on.
Milestone
2.4.21

Comments

@wangting0128
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:2.4-20241207-d2c20ed6-amd64
- Deployment mode(standalone or cluster):cluster
- MQ type(rocksmq, pulsar or kafka):pulsar    
- SDK version(e.g. pymilvus v2.0.0rc2):2.4.10rc9
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

argo task: weekly-stab-1733616000

server:

[2024-12-09 00:43:16,112 -  INFO - fouram]: [Base] Deploy initial state: 
I1208 00:11:57.477444     318 request.go:665] Waited for 1.178617083s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/helm.toolkit.fluxcd.io/v2beta1?timeout=32s
I1208 00:12:07.677866     318 request.go:665] Waited for 11.37896266s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/actions.summerwind.dev/v1alpha1?timeout=32s
I1208 00:12:17.877197     318 request.go:665] Waited for 8.397552249s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/jaegertracing.io/v1?timeout=32s
NAME                                                              READY   STATUS      RESTARTS         AGE     IP              NODE         NOMINATED NODE   READINESS GATES
weekly-stab-17316000-1-80-7860-etcd-0                             1/1     Running     0                11m     10.104.20.17    4am-node22   <none>           <none>
weekly-stab-17316000-1-80-7860-etcd-1                             1/1     Running     0                11m     10.104.21.9     4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-etcd-2                             1/1     Running     0                11m     10.104.19.106   4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-datacoord-59cc95475-fwq7p   1/1     Running     4 (5m45s ago)    11m     10.104.19.90    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-datanode-5465fc56c8-l66fh   1/1     Running     4 (5m45s ago)    11m     10.104.19.96    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-indexcoord-778d68474tlbc9   1/1     Running     0                11m     10.104.17.8     4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-indexnode-5d676f8f95zw9p9   1/1     Running     1 (10m ago)      11m     10.104.14.140   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-proxy-578bf4b49b-4l94g      1/1     Running     2 (4m15s ago)    11m     10.104.14.139   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-querycoord-577c559699ffxr   1/1     Running     2 (5m1s ago)     11m     10.104.14.141   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-querynode-7685d44945hmc9n   1/1     Running     3 (10m ago)      11m     10.104.33.224   4am-node36   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-rootcoord-856f5fd4f9c2hm2   1/1     Running     4 (5m21s ago)    11m     10.104.19.91    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-0                            1/1     Running     0                11m     10.104.20.16    4am-node22   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-1                            1/1     Running     0                11m     10.104.25.117   4am-node30   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-2                            1/1     Running     0                11m     10.104.21.10    4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-3                            1/1     Running     0                11m     10.104.32.57    4am-node39   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-0                    1/1     Running     0                11m     10.104.34.170   4am-node37   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-1                    1/1     Running     0                11m     10.104.25.118   4am-node30   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-2                    1/1     Running     0                11m     10.104.15.191   4am-node20   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-init-lmxzl           0/1     Completed   0                11m     10.104.19.95    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-broker-0                    1/1     Running     0                11m     10.104.17.10    4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-proxy-0                     1/1     Running     0                11m     10.104.17.9     4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-pulsar-init-6t76z           0/1     Completed   0                11m     10.104.19.92    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-recovery-0                  1/1     Running     0                11m     10.104.21.2     4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-0                 1/1     Running     0                11m     10.104.15.186   4am-node20   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-1                 1/1     Running     0                10m     10.104.17.36    4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-2                 1/1     Running     0                8m31s   10.104.33.250   4am-node36   <none>           <none> (base.py:261)
[2024-12-09 00:43:16,112 -  INFO - fouram]: [Cmd Exe]  kubectl get pods  -n qa-milvus  -o wide | grep -E 'NAME|weekly-stab-17316000-1-80-7860-milvus|weekly-stab-17316000-1-80-7860-minio|weekly-stab-17316000-1-80-7860-etcd|weekly-stab-17316000-1-80-7860-pulsar|weekly-stab-17316000-1-80-7860-zookeeper|weekly-stab-17316000-1-80-7860-kafka|weekly-stab-17316000-1-80-7860-log|weekly-stab-17316000-1-80-7860-tikv'  (util_cmd.py:14)
[2024-12-09 00:43:45,485 -  INFO - fouram]: [CliClient] pod details of release(weekly-stab-17316000-1-80-7860): 
 I1209 00:43:17.358461     437 request.go:665] Waited for 1.116773099s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/resolution.tekton.dev/v1alpha1?timeout=32s
I1209 00:43:27.359110     437 request.go:665] Waited for 11.117153436s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/source.toolkit.fluxcd.io/v1beta1?timeout=32s
I1209 00:43:37.559086     437 request.go:665] Waited for 8.197606719s due to client-side throttling, not priority and fairness, request: GET:https://kubernetes.default.svc.cluster.local/apis/operator.victoriametrics.com/v1beta1?timeout=32s
NAME                                                              READY   STATUS        RESTARTS         AGE     IP              NODE         NOMINATED NODE   READINESS GATES
weekly-stab-17316000-1-80-7860-etcd-0                             1/1     Running       0                24h     10.104.20.17    4am-node22   <none>           <none>
weekly-stab-17316000-1-80-7860-etcd-1                             1/1     Running       0                24h     10.104.21.9     4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-etcd-2                             1/1     Running       0                24h     10.104.19.106   4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-datacoord-59cc95475-fwq7p   1/1     Running       4 (24h ago)      24h     10.104.19.90    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-datanode-5465fc56c8-l66fh   1/1     Running       4 (24h ago)      24h     10.104.19.96    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-indexcoord-778d68474tlbc9   1/1     Running       0                24h     10.104.17.8     4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-indexnode-5d676f8f95zw9p9   1/1     Running       1 (24h ago)      24h     10.104.14.140   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-proxy-578bf4b49b-4l94g      1/1     Running       2 (24h ago)      24h     10.104.14.139   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-querycoord-577c559699ffxr   1/1     Running       2 (24h ago)      24h     10.104.14.141   4am-node18   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-querynode-7685d44945hmc9n   1/1     Running       4 (6h2m ago)     24h     10.104.33.224   4am-node36   <none>           <none>
weekly-stab-17316000-1-80-7860-milvus-rootcoord-856f5fd4f9c2hm2   1/1     Running       4 (24h ago)      24h     10.104.19.91    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-0                            1/1     Running       0                24h     10.104.20.16    4am-node22   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-1                            1/1     Running       0                24h     10.104.25.117   4am-node30   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-2                            1/1     Running       0                24h     10.104.21.10    4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-minio-3                            1/1     Running       0                24h     10.104.32.57    4am-node39   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-0                    1/1     Running       0                24h     10.104.34.170   4am-node37   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-1                    1/1     Running       0                24h     10.104.25.118   4am-node30   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-2                    1/1     Running       0                24h     10.104.15.191   4am-node20   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-bookie-init-lmxzl           0/1     Completed     0                24h     10.104.19.95    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-broker-0                    1/1     Running       0                24h     10.104.17.10    4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-proxy-0                     1/1     Running       0                24h     10.104.17.9     4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-pulsar-init-6t76z           0/1     Completed     0                24h     10.104.19.92    4am-node28   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-recovery-0                  1/1     Running       0                24h     10.104.21.2     4am-node24   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-0                 1/1     Running       0                24h     10.104.15.186   4am-node20   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-1                 1/1     Running       0                24h     10.104.17.36    4am-node23   <none>           <none>
weekly-stab-17316000-1-80-7860-pulsar-zookeeper-2                 1/1     Running       0                24h     10.104.33.250   4am-node36   <none>           <none>

queryNode panic:
queryNode_panic.log

image

client logs:

[2024-12-08 18:41:52,347 - ERROR - fouram]: RPC error: [search], <MilvusException: (code=503, message=failed to search: service internal error: target version mismatch, collection: 454457144291560318, channel: by-dev-rootcoord-dml_7_454457144291560318v1,  current target version: 0, leader version: 0: channel not available[channel=by-dev-rootcoord-dml_7_454457144291560318v1])>, <Time:{'RPC start': '2024-12-08 18:41:31.296330', 'RPC error': '2024-12-08 18:41:52.347636'}> (decorators.py:147)
[2024-12-08 18:42:13,366 - ERROR - fouram]: RPC error: [search], <MilvusException: (code=503, message=failed to search: service internal error: target version mismatch, collection: 454457144291560318, channel: by-dev-rootcoord-dml_7_454457144291560318v1,  current target version: 1733683289698637049, leader version: 0: channel not available[channel=by-dev-rootcoord-dml_7_454457144291560318v1])>, <Time:{'RPC start': '2024-12-08 18:41:52.348551', 'RPC error': '2024-12-08 18:42:13.366691'}> (decorators.py:147)
[2024-12-08 18:42:25,735 - ERROR - fouram]: RPC error: [search], <MilvusException: (code=503, message=failed to search: service internal error: target version mismatch, collection: 454457144205903441, channel: by-dev-rootcoord-dml_1_454457144205903441v1,  current target version: 1733683274985886191, leader version: 0: channel not available[channel=by-dev-rootcoord-dml_1_454457144205903441v1])>, <Time:{'RPC start': '2024-12-08 18:42:04.713464', 'RPC error': '2024-12-08 18:42:25.735621'}> (decorators.py:147)
[2024-12-08 18:42:34,687 - ERROR - fouram]: RPC error: [search], <MilvusException: (code=503, message=failed to search: service internal error: target version mismatch, collection: 454457144205903441, channel: by-dev-rootcoord-dml_1_454457144205903441v1,  current target version: 1733683274985886191, leader version: 0: channel not available[channel=by-dev-rootcoord-dml_1_454457144205903441v1])>, <Time:{'RPC start': '2024-12-08 18:42:09.778728', 'RPC error': '2024-12-08 18:42:34.687032'}> (decorators.py:147)

Expected Behavior

No response

Steps To Reproduce

1. create a collection with fields: 'id'(primary key), 'sparse_float_vector', 'float_1'
2. build SPARSE_INVERTED_INDEX index on field 'sparse_float_vector'
3. insert 4m data
4. flush collection
5. build index again
6. load collection
7. concurrent requests:
   - search
   - query
   - load
   - scene_search_test: fields: 'id', 'sparse_float_vector'
     (collection: create->insert->flush->index->load->search->drop)

Milvus Log

No response

Anything else?

test result:

[2024-12-09 00:41:00,502 -  INFO - fouram]: Print locust final stats. (locust_runner.py:56)
[2024-12-09 00:41:00,503 -  INFO - fouram]: Type     Name                                                                          # reqs      # fails |    Avg     Min     Max    Med |   req/s  failures/s (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: --------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|----------- (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: grpc     load                                                                           10722     0(0.00%) |    364       7   12297     18 |    0.12        0.00 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: grpc     query                                                                         107508     0(0.00%) |    142       2   53152      4 |    1.24        0.00 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: grpc     scene_insert_delete_flush                                                      10713 2492(23.26%) | 109916    2440  431494  66000 |    0.12        0.03 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: grpc     scene_search_test                                                              10566     1(0.01%) |  47159   12270  151094  46000 |    0.12        0.00 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: grpc     search                                                                        215423     2(0.00%) |    134      13   58027     20 |    2.49        0.00 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]: --------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|----------- (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]:          Aggregated                                                                    354932  2495(0.70%) |   4857       2  431494     19 |    4.11        0.03 (stats.py:789)
[2024-12-09 00:41:00,503 -  INFO - fouram]:  (stats.py:790)
[2024-12-09 00:41:00,505 -  INFO - fouram]: [PerfTemplate] Report data: 
{'server': {'deploy_tool': 'helm',
            'deploy_mode': 'cluster',
            'config_name': 'cluster_8c16m',
            'config': {'queryNode': {'resources': {'limits': {'cpu': 8.0, 'memory': '32Gi'}, 'requests': {'cpu': 6.0, 'memory': '16Gi'}}, 'replicas': 1},
                       'indexNode': {'resources': {'limits': {'cpu': '8.0', 'memory': '16Gi'}, 'requests': {'cpu': '5.0', 'memory': '9Gi'}}},
                       'dataNode': {'resources': {'limits': {'cpu': '8.0', 'memory': '16Gi'}, 'requests': {'cpu': '5.0', 'memory': '9Gi'}}},
                       'cluster': {'enabled': True},
                       'pulsarv3': {},
                       'kafka': {},
                       'minio': {'metrics': {'podMonitor': {'enabled': True}}},
                       'etcd': {'metrics': {'enabled': True, 'podMonitor': {'enabled': True}}},
                       'metrics': {'serviceMonitor': {'enabled': True}},
                       'log': {'level': 'debug'},
                       'image': {'all': {'repository': 'harbor.milvus.io/milvus/milvus', 'tag': '2.4-20241207-d2c20ed6-amd64'}}},
            'host': 'weekly-stab-17316000-1-80-7860-milvus.qa-milvus.svc.cluster.local',
            'port': '19530',
            'uri': ''},
 'client': {'test_case_type': 'ConcurrentClientBase',
            'test_case_name': 'test_concurrent_locust_custom_parameters',
            'test_case_params': {'dataset_params': {'metric_type': 'IP',
                                                    'vector_field_name': 'sparse_float_vector',
                                                    'dim': 400000,
                                                    'sparse_range': [200, 300],
                                                    'dataset_name': 'sparse_full',
                                                    'dataset_size': '4m',
                                                    'ni_per': 10000},
                                 'collection_params': {'other_fields': ['float_1'], 'shards_num': 2},
                                 'resource_groups_params': {'reset': False},
                                 'database_user_params': {'reset_rbac': False, 'reset_db': False},
                                 'index_params': {'index_type': 'SPARSE_INVERTED_INDEX', 'index_param': {'drop_ratio_build': 0.2}},
                                 'concurrent_params': {'concurrent_number': 20, 'during_time': '24h', 'interval': 20, 'spawn_rate': None},
                                 'concurrent_tasks': [{'type': 'search',
                                                       'weight': 20,
                                                       'params': {'nq': 10,
                                                                  'top_k': 10,
                                                                  'search_param': {'drop_ratio_search': 0.2},
                                                                  'expr': {'float_1': {'GT': -1, 'LT': 50000}},
                                                                  'ignore_growing': False,
                                                                  'timeout': 60,
                                                                  'random_data': True}},
                                                      {'type': 'query',
                                                       'weight': 10,
                                                       'params': {'ids': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9],
                                                                  'ignore_growing': False,
                                                                  'timeout': 60,
                                                                  'random_data': False,
                                                                  'random_count': 0,
                                                                  'random_range': [0, 1],
                                                                  'field_name': 'id',
                                                                  'field_type': 'int64'}},
                                                      {'type': 'load', 'weight': 1, 'params': {'replica_number': 1, 'timeout': 30}},
                                                      {'type': 'scene_insert_delete_flush',
                                                       'weight': 1,
                                                       'params': {'insert_length': 1,
                                                                  'delete_length': 1,
                                                                  'start_id': 0,
                                                                  'random_id': True,
                                                                  'random_vector': True,
                                                                  'varchar_filled': True}},
                                                      {'type': 'scene_search_test',
                                                       'weight': 1,
                                                       'params': {'dataset': 'sparse_full',
                                                                  'dim': 40000,
                                                                  'data_size': '10000',
                                                                  'nb': 3000,
                                                                  'index_type': 'SPARSE_INVERTED_INDEX',
                                                                  'index_param': {'drop_ratio_build': 0.3},
                                                                  'metric_type': 'IP',
                                                                  'nq': 10,
                                                                  'top_k': 10,
                                                                  'search_param': {'drop_ratio_search': 0.5},
                                                                  'search_counts': 20}}]},
            'run_id': 20241208,
            'datetime': '2024-12-08 00:01:05.583725',
            'client_version': '2.4.0'},
 'result': {'test_result': {'index': {'RT': 9.6583},
                            'insert': {'total_time': 1593.8592, 'VPS': 2509.632, 'batch_time': 3.9846, 'batch': 10000},
                            'flush': {'RT': 2.5416},
                            'load': {'RT': 12.2958},
                            'Locust': {'Aggregated': {'Requests': 354932,
                                                      'Fails': 2495,
                                                      'RPS': 4.11,
                                                      'fail_s': 0.01,
                                                      'RT_max': 431494.09,
                                                      'RT_avg': 4857.45,
                                                      'TP50': 19,
                                                      'TP99': 171000.0},
                                       'load': {'Requests': 10722,
                                                'Fails': 0,
                                                'RPS': 0.12,
                                                'fail_s': 0.0,
                                                'RT_max': 12297.37,
                                                'RT_avg': 364.47,
                                                'TP50': 18,
                                                'TP99': 4900.0},
                                       'query': {'Requests': 107508,
                                                 'Fails': 0,
                                                 'RPS': 1.24,
                                                 'fail_s': 0.0,
                                                 'RT_max': 53152.37,
                                                 'RT_avg': 142.84,
                                                 'TP50': 4,
                                                 'TP99': 3000.0},
                                       'scene_insert_delete_flush': {'Requests': 10713,
                                                                     'Fails': 2492,
                                                                     'RPS': 0.12,
                                                                     'fail_s': 0.23,
                                                                     'RT_max': 431494.09,
                                                                     'RT_avg': 109916.86,
                                                                     'TP50': 66000.0,
                                                                     'TP99': 303000.0},
                                       'scene_search_test': {'Requests': 10566,
                                                             'Fails': 1,
                                                             'RPS': 0.12,
                                                             'fail_s': 0.0,
                                                             'RT_max': 151094.29,
                                                             'RT_avg': 47159.31,
                                                             'TP50': 46000.0,
                                                             'TP99': 100000.0},
                                       'search': {'Requests': 215423,
                                                  'Fails': 2,
                                                  'RPS': 2.49,
                                                  'fail_s': 0.0,
                                                  'RT_max': 58027.18,
                                                  'RT_avg': 134.5,
                                                  'TP50': 20,
                                                  'TP99': 1900.0}}}}}
@wangting0128 wangting0128 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. test/benchmark benchmark test labels Dec 9, 2024
@wangting0128 wangting0128 added this to the 2.4.18 milestone Dec 9, 2024
@yanliang567
Copy link
Contributor

/assign @zhengbuqian
/unassign

@yanliang567 yanliang567 added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 9, 2024
@zhengbuqian
Copy link
Collaborator

the panic stack trace points at auto dim_id = dim_map_.find(i);, I see no reason this call may cause a panic. https://github.com/zilliztech/knowhere/blob/0c9f1182f3b312e23d42984835a14bfa0313f6de/src/index/sparse/sparse_inverted_index.h#L537-L540

the only possibility seems to be if this is a growing index in SparseInvertedIndexNodeCC, and Search was called before the index object was even properly created, then the dim_map_ may still be constructing when calling find on it. I'll take a closer look.

@yanliang567 yanliang567 modified the milestones: 2.4.18, 2.4.19, 2.4.20 Dec 24, 2024
@yanliang567 yanliang567 modified the milestones: 2.4.20, 2.4.21 Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhengbuqian zhengbuqian

Labels
kind/bug Issues or changes related a bug test/benchmark benchmark test triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Milestone
2.4.21
Development

No branches or pull requests
3 participants
@zhengbuqian @wangting0128 @yanliang567