Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: query with varchar expr milvus panic, milvus enabled queryNode.mmap.scalarField and disabled queryNode.segcore.multipleChunkedEnable #39112

Open
1 task done
wangting0128 opened this issue Jan 9, 2025 · 1 comment
Open
1 task done

[Bug]: query with varchar expr milvus panic, milvus enabled queryNode.mmap.scalarField and disabled queryNode.segcore.multipleChunkedEnable #39112

wangting0128 opened this issue Jan 9, 2025 · 1 comment
Assignees
@sunby
Labels
kind/bug Issues or changes related a bug priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. triage/accepted Indicates an issue or PR is ready to be actively worked on.
Milestone
2.6.0

Comments

@wangting0128
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:master-20250102-aa0a87ed-amd64
- Deployment mode(standalone or cluster):standalone
- MQ type(rocksmq, pulsar or kafka):rocksmq    
- SDK version(e.g. pymilvus v2.0.0rc2):2.6.0rc44
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

test case name: test_bitmap_offset_cache_query_with_string

server:

NAME                                                              READY   STATUS                   RESTARTS        AGE     IP              NODE         NOMINATED NODE   READINESS GATES
wt-test-etcd-0                                                    1/1     Running                  0               41d     10.104.15.107   4am-node20   <none>           <none>
wt-test-milvus-standalone-67b5f565d6-j7zvl                        0/1     CrashLoopBackOff         6 (3m39s ago)   6d22h   10.104.21.27    4am-node24   <none>           <none>
wt-test-minio-7b8f7b7444-fvvzn                                    1/1     Running                  0               41d     10.104.15.105   4am-node20   <none>           <none>

panic.log

截屏2025-01-09 15 03 35

client log:

[2025-01-09 14:47:00,239 - DEBUG - ci_test]: (api_request)  : [Connections.connect] args: ['default', '', '', 'default', ''], kwargs: {'host': '10.104.21.27', 'port': 19530} (api_request.py:52)
[2025-01-09 14:47:00,307 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:00,327 - INFO - ci_test]: server version: aa0a87e (client_base.py:166)
[2025-01-09 14:47:00,328 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['int64_pk', <DataType.INT64: 5>, ''], kwargs: {'is_primary': True} (api_request.py:52)
[2025-01-09 14:47:00,329 - DEBUG - ci_test]: (api_response) : {'name': 'int64_pk', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}  (api_request.py:27)
[2025-01-09 14:47:00,330 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['FLOAT_VECTOR', <DataType.FLOAT_VECTOR: 101>, ''], kwargs: {'dim': 128} (api_request.py:52)
[2025-01-09 14:47:00,330 - DEBUG - ci_test]: (api_response) : {'name': 'FLOAT_VECTOR', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}  (api_request.py:27)
[2025-01-09 14:47:00,330 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['VARCHAR_1', <DataType.VARCHAR: 21>, ''], kwargs: {'max_length': 65535} (api_request.py:52)
[2025-01-09 14:47:00,331 - DEBUG - ci_test]: (api_response) : {'name': 'VARCHAR_1', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}  (api_request.py:27)
[2025-01-09 14:47:00,332 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['INT8', <DataType.INT8: 2>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,332 - DEBUG - ci_test]: (api_response) : {'name': 'INT8', 'description': '', 'type': <DataType.INT8: 2>}  (api_request.py:27)
[2025-01-09 14:47:00,332 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['INT16', <DataType.INT16: 3>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,333 - DEBUG - ci_test]: (api_response) : {'name': 'INT16', 'description': '', 'type': <DataType.INT16: 3>}  (api_request.py:27)
[2025-01-09 14:47:00,333 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['INT32', <DataType.INT32: 4>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,334 - DEBUG - ci_test]: (api_response) : {'name': 'INT32', 'description': '', 'type': <DataType.INT32: 4>}  (api_request.py:27)
[2025-01-09 14:47:00,335 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['INT64', <DataType.INT64: 5>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,335 - DEBUG - ci_test]: (api_response) : {'name': 'INT64', 'description': '', 'type': <DataType.INT64: 5>}  (api_request.py:27)
[2025-01-09 14:47:00,336 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['VARCHAR', <DataType.VARCHAR: 21>, ''], kwargs: {'max_length': 65535} (api_request.py:52)
[2025-01-09 14:47:00,337 - DEBUG - ci_test]: (api_response) : {'name': 'VARCHAR', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}  (api_request.py:27)
[2025-01-09 14:47:00,337 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['BOOL', <DataType.BOOL: 1>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,338 - DEBUG - ci_test]: (api_response) : {'name': 'BOOL', 'description': '', 'type': <DataType.BOOL: 1>}  (api_request.py:27)
[2025-01-09 14:47:00,338 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['FLOAT', <DataType.FLOAT: 10>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,339 - DEBUG - ci_test]: (api_response) : {'name': 'FLOAT', 'description': '', 'type': <DataType.FLOAT: 10>}  (api_request.py:27)
[2025-01-09 14:47:00,339 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['DOUBLE', <DataType.DOUBLE: 11>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,340 - DEBUG - ci_test]: (api_response) : {'name': 'DOUBLE', 'description': '', 'type': <DataType.DOUBLE: 11>}  (api_request.py:27)
[2025-01-09 14:47:00,340 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_INT8', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.INT8: 2>} (api_request.py:52)
[2025-01-09 14:47:00,341 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_INT8', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.INT8: 2>}  (api_request.py:27)
[2025-01-09 14:47:00,341 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_INT16', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.INT16: 3>} (api_request.py:52)
[2025-01-09 14:47:00,342 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_INT16', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.INT16: 3>}  (api_request.py:27)
[2025-01-09 14:47:00,342 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_INT32', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.INT32: 4>} (api_request.py:52)
[2025-01-09 14:47:00,343 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_INT32', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.INT32: 4>}  (api_request.py:27)
[2025-01-09 14:47:00,343 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_INT64', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.INT64: 5>} (api_request.py:52)
[2025-01-09 14:47:00,344 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_INT64', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.INT64: 5>}  (api_request.py:27)
[2025-01-09 14:47:00,344 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_VARCHAR', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.VARCHAR: 21>, 'max_length': 65535} (api_request.py:52)
[2025-01-09 14:47:00,345 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_VARCHAR', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 65535, 'max_capacity': 100}, 'element_type': <DataType.VARCHAR: 21>}  (api_request.py:27)
[2025-01-09 14:47:00,346 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_BOOL', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.BOOL: 1>} (api_request.py:52)
[2025-01-09 14:47:00,346 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_BOOL', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.BOOL: 1>}  (api_request.py:27)
[2025-01-09 14:47:00,347 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_FLOAT', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.FLOAT: 10>} (api_request.py:52)
[2025-01-09 14:47:00,347 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_FLOAT', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.FLOAT: 10>}  (api_request.py:27)
[2025-01-09 14:47:00,348 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['ARRAY_DOUBLE', <DataType.ARRAY: 22>, ''], kwargs: {'max_capacity': 100, 'element_type': <DataType.DOUBLE: 11>} (api_request.py:52)
[2025-01-09 14:47:00,348 - DEBUG - ci_test]: (api_response) : {'name': 'ARRAY_DOUBLE', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_capacity': 100}, 'element_type': <DataType.DOUBLE: 11>}  (api_request.py:27)
[2025-01-09 14:47:00,349 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['JSON', <DataType.JSON: 23>, ''], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,349 - DEBUG - ci_test]: (api_response) : {'name': 'JSON', 'description': '', 'type': <DataType.JSON: 23>}  (api_request.py:27)
[2025-01-09 14:47:00,350 - DEBUG - ci_test]: (api_request)  : [CollectionSchema] args: [[{'name': 'int64_pk', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'FLOAT_VECTOR', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}, {'name': 'VARCHAR_1', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': ......, kwargs: {} (api_request.py:52)
[2025-01-09 14:47:00,351 - DEBUG - ci_test]: (api_response) : {'auto_id': False, 'description': '', 'fields': [{'name': 'int64_pk', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'FLOAT_VECTOR', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}, {'name': 'VARCHAR_1', 'description':......  (api_request.py:27)
[2025-01-09 14:47:00,352 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['test_bitmap_index_offset_cache_YW07uhGM', {'auto_id': False, 'description': '', 'fields': [{'name': 'int64_pk', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'FLOAT_VECTOR', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim':......, kwargs: {'consistency_level': 'Strong'} (api_request.py:52)
[2025-01-09 14:47:00,408 - DEBUG - ci_test]: (api_response) : <Collection>:
-------------
<name>: test_bitmap_index_offset_cache_YW07uhGM
<description>: 
<schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64_pk', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'FLOAT_VECTOR', 'description': '......  (api_request.py:27)
[2025-01-09 14:47:02,311 - DEBUG - ci_test]: (api_request)  : [Collection.insert] args: [[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76,......, kwargs: {'timeout': 180} (api_request.py:52)
[2025-01-09 14:47:08,780 - DEBUG - ci_test]: (api_response) : (insert count: 3000, delete count: 0, upsert count: 0, timestamp: 455188212263682054, success count: 3000, err count: 0  (api_request.py:27)
[2025-01-09 14:47:08,781 - DEBUG - ci_test]: (api_request)  : [Collection.flush] args: [], kwargs: {'timeout': 180} (api_request.py:52)
[2025-01-09 14:47:11,976 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:11,977 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['FLOAT_VECTOR', {'index_type': 'HNSW', 'params': {'M': 8, 'efConstruction': 200}, 'metric_type': 'L2'}, 1200], kwargs: {'index_name': 'FLOAT_VECTOR'} (api_request.py:52)
[2025-01-09 14:47:14,673 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:14,673 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['VARCHAR_1', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'VARCHAR_1'} (api_request.py:52)
[2025-01-09 14:47:15,263 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:15,263 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['INT8', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'INT8'} (api_request.py:52)
[2025-01-09 14:47:16,469 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:16,469 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['INT16', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'INT16'} (api_request.py:52)
[2025-01-09 14:47:17,560 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:17,560 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['INT32', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'INT32'} (api_request.py:52)
[2025-01-09 14:47:18,132 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:18,132 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['INT64', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'INT64'} (api_request.py:52)
[2025-01-09 14:47:19,221 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:19,222 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['BOOL', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'BOOL'} (api_request.py:52)
[2025-01-09 14:47:20,349 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:20,351 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['VARCHAR', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'VARCHAR'} (api_request.py:52)
[2025-01-09 14:47:21,474 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:21,475 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_INT8', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_INT8'} (api_request.py:52)
[2025-01-09 14:47:22,583 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:22,584 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_INT16', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_INT16'} (api_request.py:52)
[2025-01-09 14:47:23,334 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:23,335 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_INT32', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_INT32'} (api_request.py:52)
[2025-01-09 14:47:24,476 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:24,477 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_INT64', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_INT64'} (api_request.py:52)
[2025-01-09 14:47:25,563 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:25,564 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_BOOL', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_BOOL'} (api_request.py:52)
[2025-01-09 14:47:26,193 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:26,194 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['ARRAY_VARCHAR', {'index_type': 'BITMAP'}, 1200], kwargs: {'index_name': 'ARRAY_VARCHAR'} (api_request.py:52)
[2025-01-09 14:47:27,462 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:27)
[2025-01-09 14:47:27,463 - INFO - ci_test]: [TestcaseBase] Build all indexes done: ['FLOAT_VECTOR', 'VARCHAR_1', 'INT8', 'INT16', 'INT32', 'INT64', 'BOOL', 'VARCHAR', 'ARRAY_INT8', 'ARRAY_INT16', 'ARRAY_INT32', 'ARRAY_INT64', 'ARRAY_BOOL', 'ARRAY_VARCHAR'] (client_base.py:444)
[2025-01-09 14:47:27,486 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['INT8', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,504 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,505 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['INT16', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,520 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,520 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['INT32', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,538 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,539 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['INT64', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,555 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,556 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['BOOL', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,574 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,574 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['VARCHAR', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,600 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,600 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_INT8', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,615 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,616 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_INT16', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,632 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,633 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_INT32', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,649 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,650 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_INT64', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,670 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,671 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_BOOL', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,793 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,794 - DEBUG - ci_test]: (api_request)  : [Collection.alter_index] args: ['ARRAY_VARCHAR', {'indexoffsetcache.enabled': True}, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:27,813 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:27,814 - DEBUG - ci_test]: (api_request)  : [Collection.load] args: [None, 1, 180], kwargs: {} (api_request.py:52)
[2025-01-09 14:47:29,495 - DEBUG - ci_test]: (api_response) : None  (api_request.py:27)
[2025-01-09 14:47:29,498 - INFO - ci_test]: ************************************ setup ************************************* (client_base.py:507)
[2025-01-09 14:47:29,498 - INFO - ci_test]: [setup_method] Start setup test case test_bitmap_offset_cache_query_with_string. (client_base.py:508)
[2025-01-09 14:47:29,512 - DEBUG - ci_test]: (api_request)  : [Collection.query] args: ['VARCHAR like "a%"', ['*'], None, 180], kwargs: {'limit': 1} (api_request.py:52)
[2025-01-09 14:47:29,867 - DEBUG - ci_test]: (api_response) : data: ["{'INT16': -32767, 'VARCHAR_1': 'o', 'FLOAT': 0.38710445, 'ARRAY_INT8': [36, -47, -110, -32, 97, 8, 54, 78, -98, -43, 43, 67, 100, -15, 122, 1, 100, 78, -72, -116, 98, -13, -33, 33, -9, 8, -16, 57, 102, 53, 71, -102, 4, -18, -125, 60, -128, 119, -66, -126, -27, 14, -34, 125, 53, 76, 21, -25, ......  (api_request.py:27)
PASSED[2025-01-09 14:47:29,874 - INFO - ci_test]: *********************************** teardown *********************************** (client_base.py:511)
[2025-01-09 14:47:29,874 - INFO - ci_test]: [teardown_method] Start teardown test case test_bitmap_offset_cache_query_with_string... (client_base.py:512)

test_mix_scenes.py::TestBitmapIndexOffsetCache::test_bitmap_offset_cache_query_with_string[1-VARCHAR LIKE "%b"-VARCHAR-.*b$] [2025-01-09 14:47:29,880 - INFO - ci_test]: ************************************ setup ************************************* (client_base.py:507)
[2025-01-09 14:47:29,881 - INFO - ci_test]: [setup_method] Start setup test case test_bitmap_offset_cache_query_with_string. (client_base.py:508)
[2025-01-09 14:47:29,889 - DEBUG - ci_test]: (api_request)  : [Collection.query] args: ['VARCHAR LIKE "%b"', ['*'], None, 180], kwargs: {'limit': 1} (api_request.py:52)
[2025-01-09 14:47:30,315 - DEBUG - ci_test]: (api_response) : data: ["{'ARRAY_BOOL': [True, False, False, False, True, True, True, False, False, True, True, True, False, True, False, True, False, True, False, True, True, True, True, True, True, True, True, True, False, False, False, False, True, True, False, True, False, False, True, True, True, True, True, Fa......  (api_request.py:27)
PASSED[2025-01-09 14:47:30,318 - INFO - ci_test]: *********************************** teardown *********************************** (client_base.py:511)
[2025-01-09 14:47:30,318 - INFO - ci_test]: [teardown_method] Start teardown test case test_bitmap_offset_cache_query_with_string... (client_base.py:512)

test_mix_scenes.py::TestBitmapIndexOffsetCache::test_bitmap_offset_cache_query_with_string[1-(VARCHAR like "%b") && (VARCHAR LIKE "z%")-VARCHAR-^z.*b$] [2025-01-09 14:47:30,324 - INFO - ci_test]: ************************************ setup ************************************* (client_base.py:507)
[2025-01-09 14:47:30,324 - INFO - ci_test]: [setup_method] Start setup test case test_bitmap_offset_cache_query_with_string. (client_base.py:508)
[2025-01-09 14:47:30,334 - DEBUG - ci_test]: (api_request)  : [Collection.query] args: ['(VARCHAR like "%b") && (VARCHAR LIKE "z%")', ['*'], None, 180], kwargs: {'limit': 1} (api_request.py:52)
[2025-01-09 14:47:30,749 - DEBUG - ci_test]: (api_response) : data: ["{'INT32': -1576746590, 'ARRAY_DOUBLE': [0.09468220847182429, 0.8083785313998927, 0.8006988449562924, 0.4983379655332203, 0.45956296406743036, 0.33961728540266034, 0.8914987331298311, 0.2552368681046966, 0.38684904658026253, 0.8619537320817043, 0.7314412346389655, 0.9900914669616176, 0.904012......  (api_request.py:27)
PASSED[2025-01-09 14:47:30,753 - INFO - ci_test]: *********************************** teardown *********************************** (client_base.py:511)
[2025-01-09 14:47:30,755 - INFO - ci_test]: [teardown_method] Start teardown test case test_bitmap_offset_cache_query_with_string... (client_base.py:512)

test_mix_scenes.py::TestBitmapIndexOffsetCache::test_bitmap_offset_cache_query_with_string[1-(VARCHAR like "i%") and (VARCHAR LIKE "%j")-VARCHAR-^i.*j$] [2025-01-09 14:47:30,759 - INFO - ci_test]: ************************************ setup ************************************* (client_base.py:507)
[2025-01-09 14:47:30,760 - INFO - ci_test]: [setup_method] Start setup test case test_bitmap_offset_cache_query_with_string. (client_base.py:508)
[2025-01-09 14:47:30,777 - DEBUG - ci_test]: (api_request)  : [Collection.query] args: ['(VARCHAR like "i%") and (VARCHAR LIKE "%j")', ['*'], None, 180], kwargs: {'limit': 1} (api_request.py:52)
2025-01-09 14:50:32,181 [ERROR][handler]: RPC error: [query], <MilvusException: (code=<bound method _MultiThreadedRendezvous.code of <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused {created_time:"2025-01-09T14:50:32.1789578+08:00", grpc_status:14}"
>>, message=Retry timeout: 180s, message=failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused)>, <Time:{'RPC start': '2025-01-09 14:47:30.777812', 'RPC error': '2025-01-09 14:50:32.181802'}> (decorators.py:140)
[2025-01-09 14:50:32,192 - ERROR - ci_test]: Traceback (most recent call last):
  File "/src/milvus/tests/python_client/utils/api_request.py", line 22, in inner_wrapper
    res = func(*args, **_kwargs)
  File "/src/milvus/tests/python_client/utils/api_request.py", line 53, in api_request
    return func(*arg, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/pymilvus/orm/collection.py", line 1074, in query
    return conn.query(
  File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 141, in handler
    raise e from e
  File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 137, in handler
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 176, in handler
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 92, in handler
    raise MilvusException(e.code, f"{to_msg}, message={e.details()}") from e
pymilvus.exceptions.MilvusException: <MilvusException: (code=<bound method _MultiThreadedRendezvous.code of <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused {created_time:"2025-01-09T14:50:32.1789578+08:00", grpc_status:14}"
>>, message=Retry timeout: 180s, message=failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection refused)>
 (api_request.py:35)
[2025-01-09 14:50:32,193 - ERROR - ci_test]: (api_response) : <MilvusException: (code=<bound method _MultiThreadedRendezvous.code of <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:10.104.21.27:19530: Failed to connect to remote host: Connection re...... (api_request.py:36)
FAILED[2025-01-09 14:50:32,420 - INFO - ci_test]: *********************************** teardown *********************************** (client_base.py:511)
[2025-01-09 14:50:32,420 - INFO - ci_test]: [teardown_method] Start teardown test case test_bitmap_offset_cache_query_with_string... (client_base.py:512)

Expected Behavior

No response

Steps To Reproduce

target:
            1. check string expression
        method:
            1. prepare some data and build `BITMAP index` on scalar fields
            2. query with the different expr and limit
            3. check query result
        expected:
            1. query response equal to min(insert data, limit)

Milvus Log

No response

Anything else?

server config:

cluster:
  enabled: false
etcd:
  metrics:
    enabled: true
    podMonitor:
      enabled: true
  replicaCount: 1
extraConfigFiles:
  user.yaml: |
    queryNode:
      mmap:
        scalarField: true
      segcore:
        multipleChunkedEnable: false
image:
  all:
    repository: harbor.milvus.io/milvus/milvus
    tag: master-20250102-aa0a87ed-amd64
log:
  level: debug
metrics:
  serviceMonitor:
    enabled: true
minio:
  metrics:
    podMonitor:
      enabled: true
  mode: standalone
pulsarv3:
  enabled: false
standalone:
  resources:
    limits:
      cpu: "8.0"
      memory: 16Gi
    requests:
      cpu: "5.0"
      memory: 9Gi
@wangting0128 wangting0128 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 9, 2025
@wangting0128 wangting0128 added this to the 2.6.0 milestone Jan 9, 2025
@yanliang567 yanliang567 added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 10, 2025
@yanliang567 yanliang567 removed their assignment Jan 10, 2025
@yanliang567 yanliang567 added the priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. label Jan 10, 2025
@xiaofan-luan
Copy link
Collaborator

@sunby
are we confident to remove the original implementation and only keep multi segment enabled?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sunby sunby

Labels
kind/bug Issues or changes related a bug priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Milestone
2.6.0
Development

No branches or pull requests
4 participants
@sunby @wangting0128 @yanliang567 @xiaofan-luan