Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: list_bulk_insert_tasks returns missing fields #38172

Closed
1 task done
abd-770 opened this issue Dec 3, 2024 · 8 comments
Closed
1 task done

[Bug]: list_bulk_insert_tasks returns missing fields #38172

abd-770 opened this issue Dec 3, 2024 · 8 comments
Assignees
Labels
help wanted Extra attention is needed kind/bug Issues or changes related a bug

Comments

@abd-770
Copy link
Contributor

abd-770 commented Dec 3, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Running bulk insert and use list_bulk_insert_tasks to check the status

id = utility.do_bulk_insert(collection_name=collection_name, files=['bulk/json/01/1.json'])
tasks = utility.list_bulk_insert_tasks()
for task in tasks:
  print(task)

Output:

<Bulk insert state:
    - taskID          : 0,
    - state           : Completed,
    - row_count       : 0,
    - infos           : {'failed_reason': '', 'progress_percent': '100'},
    - id_ranges       : [],
    - create_ts       : 1969-12-31 16:00:00
>

However,

  1. taskId is incorrect
  2. row_count is wrong
  3. id_ranges is wrong
  4. create_ts is wrong

Expected Behavior

list_bulk_insert_tasks should return correct values for the above fields.
Also, why does it not return other fields as mentioned in the documentation: https://milvus.io/api-reference/pymilvus/v2.4.x/ORM/utility/list_bulk_insert_tasks.md

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

@abd-770 abd-770 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 3, 2024
@yanliang567
Copy link
Contributor

a similar issue to #38051, please check

/assign @abd-770
/unassign

@sre-ci-robot sre-ci-robot assigned abd-770 and unassigned yanliang567 Dec 3, 2024
@yanliang567 yanliang567 added help wanted Extra attention is needed and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 3, 2024
@abd-770
Copy link
Contributor Author

abd-770 commented Dec 3, 2024

@yanliang567 We are currently using milvus 2.4.x, and this issue is for function list_bulk_insert_tasks returning invalid values for the returned fields.

@yanliang567
Copy link
Contributor

/assign @bigsheeper
please help to take a look

@abd-770
Copy link
Contributor Author

abd-770 commented Dec 9, 2024

@yanliang567 @bigsheeper can you guys provide an update on this?
Please update on this issue as well: #38051 (comment)

@abd-770
Copy link
Contributor Author

abd-770 commented Dec 14, 2024

@yanliang567 Any updates?

@bigsheeper
Copy link
Contributor

@yanliang567 Any updates?

Hi @abd-770 ,

In version 2.4.x, we restructured the bulkinsert feature to enhance both performance and usability. Along with these improvements, the returned fields have also been adjusted accordingly(for example, row_count -> importedRows & totalRows ).
For more details, please refer to the updated documentation here: https://milvus.io/docs/import-data.md.

@abd-770
Copy link
Contributor Author

abd-770 commented Dec 16, 2024

@bigsheeper I'm currently using 2.4.0, So is this an expected bug for this version? Also can you specify which version the enhancements are added?

@bigsheeper
Copy link
Contributor

bigsheeper commented Dec 16, 2024

@bigsheeper I'm currently using 2.4.0, So is this an expected bug for this version? Also can you specify which version the enhancements are added?

Hi @abd-770 ,

So is this an expected bug for this version?

This behavior is not a bug but is intended by design.

Also can you specify which version the enhancements are added?

Starting from version 2.4.0. If you take a closer look, you’ll notice that the list_bulk_insert_tasks API has already been marked as deprecated.
image
We recommend referring to the 2.4 documentation and using the corresponding APIs: https://milvus.io/docs/import-data.md.

@abd-770 abd-770 closed this as completed Dec 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed kind/bug Issues or changes related a bug
Projects
None yet
Development

No branches or pull requests

3 participants