[TaskQueue-Manager] org.apache.druid.indexing.overlord.TaskLockbox - Cannot create a new taskLockPosse for request

[sujiplr]

Please provide a detailed title (e.g. "Broker crashes when using TopN query with Bound filter" instead of just "Broker crashes").

Affected Version

Druid version is 26

Description

We are loading data from external surce ( azure ADLS, parquet file ) using MSQ . But we encountered below error when I tried for replacing entire data source with a new data. We could find entries for the blocking group IDs in the druid_tasks but there were no entries in druid_tasklocks, also at the same time there were no other tasks running on the cluster.

1. Tried cleaning druid_tasks but that didn't help
2. Tried

2023-08-01T09:09:21,209 INFO [TaskQueue-Manager] org.apache.druid.indexing.overlord.TaskLockbox - Cannot create a new taskLockPosse for request[TimeChunkLockRequest{lockType=EXCLUSIVE, groupId='query-3fdd66ca-cb85-4c05-99fd-3e1c6abd51f9', dataSource='lp_activity_all', interval=-146136543-09-08T08:23:32.096Z/146140482-04-24T15:36:27.903Z, preferredVersion='null', priority=50, revoked=false}] because existing locks[[TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-34008dd1-f49d-4c81-92ac-f36bf63882c3', dataSource='lp_activity_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-29T16:24:58.935Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-02d721b2-564b-4236-8c85-05dcd6557192', dataSource='lp_txn_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-29T17:39:57.098Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-92657682-3877-4395-b861-875ead8461b1', dataSource='lp_activity_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-30T09:01:49.558Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-fd523118-4dee-4909-8bf7-312feff11feb', dataSource='lp_txn_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-30T10:27:52.461Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-cb337f37-87fe-4c97-b593-dea71778ac76', dataSource='lp_activity_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-30T12:05:32.627Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-f96e393e-b45f-4db5-b518-1e5b0b46c2ca', dataSource='lp_txn_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-30T13:07:48.614Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-cad6ca97-11df-4aaf-8514-09fe5b49dce8', dataSource='lp_activity_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-30T14:53:33.510Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-3fc05bc1-df6d-4c2b-ae65-ca8c9d12c99e', dataSource='lp_txn_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-31T05:51:32.809Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-a0039b36-8aa4-424d-b44b-b54af45d3795', dataSource='lp_activity_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-31T07:46:10.795Z', priority=50, revoked=false}, taskIds=[]}, TaskLockPosse{taskLock=TimeChunkLock{type=SHARED, groupId='query-9bc921eb-4321-4ac2-b47a-51ca2ea9f6dd', dataSource='lp_txn_all', interval=2021-01-01T00:00:00.000Z/2021-02-01T00:00:00.000Z, version='2023-07-31T08:41:24.180Z', priority=50, revoked=false}, taskIds=[]}]] have same or higher priorities

Please include as much detailed information about the problem as possible.

• Cluster size
• Configurations in use
• Steps to reproduce the problem
• The error message or stack traces encountered. Providing more context, such as nearby log messages or even entire logs, can be helpful.
• Any debugging that you have already done

[github-actions]

This issue has been marked as stale due to 280 days of inactivity.
It will be closed in 4 weeks if no further activity occurs. If this issue is still
relevant, please simply write any comment. Even if closed, you can still revive the
issue at any time or discuss it on the dev@druid.apache.org list.
Thank you for your contributions.

[github-actions]

This issue has been closed due to lack of activity. If you think that
is incorrect, or the issue requires additional review, you can revive the issue at
any time.

[teyeheimans]

We have this issue also often. There is no task lock in the table.

Cannot create a new taskLockPosse for request[TimeChunkLockRequest{lockType=EXCLUSIVE, ...] because existing locks[[TaskLockPosse{taskLock=TimeChunkLock{type=EXCLUSIVE, ...}, taskIds=[]}]] have same or higher priorities

So no existing locks can be found, still this issue.