Skip to content

[Bug][Load] Load task submit logic has some errors. #4868

@morningman

Description

@morningman

Describe the bug
1.
The pending load task thread pool and loading load task thread pool should be separated.
Because when doing the pending load task in thread pool, the pending task will try to create a new loading task
and add it to the thread pool. If the thread pool is full, it will be blocked and wait the thread pool to be available.
But itself also occupy the thread. It is just like a dead lock.

the load task thread pool's queue size should be as long as config of desired_max_waiting_jobs.

When submitting a load task to thread pool, the operation should be outside the database lock, because it may take
a while to wait the thread pool to be available.

Metadata

Metadata

Assignees

Labels

kind/fixCategorizes issue or PR as related to a bug.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions