Skip to content

[Enhancement] allocate blocks in scanner_context on demand and free them timely #19283

@dataroaring

Description

@dataroaring

Search before asking

  • I had searched in the issues and found no similar issues.

Description

Currently, _free_blocks is filled in prepare phase in advance, it allocates blocks computed from a config. It consumes a lot memory and is not used for small load.

Solution

  • allocate block on demand and limit it as current.
  • free them timely, e.g. close

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions