Skip to content

refine file gc in file sorter#850

Merged
ti-srebot merged 3 commits into
pingcap:masterfrom
amyangfei:refine-file-gc
Aug 17, 2020
Merged

refine file gc in file sorter#850
ti-srebot merged 3 commits into
pingcap:masterfrom
amyangfei:refine-file-gc

Conversation

@amyangfei
Copy link
Copy Markdown
Contributor

What problem does this PR solve?

If a puller is canceled, some files may be remained in the toRemoveFiles list and not fully removed.

What is changed and how it works?

  • gc file once before the gc routine exits because of context is Done.
  • Add control gc running time restriction.

Check List

Tests

  • Unit test
  • Integration test

Release note

  • No release note

@amyangfei
Copy link
Copy Markdown
Contributor Author

/run-integration-tests

@amyangfei amyangfei added the status/ptal Could you please take a look? label Aug 14, 2020
@liuzix
Copy link
Copy Markdown
Contributor

liuzix commented Aug 15, 2020

/lgtm

@ti-srebot ti-srebot added the status/LGT1 Indicates that a PR has LGTM 1. label Aug 15, 2020
@ti-srebot ti-srebot removed the status/LGT1 Indicates that a PR has LGTM 1. label Aug 17, 2020
@ti-srebot ti-srebot added the status/LGT2 Indicates that a PR has LGTM 2. label Aug 17, 2020
@zier-one
Copy link
Copy Markdown
Contributor

@amyangfei please resolve the conflicts

@amyangfei
Copy link
Copy Markdown
Contributor Author

/merge

@ti-srebot ti-srebot added the status/can-merge Indicates a PR has been approved by a committer. label Aug 17, 2020
@ti-srebot
Copy link
Copy Markdown
Contributor

/run-all-tests

@codecov-commenter
Copy link
Copy Markdown

Codecov Report

Merging #850 into master will not change coverage.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             master       #850   +/-   ##
===========================================
  Coverage   33.2256%   33.2256%           
===========================================
  Files            97         97           
  Lines         11148      11148           
===========================================
  Hits           3704       3704           
  Misses         7075       7075           
  Partials        369        369           

@ti-srebot ti-srebot merged commit a8d13f7 into pingcap:master Aug 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2. status/ptal Could you please take a look?

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants