Skip to content

makefile: improve deadlock-enable/disable#1736

Merged
sre-bot merged 3 commits into
tikv:masterfrom
Luffbee:deadlock-test
Sep 10, 2019
Merged

makefile: improve deadlock-enable/disable#1736
sre-bot merged 3 commits into
tikv:masterfrom
Luffbee:deadlock-test

Conversation

@Luffbee
Copy link
Copy Markdown
Contributor

@Luffbee Luffbee commented Sep 6, 2019

What problem does this PR solve?

deadlock-enable and deadlock-disable in Makefile is too slow.

What is changed and how it works?

The reason is that goimports is slow, and the origin script do this on every *.go files. The new script did three changes:

  • replace Mutex and RWMutex in one command
  • filter out unchanged files before calling goimports (the main improve)
  • call goimports once with all changed files

Check List

Tests

  • No code

@Luffbee Luffbee requested review from lhy1024 and rleungx September 6, 2019 16:31
@codecov-io
Copy link
Copy Markdown

codecov-io commented Sep 6, 2019

Codecov Report

Merging #1736 into master will decrease coverage by 0.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1736      +/-   ##
==========================================
- Coverage   76.99%   76.97%   -0.02%     
==========================================
  Files         161      161              
  Lines       15741    15741              
==========================================
- Hits        12119    12116       -3     
- Misses       2602     2611       +9     
+ Partials     1020     1014       -6
Impacted Files Coverage Δ
pkg/testutil/operator_check.go 83.33% <0%> (-16.67%) ⬇️
pkg/metricutil/metricutil.go 90.62% <0%> (-9.38%) ⬇️
server/schedulers/shuffle_hot_region.go 58.97% <0%> (-6.42%) ⬇️
server/tso/tso.go 77.06% <0%> (-2.76%) ⬇️
server/grpc_service.go 57.91% <0%> (-0.87%) ⬇️
server/member/leader.go 76.53% <0%> (-0.52%) ⬇️
server/schedule/operator/operator.go 85.22% <0%> (-0.37%) ⬇️
server/cluster.go 84.42% <0%> (+0.51%) ⬆️
server/server.go 82.79% <0%> (+0.57%) ⬆️
client/client.go 69.76% <0%> (+1.29%) ⬆️
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c7c572a...e5cc4c0. Read the comment docs.

@nolouch nolouch added the component/util Utility. label Sep 9, 2019
@Luffbee
Copy link
Copy Markdown
Contributor Author

Luffbee commented Sep 9, 2019

/rebuild

1 similar comment
@Luffbee
Copy link
Copy Markdown
Contributor Author

Luffbee commented Sep 9, 2019

/rebuild

@rleungx rleungx added status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2. labels Sep 10, 2019
@sre-bot
Copy link
Copy Markdown
Contributor

sre-bot commented Sep 10, 2019

/run-all-tests

@sre-bot sre-bot merged commit ce060a9 into tikv:master Sep 10, 2019
@Luffbee Luffbee deleted the deadlock-test branch September 11, 2019 05:18
Luffbee added a commit that referenced this pull request Sep 11, 2019
* *: unify get store function everywhere (#1671)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

*  server: use leader lease to determine tso service validity (#1676)

Signed-off-by: disksing <i@disksing.com>

* test: fix tests (#1696)

* test: fix region syncer test

Signed-off-by: disksing <i@disksing.com>

* add config-check flag for pd-server (#1695)

Signed-off-by: cwen0 <cwenyin0@gmail.com>

* operator: rewrite move region related functions (#1667)

* *: support setting endKey for ScanRange (#1700)

Signed-off-by: disksing <i@disksing.com>

* *: reduce some unnecessary parameters (#1698)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* schedule: Do not send an operator of a region wth a stale epoch (#1659)

* schedule: Do not send an operator of a region wth a stale epoch

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* schedule: check the version changed by the operator self

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* schedule: fix unit test

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* schedule: fix to avoid dispatching a stale opstep

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* dispatch: refactor "ConsumeConfVer() int" to "ExpectConfVerChange() bool"

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* dispatch: fix typo in comment

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* fix typo

Co-Authored-By: Ryan Leung <rleungx@gmail.com>

* dispatch: fix unittest

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* dispatch: refine format

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* server: fix the dead lock in scatter region (#1706)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* tools: fix set namespace in pd-ctl (#1701)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* tools: fix parse url without http prefix (#1703)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* tests: support deadlock detection in make test (#1704)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* Makefile: fix failpoint enable (#1722)

Signed-off-by: nolouch <nolouch@gmail.com>

* checker: fix the issue that a region does not merge to the sibling with smaller size (#1723)

Signed-off-by: disksing <i@disksing.com>

* tools: balance region simulator (#1708)

* scheduler: do not remove the operator when the step does not finish (#1715)

Signed-off-by: Shafreeck Sea <shafreeck@gmail.com>

* operator: fix the AddLearner config version judgment (#1732)

Signed-off-by: nolouch <nolouch@gmail.com>

* tools: fix TLS in pd control (#1729)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* syncer: support TLS for region syncer (#1728)

Signed-off-by: Ryan Leung <rleungx@gmail.com>

* schedule: fix a thread-safe bug and improve code (#1719)

* statistics: fix region flow calculation (#1688)

Signed-off-by: jiyingtk <jiyingtk@mail.ustc.edu.cn>

* makefile: improve deadlock-enable/disable (#1736)

* api: fix missing keys statistic in region information (#1741)

Signed-off-by: nolouch <nolouch@gmail.com>

* *: update go version to 1.13 (#1742)

Signed-off-by: disksing <i@disksing.com>

* coordinator: add the operator cost time in log field (#1748)

Signed-off-by: nolouch <nolouch@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/util Utility. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants