Skip to content

Persist temporary setting to etcd #3131

Merged
ti-chi-bot merged 39 commits into
tikv:masterfrom
longfangsong:persist-ttl-string
Nov 27, 2020
Merged

Persist temporary setting to etcd #3131
ti-chi-bot merged 39 commits into
tikv:masterfrom
longfangsong:persist-ttl-string

Conversation

@longfangsong
Copy link
Copy Markdown
Member

@longfangsong longfangsong commented Nov 2, 2020 •
edited
Loading

Signed-off-by: longfangsong longfangsong@icloud.com

What problem does this PR solve?

Sometimes lightning and BR want to patch some of the configuation, #3082 support this, but this implemetion store all the temporary setting in memory, this will cause these settings not taking effect when pd master in cluster is down.

What is changed and how it works?

Save the temporary setting to etcd

See this doc for details.

Check List

Tests

  • Unit test
  • Integration test

Code changes

  • Has persistent data change

Side effects

  • Possible performance regression
  • Increased code complexity

Release note

  • No release note

@longfangsong longfangsong force-pushed the persist-ttl-string branch 5 times, most recently from f9f9e5c to 4da8e77 Compare November 3, 2020 06:32
@Yisaer @longfangsong
tso: Fix Local tso alloactor become alloactor leader without pd leade…
021d688 
…r knowing its dc-location (tikv#3134)

Signed-off-by: longfangsong <longfangsong@icloud.com>
@longfangsong
Merge branch 'master' into persist-ttl-string
04f5c25
@longfangsong
persist to etcd
a677d30 
Signed-off-by: longfangsong <longfangsong@icloud.com>
@disksing disksing requested review from Yisaer and rleungx and removed request for Yisaer November 5, 2020 08:26
@longfangsong
load on boot and change leader
93875ba 
Signed-off-by: longfangsong <longfangsong@icloud.com>
@longfangsong longfangsong marked this pull request as ready for review November 5, 2020 09:38
@longfangsong
Copy link
Copy Markdown
Member Author

longfangsong commented Nov 6, 2020

@Yisaer PTAL

@longfangsong
Merge branch 'master' into persist-ttl-string
61809b8 
Signed-off-by: longfangsong <longfangsong@icloud.com>
Yisaer
Yisaer reviewed Nov 6, 2020
View reviewed changes
Comment thread server/config/persist_options.go Outdated
Comment thread server/config/persist_options.go Outdated
Comment thread server/config/persist_options.go Outdated
Comment thread server/server.go Outdated
rleungx
rleungx reviewed Nov 6, 2020
View reviewed changes
Comment thread server/config/persist_options.go Outdated
Comment thread server/config/persist_options.go Outdated
Comment thread server/config/persist_options.go Outdated
Comment thread server/config/persist_options.go Outdated
@longfangsong
Apply several suggestion from code review
220df6f 
Signed-off-by: longfangsong <longfangsong@icloud.com>
@longfangsong
extract getTTLUint and getTTLFloat
2b046be 
Signed-off-by: longfangsong <longfangsong@icloud.com>
@longfangsong
extract EtcdKVPutWithTTL
f66df0f 
Signed-off-by: longfangsong <longfangsong@icloud.com>
@longfangsong
Merge branch 'master' into persist-ttl-string
bf1ae40
rleungx
rleungx reviewed Nov 9, 2020
View reviewed changes
Comment thread server/config/persist_options.go Outdated
@longfangsong longfangsong requested a review from rleungx November 24, 2020 12:41
@rleungx
Copy link
Copy Markdown
Member

rleungx commented Nov 25, 2020

There is still a comment which is not resolved

@rleungx
Copy link
Copy Markdown
Member

rleungx commented Nov 25, 2020

Is there possible to reduce the time more?

@AndreMouche
Copy link
Copy Markdown
Member

AndreMouche commented Nov 27, 2020

/LGTM

@ti-chi-bot
Copy link
Copy Markdown
Member

ti-chi-bot commented Nov 27, 2020

@AndreMouche: adding LGTM is restricted to reviewers in list.

Details

In response to this:

/LGTM

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the tidb-community-bots/ti-community-prow repository.

@ti-chi-bot ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Nov 27, 2020
@Yisaer
Copy link
Copy Markdown
Contributor

Yisaer commented Nov 27, 2020

/merge

@ti-chi-bot
Copy link
Copy Markdown
Member

ti-chi-bot commented Nov 27, 2020

@Yisaer: It seems you want to merge this PR, I will help you trigger all the tests:

/run-all-tests

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the tidb-community-bots/ti-community-prow repository.

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Nov 27, 2020
@ti-chi-bot
Copy link
Copy Markdown
Member

ti-chi-bot commented Nov 27, 2020

Can merge label has been added.

DetailsGit tree hash: 9240830

@ti-chi-bot
Copy link
Copy Markdown
Member

ti-chi-bot commented Nov 27, 2020

@longfangsong: Your PR has out-of-dated and I have automatically updated it for you.
At the same time I will also trigger all tests for you:

/run-all-tests

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the tidb-community-bots/ti-community-prow repository.

@HunDunDM
Copy link
Copy Markdown
Member

HunDunDM commented Nov 27, 2020

/run-all-tests

@ti-chi-bot ti-chi-bot merged commit 1eeb4c8 into tikv:master Nov 27, 2020
@longfangsong longfangsong mentioned this pull request Nov 27, 2020
Open
@Yisaer Yisaer added this to the v4.0.10 milestone Nov 30, 2020
@Yisaer Yisaer added the needs-cherry-pick-release-4.0 The PR needs to cherry pick to release-4.0 branch. label Nov 30, 2020
ti-srebot pushed a commit to ti-srebot/pd that referenced this pull request Nov 30, 2020
@longfangsong @ti-srebot
cherry pick tikv#3131 to release-4.0
5f24ab7 
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot ti-srebot mentioned this pull request Nov 30, 2020
Merged
@ti-srebot
Copy link
Copy Markdown
Contributor

ti-srebot commented Nov 30, 2020

cherry pick to release-4.0 in PR #3228

ti-chi-bot pushed a commit that referenced this pull request Dec 1, 2020
@ti-srebot @longfangsong
Persist temporary setting to etcd (#3131) (#3228)
9b1baad 
* cherry pick #3131 to release-4.0

Signed-off-by: ti-srebot <ti-srebot@pingcap.com>

* fix rebasing error

Signed-off-by: longfangsong <longfangsong@icloud.com>

Co-authored-by: 龙方淞 <longfangsong@icloud.com>
@rleungx rleungx removed this from the v4.0.10 milestone Jan 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Yisaer Yisaer Yisaer approved these changes

@rleungx rleungx rleungx approved these changes

Assignees

No one assigned

Labels

needs-cherry-pick-release-4.0 The PR needs to cherry pick to release-4.0 branch. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@longfangsong @3pointer @rleungx @AndreMouche @ti-chi-bot @Yisaer @HunDunDM @ti-srebot