[feat][admin] Introduce unload flag in ns-isolation-policy set call #1

grssam · 2024-08-02T12:51:41Z

Fixes #xyz

Main Issue: #xyz

PIP: #xyz

Motivation

Modifications

Verifying this change

Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

Added integration tests for end-to-end deployment with large payloads (10MB)
Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

Documentation

doc
doc-required
doc-not-needed
doc-complete

Matching PR in forked repository

PR in forked repository:

…he#22672) Signed-off-by: Zixuan Liu <nodeces@gmail.com>

… cache (apache#22679) Co-authored-by: Jiwe Guo <technoboy@apache.org>

…che#22683)

…for TTL check (apache#22651) Co-authored-by: Jiwe Guo <technoboy@apache.org>

…L check (apache#22614)

…ucerCount on non-persistent topic (apache#22685) Co-authored-by: ruihongzhou <ruihongzhou@tencent.com>

…orting dynamic setting, but not implemented (apache#22684)

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

…nection failure retry (apache#22639)

…22635)

…Enabled (apache#22686)

)

…ache#22615) Signed-off-by: jitokim <pigberger70@gmail.com>

…22650)

…apache#22452)

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

… errors (apache#21752) Co-authored-by: 道君 <daojun@apache.org>

…tionLagInMillis (apache#22688)

… to Free (Extensible LB) (apache#22708)

Signed-off-by: Zixuan Liu <nodeces@gmail.com> Co-authored-by: Lari Hotari <lhotari@users.noreply.github.com>

… topic automatically (apache#22705)

…pic via REST API (apache#22720)

…guration and Local Metadata Store (apache#23033)

…he#23088)

…ore other ops to save resources (apache#23074)

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

…ISE_ACCESS_KEY (apache#23090)

… in rolling restarts (apache#23062)

…nts (apache#23072)

… tls-enable arguments when init cluster metadata (apache#23087) ### Motivation When using a global configuration store and geo-replication, support to specify `auth-plugin`, `auth-parameters`, and `tls-enable` arguments when init cluster metadata will be useful, it can reduce one step to create the cluster with auth. ### Modifications Support to specify `auth-plugin`, `auth-parameters` and `tls-enable` arguments when init cluster metadata

…er metadata store session rebuilt (apache#23018)

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

…chedNamespaceAsync (apache#23100) Co-authored-by: Lari Hotari <lhotari@apache.org>

…l/ClustersBase.java Co-authored-by: Zixuan Liu <nodeces@gmail.com>

dao-jun and others added 30 commits May 9, 2024 08:53

[fix][ml] Remove duplicated field initialization of ML (apache#22676)

88feb87

[fix][broker] usedLocallySinceLastReport should always be reset (apac…

8f015d8

…he#22672) Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[fix][broker] Fix geo-replication admin client url (apache#22584)

bd4c57d

[fix][offload] Fix OOM in tiered storage, caused by unbounded offsets…

566330c

… cache (apache#22679) Co-authored-by: Jiwe Guo <technoboy@apache.org>

[improve][offload] Replace usage of shaded class in OffsetsCache (apa…

03a4995

…che#22683)

[improve] [pip] PIP-349: Add additionalSystemCursorNames ignore list …

0fd223d

…for TTL check (apache#22651) Co-authored-by: Jiwe Guo <technoboy@apache.org>

[improve] [broker] Add additionalSystemCursorNames ignore list for TT…

bed032e

…L check (apache#22614)

[fix][broker] Fix ProducerBusy issue due to incorrect userCreatedProd…

253e650

…ucerCount on non-persistent topic (apache#22685) Co-authored-by: ruihongzhou <ruihongzhou@tencent.com>

[fix] [broker] Fix configurationMetadataSyncEventTopic is marked supp…

ff4853e

…orting dynamic setting, but not implemented (apache#22684)

[fix][broker] Fix cursor should use latest ledger config (apache#22644)

774a5d4

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[fix] [doc] fix the class name of transaction exception. (apache#22687)

b7ec89a

[fix][client] Fix ReaderBuilder doest not give illegalArgument on con…

b56f238

…nection failure retry (apache#22639)

[fix][sec] Upgrade postgresql version to avoid CVE-2024-1597 (apache#…

2cfd959

…22635)

[improve] [log] Print source client addr when enabled haProxyProtocol…

d77c5de

…Enabled (apache#22686)

[feat][broker] PIP-264: Add OpenTelemetry consumer metrics (apache#22693

e558cfe

)

[fix][misc] Correct the description of patternAutoDiscoveryPeriod (ap…

3b24b6e

…ache#22615) Signed-off-by: jitokim <pigberger70@gmail.com>

[improve] [pip] PIP-348: Trigger offload on topic load stage (apache#…

16556fa

…22650)

[improve][broker]Ensure namespace deletion doesn't fail (apache#22627)

936afec

[fix][broker] fix replicated subscriptions for transactional messages (…

9fd1b61

…apache#22452)

[improve][build] Improve docker-push (apache#22702)

9668674

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[improve][build] Bump version to 3.4.0-SNAPSHOT (apache#22700)

1a7ada8

[fix] [broker] fix typo and useless local variable. (apache#22704)

9f1325a

[improve][pip] PIP-327: Support force topic loading for unrecoverable…

7468928

… errors (apache#21752) Co-authored-by: 道君 <daojun@apache.org>

[improve][pip] PIP-347: add role field in consumer's stat (apache#22564)

3d26079

[improve][pip] PIP-350: Allow to disable the managedLedgerOffloadDele…

361156e

…tionLagInMillis (apache#22688)

[cleanup][broker] Remove warn logs when changing the state from Owned…

22a9023

… to Free (Extensible LB) (apache#22708)

[improve][build] Support custom image and label names (apache#22703)

7befb8d

Signed-off-by: Zixuan Liu <nodeces@gmail.com> Co-authored-by: Lari Hotari <lhotari@users.noreply.github.com>

[improve] [broker] [break change] Do not create partitioned DLQ/Retry…

f07b3a0

… topic automatically (apache#22705)

[improve][pip] PIP-347: Add role field in consumer's stat (apache#22562)

f3e52b5

[fix][schema] Error checking schema compatibility on a schema-less to…

101aee4

…pic via REST API (apache#22720)

Demogorgon314 and others added 16 commits July 26, 2024 11:40

[improve][pip] PIP-366: Support to specify different config for Confi…

47f204f

…guration and Local Metadata Store (apache#23033)

[fix][client] Fix negative acknowledgement by messageId (apache#23060)

d4bbf10

[fix] [broker] Remove blocking calls from Subscription.getStats (apac…

e59cd05

…he#23088)

[improve] [broker] Check max producers/consumers limitation first bef…

679a3d4

…ore other ops to save resources (apache#23074)

[improve][build] Upgrade docker-maven-plugin to 0.45.0 (apache#23091)

76ed555

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[improve][ci] Switch to use DEVELOCITY_ACCESS_KEY from GRADLE_ENTERPR…

a0bdf45

…ISE_ACCESS_KEY (apache#23090)

[improve][broker] Reduce the CPU pressure from the transaction buffer…

40c8c23

… in rolling restarts (apache#23062)

[improve][broker] Optimize the performance of individual acknowledgme…

77b6378

…nts (apache#23072)

[fix] [broker] Internal reader of __change_events can not started aft…

b955c65

…er metadata store session rebuilt (apache#23018)

[improve][build] Move docker-push profile to submodule (apache#23093)

47d35a0

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[cleanup][broker] Remove PersistentSubscription.getStats (apache#23095)

19fe2e4

Signed-off-by: Zixuan Liu <nodeces@gmail.com>

[fix][client] TransactionCoordinatorClient support retry (apache#23081)

6bbaec1

[fix] [broker] fix replicated namespaces filter in filterAndUnloadMat…

5aa5e7d

…chedNamespaceAsync (apache#23100) Co-authored-by: Lari Hotari <lhotari@apache.org>

[improve][broker]Reuse method getAvailableBrokersAsync (apache#23099)

c249530

[WIP] Introduce unload flag in ns-isolation-policy set call

4d6fce9

github-actions bot added the PIP label Aug 2, 2024

grssam mentioned this pull request Aug 2, 2024

[improve][admin] PIP-369 Introduce unload flag in ns-isolation-policy set call apache/pulsar#23120

Merged

14 tasks

grssam changed the title ~~Ns unload flag~~ [WIP][feat][admin] Introduce unload flag in ns-isolation-policy set call Aug 2, 2024

grssam changed the title ~~[WIP][feat][admin] Introduce unload flag in ns-isolation-policy set call~~ [feat][admin] Introduce unload flag in ns-isolation-policy set call Aug 2, 2024

grssam and others added 9 commits August 12, 2024 16:03

Changes based on PIP review

8384b27

checkstyle fixes

976bc16

minor comment name fix

e467025

Replace Pattern with String for sets

55c5e75

Test correct namespaces are unloaded based on the scope

7c8ab79

remove whitespace

61e0200

typo fix in log line

a799493

Update pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/imp…

e1372da

…l/ClustersBase.java Co-authored-by: Zixuan Liu <nodeces@gmail.com>

Add test for primary broker changed case

746f072

grssam merged commit 2fcb094 into master Sep 4, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[feat][admin] Introduce unload flag in ns-isolation-policy set call #1

[feat][admin] Introduce unload flag in ns-isolation-policy set call #1

Uh oh!

grssam commented Aug 2, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

[feat][admin] Introduce unload flag in ns-isolation-policy set call #1

[feat][admin] Introduce unload flag in ns-isolation-policy set call #1

Uh oh!

Conversation

grssam commented Aug 2, 2024

Motivation

Modifications

Verifying this change

Does this pull request potentially affect one of the following parts:

Documentation

Matching PR in forked repository

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants